2024/11/23-17:14:55.801968 139957399803456 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00: fork to child time = 0.032294 sec 2024/11/23-17:14:55.802938 139957399803456 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00 2024/11/23-17:14:55.811329 139957399803456 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00 2024/11/23-17:14:55.812558 139957399803456 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/23-17:14:55.812886 139957399803456 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/23-17:14:55.866462 139957399803456 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-31667/att-00/MANIFEST-206347 2024/11/23-17:14:55.901661 139957399803456 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-31667/att-00/MANIFEST-206347 succeeded,manifest_file_number is 206347, next_file_number is 271706, last_sequence is 4139486968, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 271540 2024/11/23-17:14:55.901669 139957399803456 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/23-17:14:55.901793 139957399803456 [version_set.cc:5721] Creating manifest 271706 2024/11/23-17:14:55.951235 139957399803456 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/23-17:14:55.970389 139957399803456 [compaction_job.cc:2437] [default] [JOB 31667] Compacting 1@2 + 21@3 files to L3, score 1.00, subcompactions 1 : 1 2024/11/23-17:14:55.970403 139957399803456 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 23698 Base level 2, inputs: [271685(22MB)], [271585(37MB) 271614(37MB) 271615(39MB) 271616(34MB) 271617(36MB) 271618(34MB) 271619(34MB) 271620(35MB) 271621(36MB) 271622(38MB) 271623(37MB) 271624(35MB) 271625(34MB) 271626(36MB) 271627(33MB) 271628(37MB) 271629(33MB) 271630(33MB) 271631(35MB) 271632(37MB) 271699(36MB)] 2024/11/23-17:14:55.976644 139957399803456 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-17:14:55.976669 139957399803456 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-17:14:55.976684 139957399803456 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-17:14:55.976689 139957399803456 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-17:14:55.976698 139957399803456 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-17:14:56.520265 139957399803456 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271707.sst) /dev/shm/ToplingTemp/Topling-129123-JE7xGQ 2024/11/23-17:14:57.266116 139957399803456 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271707.sst): first pass time = 0.75's, 179.964'MB/sec 2024/11/23-17:14:59.158081 139957399803456 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271707.sst): old prealloc_size = 147639500, real_size = 35549376 2024/11/23-17:14:59.158779 139957399803456 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271707.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925762 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0336 GB avg-val = 116.98 avg-zval = 36.25 2024/11/23-17:14:59.159605 139957399803456 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271707.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-17:15:00.142463 139957399803456 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271707.sst): second pass time = 1.89's, 57.319'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.98's, 40.039'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2593.069'MB/sec (index lex order gen) rebuild zvType time = 0.83's, 0.279'MB/sec write SST data time = 0.15's, 254.585'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 28386.105'MB/sec zip my value time = 1.89's, unzip length = 0.108'GB zip my value throughput = 57.319'MB/sec zip pipeline throughput = 110.172'MB/sec entries = 925762 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.98 avg-zval = 36.25 usrkeys = 925762 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.98 avg-zval = 36.25 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 925762 bytes = 3008736 } seq expand size = 6480334 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0336 GB dict = 1.08 MB all = 0.0394 GB } UnZip/Zip{ index = 10.5135 value = 3.2273 dict = 1.00 all = 3.4054 } Zip/UnZip{ index = 0.0951 value = 0.3099 dict = 1.00 all = 0.2936 } ---------------------------- total value len = 8.963397 GB avg = 0.168 KB (by entry num) total key len = 1.466742 GB avg = 0.028 KB total ukey len = 1.016393 GB avg = 0.015 KB total ukey num = 0.066476197 Billion total entry num = 0.053283926 Billion write speed all = 0.347811262 MB/sec (with seq num) write speed all = 0.333596495 MB/sec (without seq num) 2024/11/23-17:15:00.213178 139957399803456 [compaction_job.cc:1948] [default] [JOB 31667] Generated table #271707: 925762 keys, 39412786 bytes, temperature: kWarm 2024/11/23-17:15:00.213280 139957399803456 EVENT_LOG_v1 {"time_micros": 1732353300213219, "cf_name": "default", "job": 31667, "event": "table_file_creation", "file_number": 271707, "file_size": 39412786, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4087041805, "largest_seqno": 4139223006, "table_properties": {"data_size": 33556656, "index_size": 1761088, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25921336, "raw_average_key_size": 28, "raw_value_size": 108296480, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 925762, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732353296, "oldest_key_time": 0, "file_creation_time": 1732353296, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 271707, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-17:15:00.258544 139957399803456 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271708.sst) /dev/shm/ToplingTemp/Topling-129123-qC7y3S 2024/11/23-17:15:01.468241 139957399803456 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271708.sst): first pass time = 1.21's, 110.956'MB/sec 2024/11/23-17:15:03.635667 139957399803456 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271708.sst): old prealloc_size = 147639500, real_size = 35483008 2024/11/23-17:15:03.636259 139957399803456 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271708.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927239 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0335 GB avg-val = 116.75 avg-zval = 36.12 2024/11/23-17:15:03.637002 139957399803456 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271708.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-17:15:04.649394 139957399803456 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271708.sst): second pass time = 2.17's, 49.977'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.01's, 38.934'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3124.459'MB/sec (index lex order gen) rebuild zvType time = 0.78's, 0.298'MB/sec write SST data time = 0.23's, 168.215'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 34244.304'MB/sec zip my value time = 2.17's, unzip length = 0.108'GB zip my value throughput = 49.977'MB/sec zip pipeline throughput = 152.761'MB/sec entries = 927239 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.75 avg-zval = 36.12 usrkeys = 927239 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.75 avg-zval = 36.12 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927239 bytes = 3129440 } seq expand size = 6490673 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0335 GB dict = 1.08 MB all = 0.0395 GB } UnZip/Zip{ index = 10.5150 value = 3.2327 dict = 1.00 all = 3.4007 } Zip/UnZip{ index = 0.0951 value = 0.3093 dict = 1.00 all = 0.2941 } ---------------------------- total value len = 9.078142 GB avg = 0.167 KB (by entry num) total key len = 1.492705 GB avg = 0.028 KB total ukey len = 1.034938 GB avg = 0.015 KB total ukey num = 0.067403436 Billion total entry num = 0.054211165 Billion write speed all = 0.352450462 MB/sec (with seq num) write speed all = 0.337990504 MB/sec (without seq num) 2024/11/23-17:15:04.704221 139957399803456 [compaction_job.cc:1948] [default] [JOB 31667] Generated table #271708: 927239 keys, 39467164 bytes, temperature: kWarm 2024/11/23-17:15:04.704308 139957399803456 EVENT_LOG_v1 {"time_micros": 1732353304704261, "cf_name": "default", "job": 31667, "event": "table_file_creation", "file_number": 271708, "file_size": 39467164, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4051668904, "largest_seqno": 4139222923, "table_properties": {"data_size": 33487344, "index_size": 1763648, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25962692, "raw_average_key_size": 28, "raw_value_size": 108255074, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927239, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732353300, "oldest_key_time": 0, "file_creation_time": 1732353300, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 271708, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-17:15:04.762254 139957399803456 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271709.sst) /dev/shm/ToplingTemp/Topling-129123-6bsjDS 2024/11/23-17:15:05.763562 139957399803456 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271709.sst): first pass time = 1.00's, 134.050'MB/sec 2024/11/23-17:15:07.691473 139957399803456 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271709.sst): old prealloc_size = 147639500, real_size = 36748208 2024/11/23-17:15:07.692169 139957399803456 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271709.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 929781 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0347 GB avg-val = 116.35 avg-zval = 37.37 2024/11/23-17:15:07.693130 139957399803456 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271709.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-17:15:08.724786 139957399803456 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271709.sst): second pass time = 1.93's, 56.157'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.03's, 39.767'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2627.765'MB/sec (index lex order gen) rebuild zvType time = 0.88's, 0.263'MB/sec write SST data time = 0.15's, 273.940'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 23839.092'MB/sec zip my value time = 1.93's, unzip length = 0.108'GB zip my value throughput = 56.157'MB/sec zip pipeline throughput = 119.749'MB/sec entries = 929781 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.35 avg-zval = 37.37 usrkeys = 929781 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.35 avg-zval = 37.37 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 929781 bytes = 3486688 } seq expand size = 6508467 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0347 GB dict = 1.08 MB all = 0.0411 GB } UnZip/Zip{ index = 10.5160 value = 3.1135 dict = 1.00 all = 3.2663 } Zip/UnZip{ index = 0.0951 value = 0.3212 dict = 1.00 all = 0.3062 } ---------------------------- total value len = 9.192835 GB avg = 0.167 KB (by entry num) total key len = 1.518739 GB avg = 0.028 KB total ukey len = 1.053534 GB avg = 0.015 KB total ukey num = 0.068333217 Billion total entry num = 0.055140946 Billion write speed all = 0.357093999 MB/sec (with seq num) write speed all = 0.342388036 MB/sec (without seq num) 2024/11/23-17:15:08.778024 139957399803456 [compaction_job.cc:1948] [default] [JOB 31667] Generated table #271709: 929781 keys, 41091196 bytes, temperature: kWarm 2024/11/23-17:15:08.778092 139957399803456 EVENT_LOG_v1 {"time_micros": 1732353308778057, "cf_name": "default", "job": 31667, "event": "table_file_creation", "file_number": 271709, "file_size": 41091196, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3583362754, "largest_seqno": 4139223294, "table_properties": {"data_size": 34747232, "index_size": 1768320, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26033868, "raw_average_key_size": 28, "raw_value_size": 108183974, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 929781, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732353304, "oldest_key_time": 0, "file_creation_time": 1732353304, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 271709, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-17:15:08.830877 139957399803456 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271710.sst) /dev/shm/ToplingTemp/Topling-129123-ebMKbS 2024/11/23-17:15:09.852541 139957399803456 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271710.sst): first pass time = 1.02's, 131.378'MB/sec 2024/11/23-17:15:11.413324 139957399803456 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271710.sst): old prealloc_size = 147639500, real_size = 34872672 2024/11/23-17:15:11.414304 139957399803456 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271710.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1086820 prefix = 4 raw-key = 0.0174 GB zip-key = 0.0021 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1038 GB zip-val = 0.0325 GB avg-val = 95.50 avg-zval = 29.92 2024/11/23-17:15:11.414836 139957399803456 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271710.sst: sumWaitingMem = 0.003 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0029 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-17:15:12.370639 139957399803456 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271710.sst): second pass time = 1.56's, 66.564'MB/sec, value only(77.3% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.96's, 38.564'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2179.673'MB/sec (index lex order gen) rebuild zvType time = 0.78's, 0.347'MB/sec write SST data time = 0.17's, 212.506'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.036'MB, throughput = 36030.266'MB/sec zip my value time = 1.56's, unzip length = 0.104'GB zip my value throughput = 66.564'MB/sec zip pipeline throughput = 66.564'MB/sec entries = 1086820 avg-key = 28.00 avg-zkey = 1.91 avg-val = 95.50 avg-zval = 29.92 usrkeys = 1086820 avg-key = 20.00 avg-zkey = 1.91 avg-val = 97.59 avg-zval = 29.92 TagRS{ kinds = RS_Key0_TagN bytes = 169920 } TagArray{ size = 325556 bytes = 1098768 } seq expand size = 2278892 multi value expand size = 0 cnt WriteAppend = 17 UnZipSize{ index = 0.0217 GB value = 0.1038 GB dict = 1.04 MB all = 0.1342 GB } __ZipSize{ index = 0.0021 GB value = 0.0325 GB dict = 1.04 MB all = 0.0369 GB } UnZip/Zip{ index = 10.4463 value = 3.1915 dict = 1.00 all = 3.6357 } Zip/UnZip{ index = 0.0957 value = 0.3133 dict = 1.00 all = 0.2750 } ---------------------------- total value len = 9.298900 GB avg = 0.165 KB (by entry num) total key len = 1.549170 GB avg = 0.028 KB total ukey len = 1.075270 GB avg = 0.015 KB total ukey num = 0.069420037 Billion total entry num = 0.056227766 Billion write speed all = 0.361600468 MB/sec (with seq num) write speed all = 0.346606475 MB/sec (without seq num) 2024/11/23-17:15:12.419034 139957399803456 [compaction_job.cc:1948] [default] [JOB 31667] Generated table #271710: 1086820 keys, 36916345 bytes, temperature: kWarm 2024/11/23-17:15:12.419103 139957399803456 EVENT_LOG_v1 {"time_micros": 1732353312419068, "cf_name": "default", "job": 31667, "event": "table_file_creation", "file_number": 271710, "file_size": 36916345, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4012776165, "table_properties": {"data_size": 32520016, "index_size": 2080768, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 30430960, "raw_average_key_size": 28, "raw_value_size": 103786809, "raw_average_value_size": 95, "num_data_blocks": 1, "num_entries": 1086820, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732353308, "oldest_key_time": 0, "file_creation_time": 1732353308, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 271710, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-17:15:12.458352 139957399803456 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271711.sst) /dev/shm/ToplingTemp/Topling-129123-wdU7xQ 2024/11/23-17:15:13.463267 139957399803456 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271711.sst): first pass time = 1.00's, 133.567'MB/sec 2024/11/23-17:15:15.060706 139957399803456 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271711.sst): old prealloc_size = 147639500, real_size = 36515488 2024/11/23-17:15:15.061436 139957399803456 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271711.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 924410 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0345 GB avg-val = 117.19 avg-zval = 37.35 2024/11/23-17:15:15.061828 139957399803456 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271711.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-17:15:15.960394 139957399803456 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271711.sst): second pass time = 1.60's, 67.849'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.90's, 42.860'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2472.809'MB/sec (index lex order gen) rebuild zvType time = 0.71's, 0.325'MB/sec write SST data time = 0.19's, 206.252'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.082'MB, throughput = 37390.535'MB/sec zip my value time = 1.60's, unzip length = 0.108'GB zip my value throughput = 67.849'MB/sec zip pipeline throughput = 67.849'MB/sec entries = 924410 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.19 avg-zval = 37.35 usrkeys = 924410 avg-key = 20.00 avg-zkey = 1.90 avg-val = 119.44 avg-zval = 37.35 TagRS{ kinds = RS_Key0_TagN bytes = 144520 } TagArray{ size = 297271 bytes = 1040464 } seq expand size = 2080897 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0345 GB dict = 1.08 MB all = 0.0386 GB } UnZip/Zip{ index = 10.5138 value = 3.1378 dict = 1.00 all = 3.4807 } Zip/UnZip{ index = 0.0951 value = 0.3187 dict = 1.00 all = 0.2873 } ---------------------------- total value len = 9.409316 GB avg = 0.165 KB (by entry num) total key len = 1.575053 GB avg = 0.028 KB total ukey len = 1.093758 GB avg = 0.016 KB total ukey num = 0.070344447 Billion total entry num = 0.057152176 Billion write speed all = 0.366099929 MB/sec (with seq num) write speed all = 0.350861251 MB/sec (without seq num) 2024/11/23-17:15:16.009628 139957399803456 [compaction_job.cc:1948] [default] [JOB 31667] Generated table #271711: 924410 keys, 38560523 bytes, temperature: kWarm 2024/11/23-17:15:16.009698 139957399803456 EVENT_LOG_v1 {"time_micros": 1732353316009662, "cf_name": "default", "job": 31667, "event": "table_file_creation", "file_number": 271711, "file_size": 38560523, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3438557961, "table_properties": {"data_size": 34525712, "index_size": 1758464, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25883480, "raw_average_key_size": 28, "raw_value_size": 108334380, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 924410, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732353312, "oldest_key_time": 0, "file_creation_time": 1732353312, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 271711, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-17:15:16.055963 139957399803456 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271712.sst) /dev/shm/ToplingTemp/Topling-129123-Gobh2T 2024/11/23-17:15:17.084360 139957399803456 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271712.sst): first pass time = 1.03's, 130.518'MB/sec 2024/11/23-17:15:18.397546 139957399803456 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271712.sst): old prealloc_size = 147639500, real_size = 31744256 2024/11/23-17:15:18.398129 139957399803456 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271712.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 931429 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1081 GB zip-val = 0.0297 GB avg-val = 116.10 avg-zval = 31.93 2024/11/23-17:15:18.398964 139957399803456 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271712.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-17:15:19.236409 139957399803456 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271712.sst): second pass time = 1.31's, 82.427'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 43.022'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3162.727'MB/sec (index lex order gen) rebuild zvType time = 0.71's, 0.327'MB/sec write SST data time = 0.13's, 283.847'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 36873.264'MB/sec zip my value time = 1.31's, unzip length = 0.108'GB zip my value throughput = 82.427'MB/sec zip pipeline throughput = 82.427'MB/sec entries = 931429 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.10 avg-zval = 31.93 usrkeys = 931429 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.10 avg-zval = 31.93 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 931429 bytes = 3492880 } seq expand size = 6520003 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0297 GB dict = 1.08 MB all = 0.0361 GB } UnZip/Zip{ index = 10.5145 value = 3.6362 dict = 1.00 all = 3.7191 } Zip/UnZip{ index = 0.0951 value = 0.2750 dict = 1.00 all = 0.2689 } ---------------------------- total value len = 9.523974 GB avg = 0.164 KB (by entry num) total key len = 1.601133 GB avg = 0.028 KB total ukey len = 1.112387 GB avg = 0.016 KB total ukey num = 0.071275876 Billion total entry num = 0.058083605 Billion write speed all = 0.370750122 MB/sec (with seq num) write speed all = 0.355264785 MB/sec (without seq num) 2024/11/23-17:15:19.281963 139957399803456 [compaction_job.cc:1948] [default] [JOB 31667] Generated table #271712: 931429 keys, 36088376 bytes, temperature: kWarm 2024/11/23-17:15:19.282048 139957399803456 EVENT_LOG_v1 {"time_micros": 1732353319282008, "cf_name": "default", "job": 31667, "event": "table_file_creation", "file_number": 271712, "file_size": 36088376, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3438557962, "largest_seqno": 4012775885, "table_properties": {"data_size": 29739504, "index_size": 1771712, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26080012, "raw_average_key_size": 28, "raw_value_size": 108137762, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 931429, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732353316, "oldest_key_time": 0, "file_creation_time": 1732353316, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 271712, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-17:15:19.319625 139957399803456 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271713.sst) /dev/shm/ToplingTemp/Topling-129123-SZA5FR 2024/11/23-17:15:20.334297 139957399803456 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271713.sst): first pass time = 1.01's, 132.283'MB/sec 2024/11/23-17:15:21.646086 139957399803456 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271713.sst): old prealloc_size = 147639500, real_size = 31601168 2024/11/23-17:15:21.646622 139957399803456 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271713.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 931309 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1081 GB zip-val = 0.0296 GB avg-val = 116.12 avg-zval = 31.78 2024/11/23-17:15:21.647388 139957399803456 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271713.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-17:15:22.482333 139957399803456 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271713.sst): second pass time = 1.31's, 82.495'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 42.706'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3459.507'MB/sec (index lex order gen) rebuild zvType time = 0.71's, 0.327'MB/sec write SST data time = 0.12's, 286.297'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 33566.013'MB/sec zip my value time = 1.31's, unzip length = 0.108'GB zip my value throughput = 82.495'MB/sec zip pipeline throughput = 82.495'MB/sec entries = 931309 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.12 avg-zval = 31.78 usrkeys = 931309 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.12 avg-zval = 31.78 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 931309 bytes = 3259600 } seq expand size = 6519163 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0296 GB dict = 1.08 MB all = 0.0357 GB } UnZip/Zip{ index = 10.5127 value = 3.6539 dict = 1.00 all = 3.7583 } Zip/UnZip{ index = 0.0951 value = 0.2737 dict = 1.00 all = 0.2661 } ---------------------------- total value len = 9.638634 GB avg = 0.163 KB (by entry num) total key len = 1.627210 GB avg = 0.028 KB total ukey len = 1.131013 GB avg = 0.016 KB total ukey num = 0.072207185 Billion total entry num = 0.059014914 Billion write speed all = 0.375399648 MB/sec (with seq num) write speed all = 0.359667722 MB/sec (without seq num) 2024/11/23-17:15:22.527471 139957399803456 [compaction_job.cc:1948] [default] [JOB 31667] Generated table #271713: 931309 keys, 35712220 bytes, temperature: kWarm 2024/11/23-17:15:22.527540 139957399803456 EVENT_LOG_v1 {"time_micros": 1732353322527505, "cf_name": "default", "job": 31667, "event": "table_file_creation", "file_number": 271713, "file_size": 35712220, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3807172320, "largest_seqno": 4012775902, "table_properties": {"data_size": 29596352, "index_size": 1771776, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26076652, "raw_average_key_size": 28, "raw_value_size": 108141150, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 931309, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732353319, "oldest_key_time": 0, "file_creation_time": 1732353319, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 271713, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-17:15:22.565212 139957399803456 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271714.sst) /dev/shm/ToplingTemp/Topling-129123-JaHNDS 2024/11/23-17:15:23.495582 139957399803456 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271714.sst): first pass time = 0.93's, 144.268'MB/sec 2024/11/23-17:15:24.798114 139957399803456 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271714.sst): old prealloc_size = 147639500, real_size = 31834608 2024/11/23-17:15:24.798650 139957399803456 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271714.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 931462 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1081 GB zip-val = 0.0298 GB avg-val = 116.09 avg-zval = 32.02 2024/11/23-17:15:24.799465 139957399803456 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271714.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-17:15:25.636080 139957399803456 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271714.sst): second pass time = 1.30's, 83.072'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 43.176'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3459.611'MB/sec (index lex order gen) rebuild zvType time = 0.71's, 0.327'MB/sec write SST data time = 0.13's, 286.717'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 36554.787'MB/sec zip my value time = 1.30's, unzip length = 0.108'GB zip my value throughput = 83.072'MB/sec zip pipeline throughput = 83.072'MB/sec entries = 931462 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.09 avg-zval = 32.02 usrkeys = 931462 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.09 avg-zval = 32.02 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 931462 bytes = 3492992 } seq expand size = 6520234 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0298 GB dict = 1.08 MB all = 0.0362 GB } UnZip/Zip{ index = 10.5118 value = 3.6252 dict = 1.00 all = 3.7098 } Zip/UnZip{ index = 0.0951 value = 0.2758 dict = 1.00 all = 0.2696 } ---------------------------- total value len = 9.753291 GB avg = 0.163 KB (by entry num) total key len = 1.653291 GB avg = 0.028 KB total ukey len = 1.149642 GB avg = 0.016 KB total ukey num = 0.073138647 Billion total entry num = 0.059946376 Billion write speed all = 0.380049372 MB/sec (with seq num) write speed all = 0.364070820 MB/sec (without seq num) 2024/11/23-17:15:25.682502 139957399803456 [compaction_job.cc:1948] [default] [JOB 31667] Generated table #271714: 931462 keys, 36178844 bytes, temperature: kWarm 2024/11/23-17:15:25.682572 139957399803456 EVENT_LOG_v1 {"time_micros": 1732353325682536, "cf_name": "default", "job": 31667, "event": "table_file_creation", "file_number": 271714, "file_size": 36178844, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3273701103, "largest_seqno": 4012775918, "table_properties": {"data_size": 29829344, "index_size": 1772224, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26080936, "raw_average_key_size": 28, "raw_value_size": 108136860, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 931462, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732353322, "oldest_key_time": 0, "file_creation_time": 1732353322, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 271714, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-17:15:25.721306 139957399803456 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271715.sst) /dev/shm/ToplingTemp/Topling-129123-YrmrOQ 2024/11/23-17:15:26.713564 139957399803456 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271715.sst): first pass time = 0.99's, 135.270'MB/sec 2024/11/23-17:15:28.019049 139957399803456 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271715.sst): old prealloc_size = 147639500, real_size = 32883952 2024/11/23-17:15:28.019596 139957399803456 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271715.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925405 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0309 GB avg-val = 117.04 avg-zval = 33.38 2024/11/23-17:15:28.021673 139957399803456 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271715.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-17:15:28.858676 139957399803456 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271715.sst): second pass time = 1.30's, 83.014'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 44.181'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3353.649'MB/sec (index lex order gen) rebuild zvType time = 0.71's, 0.325'MB/sec write SST data time = 0.13's, 291.946'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 27731.236'MB/sec zip my value time = 1.30's, unzip length = 0.108'GB zip my value throughput = 83.014'MB/sec zip pipeline throughput = 83.014'MB/sec entries = 925405 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.04 avg-zval = 33.38 usrkeys = 925405 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.04 avg-zval = 33.38 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 925405 bytes = 3354608 } seq expand size = 6477835 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0309 GB dict = 1.08 MB all = 0.0371 GB } UnZip/Zip{ index = 10.5137 value = 3.5060 dict = 1.00 all = 3.6183 } Zip/UnZip{ index = 0.0951 value = 0.2852 dict = 1.00 all = 0.2764 } ---------------------------- total value len = 9.868075 GB avg = 0.162 KB (by entry num) total key len = 1.679202 GB avg = 0.028 KB total ukey len = 1.168150 GB avg = 0.016 KB total ukey num = 0.074064052 Billion total entry num = 0.060871781 Billion write speed all = 0.384695822 MB/sec (with seq num) write speed all = 0.368472348 MB/sec (without seq num) 2024/11/23-17:15:28.905027 139957399803456 [compaction_job.cc:1948] [default] [JOB 31667] Generated table #271715: 925405 keys, 37093786 bytes, temperature: kWarm 2024/11/23-17:15:28.905097 139957399803456 EVENT_LOG_v1 {"time_micros": 1732353328905062, "cf_name": "default", "job": 31667, "event": "table_file_creation", "file_number": 271715, "file_size": 37093786, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3622761296, "largest_seqno": 4012775947, "table_properties": {"data_size": 30892064, "index_size": 1760384, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25911340, "raw_average_key_size": 28, "raw_value_size": 108306414, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 925405, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732353325, "oldest_key_time": 0, "file_creation_time": 1732353325, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 271715, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-17:15:28.961048 139957399803456 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271716.sst) /dev/shm/ToplingTemp/Topling-129123-vp92IQ 2024/11/23-17:15:29.929290 139957399803456 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271716.sst): first pass time = 0.97's, 138.626'MB/sec 2024/11/23-17:15:31.302425 139957399803456 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271716.sst): old prealloc_size = 147639500, real_size = 35903856 2024/11/23-17:15:31.302935 139957399803456 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271716.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 924151 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1083 GB zip-val = 0.0339 GB avg-val = 117.23 avg-zval = 36.69 2024/11/23-17:15:31.304996 139957399803456 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271716.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-17:15:32.134965 139957399803456 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271716.sst): second pass time = 1.37's, 78.972'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.83's, 48.180'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3719.011'MB/sec (index lex order gen) rebuild zvType time = 0.71's, 0.327'MB/sec write SST data time = 0.13's, 317.416'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.082'MB, throughput = 35613.508'MB/sec zip my value time = 1.37's, unzip length = 0.108'GB zip my value throughput = 78.972'MB/sec zip pipeline throughput = 78.972'MB/sec entries = 924151 avg-key = 28.00 avg-zkey = 1.92 avg-val = 117.23 avg-zval = 36.69 usrkeys = 924151 avg-key = 20.00 avg-zkey = 1.92 avg-val = 124.23 avg-zval = 36.69 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 924151 bytes = 3350064 } seq expand size = 6469057 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0339 GB dict = 1.08 MB all = 0.0401 GB } UnZip/Zip{ index = 10.4436 value = 3.1957 dict = 1.00 all = 3.3462 } Zip/UnZip{ index = 0.0958 value = 0.3129 dict = 1.00 all = 0.2988 } ---------------------------- total value len = 9.982886 GB avg = 0.162 KB (by entry num) total key len = 1.705079 GB avg = 0.028 KB total ukey len = 1.186633 GB avg = 0.016 KB total ukey num = 0.074988203 Billion total entry num = 0.061795932 Billion write speed all = 0.389340287 MB/sec (with seq num) write speed all = 0.372872306 MB/sec (without seq num) 2024/11/23-17:15:32.183554 139957399803456 [compaction_job.cc:1948] [default] [JOB 31667] Generated table #271716: 924151 keys, 40110662 bytes, temperature: kWarm 2024/11/23-17:15:32.183624 139957399803456 EVENT_LOG_v1 {"time_micros": 1732353332183589, "cf_name": "default", "job": 31667, "event": "table_file_creation", "file_number": 271716, "file_size": 40110662, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3514720078, "largest_seqno": 4012775967, "table_properties": {"data_size": 33902816, "index_size": 1769792, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25876228, "raw_average_key_size": 28, "raw_value_size": 108341550, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 924151, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732353328, "oldest_key_time": 0, "file_creation_time": 1732353328, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 271716, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-17:15:32.234747 139957399803456 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271717.sst) /dev/shm/ToplingTemp/Topling-129123-RuOrTQ 2024/11/23-17:15:33.285798 139957399803456 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271717.sst): first pass time = 1.05's, 127.704'MB/sec 2024/11/23-17:15:34.610930 139957399803456 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271717.sst): old prealloc_size = 147639500, real_size = 34119744 2024/11/23-17:15:34.611545 139957399803456 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271717.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 930362 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0321 GB avg-val = 116.26 avg-zval = 34.52 2024/11/23-17:15:34.612353 139957399803456 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271717.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-17:15:35.447926 139957399803456 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271717.sst): second pass time = 1.32's, 81.674'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 45.497'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2989.644'MB/sec (index lex order gen) rebuild zvType time = 0.71's, 0.330'MB/sec write SST data time = 0.13's, 291.327'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 34601.732'MB/sec zip my value time = 1.32's, unzip length = 0.108'GB zip my value throughput = 81.674'MB/sec zip pipeline throughput = 81.674'MB/sec entries = 930362 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.26 avg-zval = 34.52 usrkeys = 930362 avg-key = 20.00 avg-zkey = 1.90 avg-val = 122.20 avg-zval = 34.52 TagRS{ kinds = RS_Key0_TagN bytes = 145480 } TagArray{ size = 789066 bytes = 2959008 } seq expand size = 5523462 multi value expand size = 0 cnt WriteAppend = 16 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0321 GB dict = 1.08 MB all = 0.0381 GB } UnZip/Zip{ index = 10.5149 value = 3.3679 dict = 1.00 all = 3.5246 } Zip/UnZip{ index = 0.0951 value = 0.2969 dict = 1.00 all = 0.2837 } ---------------------------- total value len = 10.096577 GB avg = 0.161 KB (by entry num) total key len = 1.731129 GB avg = 0.028 KB total ukey len = 1.205241 GB avg = 0.016 KB total ukey num = 0.075918565 Billion total entry num = 0.062726294 Billion write speed all = 0.393951761 MB/sec (with seq num) write speed all = 0.377237694 MB/sec (without seq num) 2024/11/23-17:15:35.494842 139957399803456 [compaction_job.cc:1948] [default] [JOB 31667] Generated table #271717: 930362 keys, 38079986 bytes, temperature: kWarm 2024/11/23-17:15:35.494914 139957399803456 EVENT_LOG_v1 {"time_micros": 1732353335494876, "cf_name": "default", "job": 31667, "event": "table_file_creation", "file_number": 271717, "file_size": 38079986, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4012776021, "table_properties": {"data_size": 32117360, "index_size": 1769600, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26050136, "raw_average_key_size": 28, "raw_value_size": 108167648, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 930362, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732353332, "oldest_key_time": 0, "file_creation_time": 1732353332, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 271717, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-17:15:35.532359 139957399803456 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271718.sst) /dev/shm/ToplingTemp/Topling-129123-N2kHrT 2024/11/23-17:15:36.519926 139957399803456 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271718.sst): first pass time = 0.99's, 135.912'MB/sec 2024/11/23-17:15:37.847632 139957399803456 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271718.sst): old prealloc_size = 147639500, real_size = 32642288 2024/11/23-17:15:37.848167 139957399803456 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271718.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 929287 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0306 GB avg-val = 116.43 avg-zval = 32.97 2024/11/23-17:15:37.849909 139957399803456 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271718.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-17:15:38.686801 139957399803456 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271718.sst): second pass time = 1.33's, 81.583'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 44.060'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3448.533'MB/sec (index lex order gen) rebuild zvType time = 0.71's, 0.327'MB/sec write SST data time = 0.13's, 287.048'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 32946.678'MB/sec zip my value time = 1.33's, unzip length = 0.108'GB zip my value throughput = 81.583'MB/sec zip pipeline throughput = 81.583'MB/sec entries = 929287 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.43 avg-zval = 32.97 usrkeys = 929287 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.12 avg-zval = 32.97 TagRS{ kinds = RS_Key0_TagN bytes = 145320 } TagArray{ size = 887586 bytes = 3328464 } seq expand size = 6213102 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0306 GB dict = 1.08 MB all = 0.0370 GB } UnZip/Zip{ index = 10.5142 value = 3.5310 dict = 1.00 all = 3.6302 } Zip/UnZip{ index = 0.0951 value = 0.2832 dict = 1.00 all = 0.2755 } ---------------------------- total value len = 10.210988 GB avg = 0.160 KB (by entry num) total key len = 1.757149 GB avg = 0.028 KB total ukey len = 1.223826 GB avg = 0.016 KB total ukey num = 0.076847852 Billion total entry num = 0.063655581 Billion write speed all = 0.398586168 MB/sec (with seq num) write speed all = 0.381626312 MB/sec (without seq num) 2024/11/23-17:15:38.731434 139957399803456 [compaction_job.cc:1948] [default] [JOB 31667] Generated table #271718: 929287 keys, 36972696 bytes, temperature: kWarm 2024/11/23-17:15:38.731516 139957399803456 EVENT_LOG_v1 {"time_micros": 1732353338731476, "cf_name": "default", "job": 31667, "event": "table_file_creation", "file_number": 271718, "file_size": 36972696, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4012776210, "table_properties": {"data_size": 30642080, "index_size": 1767680, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26020036, "raw_average_key_size": 28, "raw_value_size": 108197718, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 929287, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732353335, "oldest_key_time": 0, "file_creation_time": 1732353335, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 271718, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-17:15:38.765785 139957399803456 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271719.sst) /dev/shm/ToplingTemp/Topling-129123-hoGFnR 2024/11/23-17:15:39.611012 139957399803456 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271719.sst): first pass time = 0.85's, 158.801'MB/sec 2024/11/23-17:15:40.909393 139957399803456 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271719.sst): old prealloc_size = 147639500, real_size = 32125056 2024/11/23-17:15:40.909963 139957399803456 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271719.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 931692 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1081 GB zip-val = 0.0301 GB avg-val = 116.06 avg-zval = 32.33 2024/11/23-17:15:40.910790 139957399803456 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271719.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-17:15:41.754407 139957399803456 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271719.sst): second pass time = 1.30's, 83.363'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 43.022'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3135.064'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 0.325'MB/sec write SST data time = 0.13's, 286.347'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 36149.956'MB/sec zip my value time = 1.30's, unzip length = 0.108'GB zip my value throughput = 83.363'MB/sec zip pipeline throughput = 83.363'MB/sec entries = 931692 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.06 avg-zval = 32.33 usrkeys = 931692 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.06 avg-zval = 32.33 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 931692 bytes = 3377392 } seq expand size = 6521844 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0301 GB dict = 1.08 MB all = 0.0364 GB } UnZip/Zip{ index = 10.5136 value = 3.5900 dict = 1.00 all = 3.6920 } Zip/UnZip{ index = 0.0951 value = 0.2785 dict = 1.00 all = 0.2709 } ---------------------------- total value len = 10.325640 GB avg = 0.160 KB (by entry num) total key len = 1.783236 GB avg = 0.028 KB total ukey len = 1.242460 GB avg = 0.016 KB total ukey num = 0.077779544 Billion total entry num = 0.064587273 Billion write speed all = 0.403232158 MB/sec (with seq num) write speed all = 0.386025827 MB/sec (without seq num) 2024/11/23-17:15:41.801706 139957399803456 [compaction_job.cc:1948] [default] [JOB 31667] Generated table #271719: 931692 keys, 36353408 bytes, temperature: kWarm 2024/11/23-17:15:41.801775 139957399803456 EVENT_LOG_v1 {"time_micros": 1732353341801739, "cf_name": "default", "job": 31667, "event": "table_file_creation", "file_number": 271719, "file_size": 36353408, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3512539342, "largest_seqno": 4012776228, "table_properties": {"data_size": 30119600, "index_size": 1772352, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26087376, "raw_average_key_size": 28, "raw_value_size": 108130408, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 931692, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732353338, "oldest_key_time": 0, "file_creation_time": 1732353338, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 271719, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-17:15:41.838343 139957399803456 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271720.sst) /dev/shm/ToplingTemp/Topling-129123-EyWsqU 2024/11/23-17:15:42.852558 139957399803456 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271720.sst): first pass time = 1.01's, 132.342'MB/sec 2024/11/23-17:15:44.190337 139957399803456 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271720.sst): old prealloc_size = 147639500, real_size = 33665648 2024/11/23-17:15:44.190941 139957399803456 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271720.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 933210 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.1081 GB zip-val = 0.0316 GB avg-val = 115.82 avg-zval = 33.90 2024/11/23-17:15:44.193107 139957399803456 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271720.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-17:15:45.042879 139957399803456 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271720.sst): second pass time = 1.34's, 80.845'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.85's, 44.455'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3134.339'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 0.323'MB/sec write SST data time = 0.13's, 294.635'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 27176.619'MB/sec zip my value time = 1.34's, unzip length = 0.108'GB zip my value throughput = 80.845'MB/sec zip pipeline throughput = 80.845'MB/sec entries = 933210 avg-key = 28.00 avg-zkey = 1.93 avg-val = 115.82 avg-zval = 33.90 usrkeys = 933210 avg-key = 20.00 avg-zkey = 1.93 avg-val = 122.82 avg-zval = 33.90 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 933210 bytes = 3382896 } seq expand size = 6532470 multi value expand size = 0 cnt WriteAppend = 16 UnZipSize{ index = 0.0187 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0316 GB dict = 1.08 MB all = 0.0379 GB } UnZip/Zip{ index = 10.3767 value = 3.4169 dict = 1.00 all = 3.5415 } Zip/UnZip{ index = 0.0964 value = 0.2927 dict = 1.00 all = 0.2824 } ---------------------------- total value len = 10.440260 GB avg = 0.159 KB (by entry num) total key len = 1.809366 GB avg = 0.028 KB total ukey len = 1.261124 GB avg = 0.016 KB total ukey num = 0.078712754 Billion total entry num = 0.065520483 Billion write speed all = 0.407874550 MB/sec (with seq num) write speed all = 0.390421520 MB/sec (without seq num) 2024/11/23-17:15:45.091004 139957399803456 [compaction_job.cc:1948] [default] [JOB 31667] Generated table #271720: 933210 keys, 37898788 bytes, temperature: kWarm 2024/11/23-17:15:45.091073 139957399803456 EVENT_LOG_v1 {"time_micros": 1732353345091037, "cf_name": "default", "job": 31667, "event": "table_file_creation", "file_number": 271720, "file_size": 37898788, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3485447251, "largest_seqno": 4012776268, "table_properties": {"data_size": 31633504, "index_size": 1798656, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26129880, "raw_average_key_size": 28, "raw_value_size": 108087848, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 933210, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732353341, "oldest_key_time": 0, "file_creation_time": 1732353341, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 271720, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-17:15:45.130495 139957399803456 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271721.sst) /dev/shm/ToplingTemp/Topling-129123-sxmHbQ 2024/11/23-17:15:46.017508 139957399803456 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271721.sst): first pass time = 0.89's, 151.321'MB/sec 2024/11/23-17:15:47.319053 139957399803456 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271721.sst): old prealloc_size = 147639500, real_size = 32085904 2024/11/23-17:15:47.319599 139957399803456 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271721.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926045 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1083 GB zip-val = 0.0301 GB avg-val = 116.94 avg-zval = 32.48 2024/11/23-17:15:47.321822 139957399803456 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271721.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-17:15:48.156608 139957399803456 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271721.sst): second pass time = 1.30's, 83.251'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 43.477'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3402.919'MB/sec (index lex order gen) rebuild zvType time = 0.71's, 0.326'MB/sec write SST data time = 0.13's, 286.350'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 33219.046'MB/sec zip my value time = 1.30's, unzip length = 0.108'GB zip my value throughput = 83.251'MB/sec zip pipeline throughput = 83.251'MB/sec entries = 926045 avg-key = 28.00 avg-zkey = 1.92 avg-val = 116.94 avg-zval = 32.48 usrkeys = 926045 avg-key = 20.00 avg-zkey = 1.92 avg-val = 123.94 avg-zval = 32.48 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 926045 bytes = 3472688 } seq expand size = 6482315 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0301 GB dict = 1.08 MB all = 0.0364 GB } UnZip/Zip{ index = 10.4424 value = 3.6000 dict = 1.00 all = 3.6859 } Zip/UnZip{ index = 0.0958 value = 0.2778 dict = 1.00 all = 0.2713 } ---------------------------- total value len = 10.555031 GB avg = 0.159 KB (by entry num) total key len = 1.835295 GB avg = 0.028 KB total ukey len = 1.279645 GB avg = 0.016 KB total ukey num = 0.079638799 Billion total entry num = 0.066446528 Billion write speed all = 0.412516660 MB/sec (with seq num) write speed all = 0.394818789 MB/sec (without seq num) 2024/11/23-17:15:48.202071 139957399803456 [compaction_job.cc:1948] [default] [JOB 31667] Generated table #271721: 926045 keys, 36413498 bytes, temperature: kWarm 2024/11/23-17:15:48.202137 139957399803456 EVENT_LOG_v1 {"time_micros": 1732353348202102, "cf_name": "default", "job": 31667, "event": "table_file_creation", "file_number": 271721, "file_size": 36413498, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3411274482, "largest_seqno": 4012776300, "table_properties": {"data_size": 30080576, "index_size": 1773632, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25929260, "raw_average_key_size": 28, "raw_value_size": 108288578, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926045, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732353345, "oldest_key_time": 0, "file_creation_time": 1732353345, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 271721, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-17:15:48.241397 139957399803456 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271722.sst) /dev/shm/ToplingTemp/Topling-129123-W8jKeQ 2024/11/23-17:15:49.240894 139957399803456 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271722.sst): first pass time = 1.00's, 134.293'MB/sec 2024/11/23-17:15:50.575016 139957399803456 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271722.sst): old prealloc_size = 147639500, real_size = 34612320 2024/11/23-17:15:50.575626 139957399803456 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271722.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928430 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1082 GB zip-val = 0.0326 GB avg-val = 116.56 avg-zval = 35.12 2024/11/23-17:15:50.576479 139957399803456 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271722.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-17:15:51.418455 139957399803456 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271722.sst): second pass time = 1.33's, 81.171'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 46.039'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3024.277'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 0.324'MB/sec write SST data time = 0.13's, 309.696'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 34870.093'MB/sec zip my value time = 1.33's, unzip length = 0.108'GB zip my value throughput = 81.171'MB/sec zip pipeline throughput = 81.171'MB/sec entries = 928430 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.56 avg-zval = 35.12 usrkeys = 928430 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.56 avg-zval = 35.12 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 928430 bytes = 3365568 } seq expand size = 6499010 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0326 GB dict = 1.08 MB all = 0.0388 GB } UnZip/Zip{ index = 10.4455 value = 3.3194 dict = 1.00 all = 3.4565 } Zip/UnZip{ index = 0.0957 value = 0.3013 dict = 1.00 all = 0.2893 } ---------------------------- total value len = 10.669752 GB avg = 0.158 KB (by entry num) total key len = 1.861291 GB avg = 0.028 KB total ukey len = 1.298214 GB avg = 0.016 KB total ukey num = 0.080567229 Billion total entry num = 0.067374958 Billion write speed all = 0.417156307 MB/sec (with seq num) write speed all = 0.399213100 MB/sec (without seq num) 2024/11/23-17:15:51.465070 139957399803456 [compaction_job.cc:1948] [default] [JOB 31667] Generated table #271722: 928430 keys, 38830902 bytes, temperature: kWarm 2024/11/23-17:15:51.465137 139957399803456 EVENT_LOG_v1 {"time_micros": 1732353351465102, "cf_name": "default", "job": 31667, "event": "table_file_creation", "file_number": 271722, "file_size": 38830902, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3525889795, "largest_seqno": 4012776316, "table_properties": {"data_size": 32602384, "index_size": 1777664, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25996040, "raw_average_key_size": 28, "raw_value_size": 108221808, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928430, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732353348, "oldest_key_time": 0, "file_creation_time": 1732353348, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 271722, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-17:15:51.504637 139957399803456 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271723.sst) /dev/shm/ToplingTemp/Topling-129123-f1ooqU 2024/11/23-17:15:52.474376 139957399803456 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271723.sst): first pass time = 0.97's, 138.411'MB/sec 2024/11/23-17:15:53.747228 139957399803456 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271723.sst): old prealloc_size = 147639500, real_size = 30432384 2024/11/23-17:15:53.747781 139957399803456 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271723.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 930624 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0284 GB avg-val = 116.22 avg-zval = 30.55 2024/11/23-17:15:53.749864 139957399803456 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271723.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-17:15:54.566580 139957399803456 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271723.sst): second pass time = 1.27's, 85.026'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.82's, 42.442'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3343.783'MB/sec (index lex order gen) rebuild zvType time = 0.69's, 0.336'MB/sec write SST data time = 0.13's, 276.068'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 35895.413'MB/sec zip my value time = 1.27's, unzip length = 0.108'GB zip my value throughput = 85.026'MB/sec zip pipeline throughput = 85.026'MB/sec entries = 930624 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.22 avg-zval = 30.55 usrkeys = 930624 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.22 avg-zval = 30.55 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 930624 bytes = 3489856 } seq expand size = 6514368 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0284 GB dict = 1.08 MB all = 0.0348 GB } UnZip/Zip{ index = 10.5122 value = 3.8046 dict = 1.00 all = 3.8597 } Zip/UnZip{ index = 0.0951 value = 0.2628 dict = 1.00 all = 0.2591 } ---------------------------- total value len = 10.784427 GB avg = 0.158 KB (by entry num) total key len = 1.887349 GB avg = 0.028 KB total ukey len = 1.316826 GB avg = 0.016 KB total ukey num = 0.081497853 Billion total entry num = 0.068305582 Billion write speed all = 0.421797053 MB/sec (with seq num) write speed all = 0.403607909 MB/sec (without seq num) 2024/11/23-17:15:54.609557 139957399803456 [compaction_job.cc:1948] [default] [JOB 31667] Generated table #271723: 930624 keys, 34773810 bytes, temperature: kWarm 2024/11/23-17:15:54.609626 139957399803456 EVENT_LOG_v1 {"time_micros": 1732353354609591, "cf_name": "default", "job": 31667, "event": "table_file_creation", "file_number": 271723, "file_size": 34773810, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3405268578, "largest_seqno": 4012776344, "table_properties": {"data_size": 28428976, "index_size": 1770560, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26057472, "raw_average_key_size": 28, "raw_value_size": 108160340, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 930624, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732353351, "oldest_key_time": 0, "file_creation_time": 1732353351, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 271723, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-17:15:54.655021 139957399803456 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271724.sst) /dev/shm/ToplingTemp/Topling-129123-ge4SJT 2024/11/23-17:15:55.632902 139957399803456 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271724.sst): first pass time = 0.98's, 137.259'MB/sec 2024/11/23-17:15:56.945468 139957399803456 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271724.sst): old prealloc_size = 147639500, real_size = 31581296 2024/11/23-17:15:56.945999 139957399803456 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271724.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 923122 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.1084 GB zip-val = 0.0296 GB avg-val = 117.40 avg-zval = 32.03 2024/11/23-17:15:56.948151 139957399803456 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271724.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-17:15:57.766818 139957399803456 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271724.sst): second pass time = 1.31's, 82.612'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.82's, 43.710'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3507.857'MB/sec (index lex order gen) rebuild zvType time = 0.69's, 0.332'MB/sec write SST data time = 0.13's, 283.354'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 36770.156'MB/sec zip my value time = 1.31's, unzip length = 0.108'GB zip my value throughput = 82.612'MB/sec zip pipeline throughput = 82.612'MB/sec entries = 923122 avg-key = 28.00 avg-zkey = 1.93 avg-val = 117.40 avg-zval = 32.03 usrkeys = 923122 avg-key = 20.00 avg-zkey = 1.93 avg-val = 124.40 avg-zval = 32.03 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 923122 bytes = 3461728 } seq expand size = 6461854 multi value expand size = 0 cnt WriteAppend = 17 UnZipSize{ index = 0.0185 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0296 GB dict = 1.08 MB all = 0.0359 GB } UnZip/Zip{ index = 10.3757 value = 3.6648 dict = 1.00 all = 3.7386 } Zip/UnZip{ index = 0.0964 value = 0.2729 dict = 1.00 all = 0.2675 } ---------------------------- total value len = 10.899259 GB avg = 0.157 KB (by entry num) total key len = 1.913196 GB avg = 0.028 KB total ukey len = 1.335289 GB avg = 0.016 KB total ukey num = 0.082420975 Billion total entry num = 0.069228704 Billion write speed all = 0.426434340 MB/sec (with seq num) write speed all = 0.408001341 MB/sec (without seq num) 2024/11/23-17:15:57.811875 139957399803456 [compaction_job.cc:1948] [default] [JOB 31667] Generated table #271724: 923122 keys, 35900926 bytes, temperature: kWarm 2024/11/23-17:15:57.811944 139957399803456 EVENT_LOG_v1 {"time_micros": 1732353357811909, "cf_name": "default", "job": 31667, "event": "table_file_creation", "file_number": 271724, "file_size": 35900926, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3471845708, "largest_seqno": 4012776360, "table_properties": {"data_size": 29570912, "index_size": 1779392, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25847416, "raw_average_key_size": 28, "raw_value_size": 108370436, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 923122, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732353354, "oldest_key_time": 0, "file_creation_time": 1732353354, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 271724, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-17:15:57.859474 139957399803456 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271725.sst) /dev/shm/ToplingTemp/Topling-129123-heLVxS 2024/11/23-17:15:58.852775 139957399803456 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271725.sst): first pass time = 0.99's, 135.128'MB/sec 2024/11/23-17:16:00.333482 139957399803456 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271725.sst): old prealloc_size = 147639500, real_size = 36542512 2024/11/23-17:16:00.334055 139957399803456 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271725.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928898 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1082 GB zip-val = 0.0345 GB avg-val = 116.49 avg-zval = 37.17 2024/11/23-17:16:00.334246 139957399803456 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271725.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-17:16:01.046337 139957399803456 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271725.sst): second pass time = 1.48's, 73.118'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.71's, 53.107'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3240.630'MB/sec (index lex order gen) rebuild zvType time = 0.59's, 0.395'MB/sec write SST data time = 0.12's, 303.581'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 32272.841'MB/sec zip my value time = 1.48's, unzip length = 0.108'GB zip my value throughput = 73.118'MB/sec zip pipeline throughput = 73.118'MB/sec entries = 928898 avg-key = 28.00 avg-zkey = 1.92 avg-val = 116.49 avg-zval = 37.17 usrkeys = 928898 avg-key = 20.00 avg-zkey = 1.92 avg-val = 117.24 avg-zval = 37.17 TagRS{ kinds = RS_Key0_TagN bytes = 145240 } TagArray{ size = 99487 bytes = 310912 } seq expand size = 696409 multi value expand size = 0 cnt WriteAppend = 17 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0345 GB dict = 1.08 MB all = 0.0379 GB } UnZip/Zip{ index = 10.4433 value = 3.1337 dict = 1.00 all = 3.5454 } Zip/UnZip{ index = 0.0958 value = 0.3191 dict = 1.00 all = 0.2821 } ---------------------------- total value len = 11.008164 GB avg = 0.157 KB (by entry num) total key len = 1.939205 GB avg = 0.028 KB total ukey len = 1.353867 GB avg = 0.016 KB total ukey num = 0.083349873 Billion total entry num = 0.070157602 Billion write speed all = 0.430877630 MB/sec (with seq num) write speed all = 0.412199339 MB/sec (without seq num) 2024/11/23-17:16:01.093877 139957399803456 [compaction_job.cc:1948] [default] [JOB 31667] Generated table #271725: 928898 keys, 37856437 bytes, temperature: kWarm 2024/11/23-17:16:01.093945 139957399803456 EVENT_LOG_v1 {"time_micros": 1732353361093911, "cf_name": "default", "job": 31667, "event": "table_file_creation", "file_number": 271725, "file_size": 37856437, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4012773626, "table_properties": {"data_size": 34531168, "index_size": 1778944, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26009144, "raw_average_key_size": 28, "raw_value_size": 108208616, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928898, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732353357, "oldest_key_time": 0, "file_creation_time": 1732353357, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 271725, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-17:16:01.132547 139957399803456 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271726.sst) /dev/shm/ToplingTemp/Topling-129123-kbStmR 2024/11/23-17:16:02.077033 139957399803456 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271726.sst): first pass time = 0.94's, 142.113'MB/sec 2024/11/23-17:16:03.535818 139957399803456 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271726.sst): old prealloc_size = 147639500, real_size = 36966688 2024/11/23-17:16:03.536375 139957399803456 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271726.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 924245 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1083 GB zip-val = 0.0350 GB avg-val = 117.22 avg-zval = 37.83 2024/11/23-17:16:03.536869 139957399803456 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271726.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-17:16:04.292987 139957399803456 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271726.sst): second pass time = 1.46's, 74.311'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.76's, 52.391'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3283.245'MB/sec (index lex order gen) rebuild zvType time = 0.63's, 0.367'MB/sec write SST data time = 0.13's, 311.942'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.082'MB, throughput = 34801.608'MB/sec zip my value time = 1.46's, unzip length = 0.108'GB zip my value throughput = 74.311'MB/sec zip pipeline throughput = 74.311'MB/sec entries = 924245 avg-key = 28.00 avg-zkey = 1.91 avg-val = 117.22 avg-zval = 37.83 usrkeys = 924245 avg-key = 20.00 avg-zkey = 1.91 avg-val = 120.64 avg-zval = 37.83 TagRS{ kinds = RS_Key0_TagN bytes = 144520 } TagArray{ size = 452063 bytes = 1695248 } seq expand size = 3164441 multi value expand size = 0 cnt WriteAppend = 17 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0350 GB dict = 1.08 MB all = 0.0397 GB } UnZip/Zip{ index = 10.4458 value = 3.0984 dict = 1.00 all = 3.3836 } Zip/UnZip{ index = 0.0957 value = 0.3227 dict = 1.00 all = 0.2955 } ---------------------------- total value len = 11.119667 GB avg = 0.156 KB (by entry num) total key len = 1.965084 GB avg = 0.028 KB total ukey len = 1.372352 GB avg = 0.016 KB total ukey num = 0.084274118 Billion total entry num = 0.071081847 Billion write speed all = 0.435402551 MB/sec (with seq num) write speed all = 0.416480240 MB/sec (without seq num) 2024/11/23-17:16:04.341993 139957399803456 [compaction_job.cc:1948] [default] [JOB 31667] Generated table #271726: 924245 keys, 39667067 bytes, temperature: kWarm 2024/11/23-17:16:04.342060 139957399803456 EVENT_LOG_v1 {"time_micros": 1732353364342023, "cf_name": "default", "job": 31667, "event": "table_file_creation", "file_number": 271726, "file_size": 39667067, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4128865578, "table_properties": {"data_size": 34965840, "index_size": 1769600, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25878860, "raw_average_key_size": 28, "raw_value_size": 108338894, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 924245, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732353361, "oldest_key_time": 0, "file_creation_time": 1732353361, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 271726, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-17:16:04.377282 139957399803456 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271727.sst) /dev/shm/ToplingTemp/Topling-129123-qCTQTQ 2024/11/23-17:16:05.424693 139957399803456 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271727.sst): first pass time = 1.05's, 128.147'MB/sec 2024/11/23-17:16:06.747016 139957399803456 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271727.sst): old prealloc_size = 147639500, real_size = 35408208 2024/11/23-17:16:06.747588 139957399803456 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271727.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926546 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0334 GB avg-val = 116.86 avg-zval = 36.06 2024/11/23-17:16:06.748431 139957399803456 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271727.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-17:16:07.583465 139957399803456 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271727.sst): second pass time = 1.32's, 81.930'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 46.954'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3209.865'MB/sec (index lex order gen) rebuild zvType time = 0.71's, 0.327'MB/sec write SST data time = 0.13's, 308.195'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 31828.285'MB/sec zip my value time = 1.32's, unzip length = 0.108'GB zip my value throughput = 81.930'MB/sec zip pipeline throughput = 81.930'MB/sec entries = 926546 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.86 avg-zval = 36.06 usrkeys = 926546 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.86 avg-zval = 36.06 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 926546 bytes = 3011296 } seq expand size = 6485822 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0334 GB dict = 1.08 MB all = 0.0393 GB } UnZip/Zip{ index = 10.5129 value = 3.2404 dict = 1.00 all = 3.4175 } Zip/UnZip{ index = 0.0951 value = 0.3086 dict = 1.00 all = 0.2926 } ---------------------------- total value len = 11.234428 GB avg = 0.156 KB (by entry num) total key len = 1.991027 GB avg = 0.028 KB total ukey len = 1.390883 GB avg = 0.016 KB total ukey num = 0.085200664 Billion total entry num = 0.072008393 Billion write speed all = 0.440036364 MB/sec (with seq num) write speed all = 0.420869500 MB/sec (without seq num) 2024/11/23-17:16:07.632779 139957399803456 [compaction_job.cc:1948] [default] [JOB 31667] Generated table #271727: 926546 keys, 39273932 bytes, temperature: kWarm 2024/11/23-17:16:07.632850 139957399803456 EVENT_LOG_v1 {"time_micros": 1732353367632814, "cf_name": "default", "job": 31667, "event": "table_file_creation", "file_number": 271727, "file_size": 39273932, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4100101999, "largest_seqno": 4139223340, "table_properties": {"data_size": 33413696, "index_size": 1762688, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25943288, "raw_average_key_size": 28, "raw_value_size": 108274512, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926546, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732353364, "oldest_key_time": 0, "file_creation_time": 1732353364, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 271727, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-17:16:07.668194 139957399803456 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271728.sst) /dev/shm/ToplingTemp/Topling-129123-GorlgQ 2024/11/23-17:16:07.747064 139957399803456 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271728.sst): first pass time = 0.08's, 232.674'MB/sec 2024/11/23-17:16:07.908552 139957399803456 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271728.sst): old prealloc_size = 147639500, real_size = 5250496 2024/11/23-17:16:07.908679 139957399803456 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271728.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 128133 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0002 GB avg-key = 16.00 avg-zkey = 1.94 raw-val = 0.0148 GB zip-val = 0.0050 GB avg-val = 115.15 avg-zval = 38.79 2024/11/23-17:16:07.908816 139957399803456 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271728.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.018 GB 2024/11/23-17:16:08.021487 139957399803456 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00/271728.sst): second pass time = 0.16's, 91.764'MB/sec, value only(80.4% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.11's, 51.290'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2335.086'MB/sec (index lex order gen) rebuild zvType time = 0.09's, 0.340'MB/sec write SST data time = 0.02's, 310.057'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.154'MB, throughput = 4001.245'MB/sec zip my value time = 0.16's, unzip length = 0.015'GB zip my value throughput = 91.764'MB/sec zip pipeline throughput = 91.764'MB/sec entries = 128133 avg-key = 28.00 avg-zkey = 1.94 avg-val = 115.15 avg-zval = 38.79 usrkeys = 128133 avg-key = 20.00 avg-zkey = 1.94 avg-val = 122.15 avg-zval = 38.79 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 128133 bytes = 416448 } seq expand size = 896931 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0026 GB value = 0.0148 GB dict = 0.15 MB all = 0.0183 GB } __ZipSize{ index = 0.0002 GB value = 0.0050 GB dict = 0.15 MB all = 0.0058 GB } UnZip/Zip{ index = 10.3200 value = 2.9686 dict = 1.00 all = 3.1672 } Zip/UnZip{ index = 0.0969 value = 0.3369 dict = 1.00 all = 0.3157 } ---------------------------- total value len = 11.250079 GB avg = 0.156 KB (by entry num) total key len = 1.994615 GB avg = 0.028 KB total ukey len = 1.393445 GB avg = 0.016 KB total ukey num = 0.085328797 Billion total entry num = 0.072136526 Billion write speed all = 0.440670045 MB/sec (with seq num) write speed all = 0.421469356 MB/sec (without seq num) 2024/11/23-17:16:08.034413 139957399803456 [compaction_job.cc:1948] [default] [JOB 31667] Generated table #271728: 128133 keys, 5791039 bytes, temperature: kWarm 2024/11/23-17:16:08.034470 139957399803456 EVENT_LOG_v1 {"time_micros": 1732353368034436, "cf_name": "default", "job": 31667, "event": "table_file_creation", "file_number": 271728, "file_size": 5791039, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4072856654, "largest_seqno": 4139222666, "table_properties": {"data_size": 4969968, "index_size": 248320, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 3587724, "raw_average_key_size": 28, "raw_value_size": 14753894, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 128133, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732353367, "oldest_key_time": 0, "file_creation_time": 1732353367, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 271728, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-17:16:08.046701 139957399803456 [compaction_job.cc:703] job-31667: subcompact[0], size: 0.798444 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31667/att-00 [271707,271708,271709,271710,271711,271712,271713,271714,271715,271716,271717,271718,271719,271720,271721,271722,271723,271724,271725,271726,271727,271728] 2024/11/23-17:16:08.174458 139957399803456 (Original Log Time 2024/11/23-17:14:55.970450) EVENT_LOG_v1 {"time_micros": 1732353295970413, "job": 31667, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [271685], "files_L3": [271585, 271614, 271615, 271616, 271617, 271618, 271619, 271620, 271621, 271622, 271623, 271624, 271625, 271626, 271627, 271628, 271629, 271630, 271631, 271632, 271699], "score": 0.998788, "input_data_size": 818699482, "oldest_snapshot_seqno": 4139486968} 2024/11/23-17:16:08.174462 139957399803456 (Original Log Time 2024/11/23-17:16:08.172505) [compaction_job.cc:2022] [default] [JOB 31667] Compacted 1@2 + 21@3 files to L3 => 798444391 bytes 2024/11/23-17:16:08.174463 139957399803456 (Original Log Time 2024/11/23-17:16:08.174379) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 22 0 0 0] max score 0.03, MB/sec: 11.4 rd, 11.1 wr, level 3, files in(1, 21) out(22 +0 blob) MB in(22.4, 758.4 +0.0 blob) out(761.5 +0.0 blob), read-write-amplify(68.9) write-amplify(34.0) OK, records in: 19844186, records dropped: 65824 output_compression: Snappy 2024/11/23-17:16:08.174467 139957399803456 (Original Log Time 2024/11/23-17:16:08.174424) EVENT_LOG_v1 {"time_micros": 1732353368174403, "cf": "default", "job": 31667, "event": "compaction_finished", "compaction_time_micros": 72076256, "compaction_time_cpu_micros": 30151279, "output_level": 3, "num_output_files": 22, "total_output_size": 798444391, "num_input_records": 19844186, "num_output_records": 19778362, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 581529890, "file_range_sync_nanos": 0, "file_fsync_nanos": 16399, "file_prepare_write_nanos": 65175, "lsm_state": [0, 0, 0, 22, 0, 0, 0]} 2024/11/23-17:16:08.318212 139957399803456 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732256054,"starts":1732353295,"executesMs":72362,"compactionJobId":31667,"attempt":0,"compactionInputRawBytes":2846262297,"compactionInputZipBytes":818699482,"compactionOutputRawBytes":0,"compactionOutputZipBytes":798444391,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-ef7f0069593e6acdf6b2584067fe040a-ec12f0013ebaa29c-00"}}, response = 2024/11/23-17:16:08.318297 139957399803456 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-31667/att-00: olev 3, work 72.362 s, result 7.796 ms, install 1.977 ms, input{raw 2.651 GiB zip 780.773 MiB}