2024/11/24-04:13:33.001479 139957450159680 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00: fork to child time = 0.007591 sec 2024/11/24-04:13:33.002217 139957450159680 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00 2024/11/24-04:13:33.009482 139957450159680 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00 2024/11/24-04:13:33.010453 139957450159680 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/24-04:13:33.010758 139957450159680 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/24-04:13:33.074753 139957450159680 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-41330/att-00/MANIFEST-206347 2024/11/24-04:13:33.102927 139957450159680 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-41330/att-00/MANIFEST-206347 succeeded,manifest_file_number is 206347, next_file_number is 291541, last_sequence is 4434071574, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 291362 2024/11/24-04:13:33.102933 139957450159680 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/24-04:13:33.103084 139957450159680 [version_set.cc:5721] Creating manifest 291541 2024/11/24-04:13:33.138505 139957450159680 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/24-04:13:33.158420 139957450159680 [compaction_job.cc:2437] [default] [JOB 41330] Compacting 1@2 + 17@3 files to L3, score 1.00, subcompactions 1 : 1 2024/11/24-04:13:33.158440 139957450159680 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 30959 Base level 2, inputs: [291504(25MB)], [291407(35MB) 291408(34MB) 291409(33MB) 291410(35MB) 291411(35MB) 291412(33MB) 291413(34MB) 291414(35MB) 291447(33MB) 291448(33MB) 291449(35MB) 291450(35MB) 291451(33MB) 291452(7843KB) 291453(33MB) 291454(35MB) 291520(34MB)] 2024/11/24-04:13:33.165050 139957450159680 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/24-04:13:33.165079 139957450159680 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/24-04:13:33.165099 139957450159680 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/24-04:13:33.165104 139957450159680 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/24-04:13:33.165114 139957450159680 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/24-04:13:33.744012 139957450159680 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291542.sst) /dev/shm/ToplingTemp/Topling-266410-fHqh4P 2024/11/24-04:13:34.288669 139957450159680 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291542.sst): first pass time = 0.54's, 246.445'MB/sec 2024/11/24-04:13:36.093219 139957450159680 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291542.sst): old prealloc_size = 147639500, real_size = 33445328 2024/11/24-04:13:36.093900 139957450159680 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291542.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927076 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0314 GB avg-val = 116.78 avg-zval = 33.92 2024/11/24-04:13:36.094772 139957450159680 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291542.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-04:13:37.121874 139957450159680 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291542.sst): second pass time = 1.80's, 60.054'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.03's, 36.498'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2677.078'MB/sec (index lex order gen) rebuild zvType time = 0.84's, 0.276'MB/sec write SST data time = 0.19's, 198.295'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 34306.994'MB/sec zip my value time = 1.80's, unzip length = 0.108'GB zip my value throughput = 60.054'MB/sec zip pipeline throughput = 66.416'MB/sec entries = 927076 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.78 avg-zval = 33.92 usrkeys = 927076 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.78 avg-zval = 33.92 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927076 bytes = 3244784 } seq expand size = 6489532 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0314 GB dict = 1.08 MB all = 0.0375 GB } UnZip/Zip{ index = 10.5135 value = 3.4423 dict = 1.00 all = 3.5749 } Zip/UnZip{ index = 0.0951 value = 0.2905 dict = 1.00 all = 0.2797 } ---------------------------- total value len = 2251.440322 GB avg = 0.200 KB (by entry num) total key len = 306.908921 GB avg = 0.027 KB total ukey len = 237.373269 GB avg = 0.015 KB total ukey num = 15.739588239 Billion total entry num = 11.280902187 Billion write speed all = 36.808181541 MB/sec (with seq num) write speed all = 35.509752105 MB/sec (without seq num) 2024/11/24-04:13:37.168128 139957450159680 [compaction_job.cc:1948] [default] [JOB 41330] Generated table #291542: 927076 keys, 37544334 bytes, temperature: kWarm 2024/11/24-04:13:37.168231 139957450159680 EVENT_LOG_v1 {"time_micros": 1732392817168166, "cf_name": "default", "job": 41330, "event": "table_file_creation", "file_number": 291542, "file_size": 37544334, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4259662645, "largest_seqno": 4433662094, "table_properties": {"data_size": 31449792, "index_size": 1763584, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25958128, "raw_average_key_size": 28, "raw_value_size": 108259644, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927076, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732392813, "oldest_key_time": 0, "file_creation_time": 1732392813, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 291542, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-04:13:37.209891 139957450159680 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291543.sst) /dev/shm/ToplingTemp/Topling-266410-qkwTpQ 2024/11/24-04:13:38.346702 139957450159680 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291543.sst): first pass time = 1.14's, 118.070'MB/sec 2024/11/24-04:13:39.957145 139957450159680 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291543.sst): old prealloc_size = 147639500, real_size = 31883968 2024/11/24-04:13:39.957675 139957450159680 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291543.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927224 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0299 GB avg-val = 116.75 avg-zval = 32.23 2024/11/24-04:13:39.958451 139957450159680 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291543.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-04:13:40.789075 139957450159680 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291543.sst): second pass time = 1.61's, 67.254'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.83's, 43.254'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3449.839'MB/sec (index lex order gen) rebuild zvType time = 0.70's, 0.329'MB/sec write SST data time = 0.13's, 283.631'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 28258.382'MB/sec zip my value time = 1.61's, unzip length = 0.108'GB zip my value throughput = 67.254'MB/sec zip pipeline throughput = 130.512'MB/sec entries = 927224 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.75 avg-zval = 32.23 usrkeys = 927224 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.75 avg-zval = 32.23 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927224 bytes = 3245296 } seq expand size = 6490568 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0299 GB dict = 1.08 MB all = 0.0360 GB } UnZip/Zip{ index = 10.5129 value = 3.6220 dict = 1.00 all = 3.7300 } Zip/UnZip{ index = 0.0951 value = 0.2761 dict = 1.00 all = 0.2681 } ---------------------------- total value len = 2251.555068 GB avg = 0.200 KB (by entry num) total key len = 306.934883 GB avg = 0.027 KB total ukey len = 237.391813 GB avg = 0.015 KB total ukey num = 15.740515463 Billion total entry num = 11.281829411 Billion write speed all = 36.808263907 MB/sec (with seq num) write speed all = 35.509796257 MB/sec (without seq num) 2024/11/24-04:13:40.832907 139957450159680 [compaction_job.cc:1948] [default] [JOB 41330] Generated table #291543: 927224 keys, 35983792 bytes, temperature: kWarm 2024/11/24-04:13:40.832964 139957450159680 EVENT_LOG_v1 {"time_micros": 1732392820832933, "cf_name": "default", "job": 41330, "event": "table_file_creation", "file_number": 291543, "file_size": 35983792, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4261178503, "largest_seqno": 4433662106, "table_properties": {"data_size": 29887984, "index_size": 1763968, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25962272, "raw_average_key_size": 28, "raw_value_size": 108255556, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927224, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732392817, "oldest_key_time": 0, "file_creation_time": 1732392817, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 291543, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-04:13:40.870014 139957450159680 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291544.sst) /dev/shm/ToplingTemp/Topling-266410-pfGVUS 2024/11/24-04:13:41.724136 139957450159680 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291544.sst): first pass time = 0.85's, 157.149'MB/sec 2024/11/24-04:13:43.303019 139957450159680 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291544.sst): old prealloc_size = 147639500, real_size = 31420208 2024/11/24-04:13:43.303553 139957450159680 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291544.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 919300 prefix = 4 raw-key = 0.0147 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1085 GB zip-val = 0.0294 GB avg-val = 118.00 avg-zval = 32.01 2024/11/24-04:13:43.304298 139957450159680 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291544.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-04:13:44.126774 139957450159680 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291544.sst): second pass time = 1.58's, 68.739'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.82's, 43.093'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3435.145'MB/sec (index lex order gen) rebuild zvType time = 0.69's, 0.331'MB/sec write SST data time = 0.13's, 273.916'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.085'MB, throughput = 29035.806'MB/sec zip my value time = 1.58's, unzip length = 0.108'GB zip my value throughput = 68.739'MB/sec zip pipeline throughput = 137.252'MB/sec entries = 919300 avg-key = 28.00 avg-zkey = 1.92 avg-val = 118.00 avg-zval = 32.01 usrkeys = 919300 avg-key = 20.00 avg-zkey = 1.92 avg-val = 125.00 avg-zval = 32.01 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 919300 bytes = 3217568 } seq expand size = 6435100 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0184 GB value = 0.1085 GB dict = 1.09 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0294 GB dict = 1.09 MB all = 0.0355 GB } UnZip/Zip{ index = 10.4436 value = 3.6860 dict = 1.00 all = 3.7811 } Zip/UnZip{ index = 0.0958 value = 0.2713 dict = 1.00 all = 0.2645 } ---------------------------- total value len = 2251.669981 GB avg = 0.200 KB (by entry num) total key len = 306.960623 GB avg = 0.027 KB total ukey len = 237.410199 GB avg = 0.015 KB total ukey num = 15.741434763 Billion total entry num = 11.282748711 Billion write speed all = 36.808519954 MB/sec (with seq num) write speed all = 35.510008851 MB/sec (without seq num) 2024/11/24-04:13:44.197344 139957450159680 [compaction_job.cc:1948] [default] [JOB 41330] Generated table #291544: 919300 keys, 35496946 bytes, temperature: kWarm 2024/11/24-04:13:44.197416 139957450159680 EVENT_LOG_v1 {"time_micros": 1732392824197379, "cf_name": "default", "job": 41330, "event": "table_file_creation", "file_number": 291544, "file_size": 35496946, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4279427811, "largest_seqno": 4432040471, "table_properties": {"data_size": 29429664, "index_size": 1760512, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25740400, "raw_average_key_size": 28, "raw_value_size": 108477400, "raw_average_value_size": 118, "num_data_blocks": 1, "num_entries": 919300, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 118, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732392820, "oldest_key_time": 0, "file_creation_time": 1732392820, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 291544, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-04:13:44.236109 139957450159680 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291545.sst) /dev/shm/ToplingTemp/Topling-266410-f6yqLR 2024/11/24-04:13:45.092179 139957450159680 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291545.sst): first pass time = 0.86's, 156.791'MB/sec 2024/11/24-04:13:46.694370 139957450159680 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291545.sst): old prealloc_size = 147639500, real_size = 33082256 2024/11/24-04:13:46.694896 139957450159680 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291545.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927039 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0311 GB avg-val = 116.78 avg-zval = 33.53 2024/11/24-04:13:46.695691 139957450159680 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291545.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-04:13:47.551648 139957450159680 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291545.sst): second pass time = 1.60's, 67.621'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.86's, 43.373'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3468.359'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.318'MB/sec write SST data time = 0.13's, 290.980'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 22253.770'MB/sec zip my value time = 1.60's, unzip length = 0.108'GB zip my value throughput = 67.621'MB/sec zip pipeline throughput = 134.783'MB/sec entries = 927039 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.78 avg-zval = 33.53 usrkeys = 927039 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.78 avg-zval = 33.53 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927039 bytes = 3244656 } seq expand size = 6489273 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0311 GB dict = 1.08 MB all = 0.0372 GB } UnZip/Zip{ index = 10.5139 value = 3.4825 dict = 1.00 all = 3.6098 } Zip/UnZip{ index = 0.0951 value = 0.2871 dict = 1.00 all = 0.2770 } ---------------------------- total value len = 2251.784731 GB avg = 0.200 KB (by entry num) total key len = 306.986580 GB avg = 0.027 KB total ukey len = 237.428740 GB avg = 0.015 KB total ukey num = 15.742361802 Billion total entry num = 11.283675750 Billion write speed all = 36.808730592 MB/sec (with seq num) write speed all = 35.510176778 MB/sec (without seq num) 2024/11/24-04:13:47.602991 139957450159680 [compaction_job.cc:1948] [default] [JOB 41330] Generated table #291545: 927039 keys, 37181142 bytes, temperature: kWarm 2024/11/24-04:13:47.603059 139957450159680 EVENT_LOG_v1 {"time_micros": 1732392827603023, "cf_name": "default", "job": 41330, "event": "table_file_creation", "file_number": 291545, "file_size": 37181142, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4261178518, "largest_seqno": 4433662121, "table_properties": {"data_size": 31086848, "index_size": 1763456, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25957092, "raw_average_key_size": 28, "raw_value_size": 108260722, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927039, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732392824, "oldest_key_time": 0, "file_creation_time": 1732392824, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 291545, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-04:13:47.639921 139957450159680 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291546.sst) /dev/shm/ToplingTemp/Topling-266410-fT6MdU 2024/11/24-04:13:48.540316 139957450159680 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291546.sst): first pass time = 0.90's, 149.071'MB/sec 2024/11/24-04:13:50.178593 139957450159680 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291546.sst): old prealloc_size = 147639500, real_size = 32896368 2024/11/24-04:13:50.179108 139957450159680 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291546.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927143 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0309 GB avg-val = 116.76 avg-zval = 33.33 2024/11/24-04:13:50.179891 139957450159680 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291546.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-04:13:51.029419 139957450159680 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291546.sst): second pass time = 1.64's, 66.107'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.85's, 43.484'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3557.965'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 0.321'MB/sec write SST data time = 0.13's, 289.543'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 23030.692'MB/sec zip my value time = 1.64's, unzip length = 0.108'GB zip my value throughput = 66.107'MB/sec zip pipeline throughput = 130.096'MB/sec entries = 927143 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.76 avg-zval = 33.33 usrkeys = 927143 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.76 avg-zval = 33.33 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927143 bytes = 3245008 } seq expand size = 6490001 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0309 GB dict = 1.08 MB all = 0.0370 GB } UnZip/Zip{ index = 10.5128 value = 3.5034 dict = 1.00 all = 3.6279 } Zip/UnZip{ index = 0.0951 value = 0.2854 dict = 1.00 all = 0.2756 } ---------------------------- total value len = 2251.899479 GB avg = 0.200 KB (by entry num) total key len = 307.012540 GB avg = 0.027 KB total ukey len = 237.447283 GB avg = 0.015 KB total ukey num = 15.743288945 Billion total entry num = 11.284602893 Billion write speed all = 36.808913210 MB/sec (with seq num) write speed all = 35.510317665 MB/sec (without seq num) 2024/11/24-04:13:51.078891 139957450159680 [compaction_job.cc:1948] [default] [JOB 41330] Generated table #291546: 927143 keys, 36996026 bytes, temperature: kWarm 2024/11/24-04:13:51.078961 139957450159680 EVENT_LOG_v1 {"time_micros": 1732392831078922, "cf_name": "default", "job": 41330, "event": "table_file_creation", "file_number": 291546, "file_size": 36996026, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4261178530, "largest_seqno": 4433662136, "table_properties": {"data_size": 30900576, "index_size": 1763840, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25960004, "raw_average_key_size": 28, "raw_value_size": 108257790, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927143, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732392827, "oldest_key_time": 0, "file_creation_time": 1732392827, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 291546, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-04:13:51.114820 139957450159680 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291547.sst) /dev/shm/ToplingTemp/Topling-266410-pq5XCQ 2024/11/24-04:13:52.000886 139957450159680 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291547.sst): first pass time = 0.89's, 151.481'MB/sec 2024/11/24-04:13:53.569020 139957450159680 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291547.sst): old prealloc_size = 147639500, real_size = 31173552 2024/11/24-04:13:53.569580 139957450159680 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291547.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 922650 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.1084 GB zip-val = 0.0292 GB avg-val = 117.47 avg-zval = 31.61 2024/11/24-04:13:53.570319 139957450159680 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291547.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-04:13:54.383284 139957450159680 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291547.sst): second pass time = 1.57's, 69.148'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.81's, 43.160'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3292.659'MB/sec (index lex order gen) rebuild zvType time = 0.69's, 0.336'MB/sec write SST data time = 0.13's, 274.538'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 17158.011'MB/sec zip my value time = 1.57's, unzip length = 0.108'GB zip my value throughput = 69.148'MB/sec zip pipeline throughput = 136.132'MB/sec entries = 922650 avg-key = 28.00 avg-zkey = 1.93 avg-val = 117.47 avg-zval = 31.61 usrkeys = 922650 avg-key = 20.00 avg-zkey = 1.93 avg-val = 124.47 avg-zval = 31.61 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 922650 bytes = 3113952 } seq expand size = 6458550 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0292 GB dict = 1.08 MB all = 0.0351 GB } UnZip/Zip{ index = 10.3771 value = 3.7163 dict = 1.00 all = 3.8191 } Zip/UnZip{ index = 0.0964 value = 0.2691 dict = 1.00 all = 0.2618 } ---------------------------- total value len = 2252.014321 GB avg = 0.200 KB (by entry num) total key len = 307.038375 GB avg = 0.027 KB total ukey len = 237.465736 GB avg = 0.015 KB total ukey num = 15.744211595 Billion total entry num = 11.285525543 Billion write speed all = 36.809160959 MB/sec (with seq num) write speed all = 35.510521890 MB/sec (without seq num) 2024/11/24-04:13:54.458179 139957450159680 [compaction_job.cc:1948] [default] [JOB 41330] Generated table #291547: 922650 keys, 35143736 bytes, temperature: kWarm 2024/11/24-04:13:54.458232 139957450159680 EVENT_LOG_v1 {"time_micros": 1732392834458198, "cf_name": "default", "job": 41330, "event": "table_file_creation", "file_number": 291547, "file_size": 35143736, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4301226735, "largest_seqno": 4433662151, "table_properties": {"data_size": 29164448, "index_size": 1778240, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25834200, "raw_average_key_size": 28, "raw_value_size": 108383556, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 922650, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732392831, "oldest_key_time": 0, "file_creation_time": 1732392831, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 291547, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-04:13:54.503224 139957450159680 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291548.sst) /dev/shm/ToplingTemp/Topling-266410-BNZkrS 2024/11/24-04:13:55.368794 139957450159680 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291548.sst): first pass time = 0.87's, 155.069'MB/sec 2024/11/24-04:13:56.981556 139957450159680 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291548.sst): old prealloc_size = 147639500, real_size = 32794544 2024/11/24-04:13:56.982217 139957450159680 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291548.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 923718 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1084 GB zip-val = 0.0308 GB avg-val = 117.30 avg-zval = 33.34 2024/11/24-04:13:56.983030 139957450159680 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291548.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-04:13:57.839683 139957450159680 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291548.sst): second pass time = 1.61's, 67.221'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.86's, 42.984'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2760.046'MB/sec (index lex order gen) rebuild zvType time = 0.71's, 0.324'MB/sec write SST data time = 0.15's, 254.170'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.082'MB, throughput = 29689.353'MB/sec zip my value time = 1.61's, unzip length = 0.108'GB zip my value throughput = 67.221'MB/sec zip pipeline throughput = 124.170'MB/sec entries = 923718 avg-key = 28.00 avg-zkey = 1.91 avg-val = 117.30 avg-zval = 33.34 usrkeys = 923718 avg-key = 20.00 avg-zkey = 1.91 avg-val = 124.30 avg-zval = 33.34 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 923718 bytes = 3233024 } seq expand size = 6466026 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0185 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0308 GB dict = 1.08 MB all = 0.0369 GB } UnZip/Zip{ index = 10.4455 value = 3.5186 dict = 1.00 all = 3.6388 } Zip/UnZip{ index = 0.0957 value = 0.2842 dict = 1.00 all = 0.2748 } ---------------------------- total value len = 2252.129141 GB avg = 0.200 KB (by entry num) total key len = 307.064239 GB avg = 0.027 KB total ukey len = 237.484210 GB avg = 0.015 KB total ukey num = 15.745135313 Billion total entry num = 11.286449261 Billion write speed all = 36.809354509 MB/sec (with seq num) write speed all = 35.510673712 MB/sec (without seq num) 2024/11/24-04:13:57.885565 139957450159680 [compaction_job.cc:1948] [default] [JOB 41330] Generated table #291548: 923718 keys, 36884714 bytes, temperature: kWarm 2024/11/24-04:13:57.885625 139957450159680 EVENT_LOG_v1 {"time_micros": 1732392837885592, "cf_name": "default", "job": 41330, "event": "table_file_creation", "file_number": 291548, "file_size": 36884714, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4261178548, "largest_seqno": 4433660816, "table_properties": {"data_size": 30794784, "index_size": 1768640, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25864104, "raw_average_key_size": 28, "raw_value_size": 108353636, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 923718, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732392834, "oldest_key_time": 0, "file_creation_time": 1732392834, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 291548, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-04:13:57.933345 139957450159680 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291549.sst) /dev/shm/ToplingTemp/Topling-266410-cYkxuQ 2024/11/24-04:13:58.794336 139957450159680 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291549.sst): first pass time = 0.86's, 155.894'MB/sec 2024/11/24-04:14:00.348786 139957450159680 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291549.sst): old prealloc_size = 147639500, real_size = 33363104 2024/11/24-04:14:00.349373 139957450159680 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291549.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927037 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1083 GB zip-val = 0.0314 GB avg-val = 116.78 avg-zval = 33.82 2024/11/24-04:14:00.350144 139957450159680 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291549.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-04:14:01.208806 139957450159680 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291549.sst): second pass time = 1.55's, 69.682'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.86's, 43.561'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3115.205'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.316'MB/sec write SST data time = 0.13's, 298.198'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 32737.426'MB/sec zip my value time = 1.55's, unzip length = 0.108'GB zip my value throughput = 69.682'MB/sec zip pipeline throughput = 112.994'MB/sec entries = 927037 avg-key = 28.00 avg-zkey = 1.92 avg-val = 116.78 avg-zval = 33.82 usrkeys = 927037 avg-key = 20.00 avg-zkey = 1.92 avg-val = 123.78 avg-zval = 33.82 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927037 bytes = 3244640 } seq expand size = 6489259 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0314 GB dict = 1.08 MB all = 0.0375 GB } UnZip/Zip{ index = 10.4430 value = 3.4527 dict = 1.00 all = 3.5827 } Zip/UnZip{ index = 0.0958 value = 0.2896 dict = 1.00 all = 0.2791 } ---------------------------- total value len = 2252.243891 GB avg = 0.200 KB (by entry num) total key len = 307.090196 GB avg = 0.027 KB total ukey len = 237.502751 GB avg = 0.015 KB total ukey num = 15.746062350 Billion total entry num = 11.287376298 Billion write speed all = 36.809594575 MB/sec (with seq num) write speed all = 35.510870043 MB/sec (without seq num) 2024/11/24-04:14:01.256019 139957450159680 [compaction_job.cc:1948] [default] [JOB 41330] Generated table #291549: 927037 keys, 37462242 bytes, temperature: kWarm 2024/11/24-04:14:01.256083 139957450159680 EVENT_LOG_v1 {"time_micros": 1732392841256052, "cf_name": "default", "job": 41330, "event": "table_file_creation", "file_number": 291549, "file_size": 37462242, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4261178559, "largest_seqno": 4433662170, "table_properties": {"data_size": 31355728, "index_size": 1775424, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25957036, "raw_average_key_size": 28, "raw_value_size": 108260726, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927037, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732392837, "oldest_key_time": 0, "file_creation_time": 1732392837, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 291549, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-04:14:01.292645 139957450159680 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291550.sst) /dev/shm/ToplingTemp/Topling-266410-xXpQvT 2024/11/24-04:14:02.157250 139957450159680 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291550.sst): first pass time = 0.86's, 155.243'MB/sec 2024/11/24-04:14:03.698282 139957450159680 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291550.sst): old prealloc_size = 147639500, real_size = 30857088 2024/11/24-04:14:03.698851 139957450159680 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291550.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926315 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1083 GB zip-val = 0.0289 GB avg-val = 116.89 avg-zval = 31.15 2024/11/24-04:14:03.701135 139957450159680 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291550.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-04:14:04.518051 139957450159680 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291550.sst): second pass time = 1.54's, 70.300'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.82's, 42.498'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3230.733'MB/sec (index lex order gen) rebuild zvType time = 0.69's, 0.336'MB/sec write SST data time = 0.13's, 269.958'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 33528.860'MB/sec zip my value time = 1.54's, unzip length = 0.108'GB zip my value throughput = 70.300'MB/sec zip pipeline throughput = 123.478'MB/sec entries = 926315 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.89 avg-zval = 31.15 usrkeys = 926315 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.89 avg-zval = 31.15 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 926315 bytes = 3126336 } seq expand size = 6484205 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0289 GB dict = 1.08 MB all = 0.0348 GB } UnZip/Zip{ index = 10.4465 value = 3.7530 dict = 1.00 all = 3.8528 } Zip/UnZip{ index = 0.0957 value = 0.2665 dict = 1.00 all = 0.2596 } ---------------------------- total value len = 2252.358656 GB avg = 0.200 KB (by entry num) total key len = 307.116133 GB avg = 0.027 KB total ukey len = 237.521277 GB avg = 0.015 KB total ukey num = 15.746988665 Billion total entry num = 11.288302613 Billion write speed all = 36.809866269 MB/sec (with seq num) write speed all = 35.511096970 MB/sec (without seq num) 2024/11/24-04:14:04.573518 139957450159680 [compaction_job.cc:1948] [default] [JOB 41330] Generated table #291550: 926315 keys, 34836290 bytes, temperature: kWarm 2024/11/24-04:14:04.573580 139957450159680 EVENT_LOG_v1 {"time_micros": 1732392844573545, "cf_name": "default", "job": 41330, "event": "table_file_creation", "file_number": 291550, "file_size": 34836290, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4323051253, "largest_seqno": 4433662183, "table_properties": {"data_size": 28851888, "index_size": 1773440, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25936820, "raw_average_key_size": 28, "raw_value_size": 108281030, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926315, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732392841, "oldest_key_time": 0, "file_creation_time": 1732392841, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 291550, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-04:14:04.610507 139957450159680 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291551.sst) /dev/shm/ToplingTemp/Topling-266410-4CGhwU 2024/11/24-04:14:05.500232 139957450159680 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291551.sst): first pass time = 0.89's, 150.859'MB/sec 2024/11/24-04:14:07.054874 139957450159680 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291551.sst): old prealloc_size = 147639500, real_size = 31732752 2024/11/24-04:14:07.055461 139957450159680 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291551.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 920123 prefix = 4 raw-key = 0.0147 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1085 GB zip-val = 0.0298 GB avg-val = 117.87 avg-zval = 32.33 2024/11/24-04:14:07.056244 139957450159680 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291551.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-04:14:07.887632 139957450159680 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291551.sst): second pass time = 1.55's, 69.818'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.83's, 43.007'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3105.546'MB/sec (index lex order gen) rebuild zvType time = 0.69's, 0.332'MB/sec write SST data time = 0.14's, 258.428'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.084'MB, throughput = 27851.449'MB/sec zip my value time = 1.55's, unzip length = 0.108'GB zip my value throughput = 69.818'MB/sec zip pipeline throughput = 123.294'MB/sec entries = 920123 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.87 avg-zval = 32.33 usrkeys = 920123 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.87 avg-zval = 32.33 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 920123 bytes = 3220448 } seq expand size = 6440861 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0184 GB value = 0.1085 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0298 GB dict = 1.08 MB all = 0.0358 GB } UnZip/Zip{ index = 10.5125 value = 3.6453 dict = 1.00 all = 3.7477 } Zip/UnZip{ index = 0.0951 value = 0.2743 dict = 1.00 all = 0.2668 } ---------------------------- total value len = 2252.473551 GB avg = 0.200 KB (by entry num) total key len = 307.141896 GB avg = 0.027 KB total ukey len = 237.539680 GB avg = 0.015 KB total ukey num = 15.747908788 Billion total entry num = 11.289222736 Billion write speed all = 36.810105337 MB/sec (with seq num) write speed all = 35.511293115 MB/sec (without seq num) 2024/11/24-04:14:07.934249 139957450159680 [compaction_job.cc:1948] [default] [JOB 41330] Generated table #291551: 920123 keys, 35813400 bytes, temperature: kWarm 2024/11/24-04:14:07.934318 139957450159680 EVENT_LOG_v1 {"time_micros": 1732392847934285, "cf_name": "default", "job": 41330, "event": "table_file_creation", "file_number": 291551, "file_size": 35813400, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4261178575, "largest_seqno": 4433660950, "table_properties": {"data_size": 29752000, "index_size": 1750528, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25763444, "raw_average_key_size": 28, "raw_value_size": 108454426, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 920123, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732392844, "oldest_key_time": 0, "file_creation_time": 1732392844, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 291551, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-04:14:07.974062 139957450159680 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291552.sst) /dev/shm/ToplingTemp/Topling-266410-9RLEkQ 2024/11/24-04:14:08.875845 139957450159680 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291552.sst): first pass time = 0.90's, 148.843'MB/sec 2024/11/24-04:14:10.445421 139957450159680 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291552.sst): old prealloc_size = 147639500, real_size = 33350848 2024/11/24-04:14:10.445968 139957450159680 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291552.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926985 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.1083 GB zip-val = 0.0313 GB avg-val = 116.79 avg-zval = 33.80 2024/11/24-04:14:10.447577 139957450159680 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291552.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-04:14:11.301966 139957450159680 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291552.sst): second pass time = 1.57's, 69.014'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.86's, 43.723'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3288.996'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.317'MB/sec write SST data time = 0.12's, 300.047'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 37098.358'MB/sec zip my value time = 1.57's, unzip length = 0.108'GB zip my value throughput = 69.014'MB/sec zip pipeline throughput = 110.993'MB/sec entries = 926985 avg-key = 28.00 avg-zkey = 1.93 avg-val = 116.79 avg-zval = 33.80 usrkeys = 926985 avg-key = 20.00 avg-zkey = 1.93 avg-val = 123.79 avg-zval = 33.80 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 926985 bytes = 3244464 } seq expand size = 6488895 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0313 GB dict = 1.08 MB all = 0.0374 GB } UnZip/Zip{ index = 10.3758 value = 3.4553 dict = 1.00 all = 3.5840 } Zip/UnZip{ index = 0.0964 value = 0.2894 dict = 1.00 all = 0.2790 } ---------------------------- total value len = 2252.588302 GB avg = 0.200 KB (by entry num) total key len = 307.167852 GB avg = 0.027 KB total ukey len = 237.558220 GB avg = 0.015 KB total ukey num = 15.748835773 Billion total entry num = 11.290149721 Billion write speed all = 36.810321393 MB/sec (with seq num) write speed all = 35.511466299 MB/sec (without seq num) 2024/11/24-04:14:11.348765 139957450159680 [compaction_job.cc:1948] [default] [JOB 41330] Generated table #291552: 926985 keys, 37449590 bytes, temperature: kWarm 2024/11/24-04:14:11.348835 139957450159680 EVENT_LOG_v1 {"time_micros": 1732392851348798, "cf_name": "default", "job": 41330, "event": "table_file_creation", "file_number": 291552, "file_size": 37449590, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4261178589, "largest_seqno": 4433662195, "table_properties": {"data_size": 31332080, "index_size": 1786816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25955580, "raw_average_key_size": 28, "raw_value_size": 108262162, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926985, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732392847, "oldest_key_time": 0, "file_creation_time": 1732392847, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 291552, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-04:14:11.387895 139957450159680 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291553.sst) /dev/shm/ToplingTemp/Topling-266410-X7MxaS 2024/11/24-04:14:12.272594 139957450159680 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291553.sst): first pass time = 0.88's, 151.716'MB/sec 2024/11/24-04:14:13.795648 139957450159680 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291553.sst): old prealloc_size = 147639500, real_size = 31865920 2024/11/24-04:14:13.796170 139957450159680 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291553.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927053 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0299 GB avg-val = 116.78 avg-zval = 32.22 2024/11/24-04:14:13.796952 139957450159680 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291553.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-04:14:14.629898 139957450159680 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291553.sst): second pass time = 1.52's, 71.134'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.83's, 43.112'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3526.106'MB/sec (index lex order gen) rebuild zvType time = 0.71's, 0.328'MB/sec write SST data time = 0.13's, 281.539'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 31905.091'MB/sec zip my value time = 1.52's, unzip length = 0.108'GB zip my value throughput = 71.134'MB/sec zip pipeline throughput = 102.440'MB/sec entries = 927053 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.78 avg-zval = 32.22 usrkeys = 927053 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.78 avg-zval = 32.22 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927053 bytes = 3244704 } seq expand size = 6489371 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0299 GB dict = 1.08 MB all = 0.0360 GB } UnZip/Zip{ index = 10.5121 value = 3.6244 dict = 1.00 all = 3.7319 } Zip/UnZip{ index = 0.0951 value = 0.2759 dict = 1.00 all = 0.2680 } ---------------------------- total value len = 2252.703052 GB avg = 0.200 KB (by entry num) total key len = 307.193809 GB avg = 0.027 KB total ukey len = 237.576761 GB avg = 0.015 KB total ukey num = 15.749762826 Billion total entry num = 11.291076774 Billion write speed all = 36.810583178 MB/sec (with seq num) write speed all = 35.511683595 MB/sec (without seq num) 2024/11/24-04:14:14.675170 139957450159680 [compaction_job.cc:1948] [default] [JOB 41330] Generated table #291553: 927053 keys, 35965122 bytes, temperature: kWarm 2024/11/24-04:14:14.675245 139957450159680 EVENT_LOG_v1 {"time_micros": 1732392854675205, "cf_name": "default", "job": 41330, "event": "table_file_creation", "file_number": 291553, "file_size": 35965122, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4261178599, "largest_seqno": 4433662206, "table_properties": {"data_size": 29870192, "index_size": 1763776, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25957484, "raw_average_key_size": 28, "raw_value_size": 108260302, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927053, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732392851, "oldest_key_time": 0, "file_creation_time": 1732392851, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 291553, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-04:14:14.711831 139957450159680 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291554.sst) /dev/shm/ToplingTemp/Topling-266410-BL6GsU 2024/11/24-04:14:15.567785 139957450159680 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291554.sst): first pass time = 0.86's, 156.812'MB/sec 2024/11/24-04:14:17.139106 139957450159680 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291554.sst): old prealloc_size = 147639500, real_size = 31469680 2024/11/24-04:14:17.139654 139957450159680 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291554.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 919300 prefix = 4 raw-key = 0.0147 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1085 GB zip-val = 0.0295 GB avg-val = 118.00 avg-zval = 32.07 2024/11/24-04:14:17.140409 139957450159680 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291554.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-04:14:17.957659 139957450159680 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291554.sst): second pass time = 1.57's, 69.086'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.82's, 43.428'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3348.526'MB/sec (index lex order gen) rebuild zvType time = 0.69's, 0.333'MB/sec write SST data time = 0.13's, 276.325'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.085'MB, throughput = 35319.336'MB/sec zip my value time = 1.57's, unzip length = 0.108'GB zip my value throughput = 69.086'MB/sec zip pipeline throughput = 123.631'MB/sec entries = 919300 avg-key = 28.00 avg-zkey = 1.91 avg-val = 118.00 avg-zval = 32.07 usrkeys = 919300 avg-key = 20.00 avg-zkey = 1.91 avg-val = 125.00 avg-zval = 32.07 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 919300 bytes = 3217568 } seq expand size = 6435100 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0184 GB value = 0.1085 GB dict = 1.09 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0295 GB dict = 1.09 MB all = 0.0355 GB } UnZip/Zip{ index = 10.4447 value = 3.6798 dict = 1.00 all = 3.7758 } Zip/UnZip{ index = 0.0957 value = 0.2718 dict = 1.00 all = 0.2648 } ---------------------------- total value len = 2252.817964 GB avg = 0.200 KB (by entry num) total key len = 307.219549 GB avg = 0.027 KB total ukey len = 237.595147 GB avg = 0.015 KB total ukey num = 15.750682126 Billion total entry num = 11.291996074 Billion write speed all = 36.810844248 MB/sec (with seq num) write speed all = 35.511901067 MB/sec (without seq num) 2024/11/24-04:14:18.001363 139957450159680 [compaction_job.cc:1948] [default] [JOB 41330] Generated table #291554: 919300 keys, 35546418 bytes, temperature: kWarm 2024/11/24-04:14:18.001422 139957450159680 EVENT_LOG_v1 {"time_micros": 1732392858001390, "cf_name": "default", "job": 41330, "event": "table_file_creation", "file_number": 291554, "file_size": 35546418, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4279172390, "largest_seqno": 4431588613, "table_properties": {"data_size": 29479328, "index_size": 1760320, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25740400, "raw_average_key_size": 28, "raw_value_size": 108477400, "raw_average_value_size": 118, "num_data_blocks": 1, "num_entries": 919300, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 118, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732392854, "oldest_key_time": 0, "file_creation_time": 1732392854, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 291554, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-04:14:18.045075 139957450159680 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291555.sst) /dev/shm/ToplingTemp/Topling-266410-3r7KwQ 2024/11/24-04:14:18.679526 139957450159680 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291555.sst): first pass time = 0.63's, 66.889'MB/sec 2024/11/24-04:14:19.095814 139957450159680 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291555.sst): old prealloc_size = 147639500, real_size = 10705648 2024/11/24-04:14:19.096040 139957450159680 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291555.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 298487 prefix = 4 raw-key = 0.0048 GB zip-key = 0.0006 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.0341 GB zip-val = 0.0101 GB avg-val = 114.17 avg-zval = 33.69 2024/11/24-04:14:19.096319 139957450159680 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291555.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0007 GB, waited 0.000 sec, Key+Value = 0.042 GB 2024/11/24-04:14:19.362133 139957450159680 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291555.sst): second pass time = 0.42's, 82.004'MB/sec, value only(80.3% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.27's, 44.877'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2828.547'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.331'MB/sec write SST data time = 0.04's, 293.220'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.347'MB, throughput = 10236.838'MB/sec zip my value time = 0.42's, unzip length = 0.034'GB zip my value throughput = 82.004'MB/sec zip pipeline throughput = 82.004'MB/sec entries = 298487 avg-key = 28.00 avg-zkey = 1.93 avg-val = 114.17 avg-zval = 33.69 usrkeys = 298487 avg-key = 20.00 avg-zkey = 1.93 avg-val = 121.17 avg-zval = 33.69 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 298487 bytes = 970096 } seq expand size = 2089409 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0060 GB value = 0.0341 GB dict = 0.35 MB all = 0.0424 GB } __ZipSize{ index = 0.0006 GB value = 0.0101 GB dict = 0.35 MB all = 0.0120 GB } UnZip/Zip{ index = 10.3607 value = 3.3893 dict = 1.00 all = 3.5510 } Zip/UnZip{ index = 0.0965 value = 0.2950 dict = 1.00 all = 0.2816 } ---------------------------- total value len = 2252.854132 GB avg = 0.200 KB (by entry num) total key len = 307.227907 GB avg = 0.027 KB total ukey len = 237.601116 GB avg = 0.015 KB total ukey num = 15.750980613 Billion total entry num = 11.292294561 Billion write speed all = 36.810741083 MB/sec (with seq num) write speed all = 35.511789800 MB/sec (without seq num) 2024/11/24-04:14:19.381788 139957450159680 [compaction_job.cc:1948] [default] [JOB 41330] Generated table #291555: 298487 keys, 11950295 bytes, temperature: kWarm 2024/11/24-04:14:19.381854 139957450159680 EVENT_LOG_v1 {"time_micros": 1732392859381821, "cf_name": "default", "job": 41330, "event": "table_file_creation", "file_number": 291555, "file_size": 11950295, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4391746596, "largest_seqno": 4433662226, "table_properties": {"data_size": 10054624, "index_size": 576192, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 8357636, "raw_average_key_size": 28, "raw_value_size": 34078070, "raw_average_value_size": 114, "num_data_blocks": 1, "num_entries": 298487, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732392858, "oldest_key_time": 0, "file_creation_time": 1732392858, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 291555, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-04:14:19.416729 139957450159680 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291556.sst) /dev/shm/ToplingTemp/Topling-266410-NjJeTQ 2024/11/24-04:14:20.477637 139957450159680 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291556.sst): first pass time = 1.06's, 126.516'MB/sec 2024/11/24-04:14:21.793373 139957450159680 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291556.sst): old prealloc_size = 147639500, real_size = 31398672 2024/11/24-04:14:21.793899 139957450159680 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291556.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 919300 prefix = 4 raw-key = 0.0147 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1085 GB zip-val = 0.0294 GB avg-val = 118.00 avg-zval = 31.99 2024/11/24-04:14:21.794663 139957450159680 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291556.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-04:14:22.699020 139957450159680 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291556.sst): second pass time = 1.32's, 82.489'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.91's, 39.173'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3505.233'MB/sec (index lex order gen) rebuild zvType time = 0.78's, 0.294'MB/sec write SST data time = 0.12's, 286.778'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.085'MB, throughput = 34667.071'MB/sec zip my value time = 1.32's, unzip length = 0.108'GB zip my value throughput = 82.489'MB/sec zip pipeline throughput = 82.489'MB/sec entries = 919300 avg-key = 28.00 avg-zkey = 1.91 avg-val = 118.00 avg-zval = 31.99 usrkeys = 919300 avg-key = 20.00 avg-zkey = 1.91 avg-val = 125.00 avg-zval = 31.99 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 919300 bytes = 3217568 } seq expand size = 6435100 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0184 GB value = 0.1085 GB dict = 1.09 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0294 GB dict = 1.09 MB all = 0.0355 GB } UnZip/Zip{ index = 10.4458 value = 3.6886 dict = 1.00 all = 3.7834 } Zip/UnZip{ index = 0.0957 value = 0.2711 dict = 1.00 all = 0.2643 } ---------------------------- total value len = 2252.969044 GB avg = 0.199 KB (by entry num) total key len = 307.253647 GB avg = 0.027 KB total ukey len = 237.619502 GB avg = 0.015 KB total ukey num = 15.751899913 Billion total entry num = 11.293213861 Billion write speed all = 36.810997300 MB/sec (with seq num) write speed all = 35.512002596 MB/sec (without seq num) 2024/11/24-04:14:22.742522 139957450159680 [compaction_job.cc:1948] [default] [JOB 41330] Generated table #291556: 919300 keys, 35475378 bytes, temperature: kWarm 2024/11/24-04:14:22.742593 139957450159680 EVENT_LOG_v1 {"time_micros": 1732392862742556, "cf_name": "default", "job": 41330, "event": "table_file_creation", "file_number": 291556, "file_size": 35475378, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4261178645, "largest_seqno": 4414357721, "table_properties": {"data_size": 29408512, "index_size": 1760128, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25740400, "raw_average_key_size": 28, "raw_value_size": 108477400, "raw_average_value_size": 118, "num_data_blocks": 1, "num_entries": 919300, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 118, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732392859, "oldest_key_time": 0, "file_creation_time": 1732392859, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 291556, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-04:14:22.779513 139957450159680 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291557.sst) /dev/shm/ToplingTemp/Topling-266410-dzqroS 2024/11/24-04:14:23.318861 139957450159680 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291557.sst): first pass time = 0.54's, 248.868'MB/sec 2024/11/24-04:14:24.671941 139957450159680 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291557.sst): old prealloc_size = 147639500, real_size = 33378816 2024/11/24-04:14:24.672488 139957450159680 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291557.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927041 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0314 GB avg-val = 116.78 avg-zval = 33.85 2024/11/24-04:14:24.673250 139957450159680 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291557.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-04:14:25.527644 139957450159680 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291557.sst): second pass time = 1.35's, 80.105'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.86's, 43.799'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3485.609'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.317'MB/sec write SST data time = 0.12's, 300.713'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 29645.609'MB/sec zip my value time = 1.35's, unzip length = 0.108'GB zip my value throughput = 80.105'MB/sec zip pipeline throughput = 80.105'MB/sec entries = 927041 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.78 avg-zval = 33.85 usrkeys = 927041 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.78 avg-zval = 33.85 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927041 bytes = 3244656 } seq expand size = 6489287 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0314 GB dict = 1.08 MB all = 0.0375 GB } UnZip/Zip{ index = 10.5116 value = 3.4497 dict = 1.00 all = 3.5813 } Zip/UnZip{ index = 0.0951 value = 0.2899 dict = 1.00 all = 0.2792 } ---------------------------- total value len = 2253.083794 GB avg = 0.199 KB (by entry num) total key len = 307.279605 GB avg = 0.027 KB total ukey len = 237.638043 GB avg = 0.015 KB total ukey num = 15.752826954 Billion total entry num = 11.294140902 Billion write speed all = 36.811523259 MB/sec (with seq num) write speed all = 35.512474755 MB/sec (without seq num) 2024/11/24-04:14:25.574308 139957450159680 [compaction_job.cc:1948] [default] [JOB 41330] Generated table #291557: 927041 keys, 37477806 bytes, temperature: kWarm 2024/11/24-04:14:25.574376 139957450159680 EVENT_LOG_v1 {"time_micros": 1732392865574341, "cf_name": "default", "job": 41330, "event": "table_file_creation", "file_number": 291557, "file_size": 37477806, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4261178655, "largest_seqno": 4433661810, "table_properties": {"data_size": 31383024, "index_size": 1763840, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25957148, "raw_average_key_size": 28, "raw_value_size": 108260598, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927041, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732392862, "oldest_key_time": 0, "file_creation_time": 1732392862, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 291557, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-04:14:25.610704 139957450159680 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291558.sst) /dev/shm/ToplingTemp/Topling-266410-Lu54ER 2024/11/24-04:14:26.622854 139957450159680 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291558.sst): first pass time = 1.01's, 132.611'MB/sec 2024/11/24-04:14:27.968574 139957450159680 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291558.sst): old prealloc_size = 147639500, real_size = 32328576 2024/11/24-04:14:27.969128 139957450159680 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291558.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926684 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0303 GB avg-val = 116.84 avg-zval = 32.73 2024/11/24-04:14:27.970564 139957450159680 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291558.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-04:14:28.803512 139957450159680 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291558.sst): second pass time = 1.34's, 80.501'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.83's, 43.629'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3331.912'MB/sec (index lex order gen) rebuild zvType time = 0.71's, 0.328'MB/sec write SST data time = 0.13's, 285.884'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 34596.068'MB/sec zip my value time = 1.34's, unzip length = 0.108'GB zip my value throughput = 80.501'MB/sec zip pipeline throughput = 80.501'MB/sec entries = 926684 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.84 avg-zval = 32.73 usrkeys = 926684 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.84 avg-zval = 32.73 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 926684 bytes = 3243408 } seq expand size = 6486788 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0303 GB dict = 1.08 MB all = 0.0364 GB } UnZip/Zip{ index = 10.5125 value = 3.5693 dict = 1.00 all = 3.6846 } Zip/UnZip{ index = 0.0951 value = 0.2802 dict = 1.00 all = 0.2714 } ---------------------------- total value len = 2253.198552 GB avg = 0.199 KB (by entry num) total key len = 307.305552 GB avg = 0.027 KB total ukey len = 237.656577 GB avg = 0.015 KB total ukey num = 15.753753638 Billion total entry num = 11.295067586 Billion write speed all = 36.811812445 MB/sec (with seq num) write speed all = 35.512718540 MB/sec (without seq num) 2024/11/24-04:14:28.849064 139957450159680 [compaction_job.cc:1948] [default] [JOB 41330] Generated table #291558: 926684 keys, 36426558 bytes, temperature: kWarm 2024/11/24-04:14:28.849134 139957450159680 EVENT_LOG_v1 {"time_micros": 1732392868849098, "cf_name": "default", "job": 41330, "event": "table_file_creation", "file_number": 291558, "file_size": 36426558, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4261178675, "largest_seqno": 4433661676, "table_properties": {"data_size": 30333744, "index_size": 1763008, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25947152, "raw_average_key_size": 28, "raw_value_size": 108270596, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926684, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732392865, "oldest_key_time": 0, "file_creation_time": 1732392865, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 291558, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-04:14:28.898229 139957450159680 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291559.sst) /dev/shm/ToplingTemp/Topling-266410-hQQ5YQ 2024/11/24-04:14:28.908864 139957450159680 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291559.sst): first pass time = 0.01's, 152.524'MB/sec 2024/11/24-04:14:28.944145 139957450159680 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291559.sst): old prealloc_size = 147639500, real_size = 544192 2024/11/24-04:14:28.944188 139957450159680 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291559.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 11075 prefix = 4 raw-key = 0.0002 GB zip-key = 0.0000 GB avg-key = 16.00 avg-zkey = 2.05 raw-val = 0.0013 GB zip-val = 0.0005 GB avg-val = 118.00 avg-zval = 46.82 2024/11/24-04:14:28.944240 139957450159680 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291559.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0000 GB, waited 0.000 sec, Key+Value = 0.002 GB 2024/11/24-04:14:28.953346 139957450159680 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00/291559.sst): second pass time = 0.03's, 37.545'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.01's, 63.771'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 768.606'MB/sec (index lex order gen) rebuild zvType time = 0.01's, 0.378'MB/sec write SST data time = 0.00's, 321.050'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.014'MB, throughput = 559.927'MB/sec zip my value time = 0.03's, unzip length = 0.001'GB zip my value throughput = 37.545'MB/sec zip pipeline throughput = 37.545'MB/sec entries = 11075 avg-key = 28.00 avg-zkey = 2.05 avg-val = 118.00 avg-zval = 46.82 usrkeys = 11075 avg-key = 20.00 avg-zkey = 2.05 avg-val = 125.00 avg-zval = 46.82 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 11075 bytes = 29088 } seq expand size = 77525 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0002 GB value = 0.0013 GB dict = 0.01 MB all = 0.0016 GB } __ZipSize{ index = 0.0000 GB value = 0.0005 GB dict = 0.01 MB all = 0.0006 GB } UnZip/Zip{ index = 9.7491 value = 2.5204 dict = 1.00 all = 2.7598 } Zip/UnZip{ index = 0.1026 value = 0.3968 dict = 1.00 all = 0.3623 } ---------------------------- total value len = 2253.199936 GB avg = 0.199 KB (by entry num) total key len = 307.305862 GB avg = 0.027 KB total ukey len = 237.656798 GB avg = 0.015 KB total ukey num = 15.753764713 Billion total entry num = 11.295078661 Billion write speed all = 36.811757498 MB/sec (with seq num) write speed all = 35.512665118 MB/sec (without seq num) 2024/11/24-04:14:28.960574 139957450159680 [compaction_job.cc:1948] [default] [JOB 41330] Generated table #291559: 11075 keys, 585894 bytes, temperature: kWarm 2024/11/24-04:14:28.960633 139957450159680 EVENT_LOG_v1 {"time_micros": 1732392868960594, "cf_name": "default", "job": 41330, "event": "table_file_creation", "file_number": 291559, "file_size": 585894, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4285995490, "largest_seqno": 4287852706, "table_properties": {"data_size": 518512, "index_size": 22720, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 310100, "raw_average_key_size": 28, "raw_value_size": 1306850, "raw_average_value_size": 118, "num_data_blocks": 1, "num_entries": 11075, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 118, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732392868, "oldest_key_time": 0, "file_creation_time": 1732392868, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 291559, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-04:14:28.969677 139957450159680 [compaction_job.cc:703] job-41330: subcompact[0], size: 0.594220 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41330/att-00 [291542,291543,291544,291545,291546,291547,291548,291549,291550,291551,291552,291553,291554,291555,291556,291557,291558,291559] 2024/11/24-04:14:29.071482 139957450159680 (Original Log Time 2024/11/24-04:13:33.158489) EVENT_LOG_v1 {"time_micros": 1732392813158452, "job": 41330, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [291504], "files_L3": [291407, 291408, 291409, 291410, 291411, 291412, 291413, 291414, 291447, 291448, 291449, 291450, 291451, 291452, 291453, 291454, 291520], "score": 0.999141, "input_data_size": 617479485, "oldest_snapshot_seqno": 4434071453} 2024/11/24-04:14:29.071486 139957450159680 (Original Log Time 2024/11/24-04:14:29.070040) [compaction_job.cc:2022] [default] [JOB 41330] Compacted 1@2 + 17@3 files to L3 => 594219683 bytes 2024/11/24-04:14:29.071487 139957450159680 (Original Log Time 2024/11/24-04:14:29.071417) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 18 0 0 0] max score 0.02, MB/sec: 11.1 rd, 10.6 wr, level 3, files in(1, 17) out(18 +0 blob) MB in(25.6, 563.3 +0.0 blob) out(566.7 +0.0 blob), read-write-amplify(45.1) write-amplify(22.1) OK, records in: 15210938, records dropped: 107388 output_compression: Snappy 2024/11/24-04:14:29.071493 139957450159680 (Original Log Time 2024/11/24-04:14:29.071461) EVENT_LOG_v1 {"time_micros": 1732392869071440, "cf": "default", "job": 41330, "event": "compaction_finished", "compaction_time_micros": 55811192, "compaction_time_cpu_micros": 23019843, "output_level": 3, "num_output_files": 18, "total_output_size": 594219683, "num_input_records": 15210938, "num_output_records": 15103550, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 422130176, "file_range_sync_nanos": 0, "file_fsync_nanos": 12725, "file_prepare_write_nanos": 43371, "lsm_state": [0, 0, 0, 18, 0, 0, 0]} 2024/11/24-04:14:29.195816 139957450159680 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732256054,"starts":1732392812,"executesMs":56060,"compactionJobId":41330,"attempt":0,"compactionInputRawBytes":2206786360,"compactionInputZipBytes":617479485,"compactionOutputRawBytes":0,"compactionOutputZipBytes":594219683,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-59b7f5c40cd6ecd1470c9c36e4c430bb-1df77866c46569e9-00"}}, response = 2024/11/24-04:14:29.195888 139957450159680 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-41330/att-00: olev 3, work 56.061 s, result 7.687 ms, install 1.469 ms, input{raw 2.055 GiB zip 588.874 MiB}