2024/08/20-00:44:29.010865 140500321994304 DEBG dcompact_worker.cpp:2211: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00: fork to child time = 0.013399 sec 2024/08/20-00:44:29.011811 140500321994304 DEBG dcompact_worker.cpp:1011: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00 2024/08/20-00:44:29.018250 140500321994304 DEBG dcompact_worker.cpp:1031: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00 2024/08/20-00:44:29.019624 140500321994304 TRAC dcompact_worker.cpp:1081: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/08/20-00:44:29.019918 140500321994304 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/08/20-00:44:29.060507 140500321994304 [version_set.cc:6139] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-08-19T23.41.30/.rocksdb/job-02903/att-00/MANIFEST-14619535 2024/08/20-00:44:29.145173 140500321994304 [version_set.cc:6182] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-08-19T23.41.30/.rocksdb/job-02903/att-00/MANIFEST-14619535 succeeded,manifest_file_number is 14619535, next_file_number is 14622889, last_sequence is 189655331193, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 14622848 2024/08/20-00:44:29.145181 140500321994304 [version_set.cc:6197] Column family [default] (ID 0), log number is 0 2024/08/20-00:44:29.145316 140500321994304 [version_set.cc:5652] Creating manifest 14622889 2024/08/20-00:44:29.170206 140500321994304 DEBG dcompact_worker.cpp:1215: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00: bottommost_level: fake = 1, rpc = 0 2024/08/20-00:44:29.184852 140500321994304 [compaction_job.cc:2433] [default] [JOB 2903] Compacting 27@4 + 1@5 files to L5, score -1.00, subcompactions 1 : 1 2024/08/20-00:44:29.184880 140500321994304 [compaction_job.cc:2441] [default]: Compaction start summary: Base version 1463 Base level 4, inputs: [14622270(172MB) 14622387(172MB) 14622388(172MB) 14622389(172MB) 14622390(172MB) 14622391(172MB) 14622392(35MB) 14622393(172MB) 14622394(172MB) 14622395(172MB) 14622396(172MB) 14622397(172MB) 14622398(172MB) 14622399(47MB) 14622400(172MB) 14622401(172MB) 14622402(172MB) 14622403(172MB) 14622404(172MB) 14622405(172MB) 14622406(29MB) 14622407(172MB) 14622408(172MB) 14622409(172MB) 14622574(172MB) 14622575(172MB) 14622576(172MB)], [14615646(12MB)] 2024/08/20-00:44:29.189263 140500321994304 [top_zip_table.cc:59] core git_version_hash_info_is:commit 7517bad5c1a147474c3830831b9a22c996321ae8 Author: leipeng Date: 2024-01-08 19:18:17 +0800 vfork_cmd: call close before wait_finish g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/08/20-00:44:29.189301 140500321994304 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit 7517bad5c1a147474c3830831b9a22c996321ae8 Author: leipeng Date: 2024-01-08 19:18:17 +0800 vfork_cmd: call close before wait_finish g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/08/20-00:44:29.189331 140500321994304 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit 7517bad5c1a147474c3830831b9a22c996321ae8 Author: leipeng Date: 2024-01-08 19:18:17 +0800 vfork_cmd: call close before wait_finish g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/08/20-00:44:29.189341 140500321994304 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit 7f80399bfbd2071b6e0f5683e8ab7225b8e6e394 Author: leipeng Date: 2024-01-19 14:52:30 +0800 Change ToplingZipTableOptions::sampleRatio to vector g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/08/20-00:44:29.189360 140500321994304 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit 1240987ca13d0fe562c9b9c037155079f0877840 Author: leipeng Date: 2024-01-19 15:07:04 +0800 Change ToplingZipTableOptions::sampleRatio to vector g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/08/20-00:44:31.047491 140500321994304 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622890.sst) /dev/shm/ToplingTemp/Topling-81946-mIKSvA 2024/08/20-00:44:39.172017 140500321994304 [top_zip_table_builder.cc:1344] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622890.sst): first pass time = 8.12's, 66.081'MB/sec 2024/08/20-00:44:47.261027 140500321994304 [top_zip_table_builder.cc:2764] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622890.sst): old prealloc_size = 590558003, real_size = 331385040 2024/08/20-00:44:47.261116 140500321994304 [top_zip_table_builder.cc:1765] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622890.sst): index type = UintIndex_IL_256_32 , store type = DictZipBlobStore usrkeys = 2684355 prefix = 4 raw-key = 0.0107 GB zip-key = 0.0010 GB avg-key = 4.00 avg-zkey = 0.38 raw-val = 0.4939 GB zip-val = 0.3297 GB avg-val = 184.00 avg-zval = 122.82 2024/08/20-00:44:49.663122 140500321994304 [top_zip_table_builder.cc:3092] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622890.sst): second pass time = 8.09's, 61.084'MB/sec, value only(92.0% of KV) wait indexing time = 0.00's, remap KeyValue time = 2.40's, 143.635'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 22746.242'MB/sec (index lex order gen) rebuild zvType time = 2.00's, 0.336'MB/sec write SST data time = 0.40's, 852.608'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 4.914'MB, throughput = 126780.980'MB/sec zip my value time = 8.09's, unzip length = 0.494'GB zip my value throughput = 61.084'MB/sec zip pipeline throughput = 86.743'MB/sec entries = 2684355 avg-key = 16.00 avg-zkey = 0.38 avg-val = 184.00 avg-zval = 122.82 usrkeys = 2684355 avg-key = 8.00 avg-zkey = 0.38 avg-val = 191.00 avg-zval = 122.82 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 2684355 bytes = 9395264 } seq expand size = 18790485 multi value expand size = 0 cnt WriteAppend = 11 UnZipSize{ index = 0.0215 GB value = 0.4939 GB dict = 4.91 MB all = 0.5369 GB } __ZipSize{ index = 0.0010 GB value = 0.3297 GB dict = 4.91 MB all = 0.3450 GB } UnZip/Zip{ index = 21.2464 value = 1.4981 dict = 1.00 all = 1.5560 } Zip/UnZip{ index = 0.0471 value = 0.6675 dict = 1.00 all = 0.6427 } ---------------------------- total value len = 62.809462 GB avg = 0.180 KB (by entry num) total key len = 6.831707 GB avg = 0.020 KB total ukey len = 3.210982 GB avg = 0.008 KB total ukey num = 0.392017916 Billion total entry num = 0.348895924 Billion write speed all = 2.694209528 MB/sec (with seq num) write speed all = 2.586227570 MB/sec (without seq num) 2024/08/20-00:44:50.045318 140500321994304 [compaction_job.cc:1944] [default] [JOB 2903] Generated table #14622890: 2684355 keys, 345024203 bytes, temperature: kWarm 2024/08/20-00:44:50.045401 140500321994304 EVENT_LOG_v1 {"time_micros": 1724085890045353, "cf_name": "default", "job": 2903, "event": "table_file_creation", "file_number": 14622890, "file_size": 345024203, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 189410453968, "largest_seqno": 189634998158, "table_properties": {"data_size": 329703040, "index_size": 1010752, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 42949680, "raw_average_key_size": 16, "raw_value_size": 493921320, "raw_average_value_size": 184, "num_data_blocks": 1, "num_entries": 2684355, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 16, "fixed_value_len": 184, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-UintIndex_IL_256_32-DictZipBlobStore", "creation_time": 1724085871, "oldest_key_time": 0, "file_creation_time": 1724085871, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "a007a635-5c0a-4b4a-be96-b9c695cb016b", "db_session_id": "9474K4QZ2QA6TIYF9LEW", "orig_file_number": 14622890, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/08/20-00:44:50.157386 140500321994304 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622891.sst) /dev/shm/ToplingTemp/Topling-81946-Fmijkx 2024/08/20-00:44:55.603708 140500321994304 [top_zip_table_builder.cc:1344] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622891.sst): first pass time = 5.45's, 98.576'MB/sec 2024/08/20-00:45:09.273672 140500321994304 [top_zip_table_builder.cc:2764] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622891.sst): old prealloc_size = 590558003, real_size = 331414856 2024/08/20-00:45:09.273761 140500321994304 [top_zip_table_builder.cc:1765] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622891.sst): index type = UintIndex_IL_256_32 , store type = DictZipBlobStore usrkeys = 2684355 prefix = 4 raw-key = 0.0107 GB zip-key = 0.0010 GB avg-key = 4.00 avg-zkey = 0.38 raw-val = 0.4939 GB zip-val = 0.3297 GB avg-val = 184.00 avg-zval = 122.83 2024/08/20-00:45:11.682706 140500321994304 [top_zip_table_builder.cc:3092] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622891.sst): second pass time = 13.67's, 36.140'MB/sec, value only(92.0% of KV) wait indexing time = 0.00's, remap KeyValue time = 2.41's, 143.234'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 27432.540'MB/sec (index lex order gen) rebuild zvType time = 2.02's, 0.332'MB/sec write SST data time = 0.39's, 886.331'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 4.914'MB, throughput = 92834.278'MB/sec zip my value time = 13.67's, unzip length = 0.494'GB zip my value throughput = 36.140'MB/sec zip pipeline throughput = 109.871'MB/sec entries = 2684355 avg-key = 16.00 avg-zkey = 0.38 avg-val = 184.00 avg-zval = 122.83 usrkeys = 2684355 avg-key = 8.00 avg-zkey = 0.38 avg-val = 191.00 avg-zval = 122.83 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 2684355 bytes = 9395264 } seq expand size = 18790485 multi value expand size = 0 cnt WriteAppend = 11 UnZipSize{ index = 0.0215 GB value = 0.4939 GB dict = 4.91 MB all = 0.5369 GB } __ZipSize{ index = 0.0010 GB value = 0.3297 GB dict = 4.91 MB all = 0.3451 GB } UnZip/Zip{ index = 21.2383 value = 1.4979 dict = 1.00 all = 1.5559 } Zip/UnZip{ index = 0.0471 value = 0.6676 dict = 1.00 all = 0.6427 } ---------------------------- total value len = 63.322173 GB avg = 0.180 KB (by entry num) total key len = 6.874657 GB avg = 0.020 KB total ukey len = 3.232457 GB avg = 0.008 KB total ukey num = 0.394702271 Billion total entry num = 0.351580279 Billion write speed all = 2.713394949 MB/sec (with seq num) write speed all = 2.604674809 MB/sec (without seq num) 2024/08/20-00:45:12.061209 140500321994304 [compaction_job.cc:1944] [default] [JOB 2903] Generated table #14622891: 2684355 keys, 345054027 bytes, temperature: kWarm 2024/08/20-00:45:12.061281 140500321994304 EVENT_LOG_v1 {"time_micros": 1724085912061246, "cf_name": "default", "job": 2903, "event": "table_file_creation", "file_number": 14622891, "file_size": 345054027, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 189410453970, "largest_seqno": 189634998162, "table_properties": {"data_size": 329732496, "index_size": 1011136, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 42949680, "raw_average_key_size": 16, "raw_value_size": 493921320, "raw_average_value_size": 184, "num_data_blocks": 1, "num_entries": 2684355, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 16, "fixed_value_len": 184, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-UintIndex_IL_256_32-DictZipBlobStore", "creation_time": 1724085890, "oldest_key_time": 0, "file_creation_time": 1724085890, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "a007a635-5c0a-4b4a-be96-b9c695cb016b", "db_session_id": "9474K4QZ2QA6TIYF9LEW", "orig_file_number": 14622891, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/08/20-00:45:12.174862 140500321994304 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622892.sst) /dev/shm/ToplingTemp/Topling-81946-3JHsEz 2024/08/20-00:45:16.937301 140500321994304 [top_zip_table_builder.cc:1344] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622892.sst): first pass time = 4.76's, 112.732'MB/sec 2024/08/20-00:45:22.395365 140500321994304 [top_zip_table_builder.cc:2764] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622892.sst): old prealloc_size = 590558003, real_size = 331399544 2024/08/20-00:45:22.395449 140500321994304 [top_zip_table_builder.cc:1765] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622892.sst): index type = UintIndex_IL_256_32 , store type = DictZipBlobStore usrkeys = 2684355 prefix = 4 raw-key = 0.0107 GB zip-key = 0.0010 GB avg-key = 4.00 avg-zkey = 0.38 raw-val = 0.4939 GB zip-val = 0.3297 GB avg-val = 184.00 avg-zval = 122.83 2024/08/20-00:45:24.586085 140500321994304 [top_zip_table_builder.cc:3092] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622892.sst): second pass time = 5.46's, 90.539'MB/sec, value only(92.0% of KV) wait indexing time = 0.00's, remap KeyValue time = 2.19's, 157.501'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 29928.303'MB/sec (index lex order gen) rebuild zvType time = 1.80's, 0.372'MB/sec write SST data time = 0.39's, 887.231'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 4.914'MB, throughput = 76694.667'MB/sec zip my value time = 5.46's, unzip length = 0.494'GB zip my value throughput = 90.539'MB/sec zip pipeline throughput = 90.539'MB/sec entries = 2684355 avg-key = 16.00 avg-zkey = 0.38 avg-val = 184.00 avg-zval = 122.83 usrkeys = 2684355 avg-key = 8.00 avg-zkey = 0.38 avg-val = 191.00 avg-zval = 122.83 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 2684355 bytes = 9395264 } seq expand size = 18790485 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0215 GB value = 0.4939 GB dict = 4.91 MB all = 0.5369 GB } __ZipSize{ index = 0.0010 GB value = 0.3297 GB dict = 4.91 MB all = 0.3450 GB } UnZip/Zip{ index = 21.2410 value = 1.4980 dict = 1.00 all = 1.5560 } Zip/UnZip{ index = 0.0471 value = 0.6676 dict = 1.00 all = 0.6427 } ---------------------------- total value len = 63.834885 GB avg = 0.180 KB (by entry num) total key len = 6.917607 GB avg = 0.020 KB total ukey len = 3.253932 GB avg = 0.008 KB total ukey num = 0.397386626 Billion total entry num = 0.354264634 Billion write speed all = 2.733510152 MB/sec (with seq num) write speed all = 2.624014535 MB/sec (without seq num) 2024/08/20-00:45:24.958784 140500321994304 [compaction_job.cc:1944] [default] [JOB 2903] Generated table #14622892: 2684355 keys, 345038795 bytes, temperature: kWarm 2024/08/20-00:45:24.958863 140500321994304 EVENT_LOG_v1 {"time_micros": 1724085924958820, "cf_name": "default", "job": 2903, "event": "table_file_creation", "file_number": 14622892, "file_size": 345038795, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 189410453969, "largest_seqno": 189634998160, "table_properties": {"data_size": 329717344, "index_size": 1011008, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 42949680, "raw_average_key_size": 16, "raw_value_size": 493921320, "raw_average_value_size": 184, "num_data_blocks": 1, "num_entries": 2684355, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 16, "fixed_value_len": 184, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-UintIndex_IL_256_32-DictZipBlobStore", "creation_time": 1724085912, "oldest_key_time": 0, "file_creation_time": 1724085912, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "a007a635-5c0a-4b4a-be96-b9c695cb016b", "db_session_id": "9474K4QZ2QA6TIYF9LEW", "orig_file_number": 14622892, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/08/20-00:45:25.079708 140500321994304 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622893.sst) /dev/shm/ToplingTemp/Topling-81946-xfxFxz 2024/08/20-00:45:26.735527 140500321994304 [top_zip_table_builder.cc:1344] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622893.sst): first pass time = 1.66's, 29.851'MB/sec 2024/08/20-00:45:27.094693 140500321994304 [top_zip_table_builder.cc:2764] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622893.sst): old prealloc_size = 590558003, real_size = 36082648 2024/08/20-00:45:27.094752 140500321994304 [top_zip_table_builder.cc:1765] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622893.sst): index type = UintIndex_IL_256_32 , store type = DictZipBlobStore usrkeys = 247131 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0001 GB avg-key = 4.00 avg-zkey = 0.38 raw-val = 0.0455 GB zip-val = 0.0359 GB avg-val = 184.00 avg-zval = 145.38 2024/08/20-00:45:27.296285 140500321994304 [top_zip_table_builder.cc:3092] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622893.sst): second pass time = 0.36's, 126.886'MB/sec, value only(92.0% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.20's, 185.300'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3069.893'MB/sec (index lex order gen) rebuild zvType time = 0.16's, 0.375'MB/sec write SST data time = 0.04's, 1020.140'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.466'MB, throughput = 11968.748'MB/sec zip my value time = 0.36's, unzip length = 0.045'GB zip my value throughput = 126.886'MB/sec zip pipeline throughput = 126.886'MB/sec entries = 247131 avg-key = 16.00 avg-zkey = 0.38 avg-val = 184.00 avg-zval = 145.38 usrkeys = 247131 avg-key = 8.00 avg-zkey = 0.38 avg-val = 191.00 avg-zval = 145.38 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 247131 bytes = 864976 } seq expand size = 1729917 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0020 GB value = 0.0455 GB dict = 0.47 MB all = 0.0494 GB } __ZipSize{ index = 0.0001 GB value = 0.0359 GB dict = 0.47 MB all = 0.0374 GB } UnZip/Zip{ index = 21.2020 value = 1.2657 dict = 1.00 all = 1.3232 } Zip/UnZip{ index = 0.0472 value = 0.7901 dict = 1.00 all = 0.7557 } ---------------------------- total value len = 63.882087 GB avg = 0.180 KB (by entry num) total key len = 6.921561 GB avg = 0.020 KB total ukey len = 3.255909 GB avg = 0.008 KB total ukey num = 0.397633757 Billion total entry num = 0.354511765 Billion write speed all = 2.735200163 MB/sec (with seq num) write speed all = 2.625639634 MB/sec (without seq num) 2024/08/20-00:45:27.342083 140500321994304 [compaction_job.cc:1944] [default] [JOB 2903] Generated table #14622893: 247131 keys, 37352635 bytes, temperature: kWarm 2024/08/20-00:45:27.342153 140500321994304 EVENT_LOG_v1 {"time_micros": 1724085927342118, "cf_name": "default", "job": 2903, "event": "table_file_creation", "file_number": 14622893, "file_size": 37352635, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 189410458221, "largest_seqno": 189634997648, "table_properties": {"data_size": 35927488, "index_size": 93248, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 3954096, "raw_average_key_size": 16, "raw_value_size": 45472104, "raw_average_value_size": 184, "num_data_blocks": 1, "num_entries": 247131, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 16, "fixed_value_len": 184, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-UintIndex_IL_256_32-DictZipBlobStore", "creation_time": 1724085925, "oldest_key_time": 0, "file_creation_time": 1724085925, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "a007a635-5c0a-4b4a-be96-b9c695cb016b", "db_session_id": "9474K4QZ2QA6TIYF9LEW", "orig_file_number": 14622893, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/08/20-00:45:27.373662 140500321994304 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622894.sst) /dev/shm/ToplingTemp/Topling-81946-G5RmsA 2024/08/20-00:45:30.874966 140500321994304 [top_zip_table_builder.cc:1344] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622894.sst): first pass time = 3.50's, 153.337'MB/sec 2024/08/20-00:45:36.342666 140500321994304 [top_zip_table_builder.cc:2764] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622894.sst): old prealloc_size = 590558003, real_size = 331380600 2024/08/20-00:45:36.342752 140500321994304 [top_zip_table_builder.cc:1765] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622894.sst): index type = UintIndex_IL_256_32 , store type = DictZipBlobStore usrkeys = 2684355 prefix = 4 raw-key = 0.0107 GB zip-key = 0.0010 GB avg-key = 4.00 avg-zkey = 0.37 raw-val = 0.4939 GB zip-val = 0.3297 GB avg-val = 184.00 avg-zval = 122.83 2024/08/20-00:45:38.551536 140500321994304 [top_zip_table_builder.cc:3092] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622894.sst): second pass time = 5.46's, 90.382'MB/sec, value only(92.0% of KV) wait indexing time = 0.00's, remap KeyValue time = 2.21's, 156.198'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 28559.652'MB/sec (index lex order gen) rebuild zvType time = 1.82's, 0.368'MB/sec write SST data time = 0.39's, 895.290'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 4.914'MB, throughput = 108486.676'MB/sec zip my value time = 5.46's, unzip length = 0.494'GB zip my value throughput = 90.382'MB/sec zip pipeline throughput = 90.382'MB/sec entries = 2684355 avg-key = 16.00 avg-zkey = 0.37 avg-val = 184.00 avg-zval = 122.83 usrkeys = 2684355 avg-key = 8.00 avg-zkey = 0.37 avg-val = 191.00 avg-zval = 122.83 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 2684355 bytes = 9395264 } seq expand size = 18790485 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0215 GB value = 0.4939 GB dict = 4.91 MB all = 0.5369 GB } __ZipSize{ index = 0.0010 GB value = 0.3297 GB dict = 4.91 MB all = 0.3450 GB } UnZip/Zip{ index = 21.5231 value = 1.4980 dict = 1.00 all = 1.5561 } Zip/UnZip{ index = 0.0465 value = 0.6675 dict = 1.00 all = 0.6426 } ---------------------------- total value len = 64.394799 GB avg = 0.180 KB (by entry num) total key len = 6.964510 GB avg = 0.019 KB total ukey len = 3.277384 GB avg = 0.008 KB total ukey num = 0.400318112 Billion total entry num = 0.357196120 Billion write speed all = 2.755467724 MB/sec (with seq num) write speed all = 2.645125583 MB/sec (without seq num) 2024/08/20-00:45:38.926860 140500321994304 [compaction_job.cc:1944] [default] [JOB 2903] Generated table #14622894: 2684355 keys, 345019787 bytes, temperature: kWarm 2024/08/20-00:45:38.926956 140500321994304 EVENT_LOG_v1 {"time_micros": 1724085938926897, "cf_name": "default", "job": 2903, "event": "table_file_creation", "file_number": 14622894, "file_size": 345019787, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 189410454435, "largest_seqno": 189640132533, "table_properties": {"data_size": 329711600, "index_size": 997760, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 42949680, "raw_average_key_size": 16, "raw_value_size": 493921320, "raw_average_value_size": 184, "num_data_blocks": 1, "num_entries": 2684355, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 16, "fixed_value_len": 184, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-UintIndex_IL_256_32-DictZipBlobStore", "creation_time": 1724085927, "oldest_key_time": 0, "file_creation_time": 1724085927, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "a007a635-5c0a-4b4a-be96-b9c695cb016b", "db_session_id": "9474K4QZ2QA6TIYF9LEW", "orig_file_number": 14622894, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/08/20-00:45:39.057810 140500321994304 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622895.sst) /dev/shm/ToplingTemp/Topling-81946-qpB2Py 2024/08/20-00:45:43.766387 140500321994304 [top_zip_table_builder.cc:1344] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622895.sst): first pass time = 4.71's, 114.021'MB/sec 2024/08/20-00:45:49.208103 140500321994304 [top_zip_table_builder.cc:2764] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622895.sst): old prealloc_size = 590558003, real_size = 331372584 2024/08/20-00:45:49.208190 140500321994304 [top_zip_table_builder.cc:1765] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622895.sst): index type = UintIndex_IL_256_32 , store type = DictZipBlobStore usrkeys = 2684355 prefix = 4 raw-key = 0.0107 GB zip-key = 0.0010 GB avg-key = 4.00 avg-zkey = 0.37 raw-val = 0.4939 GB zip-val = 0.3297 GB avg-val = 184.00 avg-zval = 122.82 2024/08/20-00:45:51.405395 140500321994304 [top_zip_table_builder.cc:3092] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622895.sst): second pass time = 5.44's, 90.805'MB/sec, value only(92.0% of KV) wait indexing time = 0.00's, remap KeyValue time = 2.20's, 157.018'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 30726.540'MB/sec (index lex order gen) rebuild zvType time = 1.81's, 0.372'MB/sec write SST data time = 0.39's, 881.136'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 4.914'MB, throughput = 104624.609'MB/sec zip my value time = 5.44's, unzip length = 0.494'GB zip my value throughput = 90.805'MB/sec zip pipeline throughput = 90.805'MB/sec entries = 2684355 avg-key = 16.00 avg-zkey = 0.37 avg-val = 184.00 avg-zval = 122.82 usrkeys = 2684355 avg-key = 8.00 avg-zkey = 0.37 avg-val = 191.00 avg-zval = 122.82 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 2684355 bytes = 9395264 } seq expand size = 18790485 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0215 GB value = 0.4939 GB dict = 4.91 MB all = 0.5369 GB } __ZipSize{ index = 0.0010 GB value = 0.3297 GB dict = 4.91 MB all = 0.3450 GB } UnZip/Zip{ index = 21.5106 value = 1.4981 dict = 1.00 all = 1.5561 } Zip/UnZip{ index = 0.0465 value = 0.6675 dict = 1.00 all = 0.6426 } ---------------------------- total value len = 64.907511 GB avg = 0.180 KB (by entry num) total key len = 7.007460 GB avg = 0.019 KB total ukey len = 3.298859 GB avg = 0.008 KB total ukey num = 0.403002467 Billion total entry num = 0.359880475 Billion write speed all = 2.775546421 MB/sec (with seq num) write speed all = 2.664430201 MB/sec (without seq num) 2024/08/20-00:45:51.784309 140500321994304 [compaction_job.cc:1944] [default] [JOB 2903] Generated table #14622895: 2684355 keys, 345011787 bytes, temperature: kWarm 2024/08/20-00:45:51.784387 140500321994304 EVENT_LOG_v1 {"time_micros": 1724085951784348, "cf_name": "default", "job": 2903, "event": "table_file_creation", "file_number": 14622895, "file_size": 345011787, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 189410454432, "largest_seqno": 189640132531, "table_properties": {"data_size": 329703024, "index_size": 998336, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 42949680, "raw_average_key_size": 16, "raw_value_size": 493921320, "raw_average_value_size": 184, "num_data_blocks": 1, "num_entries": 2684355, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 16, "fixed_value_len": 184, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-UintIndex_IL_256_32-DictZipBlobStore", "creation_time": 1724085939, "oldest_key_time": 0, "file_creation_time": 1724085939, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "a007a635-5c0a-4b4a-be96-b9c695cb016b", "db_session_id": "9474K4QZ2QA6TIYF9LEW", "orig_file_number": 14622895, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/08/20-00:45:51.913690 140500321994304 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622896.sst) /dev/shm/ToplingTemp/Topling-81946-8ETf9x 2024/08/20-00:45:56.608043 140500321994304 [top_zip_table_builder.cc:1344] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622896.sst): first pass time = 4.69's, 114.367'MB/sec 2024/08/20-00:46:01.991408 140500321994304 [top_zip_table_builder.cc:2764] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622896.sst): old prealloc_size = 590558003, real_size = 331378944 2024/08/20-00:46:01.991493 140500321994304 [top_zip_table_builder.cc:1765] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622896.sst): index type = UintIndex_IL_256_32 , store type = DictZipBlobStore usrkeys = 2684355 prefix = 4 raw-key = 0.0107 GB zip-key = 0.0010 GB avg-key = 4.00 avg-zkey = 0.37 raw-val = 0.4939 GB zip-val = 0.3297 GB avg-val = 184.00 avg-zval = 122.82 2024/08/20-00:46:04.186095 140500321994304 [top_zip_table_builder.cc:3092] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622896.sst): second pass time = 5.38's, 91.799'MB/sec, value only(92.0% of KV) wait indexing time = 0.00's, remap KeyValue time = 2.19's, 157.207'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 28747.145'MB/sec (index lex order gen) rebuild zvType time = 1.81's, 0.371'MB/sec write SST data time = 0.39's, 892.039'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 4.914'MB, throughput = 107501.728'MB/sec zip my value time = 5.38's, unzip length = 0.494'GB zip my value throughput = 91.799'MB/sec zip pipeline throughput = 91.799'MB/sec entries = 2684355 avg-key = 16.00 avg-zkey = 0.37 avg-val = 184.00 avg-zval = 122.82 usrkeys = 2684355 avg-key = 8.00 avg-zkey = 0.37 avg-val = 191.00 avg-zval = 122.82 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 2684355 bytes = 9395264 } seq expand size = 18790485 multi value expand size = 0 cnt WriteAppend = 11 UnZipSize{ index = 0.0215 GB value = 0.4939 GB dict = 4.91 MB all = 0.5369 GB } __ZipSize{ index = 0.0010 GB value = 0.3297 GB dict = 4.91 MB all = 0.3450 GB } UnZip/Zip{ index = 21.3845 value = 1.4981 dict = 1.00 all = 1.5561 } Zip/UnZip{ index = 0.0468 value = 0.6675 dict = 1.00 all = 0.6426 } ---------------------------- total value len = 65.420223 GB avg = 0.180 KB (by entry num) total key len = 7.050410 GB avg = 0.019 KB total ukey len = 3.320334 GB avg = 0.008 KB total ukey num = 0.405686822 Billion total entry num = 0.362564830 Billion write speed all = 2.795613094 MB/sec (with seq num) write speed all = 2.683723248 MB/sec (without seq num) 2024/08/20-00:46:04.562511 140500321994304 [compaction_job.cc:1944] [default] [JOB 2903] Generated table #14622896: 2684355 keys, 345018123 bytes, temperature: kWarm 2024/08/20-00:46:04.562590 140500321994304 EVENT_LOG_v1 {"time_micros": 1724085964562549, "cf_name": "default", "job": 2903, "event": "table_file_creation", "file_number": 14622896, "file_size": 345018123, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 189410455236, "largest_seqno": 189640132115, "table_properties": {"data_size": 329703504, "index_size": 1004224, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 42949680, "raw_average_key_size": 16, "raw_value_size": 493921320, "raw_average_value_size": 184, "num_data_blocks": 1, "num_entries": 2684355, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 16, "fixed_value_len": 184, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-UintIndex_IL_256_32-DictZipBlobStore", "creation_time": 1724085951, "oldest_key_time": 0, "file_creation_time": 1724085951, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "a007a635-5c0a-4b4a-be96-b9c695cb016b", "db_session_id": "9474K4QZ2QA6TIYF9LEW", "orig_file_number": 14622896, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/08/20-00:46:04.717725 140500321994304 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622897.sst) /dev/shm/ToplingTemp/Topling-81946-Hi7Eox 2024/08/20-00:46:06.535244 140500321994304 [top_zip_table_builder.cc:1344] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622897.sst): first pass time = 1.82's, 36.714'MB/sec 2024/08/20-00:46:07.004410 140500321994304 [top_zip_table_builder.cc:2764] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622897.sst): old prealloc_size = 590558003, real_size = 47618272 2024/08/20-00:46:07.004470 140500321994304 [top_zip_table_builder.cc:1765] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622897.sst): index type = UintIndex_IL_256_32 , store type = DictZipBlobStore usrkeys = 333633 prefix = 4 raw-key = 0.0013 GB zip-key = 0.0001 GB avg-key = 4.00 avg-zkey = 0.38 raw-val = 0.0614 GB zip-val = 0.0474 GB avg-val = 184.00 avg-zval = 142.10 2024/08/20-00:46:07.272890 140500321994304 [top_zip_table_builder.cc:3092] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622897.sst): second pass time = 0.47's, 131.380'MB/sec, value only(92.0% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.27's, 183.759'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3745.877'MB/sec (index lex order gen) rebuild zvType time = 0.22's, 0.381'MB/sec write SST data time = 0.05's, 996.907'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.630'MB, throughput = 17562.634'MB/sec zip my value time = 0.47's, unzip length = 0.061'GB zip my value throughput = 131.380'MB/sec zip pipeline throughput = 131.380'MB/sec entries = 333633 avg-key = 16.00 avg-zkey = 0.38 avg-val = 184.00 avg-zval = 142.10 usrkeys = 333633 avg-key = 8.00 avg-zkey = 0.38 avg-val = 191.00 avg-zval = 142.10 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 333633 bytes = 1167728 } seq expand size = 2335431 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0027 GB value = 0.0614 GB dict = 0.63 MB all = 0.0667 GB } __ZipSize{ index = 0.0001 GB value = 0.0474 GB dict = 0.63 MB all = 0.0493 GB } UnZip/Zip{ index = 21.2127 value = 1.2949 dict = 1.00 all = 1.3526 } Zip/UnZip{ index = 0.0471 value = 0.7723 dict = 1.00 all = 0.7393 } ---------------------------- total value len = 65.483947 GB avg = 0.180 KB (by entry num) total key len = 7.055748 GB avg = 0.019 KB total ukey len = 3.323003 GB avg = 0.008 KB total ukey num = 0.406020455 Billion total entry num = 0.362898463 Billion write speed all = 2.797944051 MB/sec (with seq num) write speed all = 2.685964578 MB/sec (without seq num) 2024/08/20-00:46:07.332041 140500321994304 [compaction_job.cc:1944] [default] [JOB 2903] Generated table #14622897: 333633 keys, 49333835 bytes, temperature: kWarm 2024/08/20-00:46:07.332115 140500321994304 EVENT_LOG_v1 {"time_micros": 1724085967332077, "cf_name": "default", "job": 2903, "event": "table_file_creation", "file_number": 14622897, "file_size": 49333835, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 189410454441, "largest_seqno": 189634996029, "table_properties": {"data_size": 47408880, "index_size": 125824, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5338128, "raw_average_key_size": 16, "raw_value_size": 61388472, "raw_average_value_size": 184, "num_data_blocks": 1, "num_entries": 333633, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 16, "fixed_value_len": 184, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-UintIndex_IL_256_32-DictZipBlobStore", "creation_time": 1724085964, "oldest_key_time": 0, "file_creation_time": 1724085964, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "a007a635-5c0a-4b4a-be96-b9c695cb016b", "db_session_id": "9474K4QZ2QA6TIYF9LEW", "orig_file_number": 14622897, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/08/20-00:46:07.406735 140500321994304 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622898.sst) /dev/shm/ToplingTemp/Topling-81946-eJbiSA 2024/08/20-00:46:10.928605 140500321994304 [top_zip_table_builder.cc:1344] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622898.sst): first pass time = 3.52's, 152.442'MB/sec 2024/08/20-00:46:16.329664 140500321994304 [top_zip_table_builder.cc:2764] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622898.sst): old prealloc_size = 590558003, real_size = 331409096 2024/08/20-00:46:16.329745 140500321994304 [top_zip_table_builder.cc:1765] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622898.sst): index type = UintIndex_IL_256_32 , store type = DictZipBlobStore usrkeys = 2684355 prefix = 4 raw-key = 0.0107 GB zip-key = 0.0010 GB avg-key = 4.00 avg-zkey = 0.38 raw-val = 0.4939 GB zip-val = 0.3297 GB avg-val = 184.00 avg-zval = 122.83 2024/08/20-00:46:18.527710 140500321994304 [top_zip_table_builder.cc:3092] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622898.sst): second pass time = 5.40's, 91.491'MB/sec, value only(92.0% of KV) wait indexing time = 0.00's, remap KeyValue time = 2.20's, 156.980'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 31057.616'MB/sec (index lex order gen) rebuild zvType time = 1.81's, 0.370'MB/sec write SST data time = 0.38's, 896.673'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 4.914'MB, throughput = 108204.787'MB/sec zip my value time = 5.40's, unzip length = 0.494'GB zip my value throughput = 91.491'MB/sec zip pipeline throughput = 91.491'MB/sec entries = 2684355 avg-key = 16.00 avg-zkey = 0.38 avg-val = 184.00 avg-zval = 122.83 usrkeys = 2684355 avg-key = 8.00 avg-zkey = 0.38 avg-val = 191.00 avg-zval = 122.83 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 2684355 bytes = 9395264 } seq expand size = 18790485 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0215 GB value = 0.4939 GB dict = 4.91 MB all = 0.5369 GB } __ZipSize{ index = 0.0010 GB value = 0.3297 GB dict = 4.91 MB all = 0.3450 GB } UnZip/Zip{ index = 21.1233 value = 1.4980 dict = 1.00 all = 1.5559 } Zip/UnZip{ index = 0.0473 value = 0.6676 dict = 1.00 all = 0.6427 } ---------------------------- total value len = 65.996658 GB avg = 0.181 KB (by entry num) total key len = 7.098698 GB avg = 0.019 KB total ukey len = 3.344477 GB avg = 0.008 KB total ukey num = 0.408704810 Billion total entry num = 0.365582818 Billion write speed all = 2.818153194 MB/sec (with seq num) write speed all = 2.705394361 MB/sec (without seq num) 2024/08/20-00:46:18.902508 140500321994304 [compaction_job.cc:1944] [default] [JOB 2903] Generated table #14622898: 2684355 keys, 345048267 bytes, temperature: kWarm 2024/08/20-00:46:18.902579 140500321994304 EVENT_LOG_v1 {"time_micros": 1724085978902545, "cf_name": "default", "job": 2903, "event": "table_file_creation", "file_number": 14622898, "file_size": 345048267, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 189412283025, "largest_seqno": 189634997862, "table_properties": {"data_size": 329721216, "index_size": 1016640, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 42949680, "raw_average_key_size": 16, "raw_value_size": 493921320, "raw_average_value_size": 184, "num_data_blocks": 1, "num_entries": 2684355, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 16, "fixed_value_len": 184, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-UintIndex_IL_256_32-DictZipBlobStore", "creation_time": 1724085967, "oldest_key_time": 0, "file_creation_time": 1724085967, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "a007a635-5c0a-4b4a-be96-b9c695cb016b", "db_session_id": "9474K4QZ2QA6TIYF9LEW", "orig_file_number": 14622898, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/08/20-00:46:19.016420 140500321994304 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622899.sst) /dev/shm/ToplingTemp/Topling-81946-zqKqvB 2024/08/20-00:46:23.714318 140500321994304 [top_zip_table_builder.cc:1344] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622899.sst): first pass time = 4.70's, 114.280'MB/sec 2024/08/20-00:46:29.154632 140500321994304 [top_zip_table_builder.cc:2764] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622899.sst): old prealloc_size = 590558003, real_size = 331397544 2024/08/20-00:46:29.154715 140500321994304 [top_zip_table_builder.cc:1765] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622899.sst): index type = UintIndex_IL_256_32 , store type = DictZipBlobStore usrkeys = 2684355 prefix = 4 raw-key = 0.0107 GB zip-key = 0.0010 GB avg-key = 4.00 avg-zkey = 0.38 raw-val = 0.4939 GB zip-val = 0.3297 GB avg-val = 184.00 avg-zval = 122.83 2024/08/20-00:46:31.346182 140500321994304 [top_zip_table_builder.cc:3092] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622899.sst): second pass time = 5.44's, 90.826'MB/sec, value only(92.0% of KV) wait indexing time = 0.00's, remap KeyValue time = 2.19's, 157.440'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 30285.782'MB/sec (index lex order gen) rebuild zvType time = 1.81's, 0.371'MB/sec write SST data time = 0.38's, 906.148'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 4.914'MB, throughput = 99284.828'MB/sec zip my value time = 5.44's, unzip length = 0.494'GB zip my value throughput = 90.826'MB/sec zip pipeline throughput = 90.826'MB/sec entries = 2684355 avg-key = 16.00 avg-zkey = 0.38 avg-val = 184.00 avg-zval = 122.83 usrkeys = 2684355 avg-key = 8.00 avg-zkey = 0.38 avg-val = 191.00 avg-zval = 122.83 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 2684355 bytes = 9395264 } seq expand size = 18790485 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0215 GB value = 0.4939 GB dict = 4.91 MB all = 0.5369 GB } __ZipSize{ index = 0.0010 GB value = 0.3297 GB dict = 4.91 MB all = 0.3450 GB } UnZip/Zip{ index = 21.1260 value = 1.4980 dict = 1.00 all = 1.5560 } Zip/UnZip{ index = 0.0473 value = 0.6675 dict = 1.00 all = 0.6427 } ---------------------------- total value len = 66.509370 GB avg = 0.181 KB (by entry num) total key len = 7.141647 GB avg = 0.019 KB total ukey len = 3.365952 GB avg = 0.008 KB total ukey num = 0.411389165 Billion total entry num = 0.368267173 Billion write speed all = 2.838173780 MB/sec (with seq num) write speed all = 2.724643103 MB/sec (without seq num) 2024/08/20-00:46:31.720483 140500321994304 [compaction_job.cc:1944] [default] [JOB 2903] Generated table #14622899: 2684355 keys, 345036747 bytes, temperature: kWarm 2024/08/20-00:46:31.720553 140500321994304 EVENT_LOG_v1 {"time_micros": 1724085991720519, "cf_name": "default", "job": 2903, "event": "table_file_creation", "file_number": 14622899, "file_size": 345036747, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 189412283028, "largest_seqno": 189634997865, "table_properties": {"data_size": 329709824, "index_size": 1016512, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 42949680, "raw_average_key_size": 16, "raw_value_size": 493921320, "raw_average_value_size": 184, "num_data_blocks": 1, "num_entries": 2684355, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 16, "fixed_value_len": 184, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-UintIndex_IL_256_32-DictZipBlobStore", "creation_time": 1724085979, "oldest_key_time": 0, "file_creation_time": 1724085979, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "a007a635-5c0a-4b4a-be96-b9c695cb016b", "db_session_id": "9474K4QZ2QA6TIYF9LEW", "orig_file_number": 14622899, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/08/20-00:46:31.826999 140500321994304 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622900.sst) /dev/shm/ToplingTemp/Topling-81946-NVilEz 2024/08/20-00:46:36.629517 140500321994304 [top_zip_table_builder.cc:1344] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622900.sst): first pass time = 4.80's, 111.791'MB/sec 2024/08/20-00:46:42.017229 140500321994304 [top_zip_table_builder.cc:2764] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622900.sst): old prealloc_size = 590558003, real_size = 331406536 2024/08/20-00:46:42.017314 140500321994304 [top_zip_table_builder.cc:1765] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622900.sst): index type = UintIndex_IL_256_32 , store type = DictZipBlobStore usrkeys = 2684355 prefix = 4 raw-key = 0.0107 GB zip-key = 0.0010 GB avg-key = 4.00 avg-zkey = 0.38 raw-val = 0.4939 GB zip-val = 0.3297 GB avg-val = 184.00 avg-zval = 122.83 2024/08/20-00:46:44.212857 140500321994304 [top_zip_table_builder.cc:3092] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622900.sst): second pass time = 5.39's, 91.717'MB/sec, value only(92.0% of KV) wait indexing time = 0.00's, remap KeyValue time = 2.20's, 157.153'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 29465.356'MB/sec (index lex order gen) rebuild zvType time = 1.81's, 0.370'MB/sec write SST data time = 0.38's, 905.736'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 4.914'MB, throughput = 84530.104'MB/sec zip my value time = 5.39's, unzip length = 0.494'GB zip my value throughput = 91.717'MB/sec zip pipeline throughput = 91.717'MB/sec entries = 2684355 avg-key = 16.00 avg-zkey = 0.38 avg-val = 184.00 avg-zval = 122.83 usrkeys = 2684355 avg-key = 8.00 avg-zkey = 0.38 avg-val = 191.00 avg-zval = 122.83 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 2684355 bytes = 9395264 } seq expand size = 18790485 multi value expand size = 0 cnt WriteAppend = 10 UnZipSize{ index = 0.0215 GB value = 0.4939 GB dict = 4.91 MB all = 0.5369 GB } __ZipSize{ index = 0.0010 GB value = 0.3297 GB dict = 4.91 MB all = 0.3450 GB } UnZip/Zip{ index = 21.1380 value = 1.4980 dict = 1.00 all = 1.5559 } Zip/UnZip{ index = 0.0473 value = 0.6676 dict = 1.00 all = 0.6427 } ---------------------------- total value len = 67.022082 GB avg = 0.181 KB (by entry num) total key len = 7.184597 GB avg = 0.019 KB total ukey len = 3.387427 GB avg = 0.008 KB total ukey num = 0.414073520 Billion total entry num = 0.370951528 Billion write speed all = 2.858169290 MB/sec (with seq num) write speed all = 2.743867745 MB/sec (without seq num) 2024/08/20-00:46:44.589049 140500321994304 [compaction_job.cc:1944] [default] [JOB 2903] Generated table #14622900: 2684355 keys, 345045707 bytes, temperature: kWarm 2024/08/20-00:46:44.589120 140500321994304 EVENT_LOG_v1 {"time_micros": 1724086004589084, "cf_name": "default", "job": 2903, "event": "table_file_creation", "file_number": 14622900, "file_size": 345045707, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 189410457285, "largest_seqno": 189634997866, "table_properties": {"data_size": 329719376, "index_size": 1015936, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 42949680, "raw_average_key_size": 16, "raw_value_size": 493921320, "raw_average_value_size": 184, "num_data_blocks": 1, "num_entries": 2684355, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 16, "fixed_value_len": 184, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-UintIndex_IL_256_32-DictZipBlobStore", "creation_time": 1724085991, "oldest_key_time": 0, "file_creation_time": 1724085991, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "a007a635-5c0a-4b4a-be96-b9c695cb016b", "db_session_id": "9474K4QZ2QA6TIYF9LEW", "orig_file_number": 14622900, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/08/20-00:46:44.706207 140500321994304 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622901.sst) /dev/shm/ToplingTemp/Topling-81946-XM4W2z 2024/08/20-00:46:46.226356 140500321994304 [top_zip_table_builder.cc:1344] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622901.sst): first pass time = 1.52's, 26.882'MB/sec 2024/08/20-00:46:46.530059 140500321994304 [top_zip_table_builder.cc:2718] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622901.sst): part-0: reject ZipStore ratio = 0.802 2024/08/20-00:46:46.618042 140500321994304 [top_zip_table_builder.cc:2764] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622901.sst): old prealloc_size = 590558003, real_size = 37722432 2024/08/20-00:46:46.618091 140500321994304 [top_zip_table_builder.cc:1765] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622901.sst): index type = UintIndex_IL_256_32 , store type = MixedLenBlobStore usrkeys = 204315 prefix = 4 raw-key = 0.0008 GB zip-key = 0.0001 GB avg-key = 4.00 avg-zkey = 0.38 raw-val = 0.0376 GB zip-val = 0.0376 GB avg-val = 184.00 avg-zval = 184.00 2024/08/20-00:46:46.685170 140500321994304 [top_zip_table_builder.cc:3092] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622901.sst): second pass time = 0.30's, 124.059'MB/sec, value only(92.0% of KV) wait indexing time = 0.09's, remap KeyValue time = 0.07's, 571.847'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2315.967'MB/sec (index lex order gen) rebuild zvType time = 0.04's, 1.301'MB/sec write SST data time = 0.03's, 1379.607'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.000'MB, throughput = 0.000'MB/sec zip my value time = 0.30's, unzip length = 0.038'GB zip my value throughput = 124.059'MB/sec zip pipeline throughput = 124.059'MB/sec entries = 204315 avg-key = 16.00 avg-zkey = 0.38 avg-val = 184.00 avg-zval = 184.00 usrkeys = 204315 avg-key = 8.00 avg-zkey = 0.38 avg-val = 191.00 avg-zval = 184.00 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 204315 bytes = 715120 } seq expand size = 1430205 multi value expand size = 0 cnt WriteAppend = 4596 UnZipSize{ index = 0.0016 GB value = 0.0376 GB dict = 0.00 MB all = 0.0409 GB } __ZipSize{ index = 0.0001 GB value = 0.0376 GB dict = 0.00 MB all = 0.0384 GB } UnZip/Zip{ index = 21.2297 value = 1.0000 dict = 0.00 all = 1.0645 } Zip/UnZip{ index = 0.0471 value = 1.0000 dict = 0.00 all = 0.9394 } ---------------------------- total value len = 67.061106 GB avg = 0.181 KB (by entry num) total key len = 7.187866 GB avg = 0.019 KB total ukey len = 3.389062 GB avg = 0.008 KB total ukey num = 0.414277835 Billion total entry num = 0.371155843 Billion write speed all = 2.859525972 MB/sec (with seq num) write speed all = 2.745172359 MB/sec (without seq num) 2024/08/20-00:46:46.732571 140500321994304 [compaction_job.cc:1944] [default] [JOB 2903] Generated table #14622901: 204315 keys, 38387434 bytes, temperature: kWarm 2024/08/20-00:46:46.732637 140500321994304 EVENT_LOG_v1 {"time_micros": 1724086006732604, "cf_name": "default", "job": 2903, "event": "table_file_creation", "file_number": 14622901, "file_size": 38387434, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 189410455675, "largest_seqno": 189634997803, "table_properties": {"data_size": 37594160, "index_size": 76992, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 3269040, "raw_average_key_size": 16, "raw_value_size": 37593960, "raw_average_value_size": 184, "num_data_blocks": 1, "num_entries": 204315, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 16, "fixed_value_len": 184, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-UintIndex_IL_256_32-MixedLenBlobStore", "creation_time": 1724086004, "oldest_key_time": 0, "file_creation_time": 1724086004, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "a007a635-5c0a-4b4a-be96-b9c695cb016b", "db_session_id": "9474K4QZ2QA6TIYF9LEW", "orig_file_number": 14622901, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/08/20-00:46:46.757083 140500321994304 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622902.sst) /dev/shm/ToplingTemp/Topling-81946-mtfrlx 2024/08/20-00:46:50.228970 140500321994304 [top_zip_table_builder.cc:1344] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622902.sst): first pass time = 3.47's, 154.636'MB/sec 2024/08/20-00:46:55.594088 140500321994304 [top_zip_table_builder.cc:2764] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622902.sst): old prealloc_size = 590558003, real_size = 331410712 2024/08/20-00:46:55.594175 140500321994304 [top_zip_table_builder.cc:1765] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622902.sst): index type = UintIndex_IL_256_32 , store type = DictZipBlobStore usrkeys = 2684355 prefix = 4 raw-key = 0.0107 GB zip-key = 0.0010 GB avg-key = 4.00 avg-zkey = 0.38 raw-val = 0.4939 GB zip-val = 0.3297 GB avg-val = 184.00 avg-zval = 122.83 2024/08/20-00:46:57.789940 140500321994304 [top_zip_table_builder.cc:3092] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622902.sst): second pass time = 5.36's, 92.106'MB/sec, value only(92.0% of KV) wait indexing time = 0.00's, remap KeyValue time = 2.20's, 157.139'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 28383.323'MB/sec (index lex order gen) rebuild zvType time = 1.81's, 0.372'MB/sec write SST data time = 0.39's, 885.975'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 4.914'MB, throughput = 107080.061'MB/sec zip my value time = 5.36's, unzip length = 0.494'GB zip my value throughput = 92.106'MB/sec zip pipeline throughput = 92.106'MB/sec entries = 2684355 avg-key = 16.00 avg-zkey = 0.38 avg-val = 184.00 avg-zval = 122.83 usrkeys = 2684355 avg-key = 8.00 avg-zkey = 0.38 avg-val = 191.00 avg-zval = 122.83 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 2684355 bytes = 9395264 } seq expand size = 18790485 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0215 GB value = 0.4939 GB dict = 4.91 MB all = 0.5369 GB } __ZipSize{ index = 0.0010 GB value = 0.3297 GB dict = 4.91 MB all = 0.3450 GB } UnZip/Zip{ index = 21.1140 value = 1.4980 dict = 1.00 all = 1.5559 } Zip/UnZip{ index = 0.0474 value = 0.6676 dict = 1.00 all = 0.6427 } ---------------------------- total value len = 67.573818 GB avg = 0.181 KB (by entry num) total key len = 7.230816 GB avg = 0.019 KB total ukey len = 3.410536 GB avg = 0.008 KB total ukey num = 0.416962190 Billion total entry num = 0.373840198 Billion write speed all = 2.879694408 MB/sec (with seq num) write speed all = 2.764562981 MB/sec (without seq num) 2024/08/20-00:46:58.165242 140500321994304 [compaction_job.cc:1944] [default] [JOB 2903] Generated table #14622902: 2684355 keys, 345049931 bytes, temperature: kWarm 2024/08/20-00:46:58.165315 140500321994304 EVENT_LOG_v1 {"time_micros": 1724086018165279, "cf_name": "default", "job": 2903, "event": "table_file_creation", "file_number": 14622902, "file_size": 345049931, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 189412282139, "largest_seqno": 189634998184, "table_properties": {"data_size": 329722432, "index_size": 1017088, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 42949680, "raw_average_key_size": 16, "raw_value_size": 493921320, "raw_average_value_size": 184, "num_data_blocks": 1, "num_entries": 2684355, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 16, "fixed_value_len": 184, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-UintIndex_IL_256_32-DictZipBlobStore", "creation_time": 1724086006, "oldest_key_time": 0, "file_creation_time": 1724086006, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "a007a635-5c0a-4b4a-be96-b9c695cb016b", "db_session_id": "9474K4QZ2QA6TIYF9LEW", "orig_file_number": 14622902, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/08/20-00:46:58.280679 140500321994304 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622903.sst) /dev/shm/ToplingTemp/Topling-81946-UPABay 2024/08/20-00:47:02.958093 140500321994304 [top_zip_table_builder.cc:1344] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622903.sst): first pass time = 4.68's, 114.781'MB/sec 2024/08/20-00:47:08.319350 140500321994304 [top_zip_table_builder.cc:2764] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622903.sst): old prealloc_size = 590558003, real_size = 331415016 2024/08/20-00:47:08.319438 140500321994304 [top_zip_table_builder.cc:1765] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622903.sst): index type = UintIndex_IL_256_32 , store type = DictZipBlobStore usrkeys = 2684355 prefix = 4 raw-key = 0.0107 GB zip-key = 0.0010 GB avg-key = 4.00 avg-zkey = 0.38 raw-val = 0.4939 GB zip-val = 0.3297 GB avg-val = 184.00 avg-zval = 122.83 2024/08/20-00:47:10.511100 140500321994304 [top_zip_table_builder.cc:3092] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622903.sst): second pass time = 5.36's, 92.169'MB/sec, value only(92.0% of KV) wait indexing time = 0.00's, remap KeyValue time = 2.19's, 157.434'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 30402.293'MB/sec (index lex order gen) rebuild zvType time = 1.81's, 0.371'MB/sec write SST data time = 0.38's, 900.690'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 4.914'MB, throughput = 105541.442'MB/sec zip my value time = 5.36's, unzip length = 0.494'GB zip my value throughput = 92.169'MB/sec zip pipeline throughput = 92.169'MB/sec entries = 2684355 avg-key = 16.00 avg-zkey = 0.38 avg-val = 184.00 avg-zval = 122.83 usrkeys = 2684355 avg-key = 8.00 avg-zkey = 0.38 avg-val = 191.00 avg-zval = 122.83 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 2684355 bytes = 9395264 } seq expand size = 18790485 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0215 GB value = 0.4939 GB dict = 4.91 MB all = 0.5369 GB } __ZipSize{ index = 0.0010 GB value = 0.3297 GB dict = 4.91 MB all = 0.3451 GB } UnZip/Zip{ index = 21.0928 value = 1.4980 dict = 1.00 all = 1.5559 } Zip/UnZip{ index = 0.0474 value = 0.6676 dict = 1.00 all = 0.6427 } ---------------------------- total value len = 68.086530 GB avg = 0.181 KB (by entry num) total key len = 7.273765 GB avg = 0.019 KB total ukey len = 3.432011 GB avg = 0.008 KB total ukey num = 0.419646545 Billion total entry num = 0.376524553 Billion write speed all = 2.899665251 MB/sec (with seq num) write speed all = 2.783763883 MB/sec (without seq num) 2024/08/20-00:47:10.886534 140500321994304 [compaction_job.cc:1944] [default] [JOB 2903] Generated table #14622903: 2684355 keys, 345054219 bytes, temperature: kWarm 2024/08/20-00:47:10.886607 140500321994304 EVENT_LOG_v1 {"time_micros": 1724086030886571, "cf_name": "default", "job": 2903, "event": "table_file_creation", "file_number": 14622903, "file_size": 345054219, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 189412282132, "largest_seqno": 189634998176, "table_properties": {"data_size": 329725696, "index_size": 1018112, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 42949680, "raw_average_key_size": 16, "raw_value_size": 493921320, "raw_average_value_size": 184, "num_data_blocks": 1, "num_entries": 2684355, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 16, "fixed_value_len": 184, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-UintIndex_IL_256_32-DictZipBlobStore", "creation_time": 1724086018, "oldest_key_time": 0, "file_creation_time": 1724086018, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "a007a635-5c0a-4b4a-be96-b9c695cb016b", "db_session_id": "9474K4QZ2QA6TIYF9LEW", "orig_file_number": 14622903, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/08/20-00:47:11.001059 140500321994304 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622904.sst) /dev/shm/ToplingTemp/Topling-81946-seHqZA 2024/08/20-00:47:15.700975 140500321994304 [top_zip_table_builder.cc:1344] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622904.sst): first pass time = 4.70's, 114.231'MB/sec 2024/08/20-00:47:21.120073 140500321994304 [top_zip_table_builder.cc:2764] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622904.sst): old prealloc_size = 590558003, real_size = 331393272 2024/08/20-00:47:21.120157 140500321994304 [top_zip_table_builder.cc:1765] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622904.sst): index type = UintIndex_IL_256_32 , store type = DictZipBlobStore usrkeys = 2684355 prefix = 4 raw-key = 0.0107 GB zip-key = 0.0010 GB avg-key = 4.00 avg-zkey = 0.38 raw-val = 0.4939 GB zip-val = 0.3297 GB avg-val = 184.00 avg-zval = 122.82 2024/08/20-00:47:23.315397 140500321994304 [top_zip_table_builder.cc:3092] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622904.sst): second pass time = 5.42's, 91.189'MB/sec, value only(92.0% of KV) wait indexing time = 0.00's, remap KeyValue time = 2.20's, 157.168'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 31540.746'MB/sec (index lex order gen) rebuild zvType time = 1.81's, 0.371'MB/sec write SST data time = 0.39's, 893.710'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 4.914'MB, throughput = 110563.946'MB/sec zip my value time = 5.42's, unzip length = 0.494'GB zip my value throughput = 91.189'MB/sec zip pipeline throughput = 91.189'MB/sec entries = 2684355 avg-key = 16.00 avg-zkey = 0.38 avg-val = 184.00 avg-zval = 122.82 usrkeys = 2684355 avg-key = 8.00 avg-zkey = 0.38 avg-val = 191.00 avg-zval = 122.82 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 2684355 bytes = 9395264 } seq expand size = 18790485 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0215 GB value = 0.4939 GB dict = 4.91 MB all = 0.5369 GB } __ZipSize{ index = 0.0010 GB value = 0.3297 GB dict = 4.91 MB all = 0.3450 GB } UnZip/Zip{ index = 21.1047 value = 1.4981 dict = 1.00 all = 1.5560 } Zip/UnZip{ index = 0.0474 value = 0.6675 dict = 1.00 all = 0.6427 } ---------------------------- total value len = 68.599242 GB avg = 0.181 KB (by entry num) total key len = 7.316715 GB avg = 0.019 KB total ukey len = 3.453486 GB avg = 0.008 KB total ukey num = 0.422330900 Billion total entry num = 0.379208908 Billion write speed all = 2.919607219 MB/sec (with seq num) write speed all = 2.802937037 MB/sec (without seq num) 2024/08/20-00:47:23.692767 140500321994304 [compaction_job.cc:1944] [default] [JOB 2903] Generated table #14622904: 2684355 keys, 345032459 bytes, temperature: kWarm 2024/08/20-00:47:23.692851 140500321994304 EVENT_LOG_v1 {"time_micros": 1724086043692805, "cf_name": "default", "job": 2903, "event": "table_file_creation", "file_number": 14622904, "file_size": 345032459, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 189412282140, "largest_seqno": 189634997432, "table_properties": {"data_size": 329704512, "index_size": 1017536, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 42949680, "raw_average_key_size": 16, "raw_value_size": 493921320, "raw_average_value_size": 184, "num_data_blocks": 1, "num_entries": 2684355, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 16, "fixed_value_len": 184, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-UintIndex_IL_256_32-DictZipBlobStore", "creation_time": 1724086030, "oldest_key_time": 0, "file_creation_time": 1724086030, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "a007a635-5c0a-4b4a-be96-b9c695cb016b", "db_session_id": "9474K4QZ2QA6TIYF9LEW", "orig_file_number": 14622904, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/08/20-00:47:23.801464 140500321994304 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622905.sst) /dev/shm/ToplingTemp/Topling-81946-6U3CFy 2024/08/20-00:47:23.810022 140500321994304 [top_zip_table_builder.cc:1344] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622905.sst): first pass time = 0.01's, 0.071'MB/sec 2024/08/20-00:47:23.831124 140500321994304 [top_zip_table_builder.cc:2718] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622905.sst): part-0: reject ZipStore ratio = 1.536 2024/08/20-00:47:23.831336 140500321994304 [top_zip_table_builder.cc:2764] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622905.sst): old prealloc_size = 590558003, real_size = 1232 2024/08/20-00:47:23.831357 140500321994304 [top_zip_table_builder.cc:1765] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622905.sst): index type = UintIndex_IL_256_32 , store type = MixedLenBlobStore usrkeys = 3 prefix = 4 raw-key = 0.0000 GB zip-key = 0.0000 GB avg-key = 4.00 avg-zkey = 90.67 raw-val = 0.0000 GB zip-val = 0.0000 GB avg-val = 184.00 avg-zval = 250.67 2024/08/20-00:47:23.831575 140500321994304 [top_zip_table_builder.cc:3092] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00/14622905.sst): second pass time = 0.02's, 0.027'MB/sec, value only(92.0% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.00's, 9.549'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 15.774'MB/sec (index lex order gen) rebuild zvType time = 0.00's, 0.047'MB/sec write SST data time = 0.00's, 11.214'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.000'MB, throughput = 0.000'MB/sec zip my value time = 0.02's, unzip length = 0.000'GB zip my value throughput = 0.027'MB/sec zip pipeline throughput = 0.027'MB/sec entries = 3 avg-key = 16.00 avg-zkey = 106.67 avg-val = 184.00 avg-zval = 250.67 usrkeys = 3 avg-key = 8.00 avg-zkey = 106.67 avg-val = 191.00 avg-zval = 250.67 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 3 bytes = 32 } seq expand size = 21 multi value expand size = 0 cnt WriteAppend = 8 UnZipSize{ index = 0.0000 GB value = 0.0000 GB dict = 0.00 MB all = 0.0000 GB } __ZipSize{ index = 0.0000 GB value = 0.0000 GB dict = 0.00 MB all = 0.0000 GB } UnZip/Zip{ index = 0.0750 value = 0.7340 dict = 0.00 all = 0.2648 } Zip/UnZip{ index = 13.3333 value = 1.3623 dict = 0.00 all = 3.7767 } ---------------------------- total value len = 68.599242 GB avg = 0.181 KB (by entry num) total key len = 7.316715 GB avg = 0.019 KB total ukey len = 3.453486 GB avg = 0.008 KB total ukey num = 0.422330903 Billion total entry num = 0.379208911 Billion write speed all = 2.919549283 MB/sec (with seq num) write speed all = 2.802881416 MB/sec (without seq num) 2024/08/20-00:47:23.836052 140500321994304 [compaction_job.cc:1944] [default] [JOB 2903] Generated table #14622905: 3 keys, 2266 bytes, temperature: kWarm 2024/08/20-00:47:23.836106 140500321994304 EVENT_LOG_v1 {"time_micros": 1724086043836076, "cf_name": "default", "job": 2903, "event": "table_file_creation", "file_number": 14622905, "file_size": 2266, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 189518889717, "largest_seqno": 189632806630, "table_properties": {"data_size": 752, "index_size": 320, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 48, "raw_average_key_size": 16, "raw_value_size": 552, "raw_average_value_size": 184, "num_data_blocks": 1, "num_entries": 3, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 16, "fixed_value_len": 184, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-UintIndex_IL_256_32-MixedLenBlobStore", "creation_time": 1724086043, "oldest_key_time": 0, "file_creation_time": 1724086043, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "a007a635-5c0a-4b4a-be96-b9c695cb016b", "db_session_id": "9474K4QZ2QA6TIYF9LEW", "orig_file_number": 14622905, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/08/20-00:47:23.841087 140500321994304 [compaction_job.cc:699] job-02903: subcompact[0], size: 4.265510 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-02903/att-00 [14622890,14622891,14622892,14622893,14622894,14622895,14622896,14622897,14622898,14622899,14622900,14622901,14622902,14622903,14622904,14622905] 2024/08/20-00:47:24.375341 140500321994304 (Original Log Time 2024/08/20-00:44:29.184944) EVENT_LOG_v1 {"time_micros": 1724085869184894, "job": 2903, "event": "compaction_started", "compaction_reason": "ManualCompaction", "files_L4": [14622270, 14622387, 14622388, 14622389, 14622390, 14622391, 14622392, 14622393, 14622394, 14622395, 14622396, 14622397, 14622398, 14622399, 14622400, 14622401, 14622402, 14622403, 14622404, 14622405, 14622406, 14622407, 14622408, 14622409, 14622574, 14622575, 14622576], "files_L5": [14615646], "score": -1, "input_data_size": 4464889715, "oldest_snapshot_seqno": 189655330516} 2024/08/20-00:47:24.375344 140500321994304 (Original Log Time 2024/08/20-00:47:24.373995) [compaction_job.cc:2018] [default] [JOB 2903] Compacted 27@4 + 1@5 files to L5 => 4265510222 bytes 2024/08/20-00:47:24.375345 140500321994304 (Original Log Time 2024/08/20-00:47:24.375261) [compaction_job.cc:1220] [default] compacted to: files[0 0 0 0 0 16 0] max score 0.00, MB/sec: 25.6 rd, 24.4 wr, level 5, files in(27, 1) out(16 +0 blob) MB in(4245.8, 12.3 +0.0 blob) out(4067.9 +0.0 blob), read-write-amplify(2.0) write-amplify(1.0) OK, records in: 33025168, records dropped: 27826 output_compression: Snappy 2024/08/20-00:47:24.375349 140500321994304 (Original Log Time 2024/08/20-00:47:24.375313) EVENT_LOG_v1 {"time_micros": 1724086044375286, "cf": "default", "job": 2903, "event": "compaction_finished", "compaction_time_micros": 174656149, "compaction_time_cpu_micros": 59960987, "output_level": 5, "num_output_files": 16, "total_output_size": 4265510222, "num_input_records": 33025168, "num_output_records": 32997342, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 2522383464, "file_range_sync_nanos": 0, "file_fsync_nanos": 11866, "file_prepare_write_nanos": 187791, "lsm_state": [0, 0, 0, 0, 0, 16, 0]} 2024/08/20-00:47:24.502259 140500321994304 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"a007a635-5c0a-4b4a-be96-b9c695cb016b","dbStarts":1724082090,"starts":1724085868,"executesMs":175356,"compactionJobId":2903,"attempt":0,"compactionInputRawBytes":6605033600,"compactionInputZipBytes":4464889715,"compactionOutputRawBytes":0,"compactionOutputZipBytes":4265510222,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-953a9267158f3958f743379fbf4da0bd-4507b88f4515a875-00"}}, response = 2024/08/20-00:47:24.502363 140500321994304 INFO dcompact_worker.cpp:1456: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-08-19T23.41.30/.rocksdb/job-02903/att-00: olev 5, work 175.357 s, result 6.115 ms, install 1.377 ms, input{raw 6.151 GiB zip 4.158 GiB}