2024/11/24-04:34:33.692061 139957206771264 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00: fork to child time = 0.007736 sec 2024/11/24-04:34:33.692803 139957206771264 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00 2024/11/24-04:34:33.698476 139957206771264 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00 2024/11/24-04:34:33.699372 139957206771264 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/24-04:34:33.699627 139957206771264 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/24-04:34:33.753581 139957206771264 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-41611/att-00/MANIFEST-206347 2024/11/24-04:34:33.779055 139957206771264 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-41611/att-00/MANIFEST-206347 succeeded,manifest_file_number is 206347, next_file_number is 292144, last_sequence is 4441527162, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 292001 2024/11/24-04:34:33.779061 139957206771264 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/24-04:34:33.779169 139957206771264 [version_set.cc:5721] Creating manifest 292144 2024/11/24-04:34:33.813678 139957206771264 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/24-04:34:33.833828 139957206771264 [compaction_job.cc:2437] [default] [JOB 41611] Compacting 1@2 + 14@3 files to L3, score 0.99, subcompactions 1 : 1 2024/11/24-04:34:33.833842 139957206771264 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 31188 Base level 2, inputs: [292093(21MB)], [292005(35MB) 292006(33MB) 292007(33MB) 292008(35MB) 292009(34MB) 292010(33MB) 292011(35MB) 292012(34MB) 292013(33MB) 292014(35MB) 292015(34MB) 292016(33MB) 292017(35MB) 292122(25MB)] 2024/11/24-04:34:33.839823 139957206771264 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/24-04:34:33.839851 139957206771264 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/24-04:34:33.839870 139957206771264 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/24-04:34:33.839875 139957206771264 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/24-04:34:33.839886 139957206771264 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/24-04:34:34.329825 139957206771264 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292145.sst) /dev/shm/ToplingTemp/Topling-270960-wyzryT 2024/11/24-04:34:34.877839 139957206771264 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292145.sst): first pass time = 0.55's, 244.936'MB/sec 2024/11/24-04:34:36.712136 139957206771264 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292145.sst): old prealloc_size = 147639500, real_size = 33458400 2024/11/24-04:34:36.712666 139957206771264 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292145.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927172 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0315 GB avg-val = 116.76 avg-zval = 33.93 2024/11/24-04:34:36.713492 139957206771264 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292145.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-04:34:37.797748 139957206771264 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292145.sst): second pass time = 1.83's, 59.045'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.09's, 34.597'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3434.656'MB/sec (index lex order gen) rebuild zvType time = 0.96's, 0.242'MB/sec write SST data time = 0.13's, 293.726'MB/sec dict compress time = 0.00's, 1080708.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 35290.729'MB/sec zip my value time = 1.83's, unzip length = 0.108'GB zip my value throughput = 59.045'MB/sec zip pipeline throughput = 110.527'MB/sec entries = 927172 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.76 avg-zval = 33.93 usrkeys = 927172 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.76 avg-zval = 33.93 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927172 bytes = 3245120 } seq expand size = 6490204 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0315 GB dict = 1.08 MB all = 0.0376 GB } UnZip/Zip{ index = 10.5131 value = 3.4408 dict = 1.00 all = 3.5736 } Zip/UnZip{ index = 0.0951 value = 0.2906 dict = 1.00 all = 0.2798 } ---------------------------- total value len = 2251.440320 GB avg = 0.200 KB (by entry num) total key len = 306.908923 GB avg = 0.027 KB total ukey len = 237.373271 GB avg = 0.015 KB total ukey num = 15.739588335 Billion total entry num = 11.280902283 Billion write speed all = 36.152450553 MB/sec (with seq num) write speed all = 34.877152388 MB/sec (without seq num) 2024/11/24-04:34:37.843771 139957206771264 [compaction_job.cc:1948] [default] [JOB 41611] Generated table #292145: 927172 keys, 37558292 bytes, temperature: kWarm 2024/11/24-04:34:37.843860 139957206771264 EVENT_LOG_v1 {"time_micros": 1732394077843799, "cf_name": "default", "job": 41611, "event": "table_file_creation", "file_number": 292145, "file_size": 37558292, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4259662645, "largest_seqno": 4441097053, "table_properties": {"data_size": 31462608, "index_size": 1763840, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25960816, "raw_average_key_size": 28, "raw_value_size": 108256988, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927172, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732394074, "oldest_key_time": 0, "file_creation_time": 1732394074, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 292145, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-04:34:37.882459 139957206771264 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292146.sst) /dev/shm/ToplingTemp/Topling-270960-6xBdVW 2024/11/24-04:34:38.780111 139957206771264 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292146.sst): first pass time = 0.90's, 149.526'MB/sec 2024/11/24-04:34:40.369424 139957206771264 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292146.sst): old prealloc_size = 147639500, real_size = 30737728 2024/11/24-04:34:40.369947 139957206771264 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292146.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927308 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0287 GB avg-val = 116.74 avg-zval = 30.99 2024/11/24-04:34:40.370749 139957206771264 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292146.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-04:34:41.194808 139957206771264 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292146.sst): second pass time = 1.59's, 68.150'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.83's, 42.209'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3519.586'MB/sec (index lex order gen) rebuild zvType time = 0.70's, 0.333'MB/sec write SST data time = 0.13's, 270.099'MB/sec dict compress time = 0.00's, 1080494.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 34878.272'MB/sec zip my value time = 1.59's, unzip length = 0.108'GB zip my value throughput = 68.150'MB/sec zip pipeline throughput = 106.545'MB/sec entries = 927308 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.74 avg-zval = 30.99 usrkeys = 927308 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.74 avg-zval = 30.99 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927308 bytes = 3245600 } seq expand size = 6491156 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0287 GB dict = 1.08 MB all = 0.0348 GB } UnZip/Zip{ index = 10.5143 value = 3.7664 dict = 1.00 all = 3.8526 } Zip/UnZip{ index = 0.0951 value = 0.2655 dict = 1.00 all = 0.2596 } ---------------------------- total value len = 2251.555065 GB avg = 0.200 KB (by entry num) total key len = 306.934888 GB avg = 0.027 KB total ukey len = 237.391817 GB avg = 0.015 KB total ukey num = 15.740515643 Billion total entry num = 11.281829591 Billion write speed all = 36.152703446 MB/sec (with seq num) write speed all = 34.877361671 MB/sec (without seq num) 2024/11/24-04:34:41.237347 139957206771264 [compaction_job.cc:1948] [default] [JOB 41611] Generated table #292146: 927308 keys, 34837822 bytes, temperature: kWarm 2024/11/24-04:34:41.237415 139957206771264 EVENT_LOG_v1 {"time_micros": 1732394081237381, "cf_name": "default", "job": 41611, "event": "table_file_creation", "file_number": 292146, "file_size": 34837822, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4261178503, "largest_seqno": 4441097073, "table_properties": {"data_size": 28741808, "index_size": 1763904, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25964624, "raw_average_key_size": 28, "raw_value_size": 108253120, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927308, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732394077, "oldest_key_time": 0, "file_creation_time": 1732394077, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 292146, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-04:34:41.276646 139957206771264 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292147.sst) /dev/shm/ToplingTemp/Topling-270960-RGyRzU 2024/11/24-04:34:42.173653 139957206771264 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292147.sst): first pass time = 0.90's, 149.636'MB/sec 2024/11/24-04:34:43.656176 139957206771264 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292147.sst): old prealloc_size = 147639500, real_size = 31453408 2024/11/24-04:34:43.656718 139957206771264 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292147.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 919300 prefix = 4 raw-key = 0.0147 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1085 GB zip-val = 0.0295 GB avg-val = 118.00 avg-zval = 32.05 2024/11/24-04:34:43.657553 139957206771264 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292147.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-04:34:44.474644 139957206771264 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292147.sst): second pass time = 1.48's, 73.232'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.82's, 43.412'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3457.408'MB/sec (index lex order gen) rebuild zvType time = 0.69's, 0.333'MB/sec write SST data time = 0.13's, 278.262'MB/sec dict compress time = 0.00's, 1085010.000'MB/sec z-dict build time = 0.00's, sample length = 1.085'MB, throughput = 25885.960'MB/sec zip my value time = 1.48's, unzip length = 0.108'GB zip my value throughput = 73.232'MB/sec zip pipeline throughput = 94.236'MB/sec entries = 919300 avg-key = 28.00 avg-zkey = 1.92 avg-val = 118.00 avg-zval = 32.05 usrkeys = 919300 avg-key = 20.00 avg-zkey = 1.92 avg-val = 125.00 avg-zval = 32.05 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 919300 bytes = 3217568 } seq expand size = 6435100 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0184 GB value = 0.1085 GB dict = 1.09 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0295 GB dict = 1.09 MB all = 0.0355 GB } UnZip/Zip{ index = 10.4420 value = 3.6819 dict = 1.00 all = 3.7776 } Zip/UnZip{ index = 0.0958 value = 0.2716 dict = 1.00 all = 0.2647 } ---------------------------- total value len = 2251.669977 GB avg = 0.200 KB (by entry num) total key len = 306.960628 GB avg = 0.027 KB total ukey len = 237.410203 GB avg = 0.015 KB total ukey num = 15.741434943 Billion total entry num = 11.282748891 Billion write speed all = 36.153015405 MB/sec (with seq num) write speed all = 34.877628817 MB/sec (without seq num) 2024/11/24-04:34:44.518923 139957206771264 [compaction_job.cc:1948] [default] [JOB 41611] Generated table #292147: 919300 keys, 35530098 bytes, temperature: kWarm 2024/11/24-04:34:44.519001 139957206771264 EVENT_LOG_v1 {"time_micros": 1732394084518956, "cf_name": "default", "job": 41611, "event": "table_file_creation", "file_number": 292147, "file_size": 35530098, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4262387759, "largest_seqno": 4415704864, "table_properties": {"data_size": 29462608, "index_size": 1760768, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25740400, "raw_average_key_size": 28, "raw_value_size": 108477400, "raw_average_value_size": 118, "num_data_blocks": 1, "num_entries": 919300, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 118, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732394081, "oldest_key_time": 0, "file_creation_time": 1732394081, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 292147, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-04:34:44.555230 139957206771264 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292148.sst) /dev/shm/ToplingTemp/Topling-270960-8YSzlW 2024/11/24-04:34:45.498678 139957206771264 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292148.sst): first pass time = 0.94's, 142.268'MB/sec 2024/11/24-04:34:47.039096 139957206771264 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292148.sst): old prealloc_size = 147639500, real_size = 33345120 2024/11/24-04:34:47.039643 139957206771264 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292148.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927169 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1083 GB zip-val = 0.0313 GB avg-val = 116.76 avg-zval = 33.80 2024/11/24-04:34:47.040415 139957206771264 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292148.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-04:34:47.899768 139957206771264 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292148.sst): second pass time = 1.54's, 70.336'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.86's, 43.508'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3381.992'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.317'MB/sec write SST data time = 0.13's, 293.024'MB/sec dict compress time = 0.00's, 1080580.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 29131.642'MB/sec zip my value time = 1.54's, unzip length = 0.108'GB zip my value throughput = 70.336'MB/sec zip pipeline throughput = 90.104'MB/sec entries = 927169 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.76 avg-zval = 33.80 usrkeys = 927169 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.76 avg-zval = 33.80 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927169 bytes = 3245104 } seq expand size = 6490183 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0313 GB dict = 1.08 MB all = 0.0374 GB } UnZip/Zip{ index = 10.4449 value = 3.4545 dict = 1.00 all = 3.5844 } Zip/UnZip{ index = 0.0957 value = 0.2895 dict = 1.00 all = 0.2790 } ---------------------------- total value len = 2251.784724 GB avg = 0.200 KB (by entry num) total key len = 306.986589 GB avg = 0.027 KB total ukey len = 237.428746 GB avg = 0.015 KB total ukey num = 15.742362112 Billion total entry num = 11.283676060 Billion write speed all = 36.153253894 MB/sec (with seq num) write speed all = 34.877824227 MB/sec (without seq num) 2024/11/24-04:34:47.945249 139957206771264 [compaction_job.cc:1948] [default] [JOB 41611] Generated table #292148: 927169 keys, 37444756 bytes, temperature: kWarm 2024/11/24-04:34:47.945326 139957206771264 EVENT_LOG_v1 {"time_micros": 1732394087945284, "cf_name": "default", "job": 41611, "event": "table_file_creation", "file_number": 292148, "file_size": 37444756, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4261178518, "largest_seqno": 4441097087, "table_properties": {"data_size": 31337808, "index_size": 1775360, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25960732, "raw_average_key_size": 28, "raw_value_size": 108257018, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927169, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732394084, "oldest_key_time": 0, "file_creation_time": 1732394084, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 292148, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-04:34:47.985971 139957206771264 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292149.sst) /dev/shm/ToplingTemp/Topling-270960-DJicdU 2024/11/24-04:34:48.925008 139957206771264 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292149.sst): first pass time = 0.94's, 142.939'MB/sec 2024/11/24-04:34:50.521398 139957206771264 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292149.sst): old prealloc_size = 147639500, real_size = 31227776 2024/11/24-04:34:50.521913 139957206771264 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292149.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927259 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0292 GB avg-val = 116.75 avg-zval = 31.52 2024/11/24-04:34:50.522712 139957206771264 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292149.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-04:34:51.348671 139957206771264 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292149.sst): second pass time = 1.60's, 67.870'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.83's, 42.705'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3579.844'MB/sec (index lex order gen) rebuild zvType time = 0.70's, 0.332'MB/sec write SST data time = 0.13's, 275.444'MB/sec dict compress time = 0.00's, 1080408.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 31874.203'MB/sec zip my value time = 1.60's, unzip length = 0.108'GB zip my value throughput = 67.870'MB/sec zip pipeline throughput = 127.063'MB/sec entries = 927259 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.75 avg-zval = 31.52 usrkeys = 927259 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.75 avg-zval = 31.52 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927259 bytes = 3245424 } seq expand size = 6490813 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0292 GB dict = 1.08 MB all = 0.0353 GB } UnZip/Zip{ index = 10.5133 value = 3.7033 dict = 1.00 all = 3.7992 } Zip/UnZip{ index = 0.0951 value = 0.2700 dict = 1.00 all = 0.2632 } ---------------------------- total value len = 2251.899470 GB avg = 0.200 KB (by entry num) total key len = 307.012552 GB avg = 0.027 KB total ukey len = 237.447291 GB avg = 0.015 KB total ukey num = 15.743289371 Billion total entry num = 11.284603319 Billion write speed all = 36.153480224 MB/sec (with seq num) write speed all = 34.878007901 MB/sec (without seq num) 2024/11/24-04:34:51.413171 139957206771264 [compaction_job.cc:1948] [default] [JOB 41611] Generated table #292149: 927259 keys, 35327592 bytes, temperature: kWarm 2024/11/24-04:34:51.413250 139957206771264 EVENT_LOG_v1 {"time_micros": 1732394091413212, "cf_name": "default", "job": 41611, "event": "table_file_creation", "file_number": 292149, "file_size": 35327592, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4261178530, "largest_seqno": 4441097097, "table_properties": {"data_size": 29231792, "index_size": 1763968, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25963252, "raw_average_key_size": 28, "raw_value_size": 108254566, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927259, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732394087, "oldest_key_time": 0, "file_creation_time": 1732394087, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 292149, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-04:34:51.451469 139957206771264 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292150.sst) /dev/shm/ToplingTemp/Topling-270960-CpbspV 2024/11/24-04:34:52.336422 139957206771264 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292150.sst): first pass time = 0.88's, 151.673'MB/sec 2024/11/24-04:34:53.935884 139957206771264 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292150.sst): old prealloc_size = 147639500, real_size = 31502144 2024/11/24-04:34:53.936483 139957206771264 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292150.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 919300 prefix = 4 raw-key = 0.0147 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.1085 GB zip-val = 0.0295 GB avg-val = 118.00 avg-zval = 32.09 2024/11/24-04:34:53.937288 139957206771264 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292150.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-04:34:54.770595 139957206771264 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292150.sst): second pass time = 1.60's, 67.889'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.83's, 42.625'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3070.343'MB/sec (index lex order gen) rebuild zvType time = 0.69's, 0.331'MB/sec write SST data time = 0.14's, 253.826'MB/sec dict compress time = 0.00's, 1085010.000'MB/sec z-dict build time = 0.00's, sample length = 1.085'MB, throughput = 30854.827'MB/sec zip my value time = 1.60's, unzip length = 0.108'GB zip my value throughput = 67.889'MB/sec zip pipeline throughput = 131.109'MB/sec entries = 919300 avg-key = 28.00 avg-zkey = 1.93 avg-val = 118.00 avg-zval = 32.09 usrkeys = 919300 avg-key = 20.00 avg-zkey = 1.93 avg-val = 125.00 avg-zval = 32.09 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 919300 bytes = 3217568 } seq expand size = 6435100 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0184 GB value = 0.1085 GB dict = 1.09 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0295 GB dict = 1.09 MB all = 0.0356 GB } UnZip/Zip{ index = 10.3764 value = 3.6772 dict = 1.00 all = 3.7724 } Zip/UnZip{ index = 0.0964 value = 0.2719 dict = 1.00 all = 0.2651 } ---------------------------- total value len = 2252.014382 GB avg = 0.200 KB (by entry num) total key len = 307.038293 GB avg = 0.027 KB total ukey len = 237.465677 GB avg = 0.015 KB total ukey num = 15.744208671 Billion total entry num = 11.285522619 Billion write speed all = 36.153719528 MB/sec (with seq num) write speed all = 34.878204965 MB/sec (without seq num) 2024/11/24-04:34:54.814402 139957206771264 [compaction_job.cc:1948] [default] [JOB 41611] Generated table #292150: 919300 keys, 35578866 bytes, temperature: kWarm 2024/11/24-04:34:54.814471 139957206771264 EVENT_LOG_v1 {"time_micros": 1732394094814436, "cf_name": "default", "job": 41611, "event": "table_file_creation", "file_number": 292150, "file_size": 35578866, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4267449213, "largest_seqno": 4420360043, "table_properties": {"data_size": 29500208, "index_size": 1771904, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25740400, "raw_average_key_size": 28, "raw_value_size": 108477400, "raw_average_value_size": 118, "num_data_blocks": 1, "num_entries": 919300, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 118, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732394091, "oldest_key_time": 0, "file_creation_time": 1732394091, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 292150, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-04:34:54.853796 139957206771264 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292151.sst) /dev/shm/ToplingTemp/Topling-270960-80ubYU 2024/11/24-04:34:55.710961 139957206771264 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292151.sst): first pass time = 0.86's, 156.592'MB/sec 2024/11/24-04:34:57.246405 139957206771264 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292151.sst): old prealloc_size = 147639500, real_size = 33373056 2024/11/24-04:34:57.246942 139957206771264 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292151.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927172 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0314 GB avg-val = 116.76 avg-zval = 33.84 2024/11/24-04:34:57.247732 139957206771264 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292151.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-04:34:58.106870 139957206771264 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292151.sst): second pass time = 1.53's, 70.565'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.86's, 43.551'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3460.087'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.316'MB/sec write SST data time = 0.13's, 293.904'MB/sec dict compress time = 0.00's, 1080432.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 33335.349'MB/sec zip my value time = 1.53's, unzip length = 0.108'GB zip my value throughput = 70.565'MB/sec zip pipeline throughput = 101.419'MB/sec entries = 927172 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.76 avg-zval = 33.84 usrkeys = 927172 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.76 avg-zval = 33.84 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927172 bytes = 3245120 } seq expand size = 6490204 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0314 GB dict = 1.08 MB all = 0.0375 GB } UnZip/Zip{ index = 10.5135 value = 3.4502 dict = 1.00 all = 3.5817 } Zip/UnZip{ index = 0.0951 value = 0.2898 dict = 1.00 all = 0.2792 } ---------------------------- total value len = 2252.129129 GB avg = 0.200 KB (by entry num) total key len = 307.064254 GB avg = 0.027 KB total ukey len = 237.484221 GB avg = 0.015 KB total ukey num = 15.745135843 Billion total entry num = 11.286449791 Billion write speed all = 36.154003329 MB/sec (with seq num) write speed all = 34.878444097 MB/sec (without seq num) 2024/11/24-04:34:58.153345 139957206771264 [compaction_job.cc:1948] [default] [JOB 41611] Generated table #292151: 927172 keys, 37472704 bytes, temperature: kWarm 2024/11/24-04:34:58.153410 139957206771264 EVENT_LOG_v1 {"time_micros": 1732394098153377, "cf_name": "default", "job": 41611, "event": "table_file_creation", "file_number": 292151, "file_size": 37472704, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4261178548, "largest_seqno": 4441097113, "table_properties": {"data_size": 31377328, "index_size": 1763776, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25960816, "raw_average_key_size": 28, "raw_value_size": 108256928, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927172, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732394094, "oldest_key_time": 0, "file_creation_time": 1732394094, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 292151, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-04:34:58.189227 139957206771264 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292152.sst) /dev/shm/ToplingTemp/Topling-270960-UvDTnT 2024/11/24-04:34:59.124097 139957206771264 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292152.sst): first pass time = 0.93's, 143.575'MB/sec 2024/11/24-04:35:00.757402 139957206771264 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292152.sst): old prealloc_size = 147639500, real_size = 31597216 2024/11/24-04:35:00.757965 139957206771264 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292152.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927146 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0296 GB avg-val = 116.76 avg-zval = 31.93 2024/11/24-04:35:00.758767 139957206771264 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292152.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-04:35:01.593715 139957206771264 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292152.sst): second pass time = 1.63's, 66.317'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 42.685'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3146.648'MB/sec (index lex order gen) rebuild zvType time = 0.71's, 0.328'MB/sec write SST data time = 0.13's, 276.457'MB/sec dict compress time = 0.00's, 1080490.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 34118.223'MB/sec zip my value time = 1.63's, unzip length = 0.108'GB zip my value throughput = 66.317'MB/sec zip pipeline throughput = 130.541'MB/sec entries = 927146 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.76 avg-zval = 31.93 usrkeys = 927146 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.76 avg-zval = 31.93 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927146 bytes = 3245024 } seq expand size = 6490022 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0296 GB dict = 1.08 MB all = 0.0357 GB } UnZip/Zip{ index = 10.5147 value = 3.6571 dict = 1.00 all = 3.7599 } Zip/UnZip{ index = 0.0951 value = 0.2734 dict = 1.00 all = 0.2660 } ---------------------------- total value len = 2252.243877 GB avg = 0.200 KB (by entry num) total key len = 307.090214 GB avg = 0.027 KB total ukey len = 237.502764 GB avg = 0.015 KB total ukey num = 15.746062989 Billion total entry num = 11.287376937 Billion write speed all = 36.154210204 MB/sec (with seq num) write speed all = 34.878609024 MB/sec (without seq num) 2024/11/24-04:35:01.653404 139957206771264 [compaction_job.cc:1948] [default] [JOB 41611] Generated table #292152: 927146 keys, 35696762 bytes, temperature: kWarm 2024/11/24-04:35:01.653482 139957206771264 EVENT_LOG_v1 {"time_micros": 1732394101653442, "cf_name": "default", "job": 41611, "event": "table_file_creation", "file_number": 292152, "file_size": 35696762, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4261178559, "largest_seqno": 4441097127, "table_properties": {"data_size": 29601744, "index_size": 1763520, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25960088, "raw_average_key_size": 28, "raw_value_size": 108257640, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927146, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732394098, "oldest_key_time": 0, "file_creation_time": 1732394098, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 292152, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-04:35:01.690612 139957206771264 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292153.sst) /dev/shm/ToplingTemp/Topling-270960-alY2eX 2024/11/24-04:35:02.536858 139957206771264 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292153.sst): first pass time = 0.85's, 158.613'MB/sec 2024/11/24-04:35:04.165731 139957206771264 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292153.sst): old prealloc_size = 147639500, real_size = 31369712 2024/11/24-04:35:04.166307 139957206771264 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292153.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 919300 prefix = 4 raw-key = 0.0147 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1085 GB zip-val = 0.0294 GB avg-val = 118.00 avg-zval = 31.96 2024/11/24-04:35:04.167097 139957206771264 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292153.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-04:35:04.989705 139957206771264 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292153.sst): second pass time = 1.63's, 66.652'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.82's, 43.020'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3155.376'MB/sec (index lex order gen) rebuild zvType time = 0.69's, 0.331'MB/sec write SST data time = 0.13's, 275.947'MB/sec dict compress time = 0.00's, 1085010.000'MB/sec z-dict build time = 0.00's, sample length = 1.085'MB, throughput = 30864.482'MB/sec zip my value time = 1.63's, unzip length = 0.108'GB zip my value throughput = 66.652'MB/sec zip pipeline throughput = 133.303'MB/sec entries = 919300 avg-key = 28.00 avg-zkey = 1.91 avg-val = 118.00 avg-zval = 31.96 usrkeys = 919300 avg-key = 20.00 avg-zkey = 1.91 avg-val = 125.00 avg-zval = 31.96 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 919300 bytes = 3217568 } seq expand size = 6435100 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0184 GB value = 0.1085 GB dict = 1.09 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0294 GB dict = 1.09 MB all = 0.0354 GB } UnZip/Zip{ index = 10.4455 value = 3.6923 dict = 1.00 all = 3.7865 } Zip/UnZip{ index = 0.0957 value = 0.2708 dict = 1.00 all = 0.2641 } ---------------------------- total value len = 2252.358790 GB avg = 0.200 KB (by entry num) total key len = 307.115954 GB avg = 0.027 KB total ukey len = 237.521150 GB avg = 0.015 KB total ukey num = 15.746982289 Billion total entry num = 11.288296237 Billion write speed all = 36.154462678 MB/sec (with seq num) write speed all = 34.878818803 MB/sec (without seq num) 2024/11/24-04:35:05.040999 139957206771264 [compaction_job.cc:1948] [default] [JOB 41611] Generated table #292153: 919300 keys, 35446450 bytes, temperature: kWarm 2024/11/24-04:35:05.041068 139957206771264 EVENT_LOG_v1 {"time_micros": 1732394105041033, "cf_name": "default", "job": 41611, "event": "table_file_creation", "file_number": 292153, "file_size": 35446450, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4272641991, "largest_seqno": 4425102611, "table_properties": {"data_size": 29379488, "index_size": 1760192, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25740400, "raw_average_key_size": 28, "raw_value_size": 108477400, "raw_average_value_size": 118, "num_data_blocks": 1, "num_entries": 919300, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 118, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732394101, "oldest_key_time": 0, "file_creation_time": 1732394101, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 292153, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-04:35:05.079339 139957206771264 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292154.sst) /dev/shm/ToplingTemp/Topling-270960-Ek5QgV 2024/11/24-04:35:05.990391 139957206771264 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292154.sst): first pass time = 0.91's, 147.326'MB/sec 2024/11/24-04:35:07.634153 139957206771264 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292154.sst): old prealloc_size = 147639500, real_size = 33334368 2024/11/24-04:35:07.634683 139957206771264 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292154.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927231 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0313 GB avg-val = 116.75 avg-zval = 33.80 2024/11/24-04:35:07.635490 139957206771264 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292154.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-04:35:08.508436 139957206771264 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292154.sst): second pass time = 1.64's, 65.887'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.87's, 42.818'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3440.389'MB/sec (index lex order gen) rebuild zvType time = 0.74's, 0.312'MB/sec write SST data time = 0.13's, 287.368'MB/sec dict compress time = 0.00's, 1080272.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 27396.515'MB/sec zip my value time = 1.64's, unzip length = 0.108'GB zip my value throughput = 65.887'MB/sec zip pipeline throughput = 122.371'MB/sec entries = 927231 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.75 avg-zval = 33.80 usrkeys = 927231 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.75 avg-zval = 33.80 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927231 bytes = 3245328 } seq expand size = 6490617 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0313 GB dict = 1.08 MB all = 0.0374 GB } UnZip/Zip{ index = 10.5145 value = 3.4544 dict = 1.00 all = 3.5855 } Zip/UnZip{ index = 0.0951 value = 0.2895 dict = 1.00 all = 0.2789 } ---------------------------- total value len = 2252.473535 GB avg = 0.200 KB (by entry num) total key len = 307.141916 GB avg = 0.027 KB total ukey len = 237.539694 GB avg = 0.015 KB total ukey num = 15.747909520 Billion total entry num = 11.289223468 Billion write speed all = 36.154653230 MB/sec (with seq num) write speed all = 34.878967980 MB/sec (without seq num) 2024/11/24-04:35:08.554139 139957206771264 [compaction_job.cc:1948] [default] [JOB 41611] Generated table #292154: 927231 keys, 37433952 bytes, temperature: kWarm 2024/11/24-04:35:08.554208 139957206771264 EVENT_LOG_v1 {"time_micros": 1732394108554170, "cf_name": "default", "job": 41611, "event": "table_file_creation", "file_number": 292154, "file_size": 37433952, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4261178575, "largest_seqno": 4441097147, "table_properties": {"data_size": 31338640, "index_size": 1763712, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25962468, "raw_average_key_size": 28, "raw_value_size": 108255322, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927231, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732394105, "oldest_key_time": 0, "file_creation_time": 1732394105, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 292154, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-04:35:08.590307 139957206771264 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292155.sst) /dev/shm/ToplingTemp/Topling-270960-GnhLDT 2024/11/24-04:35:09.489289 139957206771264 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292155.sst): first pass time = 0.90's, 149.305'MB/sec 2024/11/24-04:35:11.045600 139957206771264 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292155.sst): old prealloc_size = 147639500, real_size = 31785136 2024/11/24-04:35:11.046161 139957206771264 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292155.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927109 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0298 GB avg-val = 116.77 avg-zval = 32.13 2024/11/24-04:35:11.046988 139957206771264 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292155.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-04:35:11.887816 139957206771264 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292155.sst): second pass time = 1.56's, 69.613'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 42.609'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3298.949'MB/sec (index lex order gen) rebuild zvType time = 0.71's, 0.325'MB/sec write SST data time = 0.13's, 279.364'MB/sec dict compress time = 0.00's, 1080566.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 35006.026'MB/sec zip my value time = 1.56's, unzip length = 0.108'GB zip my value throughput = 69.613'MB/sec zip pipeline throughput = 110.926'MB/sec entries = 927109 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.77 avg-zval = 32.13 usrkeys = 927109 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.77 avg-zval = 32.13 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927109 bytes = 3244896 } seq expand size = 6489763 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0298 GB dict = 1.08 MB all = 0.0359 GB } UnZip/Zip{ index = 10.5116 value = 3.6342 dict = 1.00 all = 3.7403 } Zip/UnZip{ index = 0.0951 value = 0.2752 dict = 1.00 all = 0.2674 } ---------------------------- total value len = 2252.588284 GB avg = 0.200 KB (by entry num) total key len = 307.167876 GB avg = 0.027 KB total ukey len = 237.558237 GB avg = 0.015 KB total ukey num = 15.748836629 Billion total entry num = 11.290150577 Billion write speed all = 36.154914919 MB/sec (with seq num) write speed all = 34.879185801 MB/sec (without seq num) 2024/11/24-04:35:11.931888 139957206771264 [compaction_job.cc:1948] [default] [JOB 41611] Generated table #292155: 927109 keys, 35884678 bytes, temperature: kWarm 2024/11/24-04:35:11.931955 139957206771264 EVENT_LOG_v1 {"time_micros": 1732394111931922, "cf_name": "default", "job": 41611, "event": "table_file_creation", "file_number": 292155, "file_size": 35884678, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4261178589, "largest_seqno": 4441097166, "table_properties": {"data_size": 29789216, "index_size": 1763968, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25959052, "raw_average_key_size": 28, "raw_value_size": 108258742, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927109, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732394108, "oldest_key_time": 0, "file_creation_time": 1732394108, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 292155, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-04:35:11.980724 139957206771264 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292156.sst) /dev/shm/ToplingTemp/Topling-270960-8hvHQV 2024/11/24-04:35:12.845392 139957206771264 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292156.sst): first pass time = 0.86's, 155.231'MB/sec 2024/11/24-04:35:14.343463 139957206771264 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292156.sst): old prealloc_size = 147639500, real_size = 31412832 2024/11/24-04:35:14.344045 139957206771264 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292156.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 919300 prefix = 4 raw-key = 0.0147 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1085 GB zip-val = 0.0294 GB avg-val = 118.00 avg-zval = 32.01 2024/11/24-04:35:14.344819 139957206771264 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292156.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-04:35:15.162450 139957206771264 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292156.sst): second pass time = 1.50's, 72.448'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.82's, 43.334'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3152.152'MB/sec (index lex order gen) rebuild zvType time = 0.69's, 0.333'MB/sec write SST data time = 0.13's, 278.529'MB/sec dict compress time = 0.00's, 1085010.000'MB/sec z-dict build time = 0.00's, sample length = 1.085'MB, throughput = 34065.178'MB/sec zip my value time = 1.50's, unzip length = 0.108'GB zip my value throughput = 72.448'MB/sec zip pipeline throughput = 107.715'MB/sec entries = 919300 avg-key = 28.00 avg-zkey = 1.91 avg-val = 118.00 avg-zval = 32.01 usrkeys = 919300 avg-key = 20.00 avg-zkey = 1.91 avg-val = 125.00 avg-zval = 32.01 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 919300 bytes = 3217568 } seq expand size = 6435100 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0184 GB value = 0.1085 GB dict = 1.09 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0294 GB dict = 1.09 MB all = 0.0355 GB } UnZip/Zip{ index = 10.4462 value = 3.6869 dict = 1.00 all = 3.7819 } Zip/UnZip{ index = 0.0957 value = 0.2712 dict = 1.00 all = 0.2644 } ---------------------------- total value len = 2252.703196 GB avg = 0.200 KB (by entry num) total key len = 307.193616 GB avg = 0.027 KB total ukey len = 237.576623 GB avg = 0.015 KB total ukey num = 15.749755929 Billion total entry num = 11.291069877 Billion write speed all = 36.155229291 MB/sec (with seq num) write speed all = 34.879455304 MB/sec (without seq num) 2024/11/24-04:35:15.207215 139957206771264 [compaction_job.cc:1948] [default] [JOB 41611] Generated table #292156: 919300 keys, 35489522 bytes, temperature: kWarm 2024/11/24-04:35:15.207281 139957206771264 EVENT_LOG_v1 {"time_micros": 1732394115207248, "cf_name": "default", "job": 41611, "event": "table_file_creation", "file_number": 292156, "file_size": 35489522, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4277840117, "largest_seqno": 4430086454, "table_properties": {"data_size": 29422736, "index_size": 1760064, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25740400, "raw_average_key_size": 28, "raw_value_size": 108477400, "raw_average_value_size": 118, "num_data_blocks": 1, "num_entries": 919300, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 118, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732394111, "oldest_key_time": 0, "file_creation_time": 1732394111, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 292156, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-04:35:15.245302 139957206771264 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292157.sst) /dev/shm/ToplingTemp/Topling-270960-JdWFiW 2024/11/24-04:35:16.145315 139957206771264 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292157.sst): first pass time = 0.90's, 149.135'MB/sec 2024/11/24-04:35:17.694062 139957206771264 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292157.sst): old prealloc_size = 147639500, real_size = 33393744 2024/11/24-04:35:17.694632 139957206771264 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292157.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927183 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0314 GB avg-val = 116.76 avg-zval = 33.86 2024/11/24-04:35:17.695439 139957206771264 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292157.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-04:35:18.563099 139957206771264 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292157.sst): second pass time = 1.55's, 69.929'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.87's, 43.145'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3209.432'MB/sec (index lex order gen) rebuild zvType time = 0.74's, 0.313'MB/sec write SST data time = 0.13's, 290.777'MB/sec dict compress time = 0.00's, 1080348.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 37013.430'MB/sec zip my value time = 1.55's, unzip length = 0.108'GB zip my value throughput = 69.929'MB/sec zip pipeline throughput = 106.273'MB/sec entries = 927183 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.76 avg-zval = 33.86 usrkeys = 927183 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.76 avg-zval = 33.86 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927183 bytes = 3245152 } seq expand size = 6490281 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0314 GB dict = 1.08 MB all = 0.0375 GB } UnZip/Zip{ index = 10.5121 value = 3.4479 dict = 1.00 all = 3.5798 } Zip/UnZip{ index = 0.0951 value = 0.2900 dict = 1.00 all = 0.2793 } ---------------------------- total value len = 2252.817943 GB avg = 0.200 KB (by entry num) total key len = 307.219577 GB avg = 0.027 KB total ukey len = 237.595166 GB avg = 0.015 KB total ukey num = 15.750683112 Billion total entry num = 11.291997060 Billion write speed all = 36.155480077 MB/sec (with seq num) write speed all = 34.879662604 MB/sec (without seq num) 2024/11/24-04:35:18.608690 139957206771264 [compaction_job.cc:1948] [default] [JOB 41611] Generated table #292157: 927183 keys, 37493292 bytes, temperature: kWarm 2024/11/24-04:35:18.608756 139957206771264 EVENT_LOG_v1 {"time_micros": 1732394118608725, "cf_name": "default", "job": 41611, "event": "table_file_creation", "file_number": 292157, "file_size": 37493292, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4261178599, "largest_seqno": 4441097185, "table_properties": {"data_size": 31397760, "index_size": 1764032, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25961124, "raw_average_key_size": 28, "raw_value_size": 108256706, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927183, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732394115, "oldest_key_time": 0, "file_creation_time": 1732394115, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 292157, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-04:35:18.644422 139957206771264 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292158.sst) /dev/shm/ToplingTemp/Topling-270960-d2wusV 2024/11/24-04:35:19.380076 139957206771264 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292158.sst): first pass time = 0.74's, 157.437'MB/sec 2024/11/24-04:35:20.700319 139957206771264 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292158.sst): old prealloc_size = 147639500, real_size = 27058192 2024/11/24-04:35:20.700819 139957206771264 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292158.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 801163 prefix = 4 raw-key = 0.0128 GB zip-key = 0.0015 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.0934 GB zip-val = 0.0253 GB avg-val = 116.56 avg-zval = 31.61 2024/11/24-04:35:20.701488 139957206771264 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292158.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0020 GB, waited 0.000 sec, Key+Value = 0.116 GB 2024/11/24-04:35:21.436442 139957206771264 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00/292158.sst): second pass time = 1.32's, 70.794'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.74's, 41.432'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3218.939'MB/sec (index lex order gen) rebuild zvType time = 0.62's, 0.321'MB/sec write SST data time = 0.11's, 274.286'MB/sec dict compress time = 0.00's, 932842.000'MB/sec z-dict build time = 0.00's, sample length = 0.933'MB, throughput = 28889.501'MB/sec zip my value time = 1.32's, unzip length = 0.093'GB zip my value throughput = 70.794'MB/sec zip pipeline throughput = 100.626'MB/sec entries = 801163 avg-key = 28.00 avg-zkey = 1.92 avg-val = 116.56 avg-zval = 31.61 usrkeys = 801163 avg-key = 20.00 avg-zkey = 1.92 avg-val = 123.56 avg-zval = 31.61 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 801163 bytes = 2703936 } seq expand size = 5608141 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0160 GB value = 0.0934 GB dict = 0.93 MB all = 0.1158 GB } __ZipSize{ index = 0.0015 GB value = 0.0253 GB dict = 0.93 MB all = 0.0305 GB } UnZip/Zip{ index = 10.4436 value = 3.6875 dict = 1.00 all = 3.7974 } Zip/UnZip{ index = 0.0958 value = 0.2712 dict = 1.00 all = 0.2633 } ---------------------------- total value len = 2252.916932 GB avg = 0.200 KB (by entry num) total key len = 307.242010 GB avg = 0.027 KB total ukey len = 237.611190 GB avg = 0.015 KB total ukey num = 15.751484275 Billion total entry num = 11.292798223 Billion write speed all = 36.155727707 MB/sec (with seq num) write speed all = 34.879871491 MB/sec (without seq num) 2024/11/24-04:35:21.475327 139957206771264 [compaction_job.cc:1948] [default] [JOB 41611] Generated table #292158: 801163 keys, 30498298 bytes, temperature: kWarm 2024/11/24-04:35:21.475392 139957206771264 EVENT_LOG_v1 {"time_micros": 1732394121475359, "cf_name": "default", "job": 41611, "event": "table_file_creation", "file_number": 292158, "file_size": 30498298, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4356762316, "largest_seqno": 4441097198, "table_properties": {"data_size": 25323456, "index_size": 1534272, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 22432564, "raw_average_key_size": 28, "raw_value_size": 93380814, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 801163, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732394118, "oldest_key_time": 0, "file_creation_time": 1732394118, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 292158, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-04:35:21.501337 139957206771264 [compaction_job.cc:703] job-41611: subcompact[0], size: 0.501693 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41611/att-00 [292145,292146,292147,292148,292149,292150,292151,292152,292153,292154,292155,292156,292157,292158] 2024/11/24-04:35:21.586836 139957206771264 (Original Log Time 2024/11/24-04:34:33.833889) EVENT_LOG_v1 {"time_micros": 1732394073833852, "job": 41611, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [292093], "files_L3": [292005, 292006, 292007, 292008, 292009, 292010, 292011, 292012, 292013, 292014, 292015, 292016, 292017, 292122], "score": 0.985843, "input_data_size": 522106222, "oldest_snapshot_seqno": 4441527038} 2024/11/24-04:35:21.586840 139957206771264 (Original Log Time 2024/11/24-04:35:21.585629) [compaction_job.cc:2022] [default] [JOB 41611] Compacted 1@2 + 14@3 files to L3 => 501693084 bytes 2024/11/24-04:35:21.586841 139957206771264 (Original Log Time 2024/11/24-04:35:21.586771) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 14 0 0 0] max score 0.02, MB/sec: 11.0 rd, 10.5 wr, level 3, files in(1, 14) out(14 +0 blob) MB in(21.2, 476.7 +0.0 blob) out(478.5 +0.0 blob), read-write-amplify(46.1) write-amplify(22.6) OK, records in: 12912872, records dropped: 89760 output_compression: Snappy 2024/11/24-04:35:21.586848 139957206771264 (Original Log Time 2024/11/24-04:35:21.586814) EVENT_LOG_v1 {"time_micros": 1732394121586794, "cf": "default", "job": 41611, "event": "compaction_finished", "compaction_time_micros": 47667456, "compaction_time_cpu_micros": 19568467, "output_level": 3, "num_output_files": 14, "total_output_size": 501693084, "num_input_records": 12912872, "num_output_records": 12823112, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 350013430, "file_range_sync_nanos": 0, "file_fsync_nanos": 10568, "file_prepare_write_nanos": 32924, "lsm_state": [0, 0, 0, 14, 0, 0, 0]} 2024/11/24-04:35:21.718221 139957206771264 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732256054,"starts":1732394073,"executesMs":47887,"compactionJobId":41611,"attempt":0,"compactionInputRawBytes":1873390500,"compactionInputZipBytes":522106222,"compactionOutputRawBytes":0,"compactionOutputZipBytes":501693084,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-33a6ee20691a0a26bd7cba3285664f94-e56352d4eb99e933-00"}}, response = 2024/11/24-04:35:21.718314 139957206771264 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-41611/att-00: olev 3, work 47.887 s, result 6.135 ms, install 1.234 ms, input{raw 1.745 GiB zip 497.919 MiB}