2024/11/23-22:09:40.379970 139957240342080 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00: fork to child time = 0.027353 sec 2024/11/23-22:09:40.380953 139957240342080 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00 2024/11/23-22:09:40.388214 139957240342080 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00 2024/11/23-22:09:40.389435 139957240342080 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/23-22:09:40.389844 139957240342080 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/23-22:09:40.449173 139957240342080 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-36792/att-00/MANIFEST-206347 2024/11/23-22:09:40.475616 139957240342080 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-36792/att-00/MANIFEST-206347 succeeded,manifest_file_number is 206347, next_file_number is 282653, last_sequence is 4291473322, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 282527 2024/11/23-22:09:40.475630 139957240342080 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/23-22:09:40.475839 139957240342080 [version_set.cc:5721] Creating manifest 282653 2024/11/23-22:09:40.513087 139957240342080 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00: bottommost_level: fake = 1, rpc = 1 2024/11/23-22:09:40.533098 139957240342080 [compaction_job.cc:2437] [default] [JOB 36792] Compacting 32@5 files to L6, score -1.00, subcompactions 1 : 1 2024/11/23-22:09:40.533125 139957240342080 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 27547 Base level 5, inputs: [281896(97MB) 281897(233MB) 281898(150MB) 281899(121MB) 281900(124MB) 281901(30MB) 281902(8573KB) 281903(254MB) 281904(255MB) 281905(165MB) 281906(143MB) 281907(143MB) 281908(142MB) 281909(143MB) 281910(143MB) 281911(143MB) 281912(143MB) 281913(134MB) 282042(143MB) 282043(143MB) 282044(143MB) 282045(102MB) 282046(104MB) 282047(106MB) 282048(108MB) 282049(108MB) 282050(108MB) 282051(107MB) 282052(106MB) 282053(103MB) 282054(99MB) 282055(98MB)] 2024/11/23-22:09:40.536997 139957240342080 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-22:09:40.537036 139957240342080 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-22:09:40.537061 139957240342080 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-22:09:40.537069 139957240342080 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-22:09:40.537082 139957240342080 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-22:09:41.673834 139957240342080 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282654.sst) /dev/shm/ToplingTemp/Topling-202257-eCZViV 2024/11/23-22:09:44.308735 139957240342080 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282654.sst): first pass time = 2.63's, 49.846'MB/sec 2024/11/23-22:09:46.333515 139957240342080 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282654.sst): old prealloc_size = 1073741824, real_size = 101232208 2024/11/23-22:09:46.333710 139957240342080 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282654.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 195219 prefix = 4 raw-key = 0.0023 GB zip-key = 0.0003 GB avg-key = 12.00 avg-zkey = 1.69 raw-val = 0.1267 GB zip-val = 0.1009 GB avg-val = 648.76 avg-zval = 516.62 2024/11/23-22:09:46.333774 139957240342080 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282654.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0004 GB, waited 0.000 sec, Key+Value = 0.131 GB 2024/11/23-22:09:46.657550 139957240342080 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282654.sst): second pass time = 2.02's, 62.581'MB/sec, value only(96.4% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.32's, 316.355'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1914.365'MB/sec (index lex order gen) rebuild zvType time = 0.26's, 0.186'MB/sec write SST data time = 0.06's, 1650.671'MB/sec dict compress time = 0.00's, 1321927.000'MB/sec z-dict build time = 0.00's, sample length = 1.322'MB, throughput = 37026.693'MB/sec zip my value time = 2.02's, unzip length = 0.127'GB zip my value throughput = 62.581'MB/sec zip pipeline throughput = 73.495'MB/sec entries = 195219 avg-key = 24.00 avg-zkey = 1.69 avg-val = 648.76 avg-zval = 516.62 usrkeys = 195219 avg-key = 16.00 avg-zkey = 1.69 avg-val = 648.76 avg-zval = 516.62 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 8 UnZipSize{ index = 0.0031 GB value = 0.1267 GB dict = 1.32 MB all = 0.1313 GB } __ZipSize{ index = 0.0003 GB value = 0.1009 GB dict = 1.32 MB all = 0.1025 GB } UnZip/Zip{ index = 9.4767 value = 1.2558 dict = 1.00 all = 1.2812 } Zip/UnZip{ index = 0.1055 value = 0.7963 dict = 1.00 all = 0.7805 } ---------------------------- total value len = 8.975271 GB avg = 0.171 KB (by entry num) total key len = 1.445506 GB avg = 0.028 KB total ukey len = 1.001002 GB avg = 0.015 KB total ukey num = 0.065745654 Billion total entry num = 0.052553383 Billion write speed all = 0.218582047 MB/sec (with seq num) write speed all = 0.209763338 MB/sec (without seq num) 2024/11/23-22:09:46.811399 139957240342080 [compaction_job.cc:1948] [default] [JOB 36792] Generated table #282654: 195219 keys, 102508033 bytes, temperature: kWarm 2024/11/23-22:09:46.811519 139957240342080 EVENT_LOG_v1 {"time_micros": 1732370986811461, "cf_name": "default", "job": 36792, "event": "table_file_creation", "file_number": 282654, "file_size": 102508033, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 100853632, "index_size": 329600, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 4685256, "raw_average_key_size": 24, "raw_value_size": 126651197, "raw_average_value_size": 648, "num_data_blocks": 1, "num_entries": 195219, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 24, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732370981, "oldest_key_time": 0, "file_creation_time": 1732370981, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 282654, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-22:09:46.859042 139957240342080 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282655.sst) /dev/shm/ToplingTemp/Topling-202257-tlBFwV 2024/11/23-22:09:57.270302 139957240342080 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282655.sst): first pass time = 10.41's, 103.133'MB/sec 2024/11/23-22:10:10.798425 139957240342080 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282655.sst): old prealloc_size = 1073741824, real_size = 398105480 2024/11/23-22:10:10.798491 139957240342080 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282655.sst): index type = UintIndex_AllOne , store type = DictZipBlobStore usrkeys = 14636805 prefix = 4 raw-key = 0.1171 GB zip-key = 0.0000 GB avg-key = 8.00 avg-zkey = 0.00 raw-val = 0.7810 GB zip-val = 0.3944 GB avg-val = 53.36 avg-zval = 26.95 2024/11/23-22:10:12.235054 139957240342080 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282655.sst): second pass time = 13.52's, 57.746'MB/sec, value only(72.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.44's, 280.011'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 7.784'MB/sec (index lex order gen) rebuild zvType time = 0.30's, 12.106'MB/sec write SST data time = 1.13's, 354.629'MB/sec dict compress time = 0.00's, 7817924.000'MB/sec z-dict build time = 0.00's, sample length = 7.818'MB, throughput = 242800.211'MB/sec zip my value time = 13.52's, unzip length = 0.781'GB zip my value throughput = 57.746'MB/sec zip pipeline throughput = 65.737'MB/sec entries = 14636805 avg-key = 20.00 avg-zkey = 0.00 avg-val = 53.36 avg-zval = 26.95 usrkeys = 14636805 avg-key = 12.00 avg-zkey = 0.00 avg-val = 53.36 avg-zval = 26.95 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 4 UnZipSize{ index = 0.1756 GB value = 0.7810 GB dict = 7.82 MB all = 1.0737 GB } __ZipSize{ index = 0.0000 GB value = 0.3944 GB dict = 7.82 MB all = 0.4023 GB } UnZip/Zip{ index =914800.3125 value = 1.9800 dict = 1.00 all = 2.6692 } Zip/UnZip{ index = 0.0000 value = 0.5050 dict = 1.00 all = 0.3746 } ---------------------------- total value len = 9.756277 GB avg = 0.145 KB (by entry num) total key len = 1.738242 GB avg = 0.026 KB total ukey len = 1.176643 GB avg = 0.015 KB total ukey num = 0.080382459 Billion total entry num = 0.067190188 Billion write speed all = 0.240975142 MB/sec (with seq num) write speed all = 0.229706352 MB/sec (without seq num) 2024/11/23-22:10:12.764237 139957240342080 [compaction_job.cc:1948] [default] [JOB 36792] Generated table #282655: 14636805 keys, 402265217 bytes, temperature: kWarm 2024/11/23-22:10:12.764316 139957240342080 EVENT_LOG_v1 {"time_micros": 1732371012764275, "cf_name": "default", "job": 36792, "event": "table_file_creation", "file_number": 282655, "file_size": 402265217, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 394445904, "index_size": 192, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 292736100, "raw_average_key_size": 20, "raw_value_size": 781005763, "raw_average_value_size": 53, "num_data_blocks": 1, "num_entries": 14636805, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-UintIndex_AllOne-DictZipBlobStore", "creation_time": 1732370986, "oldest_key_time": 0, "file_creation_time": 1732370986, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 282655, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-22:10:12.932192 139957240342080 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282656.sst) /dev/shm/ToplingTemp/Topling-202257-CgnoKV 2024/11/23-22:10:21.009698 139957240342080 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282656.sst): first pass time = 8.08's, 132.931'MB/sec 2024/11/23-22:10:32.955572 139957240342080 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282656.sst): old prealloc_size = 1073741824, real_size = 248655840 2024/11/23-22:10:32.955640 139957240342080 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282656.sst): index type = UintIndex_AllOne , store type = DictZipBlobStore usrkeys = 14855205 prefix = 4 raw-key = 0.1188 GB zip-key = 0.0000 GB avg-key = 8.00 avg-zkey = 0.00 raw-val = 0.7766 GB zip-val = 0.2449 GB avg-val = 52.28 avg-zval = 16.49 2024/11/23-22:10:34.270587 139957240342080 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282656.sst): second pass time = 11.94's, 65.032'MB/sec, value only(72.3% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.31's, 192.183'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 7.788'MB/sec (index lex order gen) rebuild zvType time = 0.21's, 17.771'MB/sec write SST data time = 1.11's, 228.500'MB/sec dict compress time = 0.00's, 7776962.000'MB/sec z-dict build time = 0.00's, sample length = 7.777'MB, throughput = 242567.668'MB/sec zip my value time = 11.94's, unzip length = 0.777'GB zip my value throughput = 65.032'MB/sec zip pipeline throughput = 65.032'MB/sec entries = 14855205 avg-key = 20.00 avg-zkey = 0.00 avg-val = 52.28 avg-zval = 16.49 usrkeys = 14855205 avg-key = 12.00 avg-zkey = 0.00 avg-val = 52.28 avg-zval = 16.49 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 4 UnZipSize{ index = 0.1783 GB value = 0.7766 GB dict = 7.78 MB all = 1.0737 GB } __ZipSize{ index = 0.0000 GB value = 0.2449 GB dict = 7.78 MB all = 0.2527 GB } UnZip/Zip{ index =928450.3125 value = 3.1707 dict = 1.00 all = 4.2487 } Zip/UnZip{ index = 0.0000 value = 0.3154 dict = 1.00 all = 0.2354 } ---------------------------- total value len = 10.532914 GB avg = 0.128 KB (by entry num) total key len = 2.035347 GB avg = 0.025 KB total ukey len = 1.354906 GB avg = 0.014 KB total ukey num = 0.095237664 Billion total entry num = 0.082045393 Billion write speed all = 0.263363780 MB/sec (with seq num) write speed all = 0.249609906 MB/sec (without seq num) 2024/11/23-22:10:34.549081 139957240342080 [compaction_job.cc:1948] [default] [JOB 36792] Generated table #282656: 14855205 keys, 252719995 bytes, temperature: kWarm 2024/11/23-22:10:34.549163 139957240342080 EVENT_LOG_v1 {"time_micros": 1732371034549118, "cf_name": "default", "job": 36792, "event": "table_file_creation", "file_number": 282656, "file_size": 252719995, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 244941680, "index_size": 192, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 297104100, "raw_average_key_size": 20, "raw_value_size": 776637744, "raw_average_value_size": 52, "num_data_blocks": 1, "num_entries": 14855205, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-UintIndex_AllOne-DictZipBlobStore", "creation_time": 1732371012, "oldest_key_time": 0, "file_creation_time": 1732371012, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 282656, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-22:10:34.688564 139957240342080 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282657.sst) /dev/shm/ToplingTemp/Topling-202257-aeTqIW 2024/11/23-22:10:35.953784 139957240342080 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282657.sst): first pass time = 1.27's, 99.254'MB/sec 2024/11/23-22:10:37.278634 139957240342080 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282657.sst): old prealloc_size = 1073741824, real_size = 31118280 2024/11/23-22:10:37.278683 139957240342080 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282657.sst): index type = UintIndex_AllOne , store type = DictZipBlobStore usrkeys = 1760921 prefix = 4 raw-key = 0.0141 GB zip-key = 0.0000 GB avg-key = 8.00 avg-zkey = 0.00 raw-val = 0.0904 GB zip-val = 0.0307 GB avg-val = 51.31 avg-zval = 17.42 2024/11/23-22:10:37.441355 139957240342080 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282657.sst): second pass time = 1.32's, 68.266'MB/sec, value only(72.0% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 194.096'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 8.077'MB/sec (index lex order gen) rebuild zvType time = 0.03's, 16.180'MB/sec write SST data time = 0.14's, 233.112'MB/sec dict compress time = 0.00's, 900965.000'MB/sec z-dict build time = 0.00's, sample length = 0.901'MB, throughput = 29265.413'MB/sec zip my value time = 1.32's, unzip length = 0.090'GB zip my value throughput = 68.266'MB/sec zip pipeline throughput = 68.266'MB/sec entries = 1760921 avg-key = 20.00 avg-zkey = 0.00 avg-val = 51.31 avg-zval = 17.42 usrkeys = 1760921 avg-key = 12.00 avg-zkey = 0.00 avg-val = 51.31 avg-zval = 17.42 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 4 UnZipSize{ index = 0.0211 GB value = 0.0904 GB dict = 0.90 MB all = 0.1256 GB } __ZipSize{ index = 0.0000 GB value = 0.0307 GB dict = 0.90 MB all = 0.0316 GB } UnZip/Zip{ index =110057.5625 value = 2.9453 dict = 1.00 all = 3.9764 } Zip/UnZip{ index = 0.0000 value = 0.3395 dict = 1.00 all = 0.2515 } ---------------------------- total value len = 10.623270 GB avg = 0.127 KB (by entry num) total key len = 2.070565 GB avg = 0.025 KB total ukey len = 1.376037 GB avg = 0.014 KB total ukey num = 0.096998585 Billion total entry num = 0.083806314 Billion write speed all = 0.265977471 MB/sec (with seq num) write speed all = 0.251929334 MB/sec (without seq num) 2024/11/23-22:10:37.483687 139957240342080 [compaction_job.cc:1948] [default] [JOB 36792] Generated table #282657: 1760921 keys, 31580058 bytes, temperature: kWarm 2024/11/23-22:10:37.483756 139957240342080 EVENT_LOG_v1 {"time_micros": 1732371037483721, "cf_name": "default", "job": 36792, "event": "table_file_creation", "file_number": 282657, "file_size": 31580058, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 30677712, "index_size": 192, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 35218420, "raw_average_key_size": 20, "raw_value_size": 90355641, "raw_average_value_size": 51, "num_data_blocks": 1, "num_entries": 1760921, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-UintIndex_AllOne-DictZipBlobStore", "creation_time": 1732371034, "oldest_key_time": 0, "file_creation_time": 1732371034, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 282657, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-22:10:37.524361 139957240342080 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282658.sst) /dev/shm/ToplingTemp/Topling-202257-ESTnkW 2024/11/23-22:10:42.615760 139957240342080 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282658.sst): first pass time = 5.09's, 24.468'MB/sec 2024/11/23-22:10:42.980763 139957240342080 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282658.sst): old prealloc_size = 1073741824, real_size = 10029216 2024/11/23-22:10:42.982758 139957240342080 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282658.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = ZeroLengthBlobStore usrkeys = 5190616 prefix = 4 raw-key = 0.0623 GB zip-key = 0.0087 GB avg-key = 12.00 avg-zkey = 1.68 raw-val = 0.0000 GB zip-val = 0.0000 GB avg-val = 0.00 avg-zval = 0.00 2024/11/23-22:10:42.982803 139957240342080 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282658.sst: sumWaitingMem = 0.015 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0149 GB, waited 0.000 sec, Key+Value = 0.125 GB 2024/11/23-22:10:43.505682 139957240342080 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282658.sst): second pass time = 0.00's, 0.000'MB/sec, value only( 0.0% of KV) wait indexing time = 0.36's, remap KeyValue time = 0.52's, 16.726'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 4397.706'MB/sec (index lex order gen) rebuild zvType time = 0.02's, 81.685'MB/sec write SST data time = 0.51's, 17.315'MB/sec dict compress time = 0.00's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.000'MB, throughput = -nan'MB/sec zip my value time = 0.00's, unzip length = 0.000'GB zip my value throughput = 0.000'MB/sec zip pipeline throughput = 0.000'MB/sec entries = 5190616 avg-key = 24.00 avg-zkey = 1.68 avg-val = 0.00 avg-zval = 0.00 usrkeys = 5190616 avg-key = 16.00 avg-zkey = 1.68 avg-val = 0.00 avg-zval = 0.00 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 5 UnZipSize{ index = 0.0830 GB value = 0.0000 GB dict = 0.00 MB all = 0.1246 GB } __ZipSize{ index = 0.0087 GB value = 0.0000 GB dict = 0.00 MB all = 0.0088 GB } UnZip/Zip{ index = 9.5117 value = 0.0000 dict = 0.00 all = 14.1893 } Zip/UnZip{ index = 0.1051 value = inf dict = 0.00 all = 0.0705 } ---------------------------- total value len = 10.623270 GB avg = 0.119 KB (by entry num) total key len = 2.195140 GB avg = 0.025 KB total ukey len = 1.459087 GB avg = 0.014 KB total ukey num = 0.102189201 Billion total entry num = 0.088996930 Billion write speed all = 0.268553597 MB/sec (with seq num) write speed all = 0.253637272 MB/sec (without seq num) 2024/11/23-22:10:43.521836 139957240342080 [compaction_job.cc:1948] [default] [JOB 36792] Generated table #282658: 5190616 keys, 8779487 bytes, temperature: kWarm 2024/11/23-22:10:43.521899 139957240342080 EVENT_LOG_v1 {"time_micros": 1732371043521864, "cf_name": "default", "job": 36792, "event": "table_file_creation", "file_number": 282658, "file_size": 8779487, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 80, "index_size": 8731328, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 124574784, "raw_average_key_size": 24, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 1, "num_entries": 5190616, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 24, "fixed_value_len": 0, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-ZeroLengthBlobStore", "creation_time": 1732371037, "oldest_key_time": 0, "file_creation_time": 1732371037, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 282658, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-22:10:43.560221 139957240342080 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282659.sst) /dev/shm/ToplingTemp/Topling-202257-C86TNW 2024/11/23-22:11:00.182040 139957240342080 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282659.sst): first pass time = 16.62's, 64.599'MB/sec 2024/11/23-22:11:00.435387 139957240342080 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282659.sst): old prealloc_size = 1073741824, real_size = 541045040 2024/11/23-22:11:00.447319 139957240342080 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282659.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = ZipOffsetBlobStore usrkeys = 24213485 prefix = 4 raw-key = 0.2906 GB zip-key = 0.0407 GB avg-key = 12.00 avg-zkey = 1.68 raw-val = 0.4926 GB zip-val = 0.4943 GB avg-val = 20.34 avg-zval = 20.42 2024/11/23-22:11:00.447393 139957240342080 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282659.sst: sumWaitingMem = 0.076 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0757 GB, waited 0.000 sec, Key+Value = 1.074 GB 2024/11/23-22:11:05.285339 139957240342080 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282659.sst): second pass time = 0.00's,873436533.688'MB/sec, value only(45.9% of KV) wait indexing time = 0.25's, remap KeyValue time = 4.85's, 110.349'MB/sec (all stages of remap) Get OrderMap time = 0.01's, 3410.740'MB/sec (index lex order gen) rebuild zvType time = 2.43's, 2.494'MB/sec write SST data time = 2.41's, 222.018'MB/sec dict compress time = 0.00's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.000'MB, throughput = -nan'MB/sec zip my value time = 0.00's, unzip length = 0.493'GB zip my value throughput = 873436533.688'MB/sec zip pipeline throughput = 0.000'MB/sec entries = 24213485 avg-key = 24.00 avg-zkey = 1.68 avg-val = 20.34 avg-zval = 20.42 usrkeys = 24213485 avg-key = 16.00 avg-zkey = 1.68 avg-val = 20.34 avg-zval = 20.42 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 60141 UnZipSize{ index = 0.3874 GB value = 0.4926 GB dict = 0.00 MB all = 1.0737 GB } __ZipSize{ index = 0.0407 GB value = 0.4943 GB dict = 0.00 MB all = 0.5352 GB } UnZip/Zip{ index = 9.5294 value = 0.9965 dict = 0.00 all = 2.0063 } Zip/UnZip{ index = 0.1049 value = 1.0035 dict = 0.00 all = 0.4984 } ---------------------------- total value len = 11.115888 GB avg = 0.098 KB (by entry num) total key len = 2.776263 GB avg = 0.025 KB total ukey len = 1.846502 GB avg = 0.015 KB total ukey num = 0.126402686 Billion total entry num = 0.113210415 Billion write speed all = 0.290916406 MB/sec (with seq num) write speed all = 0.271950436 MB/sec (without seq num) 2024/11/23-22:11:05.851865 139957240342080 [compaction_job.cc:1948] [default] [JOB 36792] Generated table #282659: 24213485 keys, 535186650 bytes, temperature: kWarm 2024/11/23-22:11:05.851936 139957240342080 EVENT_LOG_v1 {"time_micros": 1732371065851901, "cf_name": "default", "job": 36792, "event": "table_file_creation", "file_number": 282659, "file_size": 535186650, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 494336608, "index_size": 40654848, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 581123640, "raw_average_key_size": 24, "raw_value_size": 492618205, "raw_average_value_size": 20, "num_data_blocks": 1, "num_entries": 24213485, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 24, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-ZipOffsetBlobStore", "creation_time": 1732371043, "oldest_key_time": 0, "file_creation_time": 1732371043, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 282659, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-22:11:06.033192 139957240342080 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282660.sst) /dev/shm/ToplingTemp/Topling-202257-gHjZXT 2024/11/23-22:11:11.500850 139957240342080 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282660.sst): first pass time = 5.47's, 63.746'MB/sec 2024/11/23-22:11:11.639187 139957240342080 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282660.sst): old prealloc_size = 1073741824, real_size = 175697664 2024/11/23-22:11:11.642185 139957240342080 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282660.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = ZipOffsetBlobStore usrkeys = 7854122 prefix = 4 raw-key = 0.0942 GB zip-key = 0.0132 GB avg-key = 12.00 avg-zkey = 1.68 raw-val = 0.1600 GB zip-val = 0.1605 GB avg-val = 20.38 avg-zval = 20.44 2024/11/23-22:11:11.642230 139957240342080 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282660.sst: sumWaitingMem = 0.023 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0226 GB, waited 0.000 sec, Key+Value = 0.349 GB 2024/11/23-22:11:13.150186 139957240342080 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282660.sst): second pass time = 0.00's,272175302.721'MB/sec, value only(45.9% of KV) wait indexing time = 0.14's, remap KeyValue time = 1.51's, 115.027'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 4431.260'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 2.710'MB/sec write SST data time = 0.78's, 221.873'MB/sec dict compress time = 0.00's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.000'MB, throughput = -nan'MB/sec zip my value time = 0.00's, unzip length = 0.160'GB zip my value throughput = 272175302.721'MB/sec zip pipeline throughput = 0.000'MB/sec entries = 7854122 avg-key = 24.00 avg-zkey = 1.68 avg-val = 20.38 avg-zval = 20.44 usrkeys = 7854122 avg-key = 16.00 avg-zkey = 1.68 avg-val = 20.38 avg-zval = 20.44 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 19543 UnZipSize{ index = 0.1257 GB value = 0.1600 GB dict = 0.00 MB all = 0.3485 GB } __ZipSize{ index = 0.0132 GB value = 0.1605 GB dict = 0.00 MB all = 0.1738 GB } UnZip/Zip{ index = 9.5300 value = 0.9968 dict = 0.00 all = 2.0053 } Zip/UnZip{ index = 0.1049 value = 1.0032 dict = 0.00 all = 0.4987 } ---------------------------- total value len = 11.275927 GB avg = 0.093 KB (by entry num) total key len = 2.964762 GB avg = 0.024 KB total ukey len = 1.972168 GB avg = 0.015 KB total ukey num = 0.134256808 Billion total entry num = 0.121064537 Billion write speed all = 0.298166055 MB/sec (with seq num) write speed all = 0.277887635 MB/sec (without seq num) 2024/11/23-22:11:13.330923 139957240342080 [compaction_job.cc:1948] [default] [JOB 36792] Generated table #282660: 7854122 keys, 173805972 bytes, temperature: kWarm 2024/11/23-22:11:13.331022 139957240342080 EVENT_LOG_v1 {"time_micros": 1732371073330958, "cf_name": "default", "job": 36792, "event": "table_file_creation", "file_number": 282660, "file_size": 173805972, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 160547632, "index_size": 13186304, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 188498928, "raw_average_key_size": 24, "raw_value_size": 160039078, "raw_average_value_size": 20, "num_data_blocks": 1, "num_entries": 7854122, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 24, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-ZipOffsetBlobStore", "creation_time": 1732371066, "oldest_key_time": 0, "file_creation_time": 1732371066, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 282660, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-22:11:13.399480 139957240342080 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282661.sst) /dev/shm/ToplingTemp/Topling-202257-1GEeDT 2024/11/23-22:11:19.453130 139957240342080 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282661.sst): first pass time = 6.05's, 177.372'MB/sec 2024/11/23-22:11:30.221274 139957240342080 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282661.sst): old prealloc_size = 1073741824, real_size = 291216464 2024/11/23-22:11:30.225606 139957240342080 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282661.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 7414056 prefix = 4 raw-key = 0.1186 GB zip-key = 0.0141 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.8661 GB zip-val = 0.2753 GB avg-val = 116.83 avg-zval = 37.13 2024/11/23-22:11:30.225658 139957240342080 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282661.sst: sumWaitingMem = 0.021 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0213 GB, waited 0.000 sec, Key+Value = 1.074 GB 2024/11/23-22:11:35.847227 139957240342080 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282661.sst): second pass time = 10.77's, 80.458'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 5.63's, 52.987'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3287.197'MB/sec (index lex order gen) rebuild zvType time = 4.63's, 0.401'MB/sec write SST data time = 0.99's, 299.869'MB/sec dict compress time = 0.00's, 8673194.000'MB/sec z-dict build time = 0.00's, sample length = 8.673'MB, throughput = 245497.863'MB/sec zip my value time = 10.77's, unzip length = 0.866'GB zip my value throughput = 80.458'MB/sec zip pipeline throughput = 80.458'MB/sec entries = 7414056 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.83 avg-zval = 37.13 usrkeys = 7414056 avg-key = 20.00 avg-zkey = 1.90 avg-val = 116.83 avg-zval = 37.13 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.1483 GB value = 0.8661 GB dict = 8.67 MB all = 1.0737 GB } __ZipSize{ index = 0.0141 GB value = 0.2753 GB dict = 8.67 MB all = 0.2981 GB } UnZip/Zip{ index = 10.5206 value = 3.1466 dict = 1.00 all = 3.6019 } Zip/UnZip{ index = 0.0951 value = 0.3178 dict = 1.00 all = 0.2776 } ---------------------------- total value len = 12.142076 GB avg = 0.095 KB (by entry num) total key len = 3.172356 GB avg = 0.025 KB total ukey len = 2.120449 GB avg = 0.015 KB total ukey num = 0.141670864 Billion total entry num = 0.128478593 Billion write speed all = 0.320495341 MB/sec (with seq num) write speed all = 0.298985282 MB/sec (without seq num) 2024/11/23-22:11:36.186366 139957240342080 [compaction_job.cc:1948] [default] [JOB 36792] Generated table #282661: 7414056 keys, 298104053 bytes, temperature: kWarm 2024/11/23-22:11:36.186439 139957240342080 EVENT_LOG_v1 {"time_micros": 1732371096186403, "cf_name": "default", "job": 36792, "event": "table_file_creation", "file_number": 282661, "file_size": 298104053, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 275268416, "index_size": 14094336, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 207593568, "raw_average_key_size": 28, "raw_value_size": 866148304, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 7414056, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732371073, "oldest_key_time": 0, "file_creation_time": 1732371073, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 282661, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-22:11:36.338397 139957240342080 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282662.sst) /dev/shm/ToplingTemp/Topling-202257-5gezQU 2024/11/23-22:11:44.332354 139957240342080 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282662.sst): first pass time = 7.99's, 134.320'MB/sec 2024/11/23-22:11:54.985647 139957240342080 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282662.sst): old prealloc_size = 1073741824, real_size = 290496576 2024/11/23-22:11:54.989902 139957240342080 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282662.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 7405869 prefix = 4 raw-key = 0.1185 GB zip-key = 0.0140 GB avg-key = 16.00 avg-zkey = 1.89 raw-val = 0.8664 GB zip-val = 0.2747 GB avg-val = 116.99 avg-zval = 37.09 2024/11/23-22:11:54.989946 139957240342080 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282662.sst: sumWaitingMem = 0.021 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0213 GB, waited 0.000 sec, Key+Value = 1.074 GB 2024/11/23-22:12:00.828443 139957240342080 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282662.sst): second pass time = 10.65's, 81.347'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 5.84's, 50.899'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3317.328'MB/sec (index lex order gen) rebuild zvType time = 4.83's, 0.383'MB/sec write SST data time = 1.01's, 294.347'MB/sec dict compress time = 0.00's, 8677260.000'MB/sec z-dict build time = 0.00's, sample length = 8.677'MB, throughput = 255431.397'MB/sec zip my value time = 10.65's, unzip length = 0.866'GB zip my value throughput = 81.347'MB/sec zip pipeline throughput = 81.347'MB/sec entries = 7405869 avg-key = 28.00 avg-zkey = 1.89 avg-val = 116.99 avg-zval = 37.09 usrkeys = 7405869 avg-key = 20.00 avg-zkey = 1.89 avg-val = 116.99 avg-zval = 37.09 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 8 UnZipSize{ index = 0.1481 GB value = 0.8664 GB dict = 8.68 MB all = 1.0737 GB } __ZipSize{ index = 0.0140 GB value = 0.2747 GB dict = 8.68 MB all = 0.2974 GB } UnZip/Zip{ index = 10.5900 value = 3.1544 dict = 1.00 all = 3.6105 } Zip/UnZip{ index = 0.0944 value = 0.3170 dict = 1.00 all = 0.2770 } ---------------------------- total value len = 13.008453 GB avg = 0.096 KB (by entry num) total key len = 3.379720 GB avg = 0.025 KB total ukey len = 2.268567 GB avg = 0.015 KB total ukey num = 0.149076733 Billion total entry num = 0.135884462 Billion write speed all = 0.342787047 MB/sec (with seq num) write speed all = 0.320048975 MB/sec (without seq num) 2024/11/23-22:12:01.158033 139957240342080 [compaction_job.cc:1948] [default] [JOB 36792] Generated table #282662: 7405869 keys, 297390231 bytes, temperature: kWarm 2024/11/23-22:12:01.158106 139957240342080 EVENT_LOG_v1 {"time_micros": 1732371121158070, "cf_name": "default", "job": 36792, "event": "table_file_creation", "file_number": 282662, "file_size": 297390231, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 274658416, "index_size": 13986496, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 207364332, "raw_average_key_size": 28, "raw_value_size": 866377618, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 7405869, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732371096, "oldest_key_time": 0, "file_creation_time": 1732371096, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 282662, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-22:12:01.316819 139957240342080 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282663.sst) /dev/shm/ToplingTemp/Topling-202257-5lzfFW 2024/11/23-22:12:08.848736 139957240342080 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282663.sst): first pass time = 7.53's, 142.560'MB/sec 2024/11/23-22:12:20.483717 139957240342080 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282663.sst): old prealloc_size = 1073741824, real_size = 291268032 2024/11/23-22:12:20.487828 139957240342080 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282663.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 7409018 prefix = 4 raw-key = 0.1185 GB zip-key = 0.0141 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.8663 GB zip-val = 0.2753 GB avg-val = 116.92 avg-zval = 37.16 2024/11/23-22:12:20.487876 139957240342080 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282663.sst: sumWaitingMem = 0.021 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0213 GB, waited 0.000 sec, Key+Value = 1.074 GB 2024/11/23-22:12:26.215442 139957240342080 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282663.sst): second pass time = 11.63's, 74.482'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 5.73's, 52.019'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3458.343'MB/sec (index lex order gen) rebuild zvType time = 4.73's, 0.392'MB/sec write SST data time = 1.00's, 298.344'MB/sec dict compress time = 0.00's, 8675870.000'MB/sec z-dict build time = 0.00's, sample length = 8.676'MB, throughput = 196175.692'MB/sec zip my value time = 11.63's, unzip length = 0.866'GB zip my value throughput = 74.482'MB/sec zip pipeline throughput = 74.482'MB/sec entries = 7409018 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.92 avg-zval = 37.16 usrkeys = 7409018 avg-key = 20.00 avg-zkey = 1.90 avg-val = 116.92 avg-zval = 37.16 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.1482 GB value = 0.8663 GB dict = 8.68 MB all = 1.0737 GB } __ZipSize{ index = 0.0141 GB value = 0.2753 GB dict = 8.68 MB all = 0.2982 GB } UnZip/Zip{ index = 10.5210 value = 3.1464 dict = 1.00 all = 3.6012 } Zip/UnZip{ index = 0.0950 value = 0.3178 dict = 1.00 all = 0.2777 } ---------------------------- total value len = 13.874743 GB avg = 0.097 KB (by entry num) total key len = 3.587173 GB avg = 0.025 KB total ukey len = 2.416747 GB avg = 0.015 KB total ukey num = 0.156485751 Billion total entry num = 0.143293480 Billion write speed all = 0.365052372 MB/sec (with seq num) write speed all = 0.341087247 MB/sec (without seq num) 2024/11/23-22:12:26.546413 139957240342080 [compaction_job.cc:1948] [default] [JOB 36792] Generated table #282663: 7409018 keys, 298159593 bytes, temperature: kWarm 2024/11/23-22:12:26.546483 139957240342080 EVENT_LOG_v1 {"time_micros": 1732371146546448, "cf_name": "default", "job": 36792, "event": "table_file_creation", "file_number": 282663, "file_size": 298159593, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 275331376, "index_size": 14084224, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 207452504, "raw_average_key_size": 28, "raw_value_size": 866289416, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 7409018, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732371121, "oldest_key_time": 0, "file_creation_time": 1732371121, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 282663, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-22:12:26.708857 139957240342080 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282664.sst) /dev/shm/ToplingTemp/Topling-202257-VvM6KW 2024/11/23-22:12:36.169360 139957240342080 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282664.sst): first pass time = 9.46's, 113.498'MB/sec 2024/11/23-22:12:48.489927 139957240342080 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282664.sst): old prealloc_size = 1073741824, real_size = 291382240 2024/11/23-22:12:48.495265 139957240342080 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282664.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 7411277 prefix = 4 raw-key = 0.1186 GB zip-key = 0.0141 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.8662 GB zip-val = 0.2754 GB avg-val = 116.88 avg-zval = 37.16 2024/11/23-22:12:48.495335 139957240342080 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282664.sst: sumWaitingMem = 0.021 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0213 GB, waited 0.000 sec, Key+Value = 1.074 GB 2024/11/23-22:12:55.316477 139957240342080 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282664.sst): second pass time = 12.32's, 70.332'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 6.83's, 43.693'MB/sec (all stages of remap) Get OrderMap time = 0.01's, 2663.757'MB/sec (index lex order gen) rebuild zvType time = 5.40's, 0.343'MB/sec write SST data time = 1.42's, 209.560'MB/sec dict compress time = 0.00's, 8674396.000'MB/sec z-dict build time = 0.00's, sample length = 8.674'MB, throughput = 257652.776'MB/sec zip my value time = 12.32's, unzip length = 0.866'GB zip my value throughput = 70.332'MB/sec zip pipeline throughput = 70.469'MB/sec entries = 7411277 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.88 avg-zval = 37.16 usrkeys = 7411277 avg-key = 20.00 avg-zkey = 1.90 avg-val = 116.88 avg-zval = 37.16 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 10 UnZipSize{ index = 0.1482 GB value = 0.8662 GB dict = 8.67 MB all = 1.0737 GB } __ZipSize{ index = 0.0141 GB value = 0.2754 GB dict = 8.67 MB all = 0.2983 GB } UnZip/Zip{ index = 10.5205 value = 3.1449 dict = 1.00 all = 3.5999 } Zip/UnZip{ index = 0.0951 value = 0.3180 dict = 1.00 all = 0.2778 } ---------------------------- total value len = 14.740969 GB avg = 0.098 KB (by entry num) total key len = 3.794688 GB avg = 0.025 KB total ukey len = 2.564973 GB avg = 0.016 KB total ukey num = 0.163897028 Billion total entry num = 0.150704757 Billion write speed all = 0.387264024 MB/sec (with seq num) write speed all = 0.362074724 MB/sec (without seq num) 2024/11/23-22:12:55.668427 139957240342080 [compaction_job.cc:1948] [default] [JOB 36792] Generated table #282664: 7411277 keys, 298271719 bytes, temperature: kWarm 2024/11/23-22:12:55.668519 139957240342080 EVENT_LOG_v1 {"time_micros": 1732371175668471, "cf_name": "default", "job": 36792, "event": "table_file_creation", "file_number": 282664, "file_size": 298271719, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 275440016, "index_size": 14089216, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 207515756, "raw_average_key_size": 28, "raw_value_size": 866226206, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 7411277, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732371146, "oldest_key_time": 0, "file_creation_time": 1732371146, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 282664, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-22:12:55.924744 139957240342080 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282665.sst) /dev/shm/ToplingTemp/Topling-202257-98tjsU 2024/11/23-22:13:03.845275 139957240342080 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282665.sst): first pass time = 7.92's, 135.565'MB/sec 2024/11/23-22:13:15.662479 139957240342080 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282665.sst): old prealloc_size = 1073741824, real_size = 290915760 2024/11/23-22:13:15.666595 139957240342080 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282665.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 7415378 prefix = 4 raw-key = 0.1186 GB zip-key = 0.0140 GB avg-key = 16.00 avg-zkey = 1.89 raw-val = 0.8661 GB zip-val = 0.2751 GB avg-val = 116.80 avg-zval = 37.09 2024/11/23-22:13:15.666644 139957240342080 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282665.sst: sumWaitingMem = 0.021 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0213 GB, waited 0.000 sec, Key+Value = 1.074 GB 2024/11/23-22:13:21.528154 139957240342080 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282665.sst): second pass time = 11.81's, 73.311'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 5.87's, 50.771'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3445.523'MB/sec (index lex order gen) rebuild zvType time = 4.86's, 0.381'MB/sec write SST data time = 1.00's, 297.718'MB/sec dict compress time = 0.00's, 8673612.000'MB/sec z-dict build time = 0.00's, sample length = 8.674'MB, throughput = 132733.633'MB/sec zip my value time = 11.81's, unzip length = 0.866'GB zip my value throughput = 73.311'MB/sec zip pipeline throughput = 81.872'MB/sec entries = 7415378 avg-key = 28.00 avg-zkey = 1.89 avg-val = 116.80 avg-zval = 37.09 usrkeys = 7415378 avg-key = 20.00 avg-zkey = 1.89 avg-val = 116.80 avg-zval = 37.09 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.1483 GB value = 0.8661 GB dict = 8.67 MB all = 1.0737 GB } __ZipSize{ index = 0.0140 GB value = 0.2751 GB dict = 8.67 MB all = 0.2978 GB } UnZip/Zip{ index = 10.5905 value = 3.1488 dict = 1.00 all = 3.6055 } Zip/UnZip{ index = 0.0944 value = 0.3176 dict = 1.00 all = 0.2774 } ---------------------------- total value len = 15.607080 GB avg = 0.099 KB (by entry num) total key len = 4.002319 GB avg = 0.025 KB total ukey len = 2.713280 GB avg = 0.016 KB total ukey num = 0.171312406 Billion total entry num = 0.158120135 Billion write speed all = 0.409473385 MB/sec (with seq num) write speed all = 0.383059118 MB/sec (without seq num) 2024/11/23-22:13:21.848616 139957240342080 [compaction_job.cc:1948] [default] [JOB 36792] Generated table #282665: 7415378 keys, 297803479 bytes, temperature: kWarm 2024/11/23-22:13:21.848665 139957240342080 EVENT_LOG_v1 {"time_micros": 1732371201848636, "cf_name": "default", "job": 36792, "event": "table_file_creation", "file_number": 282665, "file_size": 297803479, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 275057888, "index_size": 14003840, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 207630584, "raw_average_key_size": 28, "raw_value_size": 866111268, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 7415378, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732371175, "oldest_key_time": 0, "file_creation_time": 1732371175, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 282665, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-22:13:22.005261 139957240342080 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282666.sst) /dev/shm/ToplingTemp/Topling-202257-7OBfUV 2024/11/23-22:13:28.783461 139957240342080 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282666.sst): first pass time = 6.78's, 158.412'MB/sec 2024/11/23-22:13:38.679115 139957240342080 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282666.sst): old prealloc_size = 1073741824, real_size = 246600656 2024/11/23-22:13:38.682905 139957240342080 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282666.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 7385254 prefix = 4 raw-key = 0.1182 GB zip-key = 0.0141 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.8670 GB zip-val = 0.2306 GB avg-val = 117.39 avg-zval = 31.23 2024/11/23-22:13:38.682953 139957240342080 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282666.sst: sumWaitingMem = 0.021 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0212 GB, waited 0.000 sec, Key+Value = 1.074 GB 2024/11/23-22:13:44.643833 139957240342080 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282666.sst): second pass time = 9.89's, 87.631'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 5.96's, 42.501'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3775.857'MB/sec (index lex order gen) rebuild zvType time = 4.95's, 0.373'MB/sec write SST data time = 1.01's, 249.973'MB/sec dict compress time = 0.00's, 8681498.000'MB/sec z-dict build time = 0.00's, sample length = 8.681'MB, throughput = 263203.311'MB/sec zip my value time = 9.89's, unzip length = 0.867'GB zip my value throughput = 87.631'MB/sec zip pipeline throughput = 87.631'MB/sec entries = 7385254 avg-key = 28.00 avg-zkey = 1.91 avg-val = 117.39 avg-zval = 31.23 usrkeys = 7385254 avg-key = 20.00 avg-zkey = 1.91 avg-val = 117.39 avg-zval = 31.23 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 10 UnZipSize{ index = 0.1477 GB value = 0.8670 GB dict = 8.68 MB all = 1.0737 GB } __ZipSize{ index = 0.0141 GB value = 0.2306 GB dict = 8.68 MB all = 0.2535 GB } UnZip/Zip{ index = 10.4519 value = 3.7592 dict = 1.00 all = 4.2356 } Zip/UnZip{ index = 0.0957 value = 0.2660 dict = 1.00 all = 0.2361 } ---------------------------- total value len = 16.474035 GB avg = 0.100 KB (by entry num) total key len = 4.209106 GB avg = 0.025 KB total ukey len = 2.860985 GB avg = 0.016 KB total ukey num = 0.178697660 Billion total entry num = 0.165505389 Billion write speed all = 0.431686340 MB/sec (with seq num) write speed all = 0.404051692 MB/sec (without seq num) 2024/11/23-22:13:44.910535 139957240342080 [compaction_job.cc:1948] [default] [JOB 36792] Generated table #282666: 7385254 keys, 253503968 bytes, temperature: kWarm 2024/11/23-22:13:44.910609 139957240342080 EVENT_LOG_v1 {"time_micros": 1732371224910571, "cf_name": "default", "job": 36792, "event": "table_file_creation", "file_number": 282666, "file_size": 253503968, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 230622336, "index_size": 14131840, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 206787112, "raw_average_key_size": 28, "raw_value_size": 866954820, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 7385254, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732371201, "oldest_key_time": 0, "file_creation_time": 1732371201, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 282666, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-22:13:45.071601 139957240342080 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282667.sst) /dev/shm/ToplingTemp/Topling-202257-9Qnb9S 2024/11/23-22:13:51.916159 139957240342080 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282667.sst): first pass time = 6.84's, 156.876'MB/sec 2024/11/23-22:14:00.533816 139957240342080 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282667.sst): old prealloc_size = 1073741824, real_size = 197751984 2024/11/23-22:14:00.537949 139957240342080 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282667.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 7377436 prefix = 4 raw-key = 0.1180 GB zip-key = 0.0140 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.8672 GB zip-val = 0.1819 GB avg-val = 117.54 avg-zval = 24.65 2024/11/23-22:14:00.538010 139957240342080 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282667.sst: sumWaitingMem = 0.021 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0212 GB, waited 0.000 sec, Key+Value = 1.074 GB 2024/11/23-22:14:06.884938 139957240342080 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282667.sst): second pass time = 8.62's, 100.655'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 6.35's, 32.219'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3421.957'MB/sec (index lex order gen) rebuild zvType time = 5.33's, 0.346'MB/sec write SST data time = 1.02's, 201.469'MB/sec dict compress time = 0.00's, 8682524.000'MB/sec z-dict build time = 0.00's, sample length = 8.683'MB, throughput = 234586.729'MB/sec zip my value time = 8.62's, unzip length = 0.867'GB zip my value throughput = 100.655'MB/sec zip pipeline throughput = 100.655'MB/sec entries = 7377436 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.54 avg-zval = 24.65 usrkeys = 7377436 avg-key = 20.00 avg-zkey = 1.90 avg-val = 117.54 avg-zval = 24.65 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.1475 GB value = 0.8672 GB dict = 8.68 MB all = 1.0737 GB } __ZipSize{ index = 0.0140 GB value = 0.1819 GB dict = 8.68 MB all = 0.2046 GB } UnZip/Zip{ index = 10.5213 value = 4.7677 dict = 1.00 all = 5.2473 } Zip/UnZip{ index = 0.0950 value = 0.2097 dict = 1.00 all = 0.1906 } ---------------------------- total value len = 17.341209 GB avg = 0.100 KB (by entry num) total key len = 4.415674 GB avg = 0.026 KB total ukey len = 3.008534 GB avg = 0.016 KB total ukey num = 0.186075096 Billion total entry num = 0.172882825 Billion write speed all = 0.453886153 MB/sec (with seq num) write speed all = 0.425033079 MB/sec (without seq num) 2024/11/23-22:14:07.106788 139957240342080 [compaction_job.cc:1948] [default] [JOB 36792] Generated table #282667: 7377436 keys, 204628194 bytes, temperature: kWarm 2024/11/23-22:14:07.106859 139957240342080 EVENT_LOG_v1 {"time_micros": 1732371247106823, "cf_name": "default", "job": 36792, "event": "table_file_creation", "file_number": 282667, "file_size": 204628194, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 181883616, "index_size": 14023808, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 206568208, "raw_average_key_size": 28, "raw_value_size": 867173680, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 7377436, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732371225, "oldest_key_time": 0, "file_creation_time": 1732371225, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 282667, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-22:14:07.270075 139957240342080 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282668.sst) /dev/shm/ToplingTemp/Topling-202257-C0vjPT 2024/11/23-22:14:14.254450 139957240342080 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282668.sst): first pass time = 6.98's, 153.736'MB/sec 2024/11/23-22:14:23.264821 139957240342080 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282668.sst): old prealloc_size = 1073741824, real_size = 201529808 2024/11/23-22:14:23.269027 139957240342080 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282668.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 7378143 prefix = 4 raw-key = 0.1181 GB zip-key = 0.0140 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.8672 GB zip-val = 0.1857 GB avg-val = 117.53 avg-zval = 25.16 2024/11/23-22:14:23.269079 139957240342080 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282668.sst: sumWaitingMem = 0.021 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0212 GB, waited 0.000 sec, Key+Value = 1.074 GB 2024/11/23-22:14:29.544966 139957240342080 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282668.sst): second pass time = 9.01's, 96.280'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 6.28's, 33.185'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3362.097'MB/sec (index lex order gen) rebuild zvType time = 5.26's, 0.351'MB/sec write SST data time = 1.02's, 204.739'MB/sec dict compress time = 0.00's, 8683054.000'MB/sec z-dict build time = 0.00's, sample length = 8.683'MB, throughput = 217195.808'MB/sec zip my value time = 9.01's, unzip length = 0.867'GB zip my value throughput = 96.280'MB/sec zip pipeline throughput = 96.280'MB/sec entries = 7378143 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.53 avg-zval = 25.16 usrkeys = 7378143 avg-key = 20.00 avg-zkey = 1.90 avg-val = 117.53 avg-zval = 25.16 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.1476 GB value = 0.8672 GB dict = 8.68 MB all = 1.0737 GB } __ZipSize{ index = 0.0140 GB value = 0.1857 GB dict = 8.68 MB all = 0.2084 GB } UnZip/Zip{ index = 10.5209 value = 4.6707 dict = 1.00 all = 5.1522 } Zip/UnZip{ index = 0.0950 value = 0.2141 dict = 1.00 all = 0.1941 } ---------------------------- total value len = 18.208363 GB avg = 0.101 KB (by entry num) total key len = 4.622262 GB avg = 0.026 KB total ukey len = 3.156097 GB avg = 0.016 KB total ukey num = 0.193453239 Billion total entry num = 0.180260968 Billion write speed all = 0.476061217 MB/sec (with seq num) write speed all = 0.445990991 MB/sec (without seq num) 2024/11/23-22:14:29.785140 139957240342080 [compaction_job.cc:1948] [default] [JOB 36792] Generated table #282668: 7378143 keys, 208406452 bytes, temperature: kWarm 2024/11/23-22:14:29.785231 139957240342080 EVENT_LOG_v1 {"time_micros": 1732371269785186, "cf_name": "default", "job": 36792, "event": "table_file_creation", "file_number": 282668, "file_size": 208406452, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 185659456, "index_size": 14025664, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 206588004, "raw_average_key_size": 28, "raw_value_size": 867153910, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 7378143, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732371247, "oldest_key_time": 0, "file_creation_time": 1732371247, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 282668, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-22:14:29.939140 139957240342080 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282669.sst) /dev/shm/ToplingTemp/Topling-202257-lmollW 2024/11/23-22:14:36.792422 139957240342080 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282669.sst): first pass time = 6.85's, 156.677'MB/sec 2024/11/23-22:14:45.155400 139957240342080 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282669.sst): old prealloc_size = 1073741824, real_size = 202244144 2024/11/23-22:14:45.159615 139957240342080 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282669.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 7377349 prefix = 4 raw-key = 0.1180 GB zip-key = 0.0140 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.8672 GB zip-val = 0.1864 GB avg-val = 117.55 avg-zval = 25.26 2024/11/23-22:14:45.159664 139957240342080 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282669.sst: sumWaitingMem = 0.021 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0212 GB, waited 0.000 sec, Key+Value = 1.074 GB 2024/11/23-22:14:51.408211 139957240342080 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282669.sst): second pass time = 8.36's, 103.729'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 6.25's, 33.444'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3355.366'MB/sec (index lex order gen) rebuild zvType time = 5.23's, 0.353'MB/sec write SST data time = 1.02's, 204.792'MB/sec dict compress time = 0.00's, 8682956.000'MB/sec z-dict build time = 0.00's, sample length = 8.683'MB, throughput = 267521.829'MB/sec zip my value time = 8.36's, unzip length = 0.867'GB zip my value throughput = 103.729'MB/sec zip pipeline throughput = 103.729'MB/sec entries = 7377349 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.55 avg-zval = 25.26 usrkeys = 7377349 avg-key = 20.00 avg-zkey = 1.90 avg-val = 117.55 avg-zval = 25.26 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.1475 GB value = 0.8672 GB dict = 8.68 MB all = 1.0737 GB } __ZipSize{ index = 0.0140 GB value = 0.1864 GB dict = 8.68 MB all = 0.2091 GB } UnZip/Zip{ index = 10.5220 value = 4.6528 dict = 1.00 all = 5.1346 } Zip/UnZip{ index = 0.0950 value = 0.2149 dict = 1.00 all = 0.1948 } ---------------------------- total value len = 19.075539 GB avg = 0.102 KB (by entry num) total key len = 4.828828 GB avg = 0.026 KB total ukey len = 3.303644 GB avg = 0.016 KB total ukey num = 0.200830588 Billion total entry num = 0.187638317 Billion write speed all = 0.498223607 MB/sec (with seq num) write speed all = 0.466936993 MB/sec (without seq num) 2024/11/23-22:14:51.636404 139957240342080 [compaction_job.cc:1948] [default] [JOB 36792] Generated table #282669: 7377349 keys, 209120850 bytes, temperature: kWarm 2024/11/23-22:14:51.636474 139957240342080 EVENT_LOG_v1 {"time_micros": 1732371291636439, "cf_name": "default", "job": 36792, "event": "table_file_creation", "file_number": 282669, "file_size": 209120850, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 186376928, "index_size": 14022720, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 206565772, "raw_average_key_size": 28, "raw_value_size": 867176094, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 7377349, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732371269, "oldest_key_time": 0, "file_creation_time": 1732371269, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 282669, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-22:14:51.792742 139957240342080 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282670.sst) /dev/shm/ToplingTemp/Topling-202257-oLxufV 2024/11/23-22:14:58.525340 139957240342080 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282670.sst): first pass time = 6.73's, 159.485'MB/sec 2024/11/23-22:15:07.078612 139957240342080 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282670.sst): old prealloc_size = 1073741824, real_size = 198972672 2024/11/23-22:15:07.082726 139957240342080 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282670.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 7377899 prefix = 4 raw-key = 0.1180 GB zip-key = 0.0141 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.8672 GB zip-val = 0.1830 GB avg-val = 117.53 avg-zval = 24.81 2024/11/23-22:15:07.082773 139957240342080 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282670.sst: sumWaitingMem = 0.021 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0212 GB, waited 0.000 sec, Key+Value = 1.074 GB 2024/11/23-22:15:13.383656 139957240342080 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282670.sst): second pass time = 8.55's, 101.420'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 6.31's, 32.648'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3464.806'MB/sec (index lex order gen) rebuild zvType time = 5.28's, 0.349'MB/sec write SST data time = 1.02's, 201.143'MB/sec dict compress time = 0.00's, 8682908.000'MB/sec z-dict build time = 0.00's, sample length = 8.683'MB, throughput = 240437.183'MB/sec zip my value time = 8.55's, unzip length = 0.867'GB zip my value throughput = 101.420'MB/sec zip pipeline throughput = 101.420'MB/sec entries = 7377899 avg-key = 28.00 avg-zkey = 1.91 avg-val = 117.53 avg-zval = 24.81 usrkeys = 7377899 avg-key = 20.00 avg-zkey = 1.91 avg-val = 117.53 avg-zval = 24.81 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 10 UnZipSize{ index = 0.1476 GB value = 0.8672 GB dict = 8.68 MB all = 1.0737 GB } __ZipSize{ index = 0.0141 GB value = 0.1830 GB dict = 8.68 MB all = 0.2058 GB } UnZip/Zip{ index = 10.4518 value = 4.7383 dict = 1.00 all = 5.2162 } Zip/UnZip{ index = 0.0957 value = 0.2110 dict = 1.00 all = 0.1917 } ---------------------------- total value len = 19.942699 GB avg = 0.102 KB (by entry num) total key len = 5.035409 GB avg = 0.026 KB total ukey len = 3.451202 GB avg = 0.017 KB total ukey num = 0.208208487 Billion total entry num = 0.195016216 Billion write speed all = 0.520364594 MB/sec (with seq num) write speed all = 0.487862683 MB/sec (without seq num) 2024/11/23-22:15:13.607118 139957240342080 [compaction_job.cc:1948] [default] [JOB 36792] Generated table #282670: 7377899 keys, 205849122 bytes, temperature: kWarm 2024/11/23-22:15:13.607197 139957240342080 EVENT_LOG_v1 {"time_micros": 1732371313607160, "cf_name": "default", "job": 36792, "event": "table_file_creation", "file_number": 282670, "file_size": 205849122, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 183010032, "index_size": 14117952, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 206581172, "raw_average_key_size": 28, "raw_value_size": 867160754, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 7377899, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732371291, "oldest_key_time": 0, "file_creation_time": 1732371291, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 282670, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-22:15:13.775897 139957240342080 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282671.sst) /dev/shm/ToplingTemp/Topling-202257-y2IfmW 2024/11/23-22:15:18.954480 139957240342080 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282671.sst): first pass time = 5.18's, 202.967'MB/sec 2024/11/23-22:15:27.199047 139957240342080 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282671.sst): old prealloc_size = 1073741824, real_size = 189516880 2024/11/23-22:15:27.203062 139957240342080 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282671.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 7214096 prefix = 4 raw-key = 0.1154 GB zip-key = 0.0137 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.8491 GB zip-val = 0.1740 GB avg-val = 117.70 avg-zval = 24.12 2024/11/23-22:15:27.203110 139957240342080 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282671.sst: sumWaitingMem = 0.021 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0207 GB, waited 0.000 sec, Key+Value = 1.051 GB 2024/11/23-22:15:33.440140 139957240342080 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00/282671.sst): second pass time = 8.24's, 103.026'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 6.24's, 31.445'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3448.633'MB/sec (index lex order gen) rebuild zvType time = 5.23's, 0.345'MB/sec write SST data time = 1.00's, 195.388'MB/sec dict compress time = 0.00's, 8502098.000'MB/sec z-dict build time = 0.00's, sample length = 8.502'MB, throughput = 237495.405'MB/sec zip my value time = 8.24's, unzip length = 0.849'GB zip my value throughput = 103.026'MB/sec zip pipeline throughput = 103.026'MB/sec entries = 7214096 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.70 avg-zval = 24.12 usrkeys = 7214096 avg-key = 20.00 avg-zkey = 1.90 avg-val = 117.70 avg-zval = 24.12 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.1443 GB value = 0.8491 GB dict = 8.50 MB all = 1.0511 GB } __ZipSize{ index = 0.0137 GB value = 0.1740 GB dict = 8.50 MB all = 0.1963 GB } UnZip/Zip{ index = 10.5212 value = 4.8798 dict = 1.00 all = 5.3557 } Zip/UnZip{ index = 0.0950 value = 0.2049 dict = 1.00 all = 0.1867 } ---------------------------- total value len = 20.791776 GB avg = 0.103 KB (by entry num) total key len = 5.237404 GB avg = 0.026 KB total ukey len = 3.595484 GB avg = 0.017 KB total ukey num = 0.215422583 Billion total entry num = 0.202230312 Billion write speed all = 0.542034907 MB/sec (with seq num) write speed all = 0.508344753 MB/sec (without seq num) 2024/11/23-22:15:33.662942 139957240342080 [compaction_job.cc:1948] [default] [JOB 36792] Generated table #282671: 7214096 keys, 196252696 bytes, temperature: kWarm 2024/11/23-22:15:33.663034 139957240342080 EVENT_LOG_v1 {"time_micros": 1732371333662997, "cf_name": "default", "job": 36792, "event": "table_file_creation", "file_number": 282671, "file_size": 196252696, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 173999680, "index_size": 13713472, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 201994688, "raw_average_key_size": 28, "raw_value_size": 849077000, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 7214096, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732371313, "oldest_key_time": 0, "file_creation_time": 1732371313, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 282671, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-22:15:33.803698 139957240342080 [compaction_job.cc:703] job-36792: subcompact[0], size: 4.274336 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36792/att-00 [282654,282655,282656,282657,282658,282659,282660,282661,282662,282663,282664,282665,282666,282667,282668,282669,282670,282671] 2024/11/23-22:15:34.346509 139957240342080 (Original Log Time 2024/11/23-22:09:40.533197) EVENT_LOG_v1 {"time_micros": 1732370980533144, "job": 36792, "event": "compaction_started", "compaction_reason": "ManualCompaction", "files_L5": [281896, 281897, 281898, 281899, 281900, 281901, 281902, 281903, 281904, 281905, 281906, 281907, 281908, 281909, 281910, 281911, 281912, 281913, 282042, 282043, 282044, 282045, 282046, 282047, 282048, 282049, 282050, 282051, 282052, 282053, 282054, 282055], "score": -1, "input_data_size": 4369634787, "oldest_snapshot_seqno": 4291473253} 2024/11/23-22:15:34.346514 139957240342080 (Original Log Time 2024/11/23-22:15:34.323812) [compaction_job.cc:2022] [default] [JOB 36792] Compacted 32@5 files to L6 => 4274335769 bytes 2024/11/23-22:15:34.346515 139957240342080 (Original Log Time 2024/11/23-22:15:34.346431) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 0 0 0 18] max score 0.00, MB/sec: 12.4 rd, 12.1 wr, level 6, files in(32, 0) out(18 +0 blob) MB in(4167.2, 0.0 +0.0 blob) out(4076.3 +0.0 blob), read-write-amplify(2.0) write-amplify(1.0) OK, records in: 149872148, records dropped: 0 output_compression: Snappy 2024/11/23-22:15:34.346519 139957240342080 (Original Log Time 2024/11/23-22:15:34.346480) EVENT_LOG_v1 {"time_micros": 1732371334346457, "cf": "default", "job": 36792, "event": "compaction_finished", "compaction_time_micros": 353270515, "compaction_time_cpu_micros": 155911380, "output_level": 6, "num_output_files": 18, "total_output_size": 4274335769, "num_input_records": 149872148, "num_output_records": 149872148, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 2723867731, "file_range_sync_nanos": 0, "file_fsync_nanos": 12950, "file_prepare_write_nanos": 3758322, "lsm_state": [0, 0, 0, 0, 0, 0, 18]} 2024/11/23-22:15:34.485054 139957240342080 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732256054,"starts":1732370980,"executesMs":353935,"compactionJobId":36792,"attempt":0,"compactionInputRawBytes":15739739626,"compactionInputZipBytes":4369634787,"compactionOutputRawBytes":0,"compactionOutputZipBytes":4274335769,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-2fd40cd3759d34a4fd89a65197168488-27362b2f259f4e33-00"}}, response = 2024/11/23-22:15:34.485167 139957240342080 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-36792/att-00: olev 6, work 353.936 s, result 7.768 ms, install 22.723 ms, input{raw 14.659 GiB zip 4.070 GiB}