2024/11/21-22:29:55.957423 139783581591104 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00: fork to child time = 0.020064 sec 2024/11/21-22:29:55.958224 139783581591104 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00 2024/11/21-22:29:55.963656 139783581591104 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00 2024/11/21-22:29:55.964773 139783581591104 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/21-22:29:55.964993 139783581591104 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/21-22:29:56.031282 139783581591104 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-21T10.40.08/.rocksdb/job-27078/att-00/MANIFEST-130099 2024/11/21-22:29:56.045863 139783581591104 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-21T10.40.08/.rocksdb/job-27078/att-00/MANIFEST-130099 succeeded,manifest_file_number is 130099, next_file_number is 166283, last_sequence is 2666496400, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 166067 2024/11/21-22:29:56.045868 139783581591104 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/21-22:29:56.045975 139783581591104 [version_set.cc:5721] Creating manifest 166283 2024/11/21-22:29:56.081229 139783581591104 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00: bottommost_level: fake = 1, rpc = 1 2024/11/21-22:29:56.107281 139783581591104 [compaction_job.cc:2437] [default] [JOB 27078] Compacting 1@2 + 16@3 files to L3, score 0.98, subcompactions 1 : 1 2024/11/21-22:29:56.107294 139783581591104 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 26391 Base level 2, inputs: [166235(12MB)], [166269(40MB) 166270(814KB) 166177(1319KB) 166126(39MB) 166127(39MB) 166128(39MB) 166129(39MB) 166130(39MB) 166131(39MB) 166132(39MB) 166133(39MB) 166134(39MB) 166135(39MB) 166136(39MB) 166137(39MB) 166138(25MB)] 2024/11/21-22:29:56.111872 139783581591104 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/21-22:29:56.111898 139783581591104 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/21-22:29:56.111916 139783581591104 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/21-22:29:56.111921 139783581591104 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/21-22:29:56.111931 139783581591104 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/21-22:29:56.487847 139783581591104 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166284.sst) /dev/shm/ToplingTemp/Topling-587670-BDfEs2 2024/11/21-22:29:56.684973 139783581591104 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166284.sst): first pass time = 0.20's, 681.020'MB/sec 2024/11/21-22:29:57.737977 139783581591104 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166284.sst): old prealloc_size = 147639500, real_size = 40581232 2024/11/21-22:29:57.738124 139783581591104 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166284.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129429 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1017.00 avg-zval = 311.60 2024/11/21-22:29:57.738187 139783581591104 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166284.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/21-22:29:58.076129 139783581591104 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166284.sst): second pass time = 1.05's, 125.770'MB/sec, value only(98.1% of KV) wait indexing time = 0.01's, remap KeyValue time = 0.34's, 123.998'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1828.037'MB/sec (index lex order gen) rebuild zvType time = 0.27's, 0.120'MB/sec write SST data time = 0.07's, 612.881'MB/sec dict compress time = 0.00's, 1378157.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 43300.145'MB/sec zip my value time = 1.05's, unzip length = 0.132'GB zip my value throughput = 125.770'MB/sec zip pipeline throughput = 131.514'MB/sec entries = 129429 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1017.00 avg-zval = 311.60 usrkeys = 129429 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1017.00 avg-zval = 311.60 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0419 GB } UnZip/Zip{ index = 7.0980 value = 3.2638 dict = 1.00 all = 3.2011 } Zip/UnZip{ index = 0.1409 value = 0.3064 dict = 1.00 all = 0.3124 } ---------------------------- total value len = 360.122830 GB avg = 0.342 KB (by entry num) total key len = 27.048906 GB avg = 0.026 KB total ukey len = 28.488871 GB avg = 0.015 KB total ukey num = 1.960409179 Billion total entry num = 1.053424884 Billion write speed all = 7.907268192 MB/sec (with seq num) write speed all = 7.735154118 MB/sec (without seq num) 2024/11/21-22:29:58.116775 139783581591104 [compaction_job.cc:1948] [default] [JOB 27078] Generated table #166284: 129429 keys, 41928735 bytes, temperature: kWarm 2024/11/21-22:29:58.116888 139783581591104 EVENT_LOG_v1 {"time_micros": 1732199398116819, "cf_name": "default", "job": 27078, "event": "table_file_creation", "file_number": 166284, "file_size": 41928735, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 40329888, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588580, "raw_average_key_size": 20, "raw_value_size": 131629280, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129429, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732199396, "oldest_key_time": 0, "file_creation_time": 1732199396, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "DRFHGKF2T4P96U3FZ4Y6", "orig_file_number": 166284, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/21-22:29:58.201450 139783581591104 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166285.sst) /dev/shm/ToplingTemp/Topling-587670-8q5tS1 2024/11/21-22:29:58.953328 139783581591104 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166285.sst): first pass time = 0.75's, 178.522'MB/sec 2024/11/21-22:30:02.411721 139783581591104 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166285.sst): old prealloc_size = 147639500, real_size = 40531392 2024/11/21-22:30:02.411859 139783581591104 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166285.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129432 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1016.98 avg-zval = 311.21 2024/11/21-22:30:02.411904 139783581591104 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166285.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/21-22:30:02.683816 139783581591104 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166285.sst): second pass time = 3.46's, 38.070'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.27's, 153.926'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1927.130'MB/sec (index lex order gen) rebuild zvType time = 0.20's, 0.160'MB/sec write SST data time = 0.07's, 602.556'MB/sec dict compress time = 0.00's, 1377522.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 36430.816'MB/sec zip my value time = 3.46's, unzip length = 0.132'GB zip my value throughput = 38.070'MB/sec zip pipeline throughput = 189.172'MB/sec entries = 129432 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1016.98 avg-zval = 311.21 usrkeys = 129432 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1016.98 avg-zval = 311.21 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0419 GB } UnZip/Zip{ index = 7.0981 value = 3.2679 dict = 1.00 all = 3.2050 } Zip/UnZip{ index = 0.1409 value = 0.3060 dict = 1.00 all = 0.3120 } ---------------------------- total value len = 360.254459 GB avg = 0.342 KB (by entry num) total key len = 27.051495 GB avg = 0.026 KB total ukey len = 28.490424 GB avg = 0.015 KB total ukey num = 1.960538611 Billion total entry num = 1.053554316 Billion write speed all = 7.909265061 MB/sec (with seq num) write speed all = 7.737146037 MB/sec (without seq num) 2024/11/21-22:30:02.723175 139783581591104 [compaction_job.cc:1948] [default] [JOB 27078] Generated table #166285: 129432 keys, 41878244 bytes, temperature: kWarm 2024/11/21-22:30:02.723253 139783581591104 EVENT_LOG_v1 {"time_micros": 1732199402723211, "cf_name": "default", "job": 27078, "event": "table_file_creation", "file_number": 166285, "file_size": 41878244, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 40280048, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588640, "raw_average_key_size": 20, "raw_value_size": 131629598, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129432, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732199398, "oldest_key_time": 0, "file_creation_time": 1732199398, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "DRFHGKF2T4P96U3FZ4Y6", "orig_file_number": 166285, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/21-22:30:02.803052 139783581591104 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166286.sst) /dev/shm/ToplingTemp/Topling-587670-XSEPo5 2024/11/21-22:30:03.279994 139783581591104 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166286.sst): first pass time = 0.48's, 281.443'MB/sec 2024/11/21-22:30:04.533063 139783581591104 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166286.sst): old prealloc_size = 147639500, real_size = 40353616 2024/11/21-22:30:04.533190 139783581591104 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166286.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1016.99 avg-zval = 309.84 2024/11/21-22:30:04.533232 139783581591104 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166286.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/21-22:30:04.835036 139783581591104 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166286.sst): second pass time = 1.25's, 105.103'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.30's, 138.107'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2142.986'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.140'MB/sec write SST data time = 0.07's, 592.876'MB/sec dict compress time = 0.00's, 1377776.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 43911.780'MB/sec zip my value time = 1.25's, unzip length = 0.132'GB zip my value throughput = 105.103'MB/sec zip pipeline throughput = 147.264'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1016.99 avg-zval = 309.84 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1016.99 avg-zval = 309.84 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0981 value = 3.2824 dict = 1.00 all = 3.2186 } Zip/UnZip{ index = 0.1409 value = 0.3047 dict = 1.00 all = 0.3107 } ---------------------------- total value len = 360.386089 GB avg = 0.342 KB (by entry num) total key len = 27.054083 GB avg = 0.026 KB total ukey len = 28.491978 GB avg = 0.015 KB total ukey num = 1.960668042 Billion total entry num = 1.053683747 Billion write speed all = 7.911658403 MB/sec (with seq num) write speed all = 7.739525796 MB/sec (without seq num) 2024/11/21-22:30:04.880441 139783581591104 [compaction_job.cc:1948] [default] [JOB 27078] Generated table #166286: 129431 keys, 41700706 bytes, temperature: kWarm 2024/11/21-22:30:04.880531 139783581591104 EVENT_LOG_v1 {"time_micros": 1732199404880477, "cf_name": "default", "job": 27078, "event": "table_file_creation", "file_number": 166286, "file_size": 41700706, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 40102272, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131629791, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732199402, "oldest_key_time": 0, "file_creation_time": 1732199402, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "DRFHGKF2T4P96U3FZ4Y6", "orig_file_number": 166286, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/21-22:30:04.945138 139783581591104 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166287.sst) /dev/shm/ToplingTemp/Topling-587670-1X40j5 2024/11/21-22:30:05.579506 139783581591104 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166287.sst): first pass time = 0.63's, 211.593'MB/sec 2024/11/21-22:30:08.676920 139783581591104 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166287.sst): old prealloc_size = 147639500, real_size = 40356544 2024/11/21-22:30:08.677065 139783581591104 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166287.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129424 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1017.04 avg-zval = 309.87 2024/11/21-22:30:08.677112 139783581591104 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166287.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/21-22:30:08.908955 139783581591104 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166287.sst): second pass time = 3.10's, 42.509'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.23's, 179.754'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1818.511'MB/sec (index lex order gen) rebuild zvType time = 0.16's, 0.201'MB/sec write SST data time = 0.07's, 590.996'MB/sec dict compress time = 0.00's, 1378413.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 44867.294'MB/sec zip my value time = 3.10's, unzip length = 0.132'GB zip my value throughput = 42.509'MB/sec zip pipeline throughput = 170.226'MB/sec entries = 129424 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1017.04 avg-zval = 309.87 usrkeys = 129424 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1017.04 avg-zval = 309.87 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0977 value = 3.2821 dict = 1.00 all = 3.2183 } Zip/UnZip{ index = 0.1409 value = 0.3047 dict = 1.00 all = 0.3107 } ---------------------------- total value len = 360.517719 GB avg = 0.342 KB (by entry num) total key len = 27.056672 GB avg = 0.026 KB total ukey len = 28.493531 GB avg = 0.015 KB total ukey num = 1.960797466 Billion total entry num = 1.053813171 Billion write speed all = 7.913740830 MB/sec (with seq num) write speed all = 7.741601400 MB/sec (without seq num) 2024/11/21-22:30:08.952809 139783581591104 [compaction_job.cc:1948] [default] [JOB 27078] Generated table #166287: 129424 keys, 41704287 bytes, temperature: kWarm 2024/11/21-22:30:08.952870 139783581591104 EVENT_LOG_v1 {"time_micros": 1732199408952833, "cf_name": "default", "job": 27078, "event": "table_file_creation", "file_number": 166287, "file_size": 41704287, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 40105200, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588480, "raw_average_key_size": 20, "raw_value_size": 131629532, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129424, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732199404, "oldest_key_time": 0, "file_creation_time": 1732199404, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "DRFHGKF2T4P96U3FZ4Y6", "orig_file_number": 166287, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/21-22:30:09.034717 139783581591104 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166288.sst) /dev/shm/ToplingTemp/Topling-587670-gO9rv4 2024/11/21-22:30:09.631504 139783581591104 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166288.sst): first pass time = 0.60's, 224.921'MB/sec 2024/11/21-22:30:11.921284 139783581591104 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166288.sst): old prealloc_size = 147639500, real_size = 40356896 2024/11/21-22:30:11.921420 139783581591104 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166288.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129426 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1017.03 avg-zval = 309.87 2024/11/21-22:30:11.921464 139783581591104 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166288.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/21-22:30:12.314554 139783581591104 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166288.sst): second pass time = 2.29's, 57.503'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.39's, 106.056'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1970.339'MB/sec (index lex order gen) rebuild zvType time = 0.30's, 0.107'MB/sec write SST data time = 0.09's, 460.395'MB/sec dict compress time = 0.00's, 1377798.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 43635.724'MB/sec zip my value time = 2.29's, unzip length = 0.132'GB zip my value throughput = 57.503'MB/sec zip pipeline throughput = 121.228'MB/sec entries = 129426 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1017.03 avg-zval = 309.87 usrkeys = 129426 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1017.03 avg-zval = 309.87 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 8 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0978 value = 3.2821 dict = 1.00 all = 3.2184 } Zip/UnZip{ index = 0.1409 value = 0.3047 dict = 1.00 all = 0.3107 } ---------------------------- total value len = 360.649349 GB avg = 0.342 KB (by entry num) total key len = 27.059260 GB avg = 0.026 KB total ukey len = 28.495084 GB avg = 0.015 KB total ukey num = 1.960926892 Billion total entry num = 1.053942597 Billion write speed all = 7.915930930 MB/sec (with seq num) write speed all = 7.743782329 MB/sec (without seq num) 2024/11/21-22:30:12.357118 139783581591104 [compaction_job.cc:1948] [default] [JOB 27078] Generated table #166288: 129426 keys, 41703992 bytes, temperature: kWarm 2024/11/21-22:30:12.357201 139783581591104 EVENT_LOG_v1 {"time_micros": 1732199412357158, "cf_name": "default", "job": 27078, "event": "table_file_creation", "file_number": 166288, "file_size": 41703992, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 40105552, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588520, "raw_average_key_size": 20, "raw_value_size": 131629717, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129426, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732199409, "oldest_key_time": 0, "file_creation_time": 1732199409, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "DRFHGKF2T4P96U3FZ4Y6", "orig_file_number": 166288, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/21-22:30:12.430774 139783581591104 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166289.sst) /dev/shm/ToplingTemp/Topling-587670-S0LoU1 2024/11/21-22:30:13.134075 139783581591104 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166289.sst): first pass time = 0.70's, 190.852'MB/sec 2024/11/21-22:30:14.320778 139783581591104 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166289.sst): old prealloc_size = 147639500, real_size = 40353232 2024/11/21-22:30:14.320915 139783581591104 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166289.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1016.99 avg-zval = 309.83 2024/11/21-22:30:14.320962 139783581591104 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166289.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/21-22:30:14.565577 139783581591104 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166289.sst): second pass time = 1.18's, 111.104'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.24's, 170.346'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1917.420'MB/sec (index lex order gen) rebuild zvType time = 0.19's, 0.166'MB/sec write SST data time = 0.05's, 838.988'MB/sec dict compress time = 0.00's, 1377971.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 33869.264'MB/sec zip my value time = 1.18's, unzip length = 0.132'GB zip my value throughput = 111.104'MB/sec zip pipeline throughput = 150.649'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1016.99 avg-zval = 309.83 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1016.99 avg-zval = 309.83 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0981 value = 3.2824 dict = 1.00 all = 3.2186 } Zip/UnZip{ index = 0.1409 value = 0.3047 dict = 1.00 all = 0.3107 } ---------------------------- total value len = 360.780978 GB avg = 0.342 KB (by entry num) total key len = 27.061849 GB avg = 0.026 KB total ukey len = 28.496637 GB avg = 0.015 KB total ukey num = 1.961056323 Billion total entry num = 1.054072028 Billion write speed all = 7.918307361 MB/sec (with seq num) write speed all = 7.746145532 MB/sec (without seq num) 2024/11/21-22:30:14.604826 139783581591104 [compaction_job.cc:1948] [default] [JOB 27078] Generated table #166289: 129431 keys, 41700517 bytes, temperature: kWarm 2024/11/21-22:30:14.604878 139783581591104 EVENT_LOG_v1 {"time_micros": 1732199414604848, "cf_name": "default", "job": 27078, "event": "table_file_creation", "file_number": 166289, "file_size": 41700517, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 40101888, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131629441, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732199412, "oldest_key_time": 0, "file_creation_time": 1732199412, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "DRFHGKF2T4P96U3FZ4Y6", "orig_file_number": 166289, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/21-22:30:14.644826 139783581591104 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166290.sst) /dev/shm/ToplingTemp/Topling-587670-Sluza3 2024/11/21-22:30:15.100050 139783581591104 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166290.sst): first pass time = 0.46's, 294.861'MB/sec 2024/11/21-22:30:17.252986 139783581591104 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166290.sst): old prealloc_size = 147639500, real_size = 40354128 2024/11/21-22:30:17.253128 139783581591104 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166290.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129428 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1017.01 avg-zval = 309.85 2024/11/21-22:30:17.253188 139783581591104 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166290.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/21-22:30:17.577169 139783581591104 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166290.sst): second pass time = 2.15's, 61.158'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.32's, 128.644'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1868.338'MB/sec (index lex order gen) rebuild zvType time = 0.26's, 0.126'MB/sec write SST data time = 0.07's, 620.255'MB/sec dict compress time = 0.00's, 1378001.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 42085.362'MB/sec zip my value time = 2.15's, unzip length = 0.132'GB zip my value throughput = 61.158'MB/sec zip pipeline throughput = 194.282'MB/sec entries = 129428 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1017.01 avg-zval = 309.85 usrkeys = 129428 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1017.01 avg-zval = 309.85 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0979 value = 3.2823 dict = 1.00 all = 3.2186 } Zip/UnZip{ index = 0.1409 value = 0.3047 dict = 1.00 all = 0.3107 } ---------------------------- total value len = 360.912608 GB avg = 0.342 KB (by entry num) total key len = 27.064437 GB avg = 0.026 KB total ukey len = 28.498190 GB avg = 0.015 KB total ukey num = 1.961185751 Billion total entry num = 1.054201456 Billion write speed all = 7.920560601 MB/sec (with seq num) write speed all = 7.748388219 MB/sec (without seq num) 2024/11/21-22:30:17.622427 139783581591104 [compaction_job.cc:1948] [default] [JOB 27078] Generated table #166290: 129428 keys, 41701443 bytes, temperature: kWarm 2024/11/21-22:30:17.622503 139783581591104 EVENT_LOG_v1 {"time_micros": 1732199417622461, "cf_name": "default", "job": 27078, "event": "table_file_creation", "file_number": 166290, "file_size": 41701443, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 40102784, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588560, "raw_average_key_size": 20, "raw_value_size": 131629679, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129428, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732199414, "oldest_key_time": 0, "file_creation_time": 1732199414, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "DRFHGKF2T4P96U3FZ4Y6", "orig_file_number": 166290, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/21-22:30:17.691243 139783581591104 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166291.sst) /dev/shm/ToplingTemp/Topling-587670-XTS1U1 2024/11/21-22:30:18.349523 139783581591104 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166291.sst): first pass time = 0.66's, 203.910'MB/sec 2024/11/21-22:30:19.195711 139783581591104 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166291.sst): old prealloc_size = 147639500, real_size = 40351472 2024/11/21-22:30:19.195847 139783581591104 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166291.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129430 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1016.99 avg-zval = 309.82 2024/11/21-22:30:19.195894 139783581591104 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166291.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/21-22:30:19.433976 139783581591104 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166291.sst): second pass time = 0.84's, 155.866'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.24's, 175.031'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1941.562'MB/sec (index lex order gen) rebuild zvType time = 0.17's, 0.188'MB/sec write SST data time = 0.07's, 632.309'MB/sec dict compress time = 0.00's, 1378103.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 45585.756'MB/sec zip my value time = 0.84's, unzip length = 0.132'GB zip my value throughput = 155.866'MB/sec zip pipeline throughput = 159.271'MB/sec entries = 129430 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1016.99 avg-zval = 309.82 usrkeys = 129430 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1016.99 avg-zval = 309.82 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0980 value = 3.2825 dict = 1.00 all = 3.2187 } Zip/UnZip{ index = 0.1409 value = 0.3046 dict = 1.00 all = 0.3107 } ---------------------------- total value len = 361.044237 GB avg = 0.342 KB (by entry num) total key len = 27.067026 GB avg = 0.026 KB total ukey len = 28.499743 GB avg = 0.015 KB total ukey num = 1.961315181 Billion total entry num = 1.054330886 Billion write speed all = 7.923000333 MB/sec (with seq num) write speed all = 7.750813339 MB/sec (without seq num) 2024/11/21-22:30:19.475897 139783581591104 [compaction_job.cc:1948] [default] [JOB 27078] Generated table #166291: 129430 keys, 41698921 bytes, temperature: kWarm 2024/11/21-22:30:19.475973 139783581591104 EVENT_LOG_v1 {"time_micros": 1732199419475932, "cf_name": "default", "job": 27078, "event": "table_file_creation", "file_number": 166291, "file_size": 41698921, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 40100128, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588600, "raw_average_key_size": 20, "raw_value_size": 131629557, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129430, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732199417, "oldest_key_time": 0, "file_creation_time": 1732199417, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "DRFHGKF2T4P96U3FZ4Y6", "orig_file_number": 166291, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/21-22:30:19.540072 139783581591104 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166292.sst) /dev/shm/ToplingTemp/Topling-587670-Ucrzn3 2024/11/21-22:30:20.263814 139783581591104 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166292.sst): first pass time = 0.72's, 185.462'MB/sec 2024/11/21-22:30:21.107314 139783581591104 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166292.sst): old prealloc_size = 147639500, real_size = 40352768 2024/11/21-22:30:21.107431 139783581591104 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166292.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129435 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1016.96 avg-zval = 309.82 2024/11/21-22:30:21.107463 139783581591104 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166292.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/21-22:30:21.259641 139783581591104 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166292.sst): second pass time = 0.84's, 156.152'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.15's, 273.806'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2287.267'MB/sec (index lex order gen) rebuild zvType time = 0.10's, 0.309'MB/sec write SST data time = 0.05's, 880.213'MB/sec dict compress time = 0.00's, 1377844.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 32631.001'MB/sec zip my value time = 0.84's, unzip length = 0.132'GB zip my value throughput = 156.152'MB/sec zip pipeline throughput = 156.152'MB/sec entries = 129435 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1016.96 avg-zval = 309.82 usrkeys = 129435 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1016.96 avg-zval = 309.82 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0983 value = 3.2824 dict = 1.00 all = 3.2187 } Zip/UnZip{ index = 0.1409 value = 0.3047 dict = 1.00 all = 0.3107 } ---------------------------- total value len = 361.175867 GB avg = 0.343 KB (by entry num) total key len = 27.069615 GB avg = 0.026 KB total ukey len = 28.501297 GB avg = 0.015 KB total ukey num = 1.961444616 Billion total entry num = 1.054460321 Billion write speed all = 7.925444921 MB/sec (with seq num) write speed all = 7.753243207 MB/sec (without seq num) 2024/11/21-22:30:21.296812 139783581591104 [compaction_job.cc:1948] [default] [JOB 27078] Generated table #166292: 129435 keys, 41699942 bytes, temperature: kWarm 2024/11/21-22:30:21.296869 139783581591104 EVENT_LOG_v1 {"time_micros": 1732199421296840, "cf_name": "default", "job": 27078, "event": "table_file_creation", "file_number": 166292, "file_size": 41699942, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 40101424, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588700, "raw_average_key_size": 20, "raw_value_size": 131629665, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129435, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732199419, "oldest_key_time": 0, "file_creation_time": 1732199419, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "DRFHGKF2T4P96U3FZ4Y6", "orig_file_number": 166292, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/21-22:30:21.339672 139783581591104 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166293.sst) /dev/shm/ToplingTemp/Topling-587670-u8kwu1 2024/11/21-22:30:21.851343 139783581591104 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166293.sst): first pass time = 0.51's, 262.329'MB/sec 2024/11/21-22:30:22.626062 139783581591104 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166293.sst): old prealloc_size = 147639500, real_size = 40351312 2024/11/21-22:30:22.626177 139783581591104 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166293.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1016.98 avg-zval = 309.82 2024/11/21-22:30:22.626207 139783581591104 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166293.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/21-22:30:22.780541 139783581591104 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166293.sst): second pass time = 0.77's, 170.054'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.15's, 269.965'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2333.390'MB/sec (index lex order gen) rebuild zvType time = 0.10's, 0.311'MB/sec write SST data time = 0.05's, 829.397'MB/sec dict compress time = 0.00's, 1378074.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 37027.084'MB/sec zip my value time = 0.77's, unzip length = 0.132'GB zip my value throughput = 170.054'MB/sec zip pipeline throughput = 170.054'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1016.98 avg-zval = 309.82 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1016.98 avg-zval = 309.82 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0981 value = 3.2825 dict = 1.00 all = 3.2188 } Zip/UnZip{ index = 0.1409 value = 0.3046 dict = 1.00 all = 0.3107 } ---------------------------- total value len = 361.307496 GB avg = 0.343 KB (by entry num) total key len = 27.072203 GB avg = 0.026 KB total ukey len = 28.502850 GB avg = 0.015 KB total ukey num = 1.961574047 Billion total entry num = 1.054589752 Billion write speed all = 7.927938636 MB/sec (with seq num) write speed all = 7.755721132 MB/sec (without seq num) 2024/11/21-22:30:22.817091 139783581591104 [compaction_job.cc:1948] [default] [JOB 27078] Generated table #166293: 129431 keys, 41698700 bytes, temperature: kWarm 2024/11/21-22:30:22.817151 139783581591104 EVENT_LOG_v1 {"time_micros": 1732199422817119, "cf_name": "default", "job": 27078, "event": "table_file_creation", "file_number": 166293, "file_size": 41698700, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 40099968, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131629163, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732199421, "oldest_key_time": 0, "file_creation_time": 1732199421, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "DRFHGKF2T4P96U3FZ4Y6", "orig_file_number": 166293, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/21-22:30:22.854178 139783581591104 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166294.sst) /dev/shm/ToplingTemp/Topling-587670-XNlG31 2024/11/21-22:30:23.336487 139783581591104 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166294.sst): first pass time = 0.48's, 278.301'MB/sec 2024/11/21-22:30:24.105389 139783581591104 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166294.sst): old prealloc_size = 147639500, real_size = 40356832 2024/11/21-22:30:24.105507 139783581591104 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166294.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129429 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1017.01 avg-zval = 309.86 2024/11/21-22:30:24.105550 139783581591104 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166294.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/21-22:30:24.259685 139783581591104 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166294.sst): second pass time = 0.77's, 171.348'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.15's, 270.295'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2072.259'MB/sec (index lex order gen) rebuild zvType time = 0.10's, 0.312'MB/sec write SST data time = 0.05's, 826.635'MB/sec dict compress time = 0.00's, 1377897.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 33683.648'MB/sec zip my value time = 0.77's, unzip length = 0.132'GB zip my value throughput = 171.348'MB/sec zip pipeline throughput = 171.348'MB/sec entries = 129429 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1017.01 avg-zval = 309.86 usrkeys = 129429 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1017.01 avg-zval = 309.86 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 8 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0980 value = 3.2821 dict = 1.00 all = 3.2184 } Zip/UnZip{ index = 0.1409 value = 0.3047 dict = 1.00 all = 0.3107 } ---------------------------- total value len = 361.439126 GB avg = 0.343 KB (by entry num) total key len = 27.074792 GB avg = 0.026 KB total ukey len = 28.504403 GB avg = 0.015 KB total ukey num = 1.961703476 Billion total entry num = 1.054719181 Billion write speed all = 7.930438971 MB/sec (with seq num) write speed all = 7.758205531 MB/sec (without seq num) 2024/11/21-22:30:24.295608 139783581591104 [compaction_job.cc:1948] [default] [JOB 27078] Generated table #166294: 129429 keys, 41704027 bytes, temperature: kWarm 2024/11/21-22:30:24.295669 139783581591104 EVENT_LOG_v1 {"time_micros": 1732199424295638, "cf_name": "default", "job": 27078, "event": "table_file_creation", "file_number": 166294, "file_size": 41704027, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 40105488, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588580, "raw_average_key_size": 20, "raw_value_size": 131629959, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129429, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732199422, "oldest_key_time": 0, "file_creation_time": 1732199422, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "DRFHGKF2T4P96U3FZ4Y6", "orig_file_number": 166294, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/21-22:30:24.362638 139783581591104 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166295.sst) /dev/shm/ToplingTemp/Topling-587670-Yh4je4 2024/11/21-22:30:24.930804 139783581591104 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166295.sst): first pass time = 0.57's, 236.243'MB/sec 2024/11/21-22:30:25.709538 139783581591104 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166295.sst): old prealloc_size = 147639500, real_size = 40356528 2024/11/21-22:30:25.709664 139783581591104 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166295.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129427 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1017.02 avg-zval = 309.87 2024/11/21-22:30:25.709695 139783581591104 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166295.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/21-22:30:25.861776 139783581591104 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166295.sst): second pass time = 0.78's, 169.339'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.15's, 273.954'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2115.472'MB/sec (index lex order gen) rebuild zvType time = 0.10's, 0.316'MB/sec write SST data time = 0.05's, 840.521'MB/sec dict compress time = 0.00's, 1377932.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 36158.602'MB/sec zip my value time = 0.78's, unzip length = 0.132'GB zip my value throughput = 169.339'MB/sec zip pipeline throughput = 169.339'MB/sec entries = 129427 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1017.02 avg-zval = 309.87 usrkeys = 129427 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1017.02 avg-zval = 309.87 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0979 value = 3.2821 dict = 1.00 all = 3.2184 } Zip/UnZip{ index = 0.1409 value = 0.3047 dict = 1.00 all = 0.3107 } ---------------------------- total value len = 361.570755 GB avg = 0.343 KB (by entry num) total key len = 27.077380 GB avg = 0.026 KB total ukey len = 28.505956 GB avg = 0.015 KB total ukey num = 1.961832903 Billion total entry num = 1.054848608 Billion write speed all = 7.932919234 MB/sec (with seq num) write speed all = 7.760670291 MB/sec (without seq num) 2024/11/21-22:30:25.902834 139783581591104 [compaction_job.cc:1948] [default] [JOB 27078] Generated table #166295: 129427 keys, 41703806 bytes, temperature: kWarm 2024/11/21-22:30:25.902898 139783581591104 EVENT_LOG_v1 {"time_micros": 1732199425902865, "cf_name": "default", "job": 27078, "event": "table_file_creation", "file_number": 166295, "file_size": 41703806, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 40105184, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588540, "raw_average_key_size": 20, "raw_value_size": 131629316, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129427, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732199424, "oldest_key_time": 0, "file_creation_time": 1732199424, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "DRFHGKF2T4P96U3FZ4Y6", "orig_file_number": 166295, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/21-22:30:25.940294 139783581591104 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166296.sst) /dev/shm/ToplingTemp/Topling-587670-s6kHp2 2024/11/21-22:30:26.376645 139783581591104 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166296.sst): first pass time = 0.44's, 307.621'MB/sec 2024/11/21-22:30:27.153298 139783581591104 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166296.sst): old prealloc_size = 147639500, real_size = 40355200 2024/11/21-22:30:27.153410 139783581591104 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166296.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129426 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1017.03 avg-zval = 309.86 2024/11/21-22:30:27.153442 139783581591104 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166296.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/21-22:30:27.306974 139783581591104 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166296.sst): second pass time = 0.78's, 169.811'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.15's, 271.399'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2407.879'MB/sec (index lex order gen) rebuild zvType time = 0.10's, 0.309'MB/sec write SST data time = 0.05's, 853.320'MB/sec dict compress time = 0.00's, 1378104.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 38876.777'MB/sec zip my value time = 0.78's, unzip length = 0.132'GB zip my value throughput = 169.811'MB/sec zip pipeline throughput = 169.811'MB/sec entries = 129426 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1017.03 avg-zval = 309.86 usrkeys = 129426 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1017.03 avg-zval = 309.86 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0978 value = 3.2822 dict = 1.00 all = 3.2185 } Zip/UnZip{ index = 0.1409 value = 0.3047 dict = 1.00 all = 0.3107 } ---------------------------- total value len = 361.702385 GB avg = 0.343 KB (by entry num) total key len = 27.079969 GB avg = 0.026 KB total ukey len = 28.507509 GB avg = 0.015 KB total ukey num = 1.961962329 Billion total entry num = 1.054978034 Billion write speed all = 7.935424757 MB/sec (with seq num) write speed all = 7.763159762 MB/sec (without seq num) 2024/11/21-22:30:27.347537 139783581591104 [compaction_job.cc:1948] [default] [JOB 27078] Generated table #166296: 129426 keys, 41702634 bytes, temperature: kWarm 2024/11/21-22:30:27.347611 139783581591104 EVENT_LOG_v1 {"time_micros": 1732199427347569, "cf_name": "default", "job": 27078, "event": "table_file_creation", "file_number": 166296, "file_size": 41702634, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 40103856, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588520, "raw_average_key_size": 20, "raw_value_size": 131629886, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129426, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732199425, "oldest_key_time": 0, "file_creation_time": 1732199425, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "DRFHGKF2T4P96U3FZ4Y6", "orig_file_number": 166296, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/21-22:30:27.385827 139783581591104 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166297.sst) /dev/shm/ToplingTemp/Topling-587670-22iJh5 2024/11/21-22:30:27.705604 139783581591104 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166297.sst): first pass time = 0.32's, 294.076'MB/sec 2024/11/21-22:30:28.270797 139783581591104 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166297.sst): old prealloc_size = 147639500, real_size = 28171832 2024/11/21-22:30:28.270840 139783581591104 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166297.sst): index type = UintIndex_AllOne , store type = DictZipBlobStore usrkeys = 90677 prefix = 4 raw-key = 0.0007 GB zip-key = 0.0000 GB avg-key = 8.00 avg-zkey = 0.00 raw-val = 0.0922 GB zip-val = 0.0281 GB avg-val =1016.97 avg-zval = 310.43 2024/11/21-22:30:28.320342 139783581591104 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00/166297.sst): second pass time = 0.56's, 163.332'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.05's, 587.376'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 8.786'MB/sec (index lex order gen) rebuild zvType time = 0.02's, 1.266'MB/sec write SST data time = 0.03's, 920.695'MB/sec dict compress time = 0.00's, 945008.000'MB/sec z-dict build time = 0.00's, sample length = 0.945'MB, throughput = 32301.340'MB/sec zip my value time = 0.56's, unzip length = 0.092'GB zip my value throughput = 163.332'MB/sec zip pipeline throughput = 163.332'MB/sec entries = 90677 avg-key = 20.00 avg-zkey = 0.00 avg-val = 1016.97 avg-zval = 310.43 usrkeys = 90677 avg-key = 12.00 avg-zkey = 0.00 avg-val = 1016.97 avg-zval = 310.43 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 3 UnZipSize{ index = 0.0011 GB value = 0.0922 GB dict = 0.95 MB all = 0.0940 GB } __ZipSize{ index = 0.0000 GB value = 0.0281 GB dict = 0.95 MB all = 0.0291 GB } UnZip/Zip{ index =5667.3125 value = 3.2760 dict = 1.00 all = 3.2318 } Zip/UnZip{ index = 0.0002 value = 0.3052 dict = 1.00 all = 0.3094 } ---------------------------- total value len = 361.794601 GB avg = 0.343 KB (by entry num) total key len = 27.081782 GB avg = 0.026 KB total ukey len = 28.508597 GB avg = 0.015 KB total ukey num = 1.962053006 Billion total entry num = 1.055068711 Billion write speed all = 7.937179817 MB/sec (with seq num) write speed all = 7.764903579 MB/sec (without seq num) 2024/11/21-22:30:28.351316 139783581591104 [compaction_job.cc:1948] [default] [JOB 27078] Generated table #166297: 90677 keys, 29095143 bytes, temperature: kWarm 2024/11/21-22:30:28.351373 139783581591104 EVENT_LOG_v1 {"time_micros": 1732199428351343, "cf_name": "default", "job": 27078, "event": "table_file_creation", "file_number": 166297, "file_size": 29095143, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 28148800, "index_size": 192, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 1813540, "raw_average_key_size": 20, "raw_value_size": 92215915, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 90677, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-UintIndex_AllOne-DictZipBlobStore", "creation_time": 1732199427, "oldest_key_time": 0, "file_creation_time": 1732199427, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "DRFHGKF2T4P96U3FZ4Y6", "orig_file_number": 166297, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/21-22:30:28.375634 139783581591104 [compaction_job.cc:703] job-27078: subcompact[0], size: 0.571621 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-27078/att-00 [166284,166285,166286,166287,166288,166289,166290,166291,166292,166293,166294,166295,166296,166297] 2024/11/21-22:30:28.465978 139783581591104 (Original Log Time 2024/11/21-22:29:56.107328) EVENT_LOG_v1 {"time_micros": 1732199396107303, "job": 27078, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [166235], "files_L3": [166269, 166270, 166177, 166126, 166127, 166128, 166129, 166130, 166131, 166132, 166133, 166134, 166135, 166136, 166137, 166138], "score": 0.983229, "input_data_size": 584973085, "oldest_snapshot_seqno": 2666496395} 2024/11/21-22:30:28.465982 139783581591104 (Original Log Time 2024/11/21-22:30:28.465259) [compaction_job.cc:2022] [default] [JOB 27078] Compacted 1@2 + 16@3 files to L3 => 571621097 bytes 2024/11/21-22:30:28.465983 139783581591104 (Original Log Time 2024/11/21-22:30:28.465917) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 14 0 0 0] max score 0.02, MB/sec: 18.1 rd, 17.7 wr, level 3, files in(1, 16) out(14 +0 blob) MB in(12.6, 545.3 +0.0 blob) out(545.1 +0.0 blob), read-write-amplify(87.6) write-amplify(43.3) OK, records in: 1786145, records dropped: 12889 output_compression: Snappy 2024/11/21-22:30:28.465989 139783581591104 (Original Log Time 2024/11/21-22:30:28.465962) EVENT_LOG_v1 {"time_micros": 1732199428465941, "cf": "default", "job": 27078, "event": "compaction_finished", "compaction_time_micros": 32268314, "compaction_time_cpu_micros": 5598993, "output_level": 3, "num_output_files": 14, "total_output_size": 571621097, "num_input_records": 1786145, "num_output_records": 1773256, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 528434020, "file_range_sync_nanos": 0, "file_fsync_nanos": 12798, "file_prepare_write_nanos": 28114, "lsm_state": [0, 0, 0, 14, 0, 0, 0]} 2024/11/21-22:30:28.587807 139783581591104 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732156808,"starts":1732199395,"executesMs":32502,"compactionJobId":27078,"attempt":0,"compactionInputRawBytes":1852231379,"compactionInputZipBytes":584973085,"compactionOutputRawBytes":0,"compactionOutputZipBytes":571621097,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-5f27a9ac5a3972c6489509382f633995-4b1afe77c2b4ff14-00"}}, response = 2024/11/21-22:30:28.587870 139783581591104 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-21T10.40.08/.rocksdb/job-27078/att-00: olev 3, work 32.503 s, result 4.931 ms, install 0.747 ms, input{raw 1.725 GiB zip 557.874 MiB}