2024/11/23-03:33:39.730490 140025070749248 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00: fork to child time = 0.009453 sec 2024/11/23-03:33:39.731248 140025070749248 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00 2024/11/23-03:33:39.737879 140025070749248 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00 2024/11/23-03:33:39.738996 140025070749248 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/23-03:33:39.739265 140025070749248 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/23-03:33:39.790620 140025070749248 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-18434/att-00/MANIFEST-206347 2024/11/23-03:33:39.819965 140025070749248 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-18434/att-00/MANIFEST-206347 succeeded,manifest_file_number is 206347, next_file_number is 242897, last_sequence is 3762360574, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 242739 2024/11/23-03:33:39.819972 140025070749248 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/23-03:33:39.820087 140025070749248 [version_set.cc:5721] Creating manifest 242897 2024/11/23-03:33:39.884577 140025070749248 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/23-03:33:39.909761 140025070749248 [compaction_job.cc:2437] [default] [JOB 18434] Compacting 1@2 + 14@3 files to L3, score 1.00, subcompactions 1 : 1 2024/11/23-03:33:39.909785 140025070749248 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 13771 Base level 2, inputs: [242885(27MB)], [242802(34MB) 242803(33MB) 242804(35MB) 242805(36MB) 242836(36MB) 242837(35MB) 242838(35MB) 242839(33MB) 242840(33MB) 242841(34MB) 242842(35MB) 242843(34MB) 242844(35MB) 242845(18MB)] 2024/11/23-03:33:39.916269 140025070749248 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-03:33:39.916304 140025070749248 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-03:33:39.916325 140025070749248 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-03:33:39.916330 140025070749248 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-03:33:39.916341 140025070749248 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-03:33:40.470285 140025070749248 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242898.sst) /dev/shm/ToplingTemp/Topling-396206-fHXgYr 2024/11/23-03:33:41.241477 140025070749248 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242898.sst): first pass time = 0.77's, 174.050'MB/sec 2024/11/23-03:33:43.023796 140025070749248 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242898.sst): old prealloc_size = 147639500, real_size = 32175168 2024/11/23-03:33:43.024370 140025070749248 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242898.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 932866 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1081 GB zip-val = 0.0302 GB avg-val = 115.88 avg-zval = 32.34 2024/11/23-03:33:43.025194 140025070749248 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242898.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-03:33:44.063656 140025070749248 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242898.sst): second pass time = 1.78's, 60.886'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.04's, 35.011'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3195.396'MB/sec (index lex order gen) rebuild zvType time = 0.90's, 0.258'MB/sec write SST data time = 0.13's, 271.041'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.077'MB, throughput = 34259.595'MB/sec zip my value time = 1.78's, unzip length = 0.108'GB zip my value throughput = 60.886'MB/sec zip pipeline throughput = 91.657'MB/sec entries = 932866 avg-key = 28.00 avg-zkey = 1.90 avg-val = 115.88 avg-zval = 32.34 usrkeys = 932866 avg-key = 20.00 avg-zkey = 1.90 avg-val = 122.88 avg-zval = 32.34 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 932866 bytes = 3381648 } seq expand size = 6530062 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0187 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0302 GB dict = 1.08 MB all = 0.0364 GB } UnZip/Zip{ index = 10.5132 value = 3.5833 dict = 1.00 all = 3.6866 } Zip/UnZip{ index = 0.0951 value = 0.2791 dict = 1.00 all = 0.2713 } ---------------------------- total value len = 0.114628 GB avg = 0.123 KB (by entry num) total key len = 0.026120 GB avg = 0.028 KB total ukey len = 0.018657 GB avg = 0.020 KB total ukey num = 0.000932866 Billion total entry num = 0.000932866 Billion write speed all = 0.002091941 MB/sec (with seq num) write speed all = 0.001981019 MB/sec (without seq num) 2024/11/23-03:33:44.100956 140025070749248 [compaction_job.cc:1948] [default] [JOB 18434] Generated table #242898: 932866 keys, 36406854 bytes, temperature: kWarm 2024/11/23-03:33:44.101050 140025070749248 EVENT_LOG_v1 {"time_micros": 1732304024100998, "cf_name": "default", "job": 18434, "event": "table_file_creation", "file_number": 242898, "file_size": 36406854, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3369194706, "largest_seqno": 3762237690, "table_properties": {"data_size": 30167088, "index_size": 1774656, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26120248, "raw_average_key_size": 28, "raw_value_size": 108097512, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 932866, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732304020, "oldest_key_time": 0, "file_creation_time": 1732304020, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 242898, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-03:33:44.138165 140025070749248 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242899.sst) /dev/shm/ToplingTemp/Topling-396206-jpq6nt 2024/11/23-03:33:44.952034 140025070749248 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242899.sst): first pass time = 0.81's, 164.920'MB/sec 2024/11/23-03:33:46.289573 140025070749248 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242899.sst): old prealloc_size = 147639500, real_size = 30875056 2024/11/23-03:33:46.290136 140025070749248 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242899.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925789 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1083 GB zip-val = 0.0289 GB avg-val = 116.98 avg-zval = 31.18 2024/11/23-03:33:46.290921 140025070749248 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242899.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-03:33:47.429599 140025070749248 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242899.sst): second pass time = 1.34's, 81.009'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.14's, 30.775'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3284.347'MB/sec (index lex order gen) rebuild zvType time = 0.96's, 0.241'MB/sec write SST data time = 0.18's, 196.763'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 31548.528'MB/sec zip my value time = 1.34's, unzip length = 0.108'GB zip my value throughput = 81.009'MB/sec zip pipeline throughput = 81.009'MB/sec entries = 925789 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.98 avg-zval = 31.18 usrkeys = 925789 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.98 avg-zval = 31.18 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 925789 bytes = 3356000 } seq expand size = 6480523 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0289 GB dict = 1.08 MB all = 0.0351 GB } UnZip/Zip{ index = 10.4447 value = 3.7511 dict = 1.00 all = 3.8256 } Zip/UnZip{ index = 0.0957 value = 0.2666 dict = 1.00 all = 0.2614 } ---------------------------- total value len = 0.229404 GB avg = 0.123 KB (by entry num) total key len = 0.052042 GB avg = 0.028 KB total ukey len = 0.037173 GB avg = 0.020 KB total ukey num = 0.001858655 Billion total entry num = 0.001858655 Billion write speed all = 0.004182936 MB/sec (with seq num) write speed all = 0.003961945 MB/sec (without seq num) 2024/11/23-03:33:47.463524 140025070749248 [compaction_job.cc:1948] [default] [JOB 18434] Generated table #242899: 925789 keys, 35084074 bytes, temperature: kWarm 2024/11/23-03:33:47.463585 140025070749248 EVENT_LOG_v1 {"time_micros": 1732304027463555, "cf_name": "default", "job": 18434, "event": "table_file_creation", "file_number": 242899, "file_size": 35084074, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3374049949, "largest_seqno": 3762239695, "table_properties": {"data_size": 28870688, "index_size": 1772736, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25922092, "raw_average_key_size": 28, "raw_value_size": 108295654, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 925789, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732304024, "oldest_key_time": 0, "file_creation_time": 1732304024, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 242899, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-03:33:47.501307 140025070749248 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242900.sst) /dev/shm/ToplingTemp/Topling-396206-yQLMot 2024/11/23-03:33:48.596535 140025070749248 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242900.sst): first pass time = 1.10's, 122.552'MB/sec 2024/11/23-03:33:49.987786 140025070749248 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242900.sst): old prealloc_size = 147639500, real_size = 33362256 2024/11/23-03:33:49.988376 140025070749248 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242900.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 929894 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1082 GB zip-val = 0.0313 GB avg-val = 116.34 avg-zval = 33.71 2024/11/23-03:33:49.989163 140025070749248 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242900.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-03:33:51.033440 140025070749248 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242900.sst): second pass time = 1.39's, 77.800'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.05's, 35.945'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3137.160'MB/sec (index lex order gen) rebuild zvType time = 0.82's, 0.285'MB/sec write SST data time = 0.23's, 163.748'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 33339.945'MB/sec zip my value time = 1.39's, unzip length = 0.108'GB zip my value throughput = 77.800'MB/sec zip pipeline throughput = 77.800'MB/sec entries = 929894 avg-key = 28.00 avg-zkey = 1.92 avg-val = 116.34 avg-zval = 33.71 usrkeys = 929894 avg-key = 20.00 avg-zkey = 1.92 avg-val = 123.34 avg-zval = 33.71 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 929894 bytes = 3370880 } seq expand size = 6509258 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0313 GB dict = 1.08 MB all = 0.0376 GB } UnZip/Zip{ index = 10.4428 value = 3.4509 dict = 1.00 all = 3.5710 } Zip/UnZip{ index = 0.0958 value = 0.2898 dict = 1.00 all = 0.2800 } ---------------------------- total value len = 0.344094 GB avg = 0.123 KB (by entry num) total key len = 0.078079 GB avg = 0.028 KB total ukey len = 0.055771 GB avg = 0.020 KB total ukey num = 0.002788549 Billion total entry num = 0.002788549 Billion write speed all = 0.006274129 MB/sec (with seq num) write speed all = 0.005942593 MB/sec (without seq num) 2024/11/23-03:33:51.070860 140025070749248 [compaction_job.cc:1948] [default] [JOB 18434] Generated table #242900: 929894 keys, 37585626 bytes, temperature: kWarm 2024/11/23-03:33:51.070951 140025070749248 EVENT_LOG_v1 {"time_micros": 1732304031070907, "cf_name": "default", "job": 18434, "event": "table_file_creation", "file_number": 242900, "file_size": 37585626, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3339428666, "largest_seqno": 3762239861, "table_properties": {"data_size": 31348672, "index_size": 1780928, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26037032, "raw_average_key_size": 28, "raw_value_size": 108180828, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 929894, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732304027, "oldest_key_time": 0, "file_creation_time": 1732304027, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 242900, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-03:33:51.128437 140025070749248 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242901.sst) /dev/shm/ToplingTemp/Topling-396206-alc9Dt 2024/11/23-03:33:52.161050 140025070749248 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242901.sst): first pass time = 1.03's, 129.985'MB/sec 2024/11/23-03:33:53.629935 140025070749248 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242901.sst): old prealloc_size = 147639500, real_size = 33515472 2024/11/23-03:33:53.630622 140025070749248 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242901.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 932384 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1081 GB zip-val = 0.0315 GB avg-val = 115.95 avg-zval = 33.79 2024/11/23-03:33:53.631460 140025070749248 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242901.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-03:33:54.853017 140025070749248 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242901.sst): second pass time = 1.47's, 73.688'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.22's, 30.867'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2683.166'MB/sec (index lex order gen) rebuild zvType time = 0.98's, 0.239'MB/sec write SST data time = 0.25's, 153.558'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 31667.352'MB/sec zip my value time = 1.47's, unzip length = 0.108'GB zip my value throughput = 73.688'MB/sec zip pipeline throughput = 73.688'MB/sec entries = 932384 avg-key = 28.00 avg-zkey = 1.90 avg-val = 115.95 avg-zval = 33.79 usrkeys = 932384 avg-key = 20.00 avg-zkey = 1.90 avg-val = 122.95 avg-zval = 33.79 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 932384 bytes = 3379904 } seq expand size = 6526688 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0315 GB dict = 1.08 MB all = 0.0377 GB } UnZip/Zip{ index = 10.5112 value = 3.4312 dict = 1.00 all = 3.5558 } Zip/UnZip{ index = 0.0951 value = 0.2914 dict = 1.00 all = 0.2812 } ---------------------------- total value len = 0.458732 GB avg = 0.123 KB (by entry num) total key len = 0.104186 GB avg = 0.028 KB total ukey len = 0.074419 GB avg = 0.020 KB total ukey num = 0.003720933 Billion total entry num = 0.003720933 Billion write speed all = 0.008365330 MB/sec (with seq num) write speed all = 0.007922966 MB/sec (without seq num) 2024/11/23-03:33:54.888927 140025070749248 [compaction_job.cc:1948] [default] [JOB 18434] Generated table #242901: 932384 keys, 37745942 bytes, temperature: kWarm 2024/11/23-03:33:54.888981 140025070749248 EVENT_LOG_v1 {"time_micros": 1732304034888952, "cf_name": "default", "job": 18434, "event": "table_file_creation", "file_number": 242901, "file_size": 37745942, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3369353416, "largest_seqno": 3762239740, "table_properties": {"data_size": 31508096, "index_size": 1774080, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26106752, "raw_average_key_size": 28, "raw_value_size": 108111100, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 932384, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732304031, "oldest_key_time": 0, "file_creation_time": 1732304031, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 242901, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-03:33:54.923651 140025070749248 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242902.sst) /dev/shm/ToplingTemp/Topling-396206-WCmyxr 2024/11/23-03:33:56.037916 140025070749248 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242902.sst): first pass time = 1.11's, 120.458'MB/sec 2024/11/23-03:33:57.876802 140025070749248 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242902.sst): old prealloc_size = 147639500, real_size = 34888656 2024/11/23-03:33:57.877340 140025070749248 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242902.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926878 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1083 GB zip-val = 0.0329 GB avg-val = 116.81 avg-zval = 35.48 2024/11/23-03:33:57.878054 140025070749248 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242902.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-03:33:58.838028 140025070749248 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242902.sst): second pass time = 1.84's, 58.910'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.96's, 40.145'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3435.719'MB/sec (index lex order gen) rebuild zvType time = 0.83's, 0.280'MB/sec write SST data time = 0.13's, 291.328'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 17487.520'MB/sec zip my value time = 1.84's, unzip length = 0.108'GB zip my value throughput = 58.910'MB/sec zip pipeline throughput = 126.409'MB/sec entries = 926878 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.81 avg-zval = 35.48 usrkeys = 926878 avg-key = 20.00 avg-zkey = 1.91 avg-val = 122.42 avg-zval = 35.48 TagRS{ kinds = RS_Key0_TagN bytes = 144920 } TagArray{ size = 743881 bytes = 2696576 } seq expand size = 5207167 multi value expand size = 0 cnt WriteAppend = 17 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0329 GB dict = 1.08 MB all = 0.0386 GB } UnZip/Zip{ index = 10.4465 value = 3.2925 dict = 1.00 all = 3.4782 } Zip/UnZip{ index = 0.0957 value = 0.3037 dict = 1.00 all = 0.2875 } ---------------------------- total value len = 0.572204 GB avg = 0.123 KB (by entry num) total key len = 0.130139 GB avg = 0.028 KB total ukey len = 0.092956 GB avg = 0.020 KB total ukey num = 0.004647811 Billion total entry num = 0.004647811 Billion write speed all = 0.010436659 MB/sec (with seq num) write speed all = 0.009884135 MB/sec (without seq num) 2024/11/23-03:33:58.872872 140025070749248 [compaction_job.cc:1948] [default] [JOB 18434] Generated table #242902: 926878 keys, 38588264 bytes, temperature: kWarm 2024/11/23-03:33:58.872934 140025070749248 EVENT_LOG_v1 {"time_micros": 1732304038872902, "cf_name": "default", "job": 18434, "event": "table_file_creation", "file_number": 242902, "file_size": 38588264, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3762240393, "table_properties": {"data_size": 32882240, "index_size": 1774528, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25952584, "raw_average_key_size": 28, "raw_value_size": 108265212, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926878, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732304034, "oldest_key_time": 0, "file_creation_time": 1732304034, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 242902, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-03:33:58.907750 140025070749248 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242903.sst) /dev/shm/ToplingTemp/Topling-396206-EUME1q 2024/11/23-03:33:59.820813 140025070749248 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242903.sst): first pass time = 0.91's, 147.013'MB/sec 2024/11/23-03:34:01.169704 140025070749248 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242903.sst): old prealloc_size = 147639500, real_size = 32986304 2024/11/23-03:34:01.170290 140025070749248 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242903.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928759 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0310 GB avg-val = 116.51 avg-zval = 33.36 2024/11/23-03:34:01.171100 140025070749248 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242903.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-03:34:02.220054 140025070749248 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242903.sst): second pass time = 1.35's, 80.260'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.05's, 35.423'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3200.070'MB/sec (index lex order gen) rebuild zvType time = 0.92's, 0.253'MB/sec write SST data time = 0.13's, 280.642'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 34306.524'MB/sec zip my value time = 1.35's, unzip length = 0.108'GB zip my value throughput = 80.260'MB/sec zip pipeline throughput = 80.260'MB/sec entries = 928759 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.51 avg-zval = 33.36 usrkeys = 928759 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.51 avg-zval = 33.36 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 928759 bytes = 3366768 } seq expand size = 6501313 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0310 GB dict = 1.08 MB all = 0.0372 GB } UnZip/Zip{ index = 10.5136 value = 3.4922 dict = 1.00 all = 3.6074 } Zip/UnZip{ index = 0.0951 value = 0.2864 dict = 1.00 all = 0.2772 } ---------------------------- total value len = 0.686918 GB avg = 0.123 KB (by entry num) total key len = 0.156144 GB avg = 0.028 KB total ukey len = 0.111531 GB avg = 0.020 KB total ukey num = 0.005576570 Billion total entry num = 0.005576570 Billion write speed all = 0.012527085 MB/sec (with seq num) write speed all = 0.011864186 MB/sec (without seq num) 2024/11/23-03:34:02.251967 140025070749248 [compaction_job.cc:1948] [default] [JOB 18434] Generated table #242903: 928759 keys, 37206264 bytes, temperature: kWarm 2024/11/23-03:34:02.252033 140025070749248 EVENT_LOG_v1 {"time_micros": 1732304042251999, "cf_name": "default", "job": 18434, "event": "table_file_creation", "file_number": 242903, "file_size": 37206264, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3480997236, "largest_seqno": 3762239453, "table_properties": {"data_size": 30987120, "index_size": 1766784, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26005252, "raw_average_key_size": 28, "raw_value_size": 108212594, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928759, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732304038, "oldest_key_time": 0, "file_creation_time": 1732304038, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 242903, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-03:34:02.289971 140025070749248 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242904.sst) /dev/shm/ToplingTemp/Topling-396206-cIZ19r 2024/11/23-03:34:03.138292 140025070749248 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242904.sst): first pass time = 0.85's, 158.223'MB/sec 2024/11/23-03:34:04.511512 140025070749248 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242904.sst): old prealloc_size = 147639500, real_size = 32525696 2024/11/23-03:34:04.512080 140025070749248 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242904.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 933755 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1081 GB zip-val = 0.0305 GB avg-val = 115.74 avg-zval = 32.67 2024/11/23-03:34:04.512864 140025070749248 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242904.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-03:34:05.530135 140025070749248 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242904.sst): second pass time = 1.37's, 78.739'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.02's, 35.975'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3274.180'MB/sec (index lex order gen) rebuild zvType time = 0.89's, 0.263'MB/sec write SST data time = 0.13's, 278.601'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 34415.094'MB/sec zip my value time = 1.37's, unzip length = 0.108'GB zip my value throughput = 78.739'MB/sec zip pipeline throughput = 78.739'MB/sec entries = 933755 avg-key = 28.00 avg-zkey = 1.91 avg-val = 115.74 avg-zval = 32.67 usrkeys = 933755 avg-key = 20.00 avg-zkey = 1.91 avg-val = 122.74 avg-zval = 32.67 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 933755 bytes = 3268160 } seq expand size = 6536285 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0187 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0305 GB dict = 1.08 MB all = 0.0366 GB } UnZip/Zip{ index = 10.4456 value = 3.5429 dict = 1.00 all = 3.6627 } Zip/UnZip{ index = 0.0957 value = 0.2823 dict = 1.00 all = 0.2730 } ---------------------------- total value len = 0.801527 GB avg = 0.123 KB (by entry num) total key len = 0.182289 GB avg = 0.028 KB total ukey len = 0.130207 GB avg = 0.020 KB total ukey num = 0.006510325 Billion total entry num = 0.006510325 Billion write speed all = 0.014617836 MB/sec (with seq num) write speed all = 0.013843977 MB/sec (without seq num) 2024/11/23-03:34:05.567794 140025070749248 [compaction_job.cc:1948] [default] [JOB 18434] Generated table #242904: 933755 keys, 36644208 bytes, temperature: kWarm 2024/11/23-03:34:05.567858 140025070749248 EVENT_LOG_v1 {"time_micros": 1732304045567826, "cf_name": "default", "job": 18434, "event": "table_file_creation", "file_number": 242904, "file_size": 36644208, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3512539342, "largest_seqno": 3762240233, "table_properties": {"data_size": 30504240, "index_size": 1787840, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26145140, "raw_average_key_size": 28, "raw_value_size": 108072678, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 933755, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732304042, "oldest_key_time": 0, "file_creation_time": 1732304042, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 242904, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-03:34:05.605534 140025070749248 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242905.sst) /dev/shm/ToplingTemp/Topling-396206-1ShjGr 2024/11/23-03:34:06.500369 140025070749248 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242905.sst): first pass time = 0.89's, 149.998'MB/sec 2024/11/23-03:34:07.836583 140025070749248 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242905.sst): old prealloc_size = 147639500, real_size = 31172480 2024/11/23-03:34:07.837223 140025070749248 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242905.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 923367 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1084 GB zip-val = 0.0292 GB avg-val = 117.36 avg-zval = 31.59 2024/11/23-03:34:07.838018 140025070749248 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242905.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-03:34:08.821155 140025070749248 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242905.sst): second pass time = 1.34's, 81.139'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.98's, 35.813'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2871.572'MB/sec (index lex order gen) rebuild zvType time = 0.83's, 0.278'MB/sec write SST data time = 0.15's, 229.780'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 34570.152'MB/sec zip my value time = 1.34's, unzip length = 0.108'GB zip my value throughput = 81.139'MB/sec zip pipeline throughput = 81.139'MB/sec entries = 923367 avg-key = 28.00 avg-zkey = 1.92 avg-val = 117.36 avg-zval = 31.59 usrkeys = 923367 avg-key = 20.00 avg-zkey = 1.92 avg-val = 124.36 avg-zval = 31.59 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 923367 bytes = 3231792 } seq expand size = 6463569 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0292 GB dict = 1.08 MB all = 0.0353 GB } UnZip/Zip{ index = 10.4434 value = 3.7145 dict = 1.00 all = 3.8065 } Zip/UnZip{ index = 0.0958 value = 0.2692 dict = 1.00 all = 0.2627 } ---------------------------- total value len = 0.916354 GB avg = 0.123 KB (by entry num) total key len = 0.208143 GB avg = 0.028 KB total ukey len = 0.148674 GB avg = 0.020 KB total ukey num = 0.007433692 Billion total entry num = 0.007433692 Billion write speed all = 0.016707305 MB/sec (with seq num) write speed all = 0.015823732 MB/sec (without seq num) 2024/11/23-03:34:08.860694 140025070749248 [compaction_job.cc:1948] [default] [JOB 18434] Generated table #242905: 923367 keys, 35260270 bytes, temperature: kWarm 2024/11/23-03:34:08.860751 140025070749248 EVENT_LOG_v1 {"time_micros": 1732304048860720, "cf_name": "default", "job": 18434, "event": "table_file_creation", "file_number": 242905, "file_size": 35260270, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3613003558, "largest_seqno": 3762237494, "table_properties": {"data_size": 29173104, "index_size": 1768320, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25854276, "raw_average_key_size": 28, "raw_value_size": 108363474, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 923367, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732304045, "oldest_key_time": 0, "file_creation_time": 1732304045, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 242905, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-03:34:08.896344 140025070749248 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242906.sst) /dev/shm/ToplingTemp/Topling-396206-Hck0fs 2024/11/23-03:34:09.684865 140025070749248 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242906.sst): first pass time = 0.79's, 170.223'MB/sec 2024/11/23-03:34:11.046497 140025070749248 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242906.sst): old prealloc_size = 147639500, real_size = 32290080 2024/11/23-03:34:11.047094 140025070749248 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242906.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926169 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0303 GB avg-val = 116.92 avg-zval = 32.71 2024/11/23-03:34:11.047903 140025070749248 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242906.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-03:34:11.951728 140025070749248 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242906.sst): second pass time = 1.36's, 79.563'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.91's, 40.324'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3065.120'MB/sec (index lex order gen) rebuild zvType time = 0.77's, 0.299'MB/sec write SST data time = 0.13's, 278.018'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 37400.900'MB/sec zip my value time = 1.36's, unzip length = 0.108'GB zip my value throughput = 79.563'MB/sec zip pipeline throughput = 79.563'MB/sec entries = 926169 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.92 avg-zval = 32.71 usrkeys = 926169 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.92 avg-zval = 32.71 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 926169 bytes = 3357376 } seq expand size = 6483183 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0303 GB dict = 1.08 MB all = 0.0365 GB } UnZip/Zip{ index = 10.5128 value = 3.5742 dict = 1.00 all = 3.6770 } Zip/UnZip{ index = 0.0951 value = 0.2798 dict = 1.00 all = 0.2720 } ---------------------------- total value len = 1.031122 GB avg = 0.123 KB (by entry num) total key len = 0.234076 GB avg = 0.028 KB total ukey len = 0.167197 GB avg = 0.020 KB total ukey num = 0.008359861 Billion total entry num = 0.008359861 Billion write speed all = 0.018796906 MB/sec (with seq num) write speed all = 0.017803294 MB/sec (without seq num) 2024/11/23-03:34:11.987742 140025070749248 [compaction_job.cc:1948] [default] [JOB 18434] Generated table #242906: 926169 keys, 36501914 bytes, temperature: kWarm 2024/11/23-03:34:11.987814 140025070749248 EVENT_LOG_v1 {"time_micros": 1732304051987773, "cf_name": "default", "job": 18434, "event": "table_file_creation", "file_number": 242906, "file_size": 36501914, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3485447251, "largest_seqno": 3762240413, "table_properties": {"data_size": 30296400, "index_size": 1761984, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25932732, "raw_average_key_size": 28, "raw_value_size": 108285046, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926169, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732304048, "oldest_key_time": 0, "file_creation_time": 1732304048, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 242906, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-03:34:12.023734 140025070749248 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242907.sst) /dev/shm/ToplingTemp/Topling-396206-o9UT9p 2024/11/23-03:34:12.924124 140025070749248 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242907.sst): first pass time = 0.90's, 149.073'MB/sec 2024/11/23-03:34:14.275945 140025070749248 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242907.sst): old prealloc_size = 147639500, real_size = 32743216 2024/11/23-03:34:14.276471 140025070749248 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242907.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925249 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0308 GB avg-val = 117.06 avg-zval = 33.24 2024/11/23-03:34:14.277284 140025070749248 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242907.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-03:34:15.204809 140025070749248 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242907.sst): second pass time = 1.35's, 80.159'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.93's, 39.783'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3492.068'MB/sec (index lex order gen) rebuild zvType time = 0.80's, 0.291'MB/sec write SST data time = 0.13's, 277.616'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 33367.140'MB/sec zip my value time = 1.35's, unzip length = 0.108'GB zip my value throughput = 80.159'MB/sec zip pipeline throughput = 80.159'MB/sec entries = 925249 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.06 avg-zval = 33.24 usrkeys = 925249 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.06 avg-zval = 33.24 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 925249 bytes = 3354048 } seq expand size = 6476743 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0308 GB dict = 1.08 MB all = 0.0370 GB } UnZip/Zip{ index = 10.5123 value = 3.5221 dict = 1.00 all = 3.6322 } Zip/UnZip{ index = 0.0951 value = 0.2839 dict = 1.00 all = 0.2753 } ---------------------------- total value len = 1.145910 GB avg = 0.123 KB (by entry num) total key len = 0.259983 GB avg = 0.028 KB total ukey len = 0.185702 GB avg = 0.020 KB total ukey num = 0.009285110 Billion total entry num = 0.009285110 Billion write speed all = 0.020886179 MB/sec (with seq num) write speed all = 0.019782650 MB/sec (without seq num) 2024/11/23-03:34:15.239062 140025070749248 [compaction_job.cc:1948] [default] [JOB 18434] Generated table #242907: 925249 keys, 36952252 bytes, temperature: kWarm 2024/11/23-03:34:15.239123 140025070749248 EVENT_LOG_v1 {"time_micros": 1732304055239092, "cf_name": "default", "job": 18434, "event": "table_file_creation", "file_number": 242907, "file_size": 36952252, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3405268533, "largest_seqno": 3762240274, "table_properties": {"data_size": 30751392, "index_size": 1760320, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25906972, "raw_average_key_size": 28, "raw_value_size": 108310774, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 925249, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732304052, "oldest_key_time": 0, "file_creation_time": 1732304052, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 242907, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-03:34:15.282359 140025070749248 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242908.sst) /dev/shm/ToplingTemp/Topling-396206-3PXB6s 2024/11/23-03:34:16.196965 140025070749248 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242908.sst): first pass time = 0.91's, 146.755'MB/sec 2024/11/23-03:34:17.540404 140025070749248 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242908.sst): old prealloc_size = 147639500, real_size = 33234640 2024/11/23-03:34:17.541002 140025070749248 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242908.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 934055 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1081 GB zip-val = 0.0312 GB avg-val = 115.69 avg-zval = 33.42 2024/11/23-03:34:17.542959 140025070749248 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242908.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-03:34:18.469615 140025070749248 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242908.sst): second pass time = 1.34's, 80.505'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.93's, 40.201'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3105.302'MB/sec (index lex order gen) rebuild zvType time = 0.80's, 0.293'MB/sec write SST data time = 0.13's, 283.375'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 31351.268'MB/sec zip my value time = 1.34's, unzip length = 0.108'GB zip my value throughput = 80.505'MB/sec zip pipeline throughput = 80.505'MB/sec entries = 934055 avg-key = 28.00 avg-zkey = 1.92 avg-val = 115.69 avg-zval = 33.42 usrkeys = 934055 avg-key = 20.00 avg-zkey = 1.92 avg-val = 122.69 avg-zval = 33.42 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 934055 bytes = 3269200 } seq expand size = 6538385 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0187 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0312 GB dict = 1.08 MB all = 0.0374 GB } UnZip/Zip{ index = 10.4434 value = 3.4622 dict = 1.00 all = 3.5931 } Zip/UnZip{ index = 0.0958 value = 0.2888 dict = 1.00 all = 0.2783 } ---------------------------- total value len = 1.260512 GB avg = 0.123 KB (by entry num) total key len = 0.286137 GB avg = 0.028 KB total ukey len = 0.204383 GB avg = 0.020 KB total ukey num = 0.010219165 Billion total entry num = 0.010219165 Billion write speed all = 0.022976161 MB/sec (with seq num) write speed all = 0.021761679 MB/sec (without seq num) 2024/11/23-03:34:18.501494 140025070749248 [compaction_job.cc:1948] [default] [JOB 18434] Generated table #242908: 934055 keys, 37354222 bytes, temperature: kWarm 2024/11/23-03:34:18.501564 140025070749248 EVENT_LOG_v1 {"time_micros": 1732304058501532, "cf_name": "default", "job": 18434, "event": "table_file_creation", "file_number": 242908, "file_size": 37354222, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3525889795, "largest_seqno": 3762240319, "table_properties": {"data_size": 31212160, "index_size": 1788800, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26153540, "raw_average_key_size": 28, "raw_value_size": 108064218, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 934055, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732304055, "oldest_key_time": 0, "file_creation_time": 1732304055, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 242908, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-03:34:18.537958 140025070749248 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242909.sst) /dev/shm/ToplingTemp/Topling-396206-1l5tLq 2024/11/23-03:34:19.415881 140025070749248 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242909.sst): first pass time = 0.88's, 152.887'MB/sec 2024/11/23-03:34:20.751249 140025070749248 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242909.sst): old prealloc_size = 147639500, real_size = 33050128 2024/11/23-03:34:20.751844 140025070749248 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242909.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 924715 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0311 GB avg-val = 117.15 avg-zval = 33.59 2024/11/23-03:34:20.752648 140025070749248 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242909.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-03:34:21.691571 140025070749248 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242909.sst): second pass time = 1.33's, 81.163'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.94's, 39.623'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3059.347'MB/sec (index lex order gen) rebuild zvType time = 0.81's, 0.286'MB/sec write SST data time = 0.13's, 284.099'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 30206.561'MB/sec zip my value time = 1.33's, unzip length = 0.108'GB zip my value throughput = 81.163'MB/sec zip pipeline throughput = 81.163'MB/sec entries = 924715 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.15 avg-zval = 33.59 usrkeys = 924715 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.15 avg-zval = 33.59 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 924715 bytes = 3352112 } seq expand size = 6473005 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0311 GB dict = 1.08 MB all = 0.0373 GB } UnZip/Zip{ index = 10.5119 value = 3.4877 dict = 1.00 all = 3.6024 } Zip/UnZip{ index = 0.0951 value = 0.2867 dict = 1.00 all = 0.2776 } ---------------------------- total value len = 1.375311 GB avg = 0.123 KB (by entry num) total key len = 0.312029 GB avg = 0.028 KB total ukey len = 0.222878 GB avg = 0.020 KB total ukey num = 0.011143880 Billion total entry num = 0.011143880 Billion write speed all = 0.025064987 MB/sec (with seq num) write speed all = 0.023740672 MB/sec (without seq num) 2024/11/23-03:34:21.724202 140025070749248 [compaction_job.cc:1948] [default] [JOB 18434] Generated table #242909: 924715 keys, 37257820 bytes, temperature: kWarm 2024/11/23-03:34:21.724268 140025070749248 EVENT_LOG_v1 {"time_micros": 1732304061724234, "cf_name": "default", "job": 18434, "event": "table_file_creation", "file_number": 242909, "file_size": 37257820, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3405268578, "largest_seqno": 3762239170, "table_properties": {"data_size": 31059392, "index_size": 1759360, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25892020, "raw_average_key_size": 28, "raw_value_size": 108325810, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 924715, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732304058, "oldest_key_time": 0, "file_creation_time": 1732304058, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 242909, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-03:34:21.762150 140025070749248 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242910.sst) /dev/shm/ToplingTemp/Topling-396206-CJc0vt 2024/11/23-03:34:22.587834 140025070749248 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242910.sst): first pass time = 0.83's, 162.561'MB/sec 2024/11/23-03:34:23.931164 140025070749248 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242910.sst): old prealloc_size = 147639500, real_size = 33338848 2024/11/23-03:34:23.931754 140025070749248 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242910.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927078 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1083 GB zip-val = 0.0313 GB avg-val = 116.78 avg-zval = 33.80 2024/11/23-03:34:23.932533 140025070749248 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242910.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-03:34:24.880822 140025070749248 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242910.sst): second pass time = 1.34's, 80.629'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.95's, 39.546'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3130.216'MB/sec (index lex order gen) rebuild zvType time = 0.82's, 0.283'MB/sec write SST data time = 0.13's, 288.803'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 32237.670'MB/sec zip my value time = 1.34's, unzip length = 0.108'GB zip my value throughput = 80.629'MB/sec zip pipeline throughput = 80.629'MB/sec entries = 927078 avg-key = 28.00 avg-zkey = 1.92 avg-val = 116.78 avg-zval = 33.80 usrkeys = 927078 avg-key = 20.00 avg-zkey = 1.92 avg-val = 123.78 avg-zval = 33.80 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927078 bytes = 3360672 } seq expand size = 6489546 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0313 GB dict = 1.08 MB all = 0.0376 GB } UnZip/Zip{ index = 10.4435 value = 3.4553 dict = 1.00 all = 3.5740 } Zip/UnZip{ index = 0.0958 value = 0.2894 dict = 1.00 all = 0.2798 } ---------------------------- total value len = 1.490060 GB avg = 0.123 KB (by entry num) total key len = 0.337987 GB avg = 0.028 KB total ukey len = 0.241419 GB avg = 0.020 KB total ukey num = 0.012070958 Billion total entry num = 0.012070958 Billion write speed all = 0.027153871 MB/sec (with seq num) write speed all = 0.025719451 MB/sec (without seq num) 2024/11/23-03:34:24.915561 140025070749248 [compaction_job.cc:1948] [default] [JOB 18434] Generated table #242910: 927078 keys, 37554062 bytes, temperature: kWarm 2024/11/23-03:34:24.915620 140025070749248 EVENT_LOG_v1 {"time_micros": 1732304064915588, "cf_name": "default", "job": 18434, "event": "table_file_creation", "file_number": 242910, "file_size": 37554062, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3471845708, "largest_seqno": 3762239822, "table_properties": {"data_size": 31331472, "index_size": 1775424, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25958184, "raw_average_key_size": 28, "raw_value_size": 108259584, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927078, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732304061, "oldest_key_time": 0, "file_creation_time": 1732304061, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 242910, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-03:34:24.963564 140025070749248 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242911.sst) /dev/shm/ToplingTemp/Topling-396206-zbHcar 2024/11/23-03:34:25.482090 140025070749248 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242911.sst): first pass time = 0.52's, 177.495'MB/sec 2024/11/23-03:34:26.386079 140025070749248 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242911.sst): old prealloc_size = 147639500, real_size = 22042208 2024/11/23-03:34:26.386504 140025070749248 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242911.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 638293 prefix = 4 raw-key = 0.0102 GB zip-key = 0.0012 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.0742 GB zip-val = 0.0207 GB avg-val = 116.18 avg-zval = 32.37 2024/11/23-03:34:26.387041 140025070749248 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242911.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0016 GB, waited 0.000 sec, Key+Value = 0.092 GB 2024/11/23-03:34:27.056952 140025070749248 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00/242911.sst): second pass time = 0.90's, 82.090'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.67's, 36.945'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3042.440'MB/sec (index lex order gen) rebuild zvType time = 0.58's, 0.274'MB/sec write SST data time = 0.09's, 279.154'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.745'MB, throughput = 23702.082'MB/sec zip my value time = 0.90's, unzip length = 0.074'GB zip my value throughput = 82.090'MB/sec zip pipeline throughput = 82.090'MB/sec entries = 638293 avg-key = 28.00 avg-zkey = 1.92 avg-val = 116.18 avg-zval = 32.37 usrkeys = 638293 avg-key = 20.00 avg-zkey = 1.92 avg-val = 123.18 avg-zval = 32.37 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 638293 bytes = 2154256 } seq expand size = 4468051 multi value expand size = 0 cnt WriteAppend = 11 UnZipSize{ index = 0.0128 GB value = 0.0742 GB dict = 0.74 MB all = 0.0920 GB } __ZipSize{ index = 0.0012 GB value = 0.0207 GB dict = 0.74 MB all = 0.0248 GB } UnZip/Zip{ index = 10.4405 value = 3.5895 dict = 1.00 all = 3.7132 } Zip/UnZip{ index = 0.0958 value = 0.2786 dict = 1.00 all = 0.2693 } ---------------------------- total value len = 1.568686 GB avg = 0.123 KB (by entry num) total key len = 0.355859 GB avg = 0.028 KB total ukey len = 0.254185 GB avg = 0.020 KB total ukey num = 0.012709251 Billion total entry num = 0.012709251 Billion write speed all = 0.028586329 MB/sec (with seq num) write speed all = 0.027076109 MB/sec (without seq num) 2024/11/23-03:34:27.082690 140025070749248 [compaction_job.cc:1948] [default] [JOB 18434] Generated table #242911: 638293 keys, 24784624 bytes, temperature: kWarm 2024/11/23-03:34:27.082749 140025070749248 EVENT_LOG_v1 {"time_micros": 1732304067082718, "cf_name": "default", "job": 18434, "event": "table_file_creation", "file_number": 242911, "file_size": 24784624, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3694413771, "largest_seqno": 3761638961, "table_properties": {"data_size": 20659728, "index_size": 1222720, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 17872204, "raw_average_key_size": 28, "raw_value_size": 74157638, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 638293, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732304064, "oldest_key_time": 0, "file_creation_time": 1732304064, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 242911, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-03:34:27.103610 140025070749248 [compaction_job.cc:703] job-18434: subcompact[0], size: 0.504926 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18434/att-00 [242898,242899,242900,242901,242902,242903,242904,242905,242906,242907,242908,242909,242910,242911] 2024/11/23-03:34:27.192807 140025070749248 (Original Log Time 2024/11/23-03:33:39.909840) EVENT_LOG_v1 {"time_micros": 1732304019909800, "job": 18434, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [242885], "files_L3": [242802, 242803, 242804, 242805, 242836, 242837, 242838, 242839, 242840, 242841, 242842, 242843, 242844, 242845], "score": 0.999698, "input_data_size": 524795145, "oldest_snapshot_seqno": 3762360441} 2024/11/23-03:34:27.192811 140025070749248 (Original Log Time 2024/11/23-03:34:27.192087) [compaction_job.cc:2022] [default] [JOB 18434] Compacted 1@2 + 14@3 files to L3 => 504926396 bytes 2024/11/23-03:34:27.192812 140025070749248 (Original Log Time 2024/11/23-03:34:27.192728) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 14 0 0 0] max score 0.02, MB/sec: 11.1 rd, 10.7 wr, level 3, files in(1, 14) out(14 +0 blob) MB in(27.1, 473.4 +0.0 blob) out(481.5 +0.0 blob), read-write-amplify(36.2) write-amplify(17.8) OK, records in: 12784611, records dropped: 75360 output_compression: Snappy 2024/11/23-03:34:27.192819 140025070749248 (Original Log Time 2024/11/23-03:34:27.192786) EVENT_LOG_v1 {"time_micros": 1732304067192751, "cf": "default", "job": 18434, "event": "compaction_finished", "compaction_time_micros": 47193776, "compaction_time_cpu_micros": 21797996, "output_level": 3, "num_output_files": 14, "total_output_size": 504926396, "num_input_records": 12784611, "num_output_records": 12709251, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 338780639, "file_range_sync_nanos": 0, "file_fsync_nanos": 12758, "file_prepare_write_nanos": 32495, "lsm_state": [0, 0, 0, 14, 0, 0, 0]} 2024/11/23-03:34:27.319450 140025070749248 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732256054,"starts":1732304019,"executesMs":47456,"compactionJobId":18434,"attempt":0,"compactionInputRawBytes":1847562270,"compactionInputZipBytes":524795145,"compactionOutputRawBytes":0,"compactionOutputZipBytes":504926396,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-551e034ada5e02a7d9cee9afc744c983-e918b1e228649002-00"}}, response = 2024/11/23-03:34:27.319516 140025070749248 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-18434/att-00: olev 3, work 47.456 s, result 5.011 ms, install 0.751 ms, input{raw 1.721 GiB zip 500.484 MiB}