2024/11/24-00:53:06.789127 139957399803456 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00: fork to child time = 0.007771 sec 2024/11/24-00:53:06.789863 139957399803456 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00 2024/11/24-00:53:06.795317 139957399803456 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00 2024/11/24-00:53:06.796203 139957399803456 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/24-00:53:06.796550 139957399803456 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/24-00:53:06.886512 139957399803456 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-38918/att-00/MANIFEST-206347 2024/11/24-00:53:06.912158 139957399803456 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-38918/att-00/MANIFEST-206347 succeeded,manifest_file_number is 206347, next_file_number is 286408, last_sequence is 4358849720, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 286263 2024/11/24-00:53:06.912165 139957399803456 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/24-00:53:06.912278 139957399803456 [version_set.cc:5721] Creating manifest 286408 2024/11/24-00:53:06.950116 139957399803456 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/24-00:53:06.975053 139957399803456 [compaction_job.cc:2437] [default] [JOB 38918] Compacting 1@2 + 14@3 files to L3, score 0.56, subcompactions 1 : 1 2024/11/24-00:53:06.975067 139957399803456 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 29158 Base level 2, inputs: [286385(27MB)], [286342(34MB) 286343(3511KB) 286327(34MB) 286328(35MB) 286329(35MB) 286330(33MB) 286331(32MB) 286332(35MB) 286333(35MB) 286334(34MB) 286335(32MB) 286336(33MB) 286337(35MB) 286402(35MB)] 2024/11/24-00:53:06.981710 139957399803456 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/24-00:53:06.981738 139957399803456 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/24-00:53:06.981758 139957399803456 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/24-00:53:06.981765 139957399803456 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/24-00:53:06.981780 139957399803456 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/24-00:53:07.737210 139957399803456 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286409.sst) /dev/shm/ToplingTemp/Topling-231500-lEPdL6 2024/11/24-00:53:08.294760 139957399803456 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286409.sst): first pass time = 0.56's, 240.745'MB/sec 2024/11/24-00:53:09.632298 139957399803456 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286409.sst): old prealloc_size = 147639500, real_size = 32241920 2024/11/24-00:53:09.632837 139957399803456 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286409.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 929068 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1082 GB zip-val = 0.0302 GB avg-val = 116.46 avg-zval = 32.54 2024/11/24-00:53:09.633657 139957399803456 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286409.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-00:53:10.487881 139957399803456 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286409.sst): second pass time = 1.34's, 80.951'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.86's, 42.347'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3441.274'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.320'MB/sec write SST data time = 0.13's, 279.836'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 31925.332'MB/sec zip my value time = 1.34's, unzip length = 0.108'GB zip my value throughput = 80.951'MB/sec zip pipeline throughput = 80.951'MB/sec entries = 929068 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.46 avg-zval = 32.54 usrkeys = 929068 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.46 avg-zval = 32.54 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 929068 bytes = 3135616 } seq expand size = 6503476 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0302 GB dict = 1.08 MB all = 0.0362 GB } UnZip/Zip{ index = 10.4448 value = 3.5793 dict = 1.00 all = 3.7046 } Zip/UnZip{ index = 0.0957 value = 0.2794 dict = 1.00 all = 0.2699 } ---------------------------- total value len = 8.963327 GB avg = 0.168 KB (by entry num) total key len = 1.466835 GB avg = 0.028 KB total ukey len = 1.016459 GB avg = 0.015 KB total ukey num = 0.066479503 Billion total entry num = 0.053287232 Billion write speed all = 0.181462691 MB/sec (with seq num) write speed all = 0.174046013 MB/sec (without seq num) 2024/11/24-00:53:10.532216 139957399803456 [compaction_job.cc:1948] [default] [JOB 38918] Generated table #286409: 929068 keys, 36230356 bytes, temperature: kWarm 2024/11/24-00:53:10.532315 139957399803456 EVENT_LOG_v1 {"time_micros": 1732380790532254, "cf_name": "default", "job": 38918, "event": "table_file_creation", "file_number": 286409, "file_size": 36230356, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4261178730, "largest_seqno": 4358700786, "table_properties": {"data_size": 30230448, "index_size": 1779008, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26013904, "raw_average_key_size": 28, "raw_value_size": 108203868, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 929068, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732380787, "oldest_key_time": 0, "file_creation_time": 1732380787, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 286409, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-00:53:10.568367 139957399803456 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286410.sst) /dev/shm/ToplingTemp/Topling-231500-MZFAY6 2024/11/24-00:53:11.639571 139957399803456 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286410.sst): first pass time = 1.07's, 125.301'MB/sec 2024/11/24-00:53:12.970671 139957399803456 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286410.sst): old prealloc_size = 147639500, real_size = 32408800 2024/11/24-00:53:12.971251 139957399803456 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286410.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926920 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0304 GB avg-val = 116.80 avg-zval = 32.81 2024/11/24-00:53:12.972031 139957399803456 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286410.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-00:53:13.802481 139957399803456 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286410.sst): second pass time = 1.33's, 81.415'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.83's, 43.751'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3169.752'MB/sec (index lex order gen) rebuild zvType time = 0.70's, 0.330'MB/sec write SST data time = 0.13's, 284.222'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 33720.779'MB/sec zip my value time = 1.33's, unzip length = 0.108'GB zip my value throughput = 81.415'MB/sec zip pipeline throughput = 81.415'MB/sec entries = 926920 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.80 avg-zval = 32.81 usrkeys = 926920 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.80 avg-zval = 32.81 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 926920 bytes = 3128368 } seq expand size = 6488440 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0304 GB dict = 1.08 MB all = 0.0364 GB } UnZip/Zip{ index = 10.5122 value = 3.5598 dict = 1.00 all = 3.6882 } Zip/UnZip{ index = 0.0951 value = 0.2809 dict = 1.00 all = 0.2711 } ---------------------------- total value len = 9.078080 GB avg = 0.167 KB (by entry num) total key len = 1.492789 GB avg = 0.028 KB total ukey len = 1.034998 GB avg = 0.015 KB total ukey num = 0.067406423 Billion total entry num = 0.054214152 Billion write speed all = 0.183900076 MB/sec (with seq num) write speed all = 0.176354822 MB/sec (without seq num) 2024/11/24-00:53:13.847880 139957399803456 [compaction_job.cc:1948] [default] [JOB 38918] Generated table #286410: 926920 keys, 36391392 bytes, temperature: kWarm 2024/11/24-00:53:13.847952 139957399803456 EVENT_LOG_v1 {"time_micros": 1732380793847916, "cf_name": "default", "job": 38918, "event": "table_file_creation", "file_number": 286410, "file_size": 36391392, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4265680186, "largest_seqno": 4358700805, "table_properties": {"data_size": 30413392, "index_size": 1763520, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25953760, "raw_average_key_size": 28, "raw_value_size": 108264076, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926920, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732380790, "oldest_key_time": 0, "file_creation_time": 1732380790, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 286410, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-00:53:13.886351 139957399803456 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286411.sst) /dev/shm/ToplingTemp/Topling-231500-mOY1pa 2024/11/24-00:53:14.724049 139957399803456 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286411.sst): first pass time = 0.84's, 160.230'MB/sec 2024/11/24-00:53:16.056959 139957399803456 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286411.sst): old prealloc_size = 147639500, real_size = 33028096 2024/11/24-00:53:16.057552 139957399803456 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286411.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925353 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0310 GB avg-val = 117.05 avg-zval = 33.54 2024/11/24-00:53:16.058321 139957399803456 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286411.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-00:53:16.898515 139957399803456 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286411.sst): second pass time = 1.33's, 81.309'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 43.975'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3271.247'MB/sec (index lex order gen) rebuild zvType time = 0.71's, 0.324'MB/sec write SST data time = 0.13's, 290.762'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 31828.184'MB/sec zip my value time = 1.33's, unzip length = 0.108'GB zip my value throughput = 81.309'MB/sec zip pipeline throughput = 81.309'MB/sec entries = 925353 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.05 avg-zval = 33.54 usrkeys = 925353 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.05 avg-zval = 33.54 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 925353 bytes = 3123088 } seq expand size = 6477471 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0310 GB dict = 1.08 MB all = 0.0370 GB } UnZip/Zip{ index = 10.5127 value = 3.4897 dict = 1.00 all = 3.6269 } Zip/UnZip{ index = 0.0951 value = 0.2866 dict = 1.00 all = 0.2757 } ---------------------------- total value len = 9.192865 GB avg = 0.167 KB (by entry num) total key len = 1.518699 GB avg = 0.028 KB total ukey len = 1.053505 GB avg = 0.015 KB total ukey num = 0.068331776 Billion total entry num = 0.055139505 Billion write speed all = 0.186337699 MB/sec (with seq num) write speed all = 0.178664072 MB/sec (without seq num) 2024/11/24-00:53:16.943522 139957399803456 [compaction_job.cc:1948] [default] [JOB 38918] Generated table #286411: 925353 keys, 37006438 bytes, temperature: kWarm 2024/11/24-00:53:16.943593 139957399803456 EVENT_LOG_v1 {"time_micros": 1732380796943558, "cf_name": "default", "job": 38918, "event": "table_file_creation", "file_number": 286411, "file_size": 37006438, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4265680212, "largest_seqno": 4358701143, "table_properties": {"data_size": 31036144, "index_size": 1760448, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25909884, "raw_average_key_size": 28, "raw_value_size": 108307966, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 925353, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732380793, "oldest_key_time": 0, "file_creation_time": 1732380793, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 286411, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-00:53:16.980292 139957399803456 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286412.sst) /dev/shm/ToplingTemp/Topling-231500-DgayJ7 2024/11/24-00:53:17.900233 139957399803456 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286412.sst): first pass time = 0.92's, 145.904'MB/sec 2024/11/24-00:53:19.240274 139957399803456 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286412.sst): old prealloc_size = 147639500, real_size = 33562560 2024/11/24-00:53:19.240792 139957399803456 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286412.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926298 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1083 GB zip-val = 0.0316 GB avg-val = 116.90 avg-zval = 34.07 2024/11/24-00:53:19.241570 139957399803456 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286412.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-00:53:20.084562 139957399803456 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286412.sst): second pass time = 1.34's, 80.847'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 44.473'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3580.924'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 0.322'MB/sec write SST data time = 0.13's, 299.142'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 36001.666'MB/sec zip my value time = 1.34's, unzip length = 0.108'GB zip my value throughput = 80.847'MB/sec zip pipeline throughput = 80.847'MB/sec entries = 926298 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.90 avg-zval = 34.07 usrkeys = 926298 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.90 avg-zval = 34.07 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 926298 bytes = 3126272 } seq expand size = 6484086 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0316 GB dict = 1.08 MB all = 0.0375 GB } UnZip/Zip{ index = 10.4448 value = 3.4313 dict = 1.00 all = 3.5746 } Zip/UnZip{ index = 0.0957 value = 0.2914 dict = 1.00 all = 0.2797 } ---------------------------- total value len = 9.307631 GB avg = 0.166 KB (by entry num) total key len = 1.544635 GB avg = 0.028 KB total ukey len = 1.072031 GB avg = 0.015 KB total ukey num = 0.069258074 Billion total entry num = 0.056065803 Billion write speed all = 0.188774876 MB/sec (with seq num) write speed all = 0.180972771 MB/sec (without seq num) 2024/11/24-00:53:20.131310 139957399803456 [compaction_job.cc:1948] [default] [JOB 38918] Generated table #286412: 926298 keys, 37547278 bytes, temperature: kWarm 2024/11/24-00:53:20.131381 139957399803456 EVENT_LOG_v1 {"time_micros": 1732380800131346, "cf_name": "default", "job": 38918, "event": "table_file_creation", "file_number": 286412, "file_size": 37547278, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4265679834, "largest_seqno": 4358701305, "table_properties": {"data_size": 31557104, "index_size": 1773696, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25936344, "raw_average_key_size": 28, "raw_value_size": 108281388, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926298, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732380796, "oldest_key_time": 0, "file_creation_time": 1732380796, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 286412, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-00:53:20.167571 139957399803456 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286413.sst) /dev/shm/ToplingTemp/Topling-231500-Smrw0a 2024/11/24-00:53:21.166131 139957399803456 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286413.sst): first pass time = 1.00's, 134.416'MB/sec 2024/11/24-00:53:22.438635 139957399803456 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286413.sst): old prealloc_size = 147639500, real_size = 29255360 2024/11/24-00:53:22.439194 139957399803456 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286413.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 942784 prefix = 4 raw-key = 0.0151 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1078 GB zip-val = 0.0272 GB avg-val = 114.36 avg-zval = 28.88 2024/11/24-00:53:22.439953 139957399803456 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286413.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0024 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-00:53:23.273166 139957399803456 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286413.sst): second pass time = 1.27's, 84.783'MB/sec, value only(80.3% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.83's, 39.883'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3359.142'MB/sec (index lex order gen) rebuild zvType time = 0.71's, 0.333'MB/sec write SST data time = 0.13's, 264.981'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.075'MB, throughput = 33515.682'MB/sec zip my value time = 1.27's, unzip length = 0.108'GB zip my value throughput = 84.783'MB/sec zip pipeline throughput = 84.783'MB/sec entries = 942784 avg-key = 28.00 avg-zkey = 1.90 avg-val = 114.36 avg-zval = 28.88 usrkeys = 942784 avg-key = 20.00 avg-zkey = 1.90 avg-val = 121.36 avg-zval = 28.88 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 942784 bytes = 3181904 } seq expand size = 6599488 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0189 GB value = 0.1078 GB dict = 1.07 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0272 GB dict = 1.07 MB all = 0.0333 GB } UnZip/Zip{ index = 10.5124 value = 3.9602 dict = 1.00 all = 4.0327 } Zip/UnZip{ index = 0.0951 value = 0.2525 dict = 1.00 all = 0.2480 } ---------------------------- total value len = 9.422050 GB avg = 0.165 KB (by entry num) total key len = 1.571033 GB avg = 0.028 KB total ukey len = 1.090886 GB avg = 0.016 KB total ukey num = 0.070200858 Billion total entry num = 0.057008587 Billion write speed all = 0.191213783 MB/sec (with seq num) write speed all = 0.183280920 MB/sec (without seq num) 2024/11/24-00:53:23.313375 139957399803456 [compaction_job.cc:1948] [default] [JOB 38918] Generated table #286413: 942784 keys, 33282486 bytes, temperature: kWarm 2024/11/24-00:53:23.313443 139957399803456 EVENT_LOG_v1 {"time_micros": 1732380803313408, "cf_name": "default", "job": 38918, "event": "table_file_creation", "file_number": 286413, "file_size": 33282486, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4265679848, "largest_seqno": 4358700682, "table_properties": {"data_size": 27225840, "index_size": 1793664, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26397952, "raw_average_key_size": 28, "raw_value_size": 107819812, "raw_average_value_size": 114, "num_data_blocks": 1, "num_entries": 942784, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732380800, "oldest_key_time": 0, "file_creation_time": 1732380800, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 286413, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-00:53:23.352854 139957399803456 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286414.sst) /dev/shm/ToplingTemp/Topling-231500-j6aYVa 2024/11/24-00:53:24.334361 139957399803456 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286414.sst): first pass time = 0.98's, 136.752'MB/sec 2024/11/24-00:53:25.638479 139957399803456 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286414.sst): old prealloc_size = 147639500, real_size = 30281056 2024/11/24-00:53:25.639024 139957399803456 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286414.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 930465 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.1082 GB zip-val = 0.0283 GB avg-val = 116.25 avg-zval = 30.37 2024/11/24-00:53:25.639787 139957399803456 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286414.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-00:53:26.456008 139957399803456 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286414.sst): second pass time = 1.30's, 82.993'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.82's, 41.922'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3451.344'MB/sec (index lex order gen) rebuild zvType time = 0.69's, 0.336'MB/sec write SST data time = 0.12's, 274.546'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 33246.671'MB/sec zip my value time = 1.30's, unzip length = 0.108'GB zip my value throughput = 82.993'MB/sec zip pipeline throughput = 82.993'MB/sec entries = 930465 avg-key = 28.00 avg-zkey = 1.93 avg-val = 116.25 avg-zval = 30.37 usrkeys = 930465 avg-key = 20.00 avg-zkey = 1.93 avg-val = 123.25 avg-zval = 30.37 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 930465 bytes = 3140336 } seq expand size = 6513255 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0283 GB dict = 1.08 MB all = 0.0343 GB } UnZip/Zip{ index = 10.3765 value = 3.8282 dict = 1.00 all = 3.9163 } Zip/UnZip{ index = 0.0964 value = 0.2612 dict = 1.00 all = 0.2553 } ---------------------------- total value len = 9.536728 GB avg = 0.165 KB (by entry num) total key len = 1.597086 GB avg = 0.028 KB total ukey len = 1.109496 GB avg = 0.016 KB total ukey num = 0.071131323 Billion total entry num = 0.057939052 Billion write speed all = 0.193650940 MB/sec (with seq num) write speed all = 0.185589047 MB/sec (without seq num) 2024/11/24-00:53:26.499051 139957399803456 [compaction_job.cc:1948] [default] [JOB 38918] Generated table #286414: 930465 keys, 34271178 bytes, temperature: kWarm 2024/11/24-00:53:26.499122 139957399803456 EVENT_LOG_v1 {"time_micros": 1732380806499086, "cf_name": "default", "job": 38918, "event": "table_file_creation", "file_number": 286414, "file_size": 34271178, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4271703916, "largest_seqno": 4358698832, "table_properties": {"data_size": 28254864, "index_size": 1793408, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26053020, "raw_average_key_size": 28, "raw_value_size": 108164834, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 930465, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732380803, "oldest_key_time": 0, "file_creation_time": 1732380803, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 286414, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-00:53:26.553187 139957399803456 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286415.sst) /dev/shm/ToplingTemp/Topling-231500-WOoFpa 2024/11/24-00:53:27.482770 139957399803456 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286415.sst): first pass time = 0.93's, 144.392'MB/sec 2024/11/24-00:53:28.801586 139957399803456 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286415.sst): old prealloc_size = 147639500, real_size = 32822672 2024/11/24-00:53:28.802141 139957399803456 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286415.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 930572 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0308 GB avg-val = 116.23 avg-zval = 33.12 2024/11/24-00:53:28.802903 139957399803456 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286415.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-00:53:29.661539 139957399803456 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286415.sst): second pass time = 1.32's, 82.067'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.86's, 42.811'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3326.579'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.317'MB/sec write SST data time = 0.12's, 294.855'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 30484.446'MB/sec zip my value time = 1.32's, unzip length = 0.108'GB zip my value throughput = 82.067'MB/sec zip pipeline throughput = 82.067'MB/sec entries = 930572 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.23 avg-zval = 33.12 usrkeys = 930572 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.23 avg-zval = 33.12 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 930572 bytes = 3140688 } seq expand size = 6514004 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0308 GB dict = 1.08 MB all = 0.0368 GB } UnZip/Zip{ index = 10.5124 value = 3.5095 dict = 1.00 all = 3.6458 } Zip/UnZip{ index = 0.0951 value = 0.2849 dict = 1.00 all = 0.2743 } ---------------------------- total value len = 9.651404 GB avg = 0.164 KB (by entry num) total key len = 1.623142 GB avg = 0.028 KB total ukey len = 1.128107 GB avg = 0.016 KB total ukey num = 0.072061895 Billion total entry num = 0.058869624 Billion write speed all = 0.196087762 MB/sec (with seq num) write speed all = 0.187896842 MB/sec (without seq num) 2024/11/24-00:53:29.706083 139957399803456 [compaction_job.cc:1948] [default] [JOB 38918] Generated table #286415: 930572 keys, 36814458 bytes, temperature: kWarm 2024/11/24-00:53:29.706154 139957399803456 EVENT_LOG_v1 {"time_micros": 1732380809706119, "cf_name": "default", "job": 38918, "event": "table_file_creation", "file_number": 286415, "file_size": 36814458, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4265679865, "largest_seqno": 4358700531, "table_properties": {"data_size": 30819392, "index_size": 1770432, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26056016, "raw_average_key_size": 28, "raw_value_size": 108161756, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 930572, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732380806, "oldest_key_time": 0, "file_creation_time": 1732380806, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 286415, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-00:53:29.739752 139957399803456 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286416.sst) /dev/shm/ToplingTemp/Topling-231500-LWFbha 2024/11/24-00:53:30.702443 139957399803456 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286416.sst): first pass time = 0.96's, 139.424'MB/sec 2024/11/24-00:53:32.025457 139957399803456 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286416.sst): old prealloc_size = 147639500, real_size = 32128640 2024/11/24-00:53:32.026019 139957399803456 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286416.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 932220 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1081 GB zip-val = 0.0301 GB avg-val = 115.98 avg-zval = 32.31 2024/11/24-00:53:32.026801 139957399803456 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286416.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-00:53:32.870803 139957399803456 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286416.sst): second pass time = 1.32's, 81.791'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.85's, 42.736'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3289.391'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 0.324'MB/sec write SST data time = 0.13's, 285.547'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 33088.571'MB/sec zip my value time = 1.32's, unzip length = 0.108'GB zip my value throughput = 81.791'MB/sec zip pipeline throughput = 81.791'MB/sec entries = 932220 avg-key = 28.00 avg-zkey = 1.90 avg-val = 115.98 avg-zval = 32.31 usrkeys = 932220 avg-key = 20.00 avg-zkey = 1.90 avg-val = 122.98 avg-zval = 32.31 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 932220 bytes = 3146256 } seq expand size = 6525540 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0301 GB dict = 1.08 MB all = 0.0361 GB } UnZip/Zip{ index = 10.5143 value = 3.5892 dict = 1.00 all = 3.7153 } Zip/UnZip{ index = 0.0951 value = 0.2786 dict = 1.00 all = 0.2692 } ---------------------------- total value len = 9.766045 GB avg = 0.163 KB (by entry num) total key len = 1.649244 GB avg = 0.028 KB total ukey len = 1.146752 GB avg = 0.016 KB total ukey num = 0.072994115 Billion total entry num = 0.059801844 Billion write speed all = 0.198524499 MB/sec (with seq num) write speed all = 0.190204337 MB/sec (without seq num) 2024/11/24-00:53:32.916196 139957399803456 [compaction_job.cc:1948] [default] [JOB 38918] Generated table #286416: 932220 keys, 36125854 bytes, temperature: kWarm 2024/11/24-00:53:32.916268 139957399803456 EVENT_LOG_v1 {"time_micros": 1732380812916231, "cf_name": "default", "job": 38918, "event": "table_file_creation", "file_number": 286416, "file_size": 36125854, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4265679880, "largest_seqno": 4358700375, "table_properties": {"data_size": 30122160, "index_size": 1773248, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26102160, "raw_average_key_size": 28, "raw_value_size": 108115568, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 932220, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732380809, "oldest_key_time": 0, "file_creation_time": 1732380809, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 286416, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-00:53:32.956150 139957399803456 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286417.sst) /dev/shm/ToplingTemp/Topling-231500-lhiM98 2024/11/24-00:53:33.970928 139957399803456 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286417.sst): first pass time = 1.01's, 132.269'MB/sec 2024/11/24-00:53:35.259465 139957399803456 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286417.sst): old prealloc_size = 147639500, real_size = 30277792 2024/11/24-00:53:35.259994 139957399803456 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286417.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 929616 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1082 GB zip-val = 0.0283 GB avg-val = 116.38 avg-zval = 30.41 2024/11/24-00:53:35.260755 139957399803456 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286417.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-00:53:36.071126 139957399803456 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286417.sst): second pass time = 1.29's, 84.043'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.81's, 42.075'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3520.198'MB/sec (index lex order gen) rebuild zvType time = 0.68's, 0.340'MB/sec write SST data time = 0.13's, 269.122'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 32512.033'MB/sec zip my value time = 1.29's, unzip length = 0.108'GB zip my value throughput = 84.043'MB/sec zip pipeline throughput = 84.043'MB/sec entries = 929616 avg-key = 28.00 avg-zkey = 1.92 avg-val = 116.38 avg-zval = 30.41 usrkeys = 929616 avg-key = 20.00 avg-zkey = 1.92 avg-val = 123.38 avg-zval = 30.41 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 929616 bytes = 3021264 } seq expand size = 6507312 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0283 GB dict = 1.08 MB all = 0.0342 GB } UnZip/Zip{ index = 10.4438 value = 3.8277 dict = 1.00 all = 3.9302 } Zip/UnZip{ index = 0.0958 value = 0.2613 dict = 1.00 all = 0.2544 } ---------------------------- total value len = 9.880741 GB avg = 0.163 KB (by entry num) total key len = 1.675273 GB avg = 0.028 KB total ukey len = 1.165344 GB avg = 0.016 KB total ukey num = 0.073923731 Billion total entry num = 0.060731460 Billion write speed all = 0.200960680 MB/sec (with seq num) write speed all = 0.192511653 MB/sec (without seq num) 2024/11/24-00:53:36.112920 139957399803456 [compaction_job.cc:1948] [default] [JOB 38918] Generated table #286417: 929616 keys, 34150040 bytes, temperature: kWarm 2024/11/24-00:53:36.112997 139957399803456 EVENT_LOG_v1 {"time_micros": 1732380816112952, "cf_name": "default", "job": 38918, "event": "table_file_creation", "file_number": 286417, "file_size": 34150040, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4292604423, "largest_seqno": 4358699834, "table_properties": {"data_size": 28264976, "index_size": 1780224, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26029248, "raw_average_key_size": 28, "raw_value_size": 108188616, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 929616, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732380812, "oldest_key_time": 0, "file_creation_time": 1732380812, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 286417, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-00:53:36.148705 139957399803456 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286418.sst) /dev/shm/ToplingTemp/Topling-231500-uXO1a7 2024/11/24-00:53:37.145140 139957399803456 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286418.sst): first pass time = 1.00's, 134.703'MB/sec 2024/11/24-00:53:38.451632 139957399803456 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286418.sst): old prealloc_size = 147639500, real_size = 30992336 2024/11/24-00:53:38.452175 139957399803456 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286418.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 922758 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1084 GB zip-val = 0.0290 GB avg-val = 117.45 avg-zval = 31.43 2024/11/24-00:53:38.453849 139957399803456 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286418.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-00:53:39.262163 139957399803456 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286418.sst): second pass time = 1.31's, 83.008'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.81's, 43.139'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3306.053'MB/sec (index lex order gen) rebuild zvType time = 0.68's, 0.337'MB/sec write SST data time = 0.13's, 278.160'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 31393.182'MB/sec zip my value time = 1.31's, unzip length = 0.108'GB zip my value throughput = 83.008'MB/sec zip pipeline throughput = 83.008'MB/sec entries = 922758 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.45 avg-zval = 31.43 usrkeys = 922758 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.45 avg-zval = 31.43 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 922758 bytes = 3114320 } seq expand size = 6459306 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0290 GB dict = 1.08 MB all = 0.0350 GB } UnZip/Zip{ index = 10.5134 value = 3.7365 dict = 1.00 all = 3.8387 } Zip/UnZip{ index = 0.0951 value = 0.2676 dict = 1.00 all = 0.2605 } ---------------------------- total value len = 9.995581 GB avg = 0.162 KB (by entry num) total key len = 1.701111 GB avg = 0.028 KB total ukey len = 1.183799 GB avg = 0.016 KB total ukey num = 0.074846489 Billion total entry num = 0.061654218 Billion write speed all = 0.203395787 MB/sec (with seq num) write speed all = 0.194818860 MB/sec (without seq num) 2024/11/24-00:53:39.304987 139957399803456 [compaction_job.cc:1948] [default] [JOB 38918] Generated table #286418: 922758 keys, 34964810 bytes, temperature: kWarm 2024/11/24-00:53:39.305064 139957399803456 EVENT_LOG_v1 {"time_micros": 1732380819305027, "cf_name": "default", "job": 38918, "event": "table_file_creation", "file_number": 286418, "file_size": 34964810, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4265679891, "largest_seqno": 4358701121, "table_properties": {"data_size": 29006080, "index_size": 1755392, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25837224, "raw_average_key_size": 28, "raw_value_size": 108380536, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 922758, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732380816, "oldest_key_time": 0, "file_creation_time": 1732380816, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 286418, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-00:53:39.356867 139957399803456 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286419.sst) /dev/shm/ToplingTemp/Topling-231500-bUA3y8 2024/11/24-00:53:40.178402 139957399803456 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286419.sst): first pass time = 0.82's, 163.383'MB/sec 2024/11/24-00:53:41.512083 139957399803456 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286419.sst): old prealloc_size = 147639500, real_size = 32830048 2024/11/24-00:53:41.512624 139957399803456 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286419.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925472 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1083 GB zip-val = 0.0308 GB avg-val = 117.03 avg-zval = 33.31 2024/11/24-00:53:41.513378 139957399803456 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286419.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-00:53:42.357569 139957399803456 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286419.sst): second pass time = 1.33's, 81.256'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.85's, 43.536'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3427.462'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 0.322'MB/sec write SST data time = 0.13's, 293.630'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 34464.704'MB/sec zip my value time = 1.33's, unzip length = 0.108'GB zip my value throughput = 81.256'MB/sec zip pipeline throughput = 81.256'MB/sec entries = 925472 avg-key = 28.00 avg-zkey = 1.91 avg-val = 117.03 avg-zval = 33.31 usrkeys = 925472 avg-key = 20.00 avg-zkey = 1.91 avg-val = 124.03 avg-zval = 33.31 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 925472 bytes = 3123488 } seq expand size = 6478304 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0308 GB dict = 1.08 MB all = 0.0368 GB } UnZip/Zip{ index = 10.4442 value = 3.5134 dict = 1.00 all = 3.6464 } Zip/UnZip{ index = 0.0957 value = 0.2846 dict = 1.00 all = 0.2742 } ---------------------------- total value len = 10.110363 GB avg = 0.162 KB (by entry num) total key len = 1.727024 GB avg = 0.028 KB total ukey len = 1.202309 GB avg = 0.016 KB total ukey num = 0.075771961 Billion total entry num = 0.062579690 Billion write speed all = 0.205831296 MB/sec (with seq num) write speed all = 0.197126092 MB/sec (without seq num) 2024/11/24-00:53:42.403810 139957399803456 [compaction_job.cc:1948] [default] [JOB 38918] Generated table #286419: 925472 keys, 36808258 bytes, temperature: kWarm 2024/11/24-00:53:42.403880 139957399803456 EVENT_LOG_v1 {"time_micros": 1732380822403845, "cf_name": "default", "job": 38918, "event": "table_file_creation", "file_number": 286419, "file_size": 36808258, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4265679902, "largest_seqno": 4358700659, "table_properties": {"data_size": 30826256, "index_size": 1772224, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25913216, "raw_average_key_size": 28, "raw_value_size": 108304568, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 925472, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732380819, "oldest_key_time": 0, "file_creation_time": 1732380819, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 286419, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-00:53:42.444930 139957399803456 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286420.sst) /dev/shm/ToplingTemp/Topling-231500-3bZbY9 2024/11/24-00:53:43.298529 139957399803456 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286420.sst): first pass time = 0.85's, 157.245'MB/sec 2024/11/24-00:53:44.647459 139957399803456 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286420.sst): old prealloc_size = 147639500, real_size = 33118960 2024/11/24-00:53:44.648023 139957399803456 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286420.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 929067 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1082 GB zip-val = 0.0311 GB avg-val = 116.47 avg-zval = 33.48 2024/11/24-00:53:44.649683 139957399803456 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286420.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-00:53:45.506789 139957399803456 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286420.sst): second pass time = 1.35's, 80.262'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.86's, 43.183'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3283.442'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.317'MB/sec write SST data time = 0.13's, 294.442'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 31931.485'MB/sec zip my value time = 1.35's, unzip length = 0.108'GB zip my value throughput = 80.262'MB/sec zip pipeline throughput = 80.262'MB/sec entries = 929067 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.47 avg-zval = 33.48 usrkeys = 929067 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.47 avg-zval = 33.48 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 929067 bytes = 3135616 } seq expand size = 6503469 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0311 GB dict = 1.08 MB all = 0.0371 GB } UnZip/Zip{ index = 10.4455 value = 3.4784 dict = 1.00 all = 3.6170 } Zip/UnZip{ index = 0.0957 value = 0.2875 dict = 1.00 all = 0.2765 } ---------------------------- total value len = 10.225071 GB avg = 0.161 KB (by entry num) total key len = 1.753038 GB avg = 0.028 KB total ukey len = 1.220890 GB avg = 0.016 KB total ukey num = 0.076701028 Billion total entry num = 0.063508757 Billion write speed all = 0.208266787 MB/sec (with seq num) write speed all = 0.199432828 MB/sec (without seq num) 2024/11/24-00:53:45.552438 139957399803456 [compaction_job.cc:1948] [default] [JOB 38918] Generated table #286420: 929067 keys, 37107620 bytes, temperature: kWarm 2024/11/24-00:53:45.552510 139957399803456 EVENT_LOG_v1 {"time_micros": 1732380825552474, "cf_name": "default", "job": 38918, "event": "table_file_creation", "file_number": 286420, "file_size": 37107620, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4265679921, "largest_seqno": 4358700906, "table_properties": {"data_size": 31107616, "index_size": 1778880, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26013876, "raw_average_key_size": 28, "raw_value_size": 108203966, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 929067, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732380822, "oldest_key_time": 0, "file_creation_time": 1732380822, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 286420, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-00:53:45.589036 139957399803456 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286421.sst) /dev/shm/ToplingTemp/Topling-231500-hgzle9 2024/11/24-00:53:46.612112 139957399803456 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286421.sst): first pass time = 1.02's, 131.195'MB/sec 2024/11/24-00:53:47.956565 139957399803456 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286421.sst): old prealloc_size = 147639500, real_size = 32511136 2024/11/24-00:53:47.957163 139957399803456 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286421.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 929382 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1082 GB zip-val = 0.0305 GB avg-val = 116.42 avg-zval = 32.82 2024/11/24-00:53:47.957918 139957399803456 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286421.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-00:53:48.811112 139957399803456 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286421.sst): second pass time = 1.34's, 80.551'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.85's, 42.715'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3114.865'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 0.321'MB/sec write SST data time = 0.13's, 281.064'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 29821.568'MB/sec zip my value time = 1.34's, unzip length = 0.108'GB zip my value throughput = 80.551'MB/sec zip pipeline throughput = 80.551'MB/sec entries = 929382 avg-key = 28.00 avg-zkey = 1.92 avg-val = 116.42 avg-zval = 32.82 usrkeys = 929382 avg-key = 20.00 avg-zkey = 1.92 avg-val = 123.42 avg-zval = 32.82 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 929382 bytes = 3136672 } seq expand size = 6505674 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0305 GB dict = 1.08 MB all = 0.0365 GB } UnZip/Zip{ index = 10.4434 value = 3.5475 dict = 1.00 all = 3.6771 } Zip/UnZip{ index = 0.0958 value = 0.2819 dict = 1.00 all = 0.2720 } ---------------------------- total value len = 10.339772 GB avg = 0.160 KB (by entry num) total key len = 1.779060 GB avg = 0.028 KB total ukey len = 1.239478 GB avg = 0.016 KB total ukey num = 0.077630410 Billion total entry num = 0.064438139 Billion write speed all = 0.210701480 MB/sec (with seq num) write speed all = 0.201738761 MB/sec (without seq num) 2024/11/24-00:53:48.856343 139957399803456 [compaction_job.cc:1948] [default] [JOB 38918] Generated table #286421: 929382 keys, 36500596 bytes, temperature: kWarm 2024/11/24-00:53:48.856415 139957399803456 EVENT_LOG_v1 {"time_micros": 1732380828856379, "cf_name": "default", "job": 38918, "event": "table_file_creation", "file_number": 286421, "file_size": 36500596, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4265679941, "largest_seqno": 4358700618, "table_properties": {"data_size": 30498768, "index_size": 1779840, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26022696, "raw_average_key_size": 28, "raw_value_size": 108195044, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 929382, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732380825, "oldest_key_time": 0, "file_creation_time": 1732380825, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 286421, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-00:53:48.901586 139957399803456 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286422.sst) /dev/shm/ToplingTemp/Topling-231500-wAoD26 2024/11/24-00:53:49.027633 139957399803456 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286422.sst): first pass time = 0.13's, 238.231'MB/sec 2024/11/24-00:53:49.310258 139957399803456 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286422.sst): old prealloc_size = 147639500, real_size = 8490816 2024/11/24-00:53:49.310443 139957399803456 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286422.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 205610 prefix = 4 raw-key = 0.0033 GB zip-key = 0.0004 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.0243 GB zip-val = 0.0080 GB avg-val = 118.00 avg-zval = 39.12 2024/11/24-00:53:49.310642 139957399803456 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286422.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0005 GB, waited 0.000 sec, Key+Value = 0.030 GB 2024/11/24-00:53:49.494253 139957399803456 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00/286422.sst): second pass time = 0.28's, 86.202'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.18's, 50.746'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2466.984'MB/sec (index lex order gen) rebuild zvType time = 0.16's, 0.331'MB/sec write SST data time = 0.03's, 326.021'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.253'MB, throughput = 8365.745'MB/sec zip my value time = 0.28's, unzip length = 0.024'GB zip my value throughput = 86.202'MB/sec zip pipeline throughput = 86.202'MB/sec entries = 205610 avg-key = 28.00 avg-zkey = 1.92 avg-val = 118.00 avg-zval = 39.12 usrkeys = 205610 avg-key = 20.00 avg-zkey = 1.92 avg-val = 125.00 avg-zval = 39.12 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 205610 bytes = 642544 } seq expand size = 1439270 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0041 GB value = 0.0243 GB dict = 0.25 MB all = 0.0300 GB } __ZipSize{ index = 0.0004 GB value = 0.0080 GB dict = 0.25 MB all = 0.0093 GB } UnZip/Zip{ index = 10.4172 value = 3.0160 dict = 1.00 all = 3.2154 } Zip/UnZip{ index = 0.0960 value = 0.3316 dict = 1.00 all = 0.3110 } ---------------------------- total value len = 10.365473 GB avg = 0.160 KB (by entry num) total key len = 1.784817 GB avg = 0.028 KB total ukey len = 1.243590 GB avg = 0.016 KB total ukey num = 0.077836020 Billion total entry num = 0.064643749 Billion write speed all = 0.211245914 MB/sec (with seq num) write speed all = 0.202254704 MB/sec (without seq num) 2024/11/24-00:53:49.511420 139957399803456 [compaction_job.cc:1948] [default] [JOB 38918] Generated table #286422: 205610 keys, 9336071 bytes, temperature: kWarm 2024/11/24-00:53:49.511477 139957399803456 EVENT_LOG_v1 {"time_micros": 1732380829511449, "cf_name": "default", "job": 38918, "event": "table_file_creation", "file_number": 286422, "file_size": 9336071, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4293026972, "largest_seqno": 4317054513, "table_properties": {"data_size": 8044464, "index_size": 394752, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5757080, "raw_average_key_size": 28, "raw_value_size": 24261980, "raw_average_value_size": 118, "num_data_blocks": 1, "num_entries": 205610, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 118, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732380828, "oldest_key_time": 0, "file_creation_time": 1732380828, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 286422, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-00:53:49.524040 139957399803456 [compaction_job.cc:703] job-38918: subcompact[0], size: 0.476537 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-38918/att-00 [286409,286410,286411,286412,286413,286414,286415,286416,286417,286418,286419,286420,286421,286422] 2024/11/24-00:53:49.606722 139957399803456 (Original Log Time 2024/11/24-00:53:06.975120) EVENT_LOG_v1 {"time_micros": 1732380786975080, "job": 38918, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [286385], "files_L3": [286342, 286343, 286327, 286328, 286329, 286330, 286331, 286332, 286333, 286334, 286335, 286336, 286337, 286402], "score": 0.563584, "input_data_size": 501900848, "oldest_snapshot_seqno": 4358849705} 2024/11/24-00:53:49.606726 139957399803456 (Original Log Time 2024/11/24-00:53:49.605560) [compaction_job.cc:2022] [default] [JOB 38918] Compacted 1@2 + 14@3 files to L3 => 476536835 bytes 2024/11/24-00:53:49.606727 139957399803456 (Original Log Time 2024/11/24-00:53:49.606656) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 14 0 0 0] max score 0.02, MB/sec: 11.8 rd, 11.2 wr, level 3, files in(1, 14) out(14 +0 blob) MB in(27.1, 451.6 +0.0 blob) out(454.5 +0.0 blob), read-write-amplify(34.4) write-amplify(16.8) OK, records in: 12384932, records dropped: 99347 output_compression: Snappy 2024/11/24-00:53:49.606733 139957399803456 (Original Log Time 2024/11/24-00:53:49.606700) EVENT_LOG_v1 {"time_micros": 1732380829606679, "cf": "default", "job": 38918, "event": "compaction_finished", "compaction_time_micros": 42548930, "compaction_time_cpu_micros": 18392573, "output_level": 3, "num_output_files": 14, "total_output_size": 476536835, "num_input_records": 12384932, "num_output_records": 12285585, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 331996982, "file_range_sync_nanos": 0, "file_fsync_nanos": 9273, "file_prepare_write_nanos": 38563, "lsm_state": [0, 0, 0, 14, 0, 0, 0]} 2024/11/24-00:53:49.747529 139957399803456 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732256054,"starts":1732380786,"executesMs":42808,"compactionJobId":38918,"attempt":0,"compactionInputRawBytes":1788957632,"compactionInputZipBytes":501900848,"compactionOutputRawBytes":0,"compactionOutputZipBytes":476536835,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-2256a4bbdfbd629a002021d740536329-d208e0d370c77e03-00"}}, response = 2024/11/24-00:53:49.747604 139957399803456 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-38918/att-00: olev 3, work 42.808 s, result 7.725 ms, install 1.188 ms, input{raw 1.666 GiB zip 478.650 MiB}