2024/11/23-19:26:10.875041 139957576050240 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00: fork to child time = 0.022459 sec 2024/11/23-19:26:10.875952 139957576050240 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00 2024/11/23-19:26:10.885519 139957576050240 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00 2024/11/23-19:26:10.886772 139957576050240 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/23-19:26:10.887155 139957576050240 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/23-19:26:10.945352 139957576050240 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-34176/att-00/MANIFEST-206347 2024/11/23-19:26:10.971737 139957576050240 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-34176/att-00/MANIFEST-206347 succeeded,manifest_file_number is 206347, next_file_number is 277133, last_sequence is 4214791692, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 276977 2024/11/23-19:26:10.971747 139957576050240 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/23-19:26:10.971928 139957576050240 [version_set.cc:5721] Creating manifest 277133 2024/11/23-19:26:11.009720 139957576050240 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/23-19:26:11.032209 139957576050240 [compaction_job.cc:2437] [default] [JOB 34176] Compacting 1@2 + 18@3 files to L3, score 1.00, subcompactions 1 : 1 2024/11/23-19:26:11.032235 139957576050240 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 25584 Base level 2, inputs: [277113(27MB)], [277128(37MB) 277129(1874KB) 277024(36MB) 277065(39MB) 277066(37MB) 277067(38MB) 277068(35MB) 277069(35MB) 277070(33MB) 277071(35MB) 277072(36MB) 277073(36MB) 277074(35MB) 277075(35MB) 277076(36MB) 277077(37MB) 277078(36MB) 277080(36MB)] 2024/11/23-19:26:11.039009 139957576050240 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-19:26:11.039042 139957576050240 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-19:26:11.039059 139957576050240 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-19:26:11.039065 139957576050240 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-19:26:11.039078 139957576050240 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-19:26:11.645160 139957576050240 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277134.sst) /dev/shm/ToplingTemp/Topling-165532-4jQkEW 2024/11/23-19:26:12.448676 139957576050240 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277134.sst): first pass time = 0.80's, 167.051'MB/sec 2024/11/23-19:26:15.696854 139957576050240 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277134.sst): old prealloc_size = 147639500, real_size = 34845328 2024/11/23-19:26:15.697495 139957576050240 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277134.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928815 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1082 GB zip-val = 0.0328 GB avg-val = 116.50 avg-zval = 35.35 2024/11/23-19:26:15.698329 139957576050240 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277134.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-19:26:16.737126 139957576050240 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277134.sst): second pass time = 3.25's, 33.323'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.04's, 37.331'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2875.293'MB/sec (index lex order gen) rebuild zvType time = 0.80's, 0.289'MB/sec write SST data time = 0.24's, 164.657'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 28487.648'MB/sec zip my value time = 3.25's, unzip length = 0.108'GB zip my value throughput = 33.323'MB/sec zip pipeline throughput = 111.950'MB/sec entries = 928815 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.50 avg-zval = 35.35 usrkeys = 928815 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.50 avg-zval = 35.35 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 928815 bytes = 3134768 } seq expand size = 6501705 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0328 GB dict = 1.08 MB all = 0.0388 GB } UnZip/Zip{ index = 10.4453 value = 3.2956 dict = 1.00 all = 3.4563 } Zip/UnZip{ index = 0.0957 value = 0.3034 dict = 1.00 all = 0.2893 } ---------------------------- total value len = 8.963332 GB avg = 0.168 KB (by entry num) total key len = 1.466828 GB avg = 0.028 KB total ukey len = 1.016454 GB avg = 0.015 KB total ukey num = 0.066479250 Billion total entry num = 0.053286979 Billion write speed all = 0.275459975 MB/sec (with seq num) write speed all = 0.264201525 MB/sec (without seq num) 2024/11/23-19:26:16.794688 139957576050240 [compaction_job.cc:1948] [default] [JOB 34176] Generated table #277134: 928815 keys, 38833148 bytes, temperature: kWarm 2024/11/23-19:26:16.794827 139957576050240 EVENT_LOG_v1 {"time_micros": 1732361176794734, "cf_name": "default", "job": 34176, "event": "table_file_creation", "file_number": 277134, "file_size": 38833148, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4136224572, "largest_seqno": 4214720466, "table_properties": {"data_size": 32834496, "index_size": 1778432, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26006820, "raw_average_key_size": 28, "raw_value_size": 108210994, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928815, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732361171, "oldest_key_time": 0, "file_creation_time": 1732361171, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 277134, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-19:26:16.873114 139957576050240 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277135.sst) /dev/shm/ToplingTemp/Topling-165532-xfORpW 2024/11/23-19:26:18.066366 139957576050240 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277135.sst): first pass time = 1.19's, 112.485'MB/sec 2024/11/23-19:26:20.528510 139957576050240 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277135.sst): old prealloc_size = 147639500, real_size = 34629840 2024/11/23-19:26:20.529098 139957576050240 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277135.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926466 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0326 GB avg-val = 116.87 avg-zval = 35.23 2024/11/23-19:26:20.529896 139957576050240 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277135.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-19:26:21.611373 139957576050240 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277135.sst): second pass time = 2.46's, 43.998'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.08's, 35.551'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3115.741'MB/sec (index lex order gen) rebuild zvType time = 0.85's, 0.274'MB/sec write SST data time = 0.24's, 163.073'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 33980.685'MB/sec zip my value time = 2.46's, unzip length = 0.108'GB zip my value throughput = 43.998'MB/sec zip pipeline throughput = 101.578'MB/sec entries = 926466 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.87 avg-zval = 35.23 usrkeys = 926466 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.87 avg-zval = 35.23 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 926466 bytes = 3011024 } seq expand size = 6485262 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0326 GB dict = 1.08 MB all = 0.0385 GB } UnZip/Zip{ index = 10.5116 value = 3.3178 dict = 1.00 all = 3.4866 } Zip/UnZip{ index = 0.0951 value = 0.3014 dict = 1.00 all = 0.2868 } ---------------------------- total value len = 9.078095 GB avg = 0.167 KB (by entry num) total key len = 1.492769 GB avg = 0.028 KB total ukey len = 1.034984 GB avg = 0.015 KB total ukey num = 0.067405716 Billion total entry num = 0.054213445 Billion write speed all = 0.279140003 MB/sec (with seq num) write speed all = 0.267687284 MB/sec (without seq num) 2024/11/23-19:26:21.666128 139957576050240 [compaction_job.cc:1948] [default] [JOB 34176] Generated table #277135: 926466 keys, 38495268 bytes, temperature: kWarm 2024/11/23-19:26:21.666209 139957576050240 EVENT_LOG_v1 {"time_micros": 1732361181666173, "cf_name": "default", "job": 34176, "event": "table_file_creation", "file_number": 277135, "file_size": 38495268, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4155809461, "largest_seqno": 4214719627, "table_properties": {"data_size": 32635264, "index_size": 1762752, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25941048, "raw_average_key_size": 28, "raw_value_size": 108276808, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926466, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732361176, "oldest_key_time": 0, "file_creation_time": 1732361176, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 277135, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-19:26:21.704108 139957576050240 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277136.sst) /dev/shm/ToplingTemp/Topling-165532-73njlY 2024/11/23-19:26:23.211189 139957576050240 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277136.sst): first pass time = 1.51's, 89.060'MB/sec 2024/11/23-19:26:24.847595 139957576050240 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277136.sst): old prealloc_size = 147639500, real_size = 35978800 2024/11/23-19:26:24.848189 139957576050240 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277136.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 934701 prefix = 4 raw-key = 0.0150 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.89 raw-val = 0.1080 GB zip-val = 0.0340 GB avg-val = 115.59 avg-zval = 36.35 2024/11/23-19:26:24.848983 139957576050240 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277136.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-19:26:25.996353 139957576050240 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277136.sst): second pass time = 1.64's, 66.074'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.15's, 34.912'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3086.660'MB/sec (index lex order gen) rebuild zvType time = 1.00's, 0.233'MB/sec write SST data time = 0.15's, 276.434'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 31928.741'MB/sec zip my value time = 1.64's, unzip length = 0.108'GB zip my value throughput = 66.074'MB/sec zip pipeline throughput = 66.074'MB/sec entries = 934701 avg-key = 28.00 avg-zkey = 1.89 avg-val = 115.59 avg-zval = 36.35 usrkeys = 934701 avg-key = 20.00 avg-zkey = 1.89 avg-val = 122.59 avg-zval = 36.35 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 934701 bytes = 3271472 } seq expand size = 6542907 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0187 GB value = 0.1080 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0340 GB dict = 1.08 MB all = 0.0401 GB } UnZip/Zip{ index = 10.5816 value = 3.1799 dict = 1.00 all = 3.3467 } Zip/UnZip{ index = 0.0945 value = 0.3145 dict = 1.00 all = 0.2988 } ---------------------------- total value len = 9.192684 GB avg = 0.167 KB (by entry num) total key len = 1.518941 GB avg = 0.028 KB total ukey len = 1.053678 GB avg = 0.015 KB total ukey num = 0.068340417 Billion total entry num = 0.055148146 Billion write speed all = 0.282824257 MB/sec (with seq num) write speed all = 0.271175429 MB/sec (without seq num) 2024/11/23-19:26:26.048624 139957576050240 [compaction_job.cc:1948] [default] [JOB 34176] Generated table #277136: 934701 keys, 40104234 bytes, temperature: kWarm 2024/11/23-19:26:26.048692 139957576050240 EVENT_LOG_v1 {"time_micros": 1732361186048657, "cf_name": "default", "job": 34176, "event": "table_file_creation", "file_number": 277136, "file_size": 40104234, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3967285072, "largest_seqno": 4214720339, "table_properties": {"data_size": 33978272, "index_size": 1766656, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26171628, "raw_average_key_size": 28, "raw_value_size": 108046126, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 934701, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732361181, "oldest_key_time": 0, "file_creation_time": 1732361181, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 277136, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-19:26:26.085686 139957576050240 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277137.sst) /dev/shm/ToplingTemp/Topling-165532-0GOw3V 2024/11/23-19:26:27.339205 139957576050240 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277137.sst): first pass time = 1.25's, 107.076'MB/sec 2024/11/23-19:26:28.814972 139957576050240 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277137.sst): old prealloc_size = 147639500, real_size = 36462016 2024/11/23-19:26:28.815676 139957576050240 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277137.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 932880 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.1081 GB zip-val = 0.0344 GB avg-val = 115.87 avg-zval = 36.91 2024/11/23-19:26:28.816386 139957576050240 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277137.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-19:26:29.716129 139957576050240 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277137.sst): second pass time = 1.47's, 73.338'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.90's, 44.143'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2685.359'MB/sec (index lex order gen) rebuild zvType time = 0.74's, 0.315'MB/sec write SST data time = 0.16's, 248.021'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 34754.595'MB/sec zip my value time = 1.47's, unzip length = 0.108'GB zip my value throughput = 73.338'MB/sec zip pipeline throughput = 73.338'MB/sec entries = 932880 avg-key = 28.00 avg-zkey = 1.93 avg-val = 115.87 avg-zval = 36.91 usrkeys = 932880 avg-key = 20.00 avg-zkey = 1.93 avg-val = 120.67 avg-zval = 36.91 TagRS{ kinds = RS_Key0_TagN bytes = 145880 } TagArray{ size = 639020 bytes = 2316464 } seq expand size = 4473140 multi value expand size = 0 cnt WriteAppend = 18 UnZipSize{ index = 0.0187 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0344 GB dict = 1.08 MB all = 0.0398 GB } UnZip/Zip{ index = 10.3775 value = 3.1396 dict = 1.00 all = 3.3741 } Zip/UnZip{ index = 0.0964 value = 0.3185 dict = 1.00 all = 0.2964 } ---------------------------- total value len = 9.305254 GB avg = 0.166 KB (by entry num) total key len = 1.545061 GB avg = 0.028 KB total ukey len = 1.072335 GB avg = 0.015 KB total ukey num = 0.069273297 Billion total entry num = 0.056081026 Billion write speed all = 0.286458048 MB/sec (with seq num) write speed all = 0.274613333 MB/sec (without seq num) 2024/11/23-19:26:29.765992 139957576050240 [compaction_job.cc:1948] [default] [JOB 34176] Generated table #277137: 932880 keys, 39778364 bytes, temperature: kWarm 2024/11/23-19:26:29.766066 139957576050240 EVENT_LOG_v1 {"time_micros": 1732361189766030, "cf_name": "default", "job": 34176, "event": "table_file_creation", "file_number": 277137, "file_size": 39778364, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4012776165, "table_properties": {"data_size": 34430704, "index_size": 1797888, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26120640, "raw_average_key_size": 28, "raw_value_size": 108097192, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 932880, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732361186, "oldest_key_time": 0, "file_creation_time": 1732361186, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 277137, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-19:26:29.810737 139957576050240 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277138.sst) /dev/shm/ToplingTemp/Topling-165532-0h5xPX 2024/11/23-19:26:31.059478 139957576050240 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277138.sst): first pass time = 1.25's, 107.486'MB/sec 2024/11/23-19:26:32.658322 139957576050240 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277138.sst): old prealloc_size = 147639500, real_size = 35785696 2024/11/23-19:26:32.659038 139957576050240 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277138.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 929239 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.1082 GB zip-val = 0.0338 GB avg-val = 116.44 avg-zval = 36.33 2024/11/23-19:26:32.659934 139957576050240 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277138.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-19:26:33.493133 139957576050240 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277138.sst): second pass time = 1.60's, 67.709'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.83's, 48.183'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2579.736'MB/sec (index lex order gen) rebuild zvType time = 0.70's, 0.331'MB/sec write SST data time = 0.13's, 305.515'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 32732.073'MB/sec zip my value time = 1.60's, unzip length = 0.108'GB zip my value throughput = 67.709'MB/sec zip pipeline throughput = 67.709'MB/sec entries = 929239 avg-key = 28.00 avg-zkey = 1.93 avg-val = 116.44 avg-zval = 36.33 usrkeys = 929239 avg-key = 20.00 avg-zkey = 1.93 avg-val = 123.34 avg-zval = 36.33 TagRS{ kinds = RS_Key0_TagN bytes = 145280 } TagArray{ size = 916307 bytes = 3436160 } seq expand size = 6414149 multi value expand size = 0 cnt WriteAppend = 16 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0338 GB dict = 1.08 MB all = 0.0402 GB } UnZip/Zip{ index = 10.3754 value = 3.2048 dict = 1.00 all = 3.3368 } Zip/UnZip{ index = 0.0964 value = 0.3120 dict = 1.00 all = 0.2997 } ---------------------------- total value len = 9.419867 GB avg = 0.165 KB (by entry num) total key len = 1.571080 GB avg = 0.028 KB total ukey len = 1.090920 GB avg = 0.016 KB total ukey num = 0.070202536 Billion total entry num = 0.057010265 Billion write speed all = 0.290141926 MB/sec (with seq num) write speed all = 0.278102150 MB/sec (without seq num) 2024/11/23-19:26:33.546468 139957576050240 [compaction_job.cc:1948] [default] [JOB 34176] Generated table #277138: 929239 keys, 40223084 bytes, temperature: kWarm 2024/11/23-19:26:33.546542 139957576050240 EVENT_LOG_v1 {"time_micros": 1732361193546505, "cf_name": "default", "job": 34176, "event": "table_file_creation", "file_number": 277138, "file_size": 40223084, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4012775967, "table_properties": {"data_size": 33762000, "index_size": 1791232, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26018692, "raw_average_key_size": 28, "raw_value_size": 108199114, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 929239, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732361189, "oldest_key_time": 0, "file_creation_time": 1732361189, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 277138, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-19:26:33.597666 139957576050240 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277139.sst) /dev/shm/ToplingTemp/Topling-165532-iYWJTV 2024/11/23-19:26:34.735925 139957576050240 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277139.sst): first pass time = 1.14's, 117.919'MB/sec 2024/11/23-19:26:36.250500 139957576050240 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277139.sst): old prealloc_size = 147639500, real_size = 32759808 2024/11/23-19:26:36.251212 139957576050240 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277139.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928520 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0308 GB avg-val = 116.55 avg-zval = 33.13 2024/11/23-19:26:36.252102 139957576050240 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277139.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-19:26:37.117583 139957576050240 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277139.sst): second pass time = 1.51's, 71.528'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.87's, 42.782'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2520.986'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 0.324'MB/sec write SST data time = 0.15's, 246.474'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 36829.365'MB/sec zip my value time = 1.51's, unzip length = 0.108'GB zip my value throughput = 71.528'MB/sec zip pipeline throughput = 71.528'MB/sec entries = 928520 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.55 avg-zval = 33.13 usrkeys = 928520 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.55 avg-zval = 33.13 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 928520 bytes = 3481968 } seq expand size = 6499640 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0308 GB dict = 1.08 MB all = 0.0371 GB } UnZip/Zip{ index = 10.5143 value = 3.5180 dict = 1.00 all = 3.6182 } Zip/UnZip{ index = 0.0951 value = 0.2842 dict = 1.00 all = 0.2764 } ---------------------------- total value len = 9.534586 GB avg = 0.165 KB (by entry num) total key len = 1.597078 GB avg = 0.028 KB total ukey len = 1.109490 GB avg = 0.016 KB total ukey num = 0.071131056 Billion total entry num = 0.057938785 Billion write speed all = 0.293828511 MB/sec (with seq num) write speed all = 0.281593814 MB/sec (without seq num) 2024/11/23-19:26:37.166530 139957576050240 [compaction_job.cc:1948] [default] [JOB 34176] Generated table #277139: 928520 keys, 37095056 bytes, temperature: kWarm 2024/11/23-19:26:37.166596 139957576050240 EVENT_LOG_v1 {"time_micros": 1732361197166562, "cf_name": "default", "job": 34176, "event": "table_file_creation", "file_number": 277139, "file_size": 37095056, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3369353416, "largest_seqno": 4012776021, "table_properties": {"data_size": 30761264, "index_size": 1766208, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25998560, "raw_average_key_size": 28, "raw_value_size": 108219308, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928520, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732361193, "oldest_key_time": 0, "file_creation_time": 1732361193, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 277139, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-19:26:37.204257 139957576050240 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277140.sst) /dev/shm/ToplingTemp/Topling-165532-hdDuKV 2024/11/23-19:26:38.386460 139957576050240 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277140.sst): first pass time = 1.18's, 113.535'MB/sec 2024/11/23-19:26:39.863822 139957576050240 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277140.sst): old prealloc_size = 147639500, real_size = 34628240 2024/11/23-19:26:39.864571 139957576050240 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277140.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927156 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1083 GB zip-val = 0.0326 GB avg-val = 116.76 avg-zval = 35.18 2024/11/23-19:26:39.865376 139957576050240 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277140.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-19:26:40.817973 139957576050240 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277140.sst): second pass time = 1.48's, 73.393'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.95's, 40.269'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2447.678'MB/sec (index lex order gen) rebuild zvType time = 0.79's, 0.294'MB/sec write SST data time = 0.17's, 231.837'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 34891.723'MB/sec zip my value time = 1.48's, unzip length = 0.108'GB zip my value throughput = 73.393'MB/sec zip pipeline throughput = 73.393'MB/sec entries = 927156 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.76 avg-zval = 35.18 usrkeys = 927156 avg-key = 20.00 avg-zkey = 1.91 avg-val = 122.38 avg-zval = 35.18 TagRS{ kinds = RS_Key0_TagN bytes = 144960 } TagArray{ size = 744159 bytes = 2790608 } seq expand size = 5209113 multi value expand size = 0 cnt WriteAppend = 18 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0326 GB dict = 1.08 MB all = 0.0384 GB } UnZip/Zip{ index = 10.4451 value = 3.3186 dict = 1.00 all = 3.4932 } Zip/UnZip{ index = 0.0957 value = 0.3013 dict = 1.00 all = 0.2863 } ---------------------------- total value len = 9.648053 GB avg = 0.164 KB (by entry num) total key len = 1.623039 GB avg = 0.028 KB total ukey len = 1.128034 GB avg = 0.016 KB total ukey num = 0.072058212 Billion total entry num = 0.058865941 Billion write speed all = 0.297479730 MB/sec (with seq num) write speed all = 0.285050465 MB/sec (without seq num) 2024/11/23-19:26:40.866460 139957576050240 [compaction_job.cc:1948] [default] [JOB 34176] Generated table #277140: 927156 keys, 38422076 bytes, temperature: kWarm 2024/11/23-19:26:40.866527 139957576050240 EVENT_LOG_v1 {"time_micros": 1732361200866495, "cf_name": "default", "job": 34176, "event": "table_file_creation", "file_number": 277140, "file_size": 38422076, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4012776210, "table_properties": {"data_size": 32620992, "index_size": 1775296, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25960368, "raw_average_key_size": 28, "raw_value_size": 108257420, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927156, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732361197, "oldest_key_time": 0, "file_creation_time": 1732361197, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 277140, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-19:26:40.906842 139957576050240 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277141.sst) /dev/shm/ToplingTemp/Topling-165532-POfDEY 2024/11/23-19:26:42.082889 139957576050240 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277141.sst): first pass time = 1.18's, 114.130'MB/sec 2024/11/23-19:26:43.549881 139957576050240 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277141.sst): old prealloc_size = 147639500, real_size = 31742480 2024/11/23-19:26:43.550630 139957576050240 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277141.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 933457 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1081 GB zip-val = 0.0297 GB avg-val = 115.79 avg-zval = 31.85 2024/11/23-19:26:43.551658 139957576050240 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277141.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-19:26:44.436292 139957576050240 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277141.sst): second pass time = 1.47's, 73.763'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.89's, 40.587'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2427.723'MB/sec (index lex order gen) rebuild zvType time = 0.74's, 0.316'MB/sec write SST data time = 0.15's, 244.354'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 35197.897'MB/sec zip my value time = 1.47's, unzip length = 0.108'GB zip my value throughput = 73.763'MB/sec zip pipeline throughput = 73.763'MB/sec entries = 933457 avg-key = 28.00 avg-zkey = 1.90 avg-val = 115.79 avg-zval = 31.85 usrkeys = 933457 avg-key = 20.00 avg-zkey = 1.90 avg-val = 122.79 avg-zval = 31.85 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 933457 bytes = 3383792 } seq expand size = 6534199 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0187 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0297 GB dict = 1.08 MB all = 0.0360 GB } UnZip/Zip{ index = 10.5138 value = 3.6350 dict = 1.00 all = 3.7307 } Zip/UnZip{ index = 0.0951 value = 0.2751 dict = 1.00 all = 0.2680 } ---------------------------- total value len = 9.762668 GB avg = 0.163 KB (by entry num) total key len = 1.649176 GB avg = 0.028 KB total ukey len = 1.146703 GB avg = 0.016 KB total ukey num = 0.072991669 Billion total entry num = 0.059799398 Billion write speed all = 0.301165861 MB/sec (with seq num) write speed all = 0.288540706 MB/sec (without seq num) 2024/11/23-19:26:44.481209 139957576050240 [compaction_job.cc:1948] [default] [JOB 34176] Generated table #277141: 933457 keys, 35976598 bytes, temperature: kWarm 2024/11/23-19:26:44.481290 139957576050240 EVENT_LOG_v1 {"time_micros": 1732361204481253, "cf_name": "default", "job": 34176, "event": "table_file_creation", "file_number": 277141, "file_size": 35976598, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3480997236, "largest_seqno": 4012776228, "table_properties": {"data_size": 29733248, "index_size": 1775680, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26136796, "raw_average_key_size": 28, "raw_value_size": 108081050, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 933457, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732361200, "oldest_key_time": 0, "file_creation_time": 1732361200, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 277141, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-19:26:44.521206 139957576050240 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277142.sst) /dev/shm/ToplingTemp/Topling-165532-pSCGJW 2024/11/23-19:26:45.551896 139957576050240 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277142.sst): first pass time = 1.03's, 130.228'MB/sec 2024/11/23-19:26:47.050959 139957576050240 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277142.sst): old prealloc_size = 147639500, real_size = 33291168 2024/11/23-19:26:47.051687 139957576050240 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277142.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 931033 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1081 GB zip-val = 0.0313 GB avg-val = 116.16 avg-zval = 33.59 2024/11/23-19:26:47.054141 139957576050240 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277142.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-19:26:47.979904 139957576050240 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277142.sst): second pass time = 1.49's, 72.539'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.93's, 40.388'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2564.017'MB/sec (index lex order gen) rebuild zvType time = 0.77's, 0.303'MB/sec write SST data time = 0.16's, 235.522'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 36620.191'MB/sec zip my value time = 1.49's, unzip length = 0.108'GB zip my value throughput = 72.539'MB/sec zip pipeline throughput = 72.539'MB/sec entries = 931033 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.16 avg-zval = 33.59 usrkeys = 931033 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.16 avg-zval = 33.59 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 931033 bytes = 3375008 } seq expand size = 6517231 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0186 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0313 GB dict = 1.08 MB all = 0.0375 GB } UnZip/Zip{ index = 10.4458 value = 3.4579 dict = 1.00 all = 3.5774 } Zip/UnZip{ index = 0.0957 value = 0.2892 dict = 1.00 all = 0.2795 } ---------------------------- total value len = 9.877334 GB avg = 0.163 KB (by entry num) total key len = 1.675245 GB avg = 0.028 KB total ukey len = 1.165323 GB avg = 0.016 KB total ukey num = 0.073922702 Billion total entry num = 0.060730431 Billion write speed all = 0.304851441 MB/sec (with seq num) write speed all = 0.292030920 MB/sec (without seq num) 2024/11/23-19:26:48.027447 139957576050240 [compaction_job.cc:1948] [default] [JOB 34176] Generated table #277142: 931033 keys, 37517804 bytes, temperature: kWarm 2024/11/23-19:26:48.027510 139957576050240 EVENT_LOG_v1 {"time_micros": 1732361208027476, "cf_name": "default", "job": 34176, "event": "table_file_creation", "file_number": 277142, "file_size": 37517804, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3512539342, "largest_seqno": 4012776268, "table_properties": {"data_size": 31275664, "index_size": 1782592, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26068924, "raw_average_key_size": 28, "raw_value_size": 108148938, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 931033, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732361204, "oldest_key_time": 0, "file_creation_time": 1732361204, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 277142, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-19:26:48.064207 139957576050240 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277143.sst) /dev/shm/ToplingTemp/Topling-165532-iBpVrZ 2024/11/23-19:26:49.290267 139957576050240 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277143.sst): first pass time = 1.23's, 109.475'MB/sec 2024/11/23-19:26:50.822680 139957576050240 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277143.sst): old prealloc_size = 147639500, real_size = 34636528 2024/11/23-19:26:50.823423 139957576050240 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277143.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925441 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.1083 GB zip-val = 0.0326 GB avg-val = 117.03 avg-zval = 35.25 2024/11/23-19:26:50.826005 139957576050240 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277143.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-19:26:51.677342 139957576050240 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277143.sst): second pass time = 1.53's, 70.742'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.85's, 45.588'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2477.584'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.319'MB/sec write SST data time = 0.13's, 304.615'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 35057.804'MB/sec zip my value time = 1.53's, unzip length = 0.108'GB zip my value throughput = 70.742'MB/sec zip pipeline throughput = 70.742'MB/sec entries = 925441 avg-key = 28.00 avg-zkey = 1.93 avg-val = 117.03 avg-zval = 35.25 usrkeys = 925441 avg-key = 20.00 avg-zkey = 1.93 avg-val = 124.03 avg-zval = 35.25 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 925441 bytes = 3470416 } seq expand size = 6478087 multi value expand size = 0 cnt WriteAppend = 16 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0326 GB dict = 1.08 MB all = 0.0390 GB } UnZip/Zip{ index = 10.3742 value = 3.3201 dict = 1.00 all = 3.4449 } Zip/UnZip{ index = 0.0964 value = 0.3012 dict = 1.00 all = 0.2903 } ---------------------------- total value len = 9.992118 GB avg = 0.162 KB (by entry num) total key len = 1.701157 GB avg = 0.028 KB total ukey len = 1.183832 GB avg = 0.016 KB total ukey num = 0.074848143 Billion total entry num = 0.061655872 Billion write speed all = 0.308534044 MB/sec (with seq num) write speed all = 0.295519428 MB/sec (without seq num) 2024/11/23-19:26:51.726366 139957576050240 [compaction_job.cc:1948] [default] [JOB 34176] Generated table #277143: 925441 keys, 38961590 bytes, temperature: kWarm 2024/11/23-19:26:51.726434 139957576050240 EVENT_LOG_v1 {"time_micros": 1732361211726397, "cf_name": "default", "job": 34176, "event": "table_file_creation", "file_number": 277143, "file_size": 38961590, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3411274482, "largest_seqno": 4012774796, "table_properties": {"data_size": 32620832, "index_size": 1784128, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25912348, "raw_average_key_size": 28, "raw_value_size": 108305422, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 925441, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732361208, "oldest_key_time": 0, "file_creation_time": 1732361208, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 277143, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-19:26:51.764051 139957576050240 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277144.sst) /dev/shm/ToplingTemp/Topling-165532-zGMAFY 2024/11/23-19:26:52.902068 139957576050240 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277144.sst): first pass time = 1.14's, 117.944'MB/sec 2024/11/23-19:26:54.226447 139957576050240 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277144.sst): old prealloc_size = 147639500, real_size = 32605264 2024/11/23-19:26:54.227048 139957576050240 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277144.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 933130 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1081 GB zip-val = 0.0306 GB avg-val = 115.84 avg-zval = 32.79 2024/11/23-19:26:54.229149 139957576050240 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277144.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-19:26:55.090179 139957576050240 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277144.sst): second pass time = 1.32's, 81.663'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.86's, 42.652'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3058.927'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.318'MB/sec write SST data time = 0.13's, 284.775'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 35518.614'MB/sec zip my value time = 1.32's, unzip length = 0.108'GB zip my value throughput = 81.663'MB/sec zip pipeline throughput = 81.663'MB/sec entries = 933130 avg-key = 28.00 avg-zkey = 1.90 avg-val = 115.84 avg-zval = 32.79 usrkeys = 933130 avg-key = 20.00 avg-zkey = 1.90 avg-val = 122.84 avg-zval = 32.79 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 933130 bytes = 3382608 } seq expand size = 6531910 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0187 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0306 GB dict = 1.08 MB all = 0.0368 GB } UnZip/Zip{ index = 10.5139 value = 3.5327 dict = 1.00 all = 3.6434 } Zip/UnZip{ index = 0.0951 value = 0.2831 dict = 1.00 all = 0.2745 } ---------------------------- total value len = 10.106740 GB avg = 0.161 KB (by entry num) total key len = 1.727285 GB avg = 0.028 KB total ukey len = 1.202495 GB avg = 0.016 KB total ukey num = 0.075781273 Billion total entry num = 0.062589002 Billion write speed all = 0.312219695 MB/sec (with seq num) write speed all = 0.299009299 MB/sec (without seq num) 2024/11/23-19:26:55.137458 139957576050240 [compaction_job.cc:1948] [default] [JOB 34176] Generated table #277144: 933130 keys, 36838596 bytes, temperature: kWarm 2024/11/23-19:26:55.137542 139957576050240 EVENT_LOG_v1 {"time_micros": 1732361215137493, "cf_name": "default", "job": 34176, "event": "table_file_creation", "file_number": 277144, "file_size": 36838596, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3525889795, "largest_seqno": 4012776316, "table_properties": {"data_size": 30596736, "index_size": 1775040, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26127640, "raw_average_key_size": 28, "raw_value_size": 108090204, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 933130, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732361211, "oldest_key_time": 0, "file_creation_time": 1732361211, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 277144, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-19:26:55.173723 139957576050240 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277145.sst) /dev/shm/ToplingTemp/Topling-165532-pAvBTX 2024/11/23-19:26:56.138518 139957576050240 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277145.sst): first pass time = 0.96's, 139.121'MB/sec 2024/11/23-19:26:57.449503 139957576050240 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277145.sst): old prealloc_size = 147639500, real_size = 33964288 2024/11/23-19:26:57.450058 139957576050240 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277145.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 923008 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1084 GB zip-val = 0.0320 GB avg-val = 117.41 avg-zval = 34.64 2024/11/23-19:26:57.452148 139957576050240 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277145.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-19:26:58.301820 139957576050240 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277145.sst): second pass time = 1.31's, 82.746'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.85's, 44.918'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3306.260'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 0.319'MB/sec write SST data time = 0.13's, 297.374'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 34229.135'MB/sec zip my value time = 1.31's, unzip length = 0.108'GB zip my value throughput = 82.746'MB/sec zip pipeline throughput = 82.746'MB/sec entries = 923008 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.41 avg-zval = 34.64 usrkeys = 923008 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.41 avg-zval = 34.64 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 923008 bytes = 3461296 } seq expand size = 6461056 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0320 GB dict = 1.08 MB all = 0.0383 GB } UnZip/Zip{ index = 10.5128 value = 3.3891 dict = 1.00 all = 3.5059 } Zip/UnZip{ index = 0.0951 value = 0.2951 dict = 1.00 all = 0.2852 } ---------------------------- total value len = 10.221574 GB avg = 0.161 KB (by entry num) total key len = 1.753129 GB avg = 0.028 KB total ukey len = 1.220955 GB avg = 0.016 KB total ukey num = 0.076704281 Billion total entry num = 0.063512010 Billion write speed all = 0.315904490 MB/sec (with seq num) write speed all = 0.302500414 MB/sec (without seq num) 2024/11/23-19:26:58.348751 139957576050240 [compaction_job.cc:1948] [default] [JOB 34176] Generated table #277145: 923008 keys, 38283392 bytes, temperature: kWarm 2024/11/23-19:26:58.348819 139957576050240 EVENT_LOG_v1 {"time_micros": 1732361218348783, "cf_name": "default", "job": 34176, "event": "table_file_creation", "file_number": 277145, "file_size": 38283392, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3405268578, "largest_seqno": 4012776344, "table_properties": {"data_size": 31977392, "index_size": 1755968, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25844224, "raw_average_key_size": 28, "raw_value_size": 108373600, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 923008, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732361215, "oldest_key_time": 0, "file_creation_time": 1732361215, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 277145, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-19:26:58.386171 139957576050240 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277146.sst) /dev/shm/ToplingTemp/Topling-165532-2wVw7W 2024/11/23-19:26:59.400992 139957576050240 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277146.sst): first pass time = 1.01's, 132.263'MB/sec 2024/11/23-19:27:00.716689 139957576050240 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277146.sst): old prealloc_size = 147639500, real_size = 33031872 2024/11/23-19:27:00.717264 139957576050240 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277146.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928885 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1082 GB zip-val = 0.0310 GB avg-val = 116.49 avg-zval = 33.40 2024/11/23-19:27:00.719434 139957576050240 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277146.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-19:27:01.580507 139957576050240 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277146.sst): second pass time = 1.31's, 82.291'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.86's, 43.260'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3205.455'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.317'MB/sec write SST data time = 0.13's, 287.550'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 33671.763'MB/sec zip my value time = 1.31's, unzip length = 0.108'GB zip my value throughput = 82.291'MB/sec zip pipeline throughput = 82.291'MB/sec entries = 928885 avg-key = 28.00 avg-zkey = 1.92 avg-val = 116.49 avg-zval = 33.40 usrkeys = 928885 avg-key = 20.00 avg-zkey = 1.92 avg-val = 123.49 avg-zval = 33.40 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 928885 bytes = 3483328 } seq expand size = 6502195 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0310 GB dict = 1.08 MB all = 0.0374 GB } UnZip/Zip{ index = 10.4431 value = 3.4883 dict = 1.00 all = 3.5918 } Zip/UnZip{ index = 0.0958 value = 0.2867 dict = 1.00 all = 0.2784 } ---------------------------- total value len = 10.336286 GB avg = 0.160 KB (by entry num) total key len = 1.779138 GB avg = 0.028 KB total ukey len = 1.239533 GB avg = 0.016 KB total ukey num = 0.077633166 Billion total entry num = 0.064440895 Billion write speed all = 0.319589181 MB/sec (with seq num) write speed all = 0.305990242 MB/sec (without seq num) 2024/11/23-19:27:01.628259 139957576050240 [compaction_job.cc:1948] [default] [JOB 34176] Generated table #277146: 928885 keys, 37367964 bytes, temperature: kWarm 2024/11/23-19:27:01.628330 139957576050240 EVENT_LOG_v1 {"time_micros": 1732361221628293, "cf_name": "default", "job": 34176, "event": "table_file_creation", "file_number": 277146, "file_size": 37367964, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3471845708, "largest_seqno": 4012771944, "table_properties": {"data_size": 31020528, "index_size": 1778944, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26008780, "raw_average_key_size": 28, "raw_value_size": 108209090, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928885, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732361218, "oldest_key_time": 0, "file_creation_time": 1732361218, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 277146, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-19:27:01.664408 139957576050240 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277147.sst) /dev/shm/ToplingTemp/Topling-165532-5D7tvW 2024/11/23-19:27:02.671035 139957576050240 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277147.sst): first pass time = 1.01's, 133.340'MB/sec 2024/11/23-19:27:04.097702 139957576050240 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277147.sst): old prealloc_size = 147639500, real_size = 35256816 2024/11/23-19:27:04.098308 139957576050240 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277147.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 929173 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1082 GB zip-val = 0.0332 GB avg-val = 116.45 avg-zval = 35.78 2024/11/23-19:27:04.098742 139957576050240 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277147.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-19:27:04.873898 139957576050240 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277147.sst): second pass time = 1.43's, 75.885'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.78's, 48.576'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3026.729'MB/sec (index lex order gen) rebuild zvType time = 0.65's, 0.358'MB/sec write SST data time = 0.13's, 296.359'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 32166.304'MB/sec zip my value time = 1.43's, unzip length = 0.108'GB zip my value throughput = 75.885'MB/sec zip pipeline throughput = 75.885'MB/sec entries = 929173 avg-key = 28.00 avg-zkey = 1.92 avg-val = 116.45 avg-zval = 35.78 usrkeys = 929173 avg-key = 20.00 avg-zkey = 1.92 avg-val = 119.56 avg-zval = 35.78 TagRS{ kinds = RS_Key0_TagN bytes = 145280 } TagArray{ size = 412416 bytes = 1443472 } seq expand size = 2886912 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0332 GB dict = 1.08 MB all = 0.0377 GB } UnZip/Zip{ index = 10.4430 value = 3.2547 dict = 1.00 all = 3.5599 } Zip/UnZip{ index = 0.0958 value = 0.3073 dict = 1.00 all = 0.2809 } ---------------------------- total value len = 10.447374 GB avg = 0.160 KB (by entry num) total key len = 1.805154 GB avg = 0.028 KB total ukey len = 1.258116 GB avg = 0.016 KB total ukey num = 0.078562339 Billion total entry num = 0.065370068 Billion write speed all = 0.323177751 MB/sec (with seq num) write speed all = 0.309383927 MB/sec (without seq num) 2024/11/23-19:27:04.919184 139957576050240 [compaction_job.cc:1948] [default] [JOB 34176] Generated table #277147: 929173 keys, 37703099 bytes, temperature: kWarm 2024/11/23-19:27:04.919269 139957576050240 EVENT_LOG_v1 {"time_micros": 1732361224919224, "cf_name": "default", "job": 34176, "event": "table_file_creation", "file_number": 277147, "file_size": 37703099, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4012776360, "table_properties": {"data_size": 33244832, "index_size": 1779520, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26016844, "raw_average_key_size": 28, "raw_value_size": 108200982, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 929173, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732361221, "oldest_key_time": 0, "file_creation_time": 1732361221, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 277147, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-19:27:04.955428 139957576050240 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277148.sst) /dev/shm/ToplingTemp/Topling-165532-1wUksV 2024/11/23-19:27:05.852090 139957576050240 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277148.sst): first pass time = 0.90's, 149.692'MB/sec 2024/11/23-19:27:07.341452 139957576050240 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277148.sst): old prealloc_size = 147639500, real_size = 36858864 2024/11/23-19:27:07.342022 139957576050240 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277148.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926698 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0349 GB avg-val = 116.83 avg-zval = 37.62 2024/11/23-19:27:07.342262 139957576050240 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277148.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-19:27:08.056892 139957576050240 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277148.sst): second pass time = 1.49's, 72.735'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.72's, 53.597'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3222.941'MB/sec (index lex order gen) rebuild zvType time = 0.59's, 0.392'MB/sec write SST data time = 0.12's, 308.974'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 30115.085'MB/sec zip my value time = 1.49's, unzip length = 0.108'GB zip my value throughput = 72.735'MB/sec zip pipeline throughput = 72.735'MB/sec entries = 926698 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.83 avg-zval = 37.62 usrkeys = 926698 avg-key = 20.00 avg-zkey = 1.90 avg-val = 118.00 avg-zval = 37.62 TagRS{ kinds = RS_Key0_TagN bytes = 144880 } TagArray{ size = 154398 bytes = 482512 } seq expand size = 1080786 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0349 GB dict = 1.08 MB all = 0.0383 GB } UnZip/Zip{ index = 10.5142 value = 3.1055 dict = 1.00 all = 3.5003 } Zip/UnZip{ index = 0.0951 value = 0.3220 dict = 1.00 all = 0.2857 } ---------------------------- total value len = 10.556725 GB avg = 0.159 KB (by entry num) total key len = 1.831102 GB avg = 0.028 KB total ukey len = 1.276650 GB avg = 0.016 KB total ukey num = 0.079489037 Billion total entry num = 0.066296766 Billion write speed all = 0.326719011 MB/sec (with seq num) write speed all = 0.312730818 MB/sec (without seq num) 2024/11/23-19:27:08.103211 139957576050240 [compaction_job.cc:1948] [default] [JOB 34176] Generated table #277148: 926698 keys, 38344341 bytes, temperature: kWarm 2024/11/23-19:27:08.103283 139957576050240 EVENT_LOG_v1 {"time_micros": 1732361228103247, "cf_name": "default", "job": 34176, "event": "table_file_creation", "file_number": 277148, "file_size": 38344341, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3273700812, "table_properties": {"data_size": 34864224, "index_size": 1762752, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25947544, "raw_average_key_size": 28, "raw_value_size": 108270216, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926698, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732361224, "oldest_key_time": 0, "file_creation_time": 1732361224, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 277148, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-19:27:08.148031 139957576050240 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277149.sst) /dev/shm/ToplingTemp/Topling-165532-BWHaKW 2024/11/23-19:27:09.149027 139957576050240 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277149.sst): first pass time = 1.00's, 134.089'MB/sec 2024/11/23-19:27:10.464646 139957576050240 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277149.sst): old prealloc_size = 147639500, real_size = 34466352 2024/11/23-19:27:10.465203 139957576050240 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277149.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926955 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0325 GB avg-val = 116.79 avg-zval = 35.03 2024/11/23-19:27:10.467262 139957576050240 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277149.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-19:27:11.313818 139957576050240 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277149.sst): second pass time = 1.31's, 82.336'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.85's, 45.540'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3281.392'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 0.324'MB/sec write SST data time = 0.13's, 291.262'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 34857.318'MB/sec zip my value time = 1.31's, unzip length = 0.108'GB zip my value throughput = 82.336'MB/sec zip pipeline throughput = 82.336'MB/sec entries = 926955 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.79 avg-zval = 35.03 usrkeys = 926955 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.70 avg-zval = 35.03 TagRS{ kinds = RS_Key0_TagN bytes = 144920 } TagArray{ size = 914419 bytes = 3200480 } seq expand size = 6400933 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0325 GB dict = 1.08 MB all = 0.0387 GB } UnZip/Zip{ index = 10.5137 value = 3.3341 dict = 1.00 all = 3.4708 } Zip/UnZip{ index = 0.0951 value = 0.2999 dict = 1.00 all = 0.2881 } ---------------------------- total value len = 10.671388 GB avg = 0.159 KB (by entry num) total key len = 1.857057 GB avg = 0.028 KB total ukey len = 1.295189 GB avg = 0.016 KB total ukey num = 0.080415992 Billion total entry num = 0.067223721 Billion write speed all = 0.330399336 MB/sec (with seq num) write speed all = 0.316216779 MB/sec (without seq num) 2024/11/23-19:27:11.360298 139957576050240 [compaction_job.cc:1948] [default] [JOB 34176] Generated table #277149: 926955 keys, 38670126 bytes, temperature: kWarm 2024/11/23-19:27:11.360371 139957576050240 EVENT_LOG_v1 {"time_micros": 1732361231360333, "cf_name": "default", "job": 34176, "event": "table_file_creation", "file_number": 277149, "file_size": 38670126, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4214720444, "table_properties": {"data_size": 32471072, "index_size": 1763328, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25954740, "raw_average_key_size": 28, "raw_value_size": 108263010, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926955, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732361228, "oldest_key_time": 0, "file_creation_time": 1732361228, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 277149, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-19:27:11.404502 139957576050240 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277150.sst) /dev/shm/ToplingTemp/Topling-165532-i1UIaV 2024/11/23-19:27:12.462272 139957576050240 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277150.sst): first pass time = 1.06's, 126.893'MB/sec 2024/11/23-19:27:13.808957 139957576050240 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277150.sst): old prealloc_size = 147639500, real_size = 35232864 2024/11/23-19:27:13.809532 139957576050240 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277150.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 930377 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1082 GB zip-val = 0.0332 GB avg-val = 116.26 avg-zval = 35.70 2024/11/23-19:27:13.811429 139957576050240 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277150.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-19:27:14.645692 139957576050240 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277150.sst): second pass time = 1.35's, 80.367'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 46.879'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3362.484'MB/sec (index lex order gen) rebuild zvType time = 0.71's, 0.329'MB/sec write SST data time = 0.13's, 305.623'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 33622.088'MB/sec zip my value time = 1.35's, unzip length = 0.108'GB zip my value throughput = 80.367'MB/sec zip pipeline throughput = 80.367'MB/sec entries = 930377 avg-key = 28.00 avg-zkey = 1.92 avg-val = 116.26 avg-zval = 35.70 usrkeys = 930377 avg-key = 20.00 avg-zkey = 1.92 avg-val = 123.26 avg-zval = 35.70 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 930377 bytes = 3140032 } seq expand size = 6512639 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0332 GB dict = 1.08 MB all = 0.0392 GB } UnZip/Zip{ index = 10.4430 value = 3.2563 dict = 1.00 all = 3.4218 } Zip/UnZip{ index = 0.0958 value = 0.3071 dict = 1.00 all = 0.2922 } ---------------------------- total value len = 10.786068 GB avg = 0.158 KB (by entry num) total key len = 1.883107 GB avg = 0.028 KB total ukey len = 1.313797 GB avg = 0.016 KB total ukey num = 0.081346369 Billion total entry num = 0.068154098 Billion write speed all = 0.334081315 MB/sec (with seq num) write speed all = 0.319703735 MB/sec (without seq num) 2024/11/23-19:27:14.692108 139957576050240 [compaction_job.cc:1948] [default] [JOB 34176] Generated table #277150: 930377 keys, 39224486 bytes, temperature: kWarm 2024/11/23-19:27:14.692173 139957576050240 EVENT_LOG_v1 {"time_micros": 1732361234692139, "cf_name": "default", "job": 34176, "event": "table_file_creation", "file_number": 277150, "file_size": 39224486, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4100102034, "largest_seqno": 4214720606, "table_properties": {"data_size": 33218256, "index_size": 1781824, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26050556, "raw_average_key_size": 28, "raw_value_size": 108167254, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 930377, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732361231, "oldest_key_time": 0, "file_creation_time": 1732361231, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 277150, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-19:27:14.727327 139957576050240 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277151.sst) /dev/shm/ToplingTemp/Topling-165532-eNGkSX 2024/11/23-19:27:14.845627 139957576050240 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277151.sst): first pass time = 0.12's, 242.912'MB/sec 2024/11/23-19:27:15.122031 139957576050240 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277151.sst): old prealloc_size = 147639500, real_size = 8151536 2024/11/23-19:27:15.122198 139957576050240 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277151.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 196767 prefix = 4 raw-key = 0.0031 GB zip-key = 0.0004 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.0232 GB zip-val = 0.0077 GB avg-val = 118.00 avg-zval = 39.26 2024/11/23-19:27:15.122401 139957576050240 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277151.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0004 GB, waited 0.000 sec, Key+Value = 0.029 GB 2024/11/23-19:27:15.298366 139957576050240 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00/277151.sst): second pass time = 0.28's, 84.229'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.18's, 50.967'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2589.895'MB/sec (index lex order gen) rebuild zvType time = 0.15's, 0.331'MB/sec write SST data time = 0.03's, 326.182'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.243'MB, throughput = 7972.659'MB/sec zip my value time = 0.28's, unzip length = 0.023'GB zip my value throughput = 84.229'MB/sec zip pipeline throughput = 84.229'MB/sec entries = 196767 avg-key = 28.00 avg-zkey = 1.92 avg-val = 118.00 avg-zval = 39.26 usrkeys = 196767 avg-key = 20.00 avg-zkey = 1.92 avg-val = 125.00 avg-zval = 39.26 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 196767 bytes = 639504 } seq expand size = 1377369 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0039 GB value = 0.0232 GB dict = 0.24 MB all = 0.0287 GB } __ZipSize{ index = 0.0004 GB value = 0.0077 GB dict = 0.24 MB all = 0.0090 GB } UnZip/Zip{ index = 10.4132 value = 3.0059 dict = 1.00 all = 3.1969 } Zip/UnZip{ index = 0.0960 value = 0.3327 dict = 1.00 all = 0.3128 } ---------------------------- total value len = 10.810664 GB avg = 0.158 KB (by entry num) total key len = 1.888617 GB avg = 0.028 KB total ukey len = 1.317732 GB avg = 0.016 KB total ukey num = 0.081543136 Billion total entry num = 0.068350865 Billion write speed all = 0.334869418 MB/sec (with seq num) write speed all = 0.320450577 MB/sec (without seq num) 2024/11/23-19:27:15.314932 139957576050240 [compaction_job.cc:1948] [default] [JOB 34176] Generated table #277151: 196767 keys, 8986127 bytes, temperature: kWarm 2024/11/23-19:27:15.315003 139957576050240 EVENT_LOG_v1 {"time_micros": 1732361235314959, "cf_name": "default", "job": 34176, "event": "table_file_creation", "file_number": 277151, "file_size": 8986127, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4158278810, "largest_seqno": 4193514500, "table_properties": {"data_size": 7724256, "index_size": 377920, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5509476, "raw_average_key_size": 28, "raw_value_size": 23218506, "raw_average_value_size": 118, "num_data_blocks": 1, "num_entries": 196767, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 118, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732361234, "oldest_key_time": 0, "file_creation_time": 1732361234, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 277151, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-19:27:15.328172 139957576050240 [compaction_job.cc:703] job-34176: subcompact[0], size: 0.660825 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34176/att-00 [277134,277135,277136,277137,277138,277139,277140,277141,277142,277143,277144,277145,277146,277147,277148,277149,277150,277151] 2024/11/23-19:27:15.455423 139957576050240 (Original Log Time 2024/11/23-19:26:11.032289) EVENT_LOG_v1 {"time_micros": 1732361171032250, "job": 34176, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [277113], "files_L3": [277128, 277129, 277024, 277065, 277066, 277067, 277068, 277069, 277070, 277071, 277072, 277073, 277074, 277075, 277076, 277077, 277078, 277080], "score": 0.998834, "input_data_size": 679377641, "oldest_snapshot_seqno": 4214791656} 2024/11/23-19:27:15.455426 139957576050240 (Original Log Time 2024/11/23-19:27:15.454022) [compaction_job.cc:2022] [default] [JOB 34176] Compacted 1@2 + 18@3 files to L3 => 660825353 bytes 2024/11/23-19:27:15.455428 139957576050240 (Original Log Time 2024/11/23-19:27:15.455360) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 18 0 0 0] max score 0.02, MB/sec: 10.6 rd, 10.3 wr, level 3, files in(1, 18) out(18 +0 blob) MB in(27.2, 620.7 +0.0 blob) out(630.2 +0.0 blob), read-write-amplify(47.0) write-amplify(23.2) OK, records in: 16065782, records dropped: 73081 output_compression: Snappy 2024/11/23-19:27:15.455433 139957576050240 (Original Log Time 2024/11/23-19:27:15.455403) EVENT_LOG_v1 {"time_micros": 1732361235455383, "cf": "default", "job": 34176, "event": "compaction_finished", "compaction_time_micros": 64295891, "compaction_time_cpu_micros": 26224577, "output_level": 3, "num_output_files": 18, "total_output_size": 660825353, "num_input_records": 16065782, "num_output_records": 15992701, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 514978891, "file_range_sync_nanos": 0, "file_fsync_nanos": 12594, "file_prepare_write_nanos": 51486, "lsm_state": [0, 0, 0, 18, 0, 0, 0]} 2024/11/23-19:27:15.595346 139957576050240 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732256054,"starts":1732361170,"executesMs":64570,"compactionJobId":34176,"attempt":0,"compactionInputRawBytes":2320808364,"compactionInputZipBytes":679377641,"compactionOutputRawBytes":0,"compactionOutputZipBytes":660825353,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-1a22a48ff6d79220bd3d59c382d5a9fb-e0a28879bccb3c1a-00"}}, response = 2024/11/23-19:27:15.595432 139957576050240 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-34176/att-00: olev 3, work 64.571 s, result 7.736 ms, install 1.427 ms, input{raw 2.161 GiB zip 647.905 MiB}