2024/11/24-07:17:50.234325 139957693548096 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00: fork to child time = 0.007806 sec 2024/11/24-07:17:50.235123 139957693548096 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00 2024/11/24-07:17:50.241294 139957693548096 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00 2024/11/24-07:17:50.242202 139957693548096 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/24-07:17:50.242460 139957693548096 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/24-07:17:50.314075 139957693548096 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-43319/att-00/MANIFEST-206347 2024/11/24-07:17:50.339531 139957693548096 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-43319/att-00/MANIFEST-206347 succeeded,manifest_file_number is 206347, next_file_number is 296088, last_sequence is 4493831553, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 295922 2024/11/24-07:17:50.339536 139957693548096 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/24-07:17:50.339666 139957693548096 [version_set.cc:5721] Creating manifest 296088 2024/11/24-07:17:50.372335 139957693548096 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/24-07:17:50.391970 139957693548096 [compaction_job.cc:2437] [default] [JOB 43319] Compacting 1@2 + 26@3 files to L3, score 0.97, subcompactions 1 : 1 2024/11/24-07:17:50.392001 139957693548096 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 32470 Base level 2, inputs: [296027(27MB)], [296086(18MB) 295987(33MB) 295988(30MB) 295989(30MB) 295990(34MB) 295991(32MB) 295992(31MB) 295993(33MB) 295994(33MB) 295995(34MB) 295996(33MB) 295997(32MB) 295998(34MB) 295999(33MB) 296000(21MB) 295952(34MB) 295953(33MB) 295954(34MB) 295955(33MB) 295956(32MB) 295957(35MB) 295958(33MB) 295959(34MB) 295960(33MB) 295961(33MB) 296048(35MB)] 2024/11/24-07:17:50.398540 139957693548096 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/24-07:17:50.398567 139957693548096 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/24-07:17:50.398586 139957693548096 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/24-07:17:50.398591 139957693548096 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/24-07:17:50.398602 139957693548096 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/24-07:17:51.028389 139957693548096 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296089.sst) /dev/shm/ToplingTemp/Topling-296260-Zcz5iY 2024/11/24-07:17:52.034190 139957693548096 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296089.sst): first pass time = 1.01's, 133.451'MB/sec 2024/11/24-07:17:53.396649 139957693548096 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296089.sst): old prealloc_size = 147639500, real_size = 33545712 2024/11/24-07:17:53.397198 139957693548096 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296089.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928203 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1082 GB zip-val = 0.0315 GB avg-val = 116.60 avg-zval = 33.98 2024/11/24-07:17:53.398013 139957693548096 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296089.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-07:17:54.259750 139957693548096 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296089.sst): second pass time = 1.36's, 79.520'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.86's, 43.625'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3357.818'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.317'MB/sec write SST data time = 0.13's, 287.876'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 28567.574'MB/sec zip my value time = 1.36's, unzip length = 0.108'GB zip my value throughput = 79.520'MB/sec zip pipeline throughput = 79.520'MB/sec entries = 928203 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.60 avg-zval = 33.98 usrkeys = 928203 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.60 avg-zval = 33.98 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 928203 bytes = 3248720 } seq expand size = 6497421 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0315 GB dict = 1.08 MB all = 0.0377 GB } UnZip/Zip{ index = 10.4463 value = 3.4318 dict = 1.00 all = 3.5647 } Zip/UnZip{ index = 0.0957 value = 0.2914 dict = 1.00 all = 0.2805 } ---------------------------- total value len = 2251.440299 GB avg = 0.200 KB (by entry num) total key len = 306.908952 GB avg = 0.027 KB total ukey len = 237.373291 GB avg = 0.015 KB total ukey num = 15.739589366 Billion total entry num = 11.280903314 Billion write speed all = 31.756260009 MB/sec (with seq num) write speed all = 30.636039856 MB/sec (without seq num) 2024/11/24-07:17:54.305375 139957693548096 [compaction_job.cc:1948] [default] [JOB 43319] Generated table #296089: 928203 keys, 37651924 bytes, temperature: kWarm 2024/11/24-07:17:54.305485 139957693548096 EVENT_LOG_v1 {"time_micros": 1732403874305415, "cf_name": "default", "job": 43319, "event": "table_file_creation", "file_number": 296089, "file_size": 37651924, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4265679834, "largest_seqno": 4493438381, "table_properties": {"data_size": 31536416, "index_size": 1777088, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25989684, "raw_average_key_size": 28, "raw_value_size": 108228134, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928203, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732403871, "oldest_key_time": 0, "file_creation_time": 1732403871, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 296089, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-07:17:54.342777 139957693548096 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296090.sst) /dev/shm/ToplingTemp/Topling-296260-03L7g1 2024/11/24-07:17:55.294381 139957693548096 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296090.sst): first pass time = 0.95's, 141.050'MB/sec 2024/11/24-07:17:56.579225 139957693548096 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296090.sst): old prealloc_size = 147639500, real_size = 29673952 2024/11/24-07:17:56.579768 139957693548096 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296090.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 934686 prefix = 4 raw-key = 0.0150 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1080 GB zip-val = 0.0277 GB avg-val = 115.60 avg-zval = 29.58 2024/11/24-07:17:56.580564 139957693548096 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296090.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-07:17:57.409693 139957693548096 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296090.sst): second pass time = 1.28's, 84.146'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.83's, 40.694'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3434.756'MB/sec (index lex order gen) rebuild zvType time = 0.70's, 0.335'MB/sec write SST data time = 0.13's, 256.790'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 32591.240'MB/sec zip my value time = 1.28's, unzip length = 0.108'GB zip my value throughput = 84.146'MB/sec zip pipeline throughput = 84.146'MB/sec entries = 934686 avg-key = 28.00 avg-zkey = 1.92 avg-val = 115.60 avg-zval = 29.58 usrkeys = 934686 avg-key = 20.00 avg-zkey = 1.92 avg-val = 122.60 avg-zval = 29.58 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 934686 bytes = 3271408 } seq expand size = 6542802 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0187 GB value = 0.1080 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0277 GB dict = 1.08 MB all = 0.0338 GB } UnZip/Zip{ index = 10.4433 value = 3.9076 dict = 1.00 all = 3.9717 } Zip/UnZip{ index = 0.0958 value = 0.2559 dict = 1.00 all = 0.2518 } ---------------------------- total value len = 2251.554888 GB avg = 0.200 KB (by entry num) total key len = 306.935123 GB avg = 0.027 KB total ukey len = 237.391985 GB avg = 0.015 KB total ukey num = 15.740524052 Billion total entry num = 11.281838000 Billion write speed all = 31.756765567 MB/sec (with seq num) write speed all = 30.636496399 MB/sec (without seq num) 2024/11/24-07:17:57.451877 139957693548096 [compaction_job.cc:1948] [default] [JOB 43319] Generated table #296090: 934686 keys, 33793816 bytes, temperature: kWarm 2024/11/24-07:17:57.451948 139957693548096 EVENT_LOG_v1 {"time_micros": 1732403877451913, "cf_name": "default", "job": 43319, "event": "table_file_creation", "file_number": 296090, "file_size": 33793816, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4265680463, "largest_seqno": 4493436471, "table_properties": {"data_size": 27650064, "index_size": 1790016, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26171208, "raw_average_key_size": 28, "raw_value_size": 108046648, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 934686, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732403874, "oldest_key_time": 0, "file_creation_time": 1732403874, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 296090, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-07:17:57.489146 139957693548096 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296091.sst) /dev/shm/ToplingTemp/Topling-296260-WyhoC1 2024/11/24-07:17:58.416628 139957693548096 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296091.sst): first pass time = 0.93's, 144.719'MB/sec 2024/11/24-07:17:59.666728 139957693548096 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296091.sst): old prealloc_size = 147639500, real_size = 27731472 2024/11/24-07:17:59.667280 139957693548096 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296091.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 945196 prefix = 4 raw-key = 0.0151 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1078 GB zip-val = 0.0257 GB avg-val = 114.00 avg-zval = 27.17 2024/11/24-07:17:59.668054 139957693548096 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296091.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0024 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-07:18:00.515160 139957693548096 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296091.sst): second pass time = 1.25's, 86.257'MB/sec, value only(80.3% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.85's, 37.438'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3423.491'MB/sec (index lex order gen) rebuild zvType time = 0.71's, 0.330'MB/sec write SST data time = 0.13's, 239.020'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.073'MB, throughput = 31808.926'MB/sec zip my value time = 1.25's, unzip length = 0.108'GB zip my value throughput = 86.257'MB/sec zip pipeline throughput = 86.257'MB/sec entries = 945196 avg-key = 28.00 avg-zkey = 1.91 avg-val = 114.00 avg-zval = 27.17 usrkeys = 945196 avg-key = 20.00 avg-zkey = 1.91 avg-val = 121.00 avg-zval = 27.17 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 945196 bytes = 3190048 } seq expand size = 6616372 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0189 GB value = 0.1078 GB dict = 1.07 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0257 GB dict = 1.07 MB all = 0.0318 GB } UnZip/Zip{ index = 10.4461 value = 4.1951 dict = 1.00 all = 4.2256 } Zip/UnZip{ index = 0.0957 value = 0.2384 dict = 1.00 all = 0.2367 } ---------------------------- total value len = 2251.669257 GB avg = 0.200 KB (by entry num) total key len = 306.961589 GB avg = 0.027 KB total ukey len = 237.410889 GB avg = 0.015 KB total ukey num = 15.741469248 Billion total entry num = 11.282783196 Billion write speed all = 31.757289528 MB/sec (with seq num) write speed all = 30.636969688 MB/sec (without seq num) 2024/11/24-07:18:00.555268 139957693548096 [compaction_job.cc:1948] [default] [JOB 43319] Generated table #296091: 945196 keys, 31762672 bytes, temperature: kWarm 2024/11/24-07:18:00.555339 139957693548096 EVENT_LOG_v1 {"time_micros": 1732403880555304, "cf_name": "default", "job": 43319, "event": "table_file_creation", "file_number": 296091, "file_size": 31762672, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4324508762, "largest_seqno": 4426671127, "table_properties": {"data_size": 25685312, "index_size": 1809664, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26465488, "raw_average_key_size": 28, "raw_value_size": 107752344, "raw_average_value_size": 114, "num_data_blocks": 1, "num_entries": 945196, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 114, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732403877, "oldest_key_time": 0, "file_creation_time": 1732403877, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 296091, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-07:18:00.596171 139957693548096 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296092.sst) /dev/shm/ToplingTemp/Topling-296260-iMUyu1 2024/11/24-07:18:01.611560 139957693548096 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296092.sst): first pass time = 1.02's, 132.190'MB/sec 2024/11/24-07:18:02.957278 139957693548096 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296092.sst): old prealloc_size = 147639500, real_size = 32071168 2024/11/24-07:18:02.957816 139957693548096 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296092.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 935695 prefix = 4 raw-key = 0.0150 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1080 GB zip-val = 0.0301 GB avg-val = 115.44 avg-zval = 32.12 2024/11/24-07:18:02.958612 139957693548096 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296092.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-07:18:03.824359 139957693548096 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296092.sst): second pass time = 1.34's, 80.348'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.87's, 41.745'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3461.272'MB/sec (index lex order gen) rebuild zvType time = 0.74's, 0.318'MB/sec write SST data time = 0.13's, 277.638'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.077'MB, throughput = 32526.497'MB/sec zip my value time = 1.34's, unzip length = 0.108'GB zip my value throughput = 80.348'MB/sec zip pipeline throughput = 80.348'MB/sec entries = 935695 avg-key = 28.00 avg-zkey = 1.90 avg-val = 115.44 avg-zval = 32.12 usrkeys = 935695 avg-key = 20.00 avg-zkey = 1.90 avg-val = 122.44 avg-zval = 32.12 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 935695 bytes = 3274944 } seq expand size = 6549865 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0187 GB value = 0.1080 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0301 GB dict = 1.08 MB all = 0.0362 GB } UnZip/Zip{ index = 10.5125 value = 3.5938 dict = 1.00 all = 3.7082 } Zip/UnZip{ index = 0.0951 value = 0.2783 dict = 1.00 all = 0.2697 } ---------------------------- total value len = 2251.783825 GB avg = 0.200 KB (by entry num) total key len = 306.987788 GB avg = 0.027 KB total ukey len = 237.429603 GB avg = 0.015 KB total ukey num = 15.742404943 Billion total entry num = 11.283718891 Billion write speed all = 31.757732319 MB/sec (with seq num) write speed all = 30.637365586 MB/sec (without seq num) 2024/11/24-07:18:03.868537 139957693548096 [compaction_job.cc:1948] [default] [JOB 43319] Generated table #296092: 935695 keys, 36195276 bytes, temperature: kWarm 2024/11/24-07:18:03.868607 139957693548096 EVENT_LOG_v1 {"time_micros": 1732403883868572, "cf_name": "default", "job": 43319, "event": "table_file_creation", "file_number": 296092, "file_size": 36195276, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4265679848, "largest_seqno": 4493437726, "table_properties": {"data_size": 30056880, "index_size": 1780160, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26199460, "raw_average_key_size": 28, "raw_value_size": 108018394, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 935695, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732403880, "oldest_key_time": 0, "file_creation_time": 1732403880, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 296092, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-07:18:03.906417 139957693548096 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296093.sst) /dev/shm/ToplingTemp/Topling-296260-woAm6X 2024/11/24-07:18:04.808084 139957693548096 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296093.sst): first pass time = 0.90's, 148.863'MB/sec 2024/11/24-07:18:06.117229 139957693548096 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296093.sst): old prealloc_size = 147639500, real_size = 31453856 2024/11/24-07:18:06.117762 139957693548096 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296093.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 919300 prefix = 4 raw-key = 0.0147 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1085 GB zip-val = 0.0295 GB avg-val = 118.00 avg-zval = 32.05 2024/11/24-07:18:06.118545 139957693548096 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296093.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-07:18:06.945967 139957693548096 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296093.sst): second pass time = 1.31's, 82.944'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.83's, 42.874'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3441.090'MB/sec (index lex order gen) rebuild zvType time = 0.70's, 0.330'MB/sec write SST data time = 0.13's, 271.498'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.085'MB, throughput = 30744.666'MB/sec zip my value time = 1.31's, unzip length = 0.108'GB zip my value throughput = 82.944'MB/sec zip pipeline throughput = 82.944'MB/sec entries = 919300 avg-key = 28.00 avg-zkey = 1.91 avg-val = 118.00 avg-zval = 32.05 usrkeys = 919300 avg-key = 20.00 avg-zkey = 1.91 avg-val = 125.00 avg-zval = 32.05 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 919300 bytes = 3217568 } seq expand size = 6435100 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0184 GB value = 0.1085 GB dict = 1.09 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0295 GB dict = 1.09 MB all = 0.0355 GB } UnZip/Zip{ index = 10.4439 value = 3.6818 dict = 1.00 all = 3.7775 } Zip/UnZip{ index = 0.0957 value = 0.2716 dict = 1.00 all = 0.2647 } ---------------------------- total value len = 2251.898738 GB avg = 0.200 KB (by entry num) total key len = 307.013529 GB avg = 0.027 KB total ukey len = 237.447989 GB avg = 0.015 KB total ukey num = 15.743324243 Billion total entry num = 11.284638191 Billion write speed all = 31.758247589 MB/sec (with seq num) write speed all = 30.637832987 MB/sec (without seq num) 2024/11/24-07:18:06.989100 139957693548096 [compaction_job.cc:1948] [default] [JOB 43319] Generated table #296093: 919300 keys, 35530546 bytes, temperature: kWarm 2024/11/24-07:18:06.989171 139957693548096 EVENT_LOG_v1 {"time_micros": 1732403886989135, "cf_name": "default", "job": 43319, "event": "table_file_creation", "file_number": 296093, "file_size": 35530546, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4315975746, "largest_seqno": 4464788817, "table_properties": {"data_size": 29463376, "index_size": 1760448, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25740400, "raw_average_key_size": 28, "raw_value_size": 108477400, "raw_average_value_size": 118, "num_data_blocks": 1, "num_entries": 919300, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 118, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732403883, "oldest_key_time": 0, "file_creation_time": 1732403883, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 296093, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-07:18:07.025055 139957693548096 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296094.sst) /dev/shm/ToplingTemp/Topling-296260-bRQlMY 2024/11/24-07:18:07.892702 139957693548096 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296094.sst): first pass time = 0.87's, 154.699'MB/sec 2024/11/24-07:18:09.172381 139957693548096 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296094.sst): old prealloc_size = 147639500, real_size = 28587008 2024/11/24-07:18:09.172923 139957693548096 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296094.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 940781 prefix = 4 raw-key = 0.0151 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1079 GB zip-val = 0.0266 GB avg-val = 114.67 avg-zval = 28.22 2024/11/24-07:18:09.173719 139957693548096 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296094.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0024 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-07:18:10.011661 139957693548096 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296094.sst): second pass time = 1.28's, 84.380'MB/sec, value only(80.4% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 38.993'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3482.259'MB/sec (index lex order gen) rebuild zvType time = 0.70's, 0.335'MB/sec write SST data time = 0.14's, 240.986'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.076'MB, throughput = 35180.127'MB/sec zip my value time = 1.28's, unzip length = 0.108'GB zip my value throughput = 84.380'MB/sec zip pipeline throughput = 84.380'MB/sec entries = 940781 avg-key = 28.00 avg-zkey = 1.91 avg-val = 114.67 avg-zval = 28.22 usrkeys = 940781 avg-key = 20.00 avg-zkey = 1.91 avg-val = 121.67 avg-zval = 28.22 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 940781 bytes = 3292752 } seq expand size = 6585467 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0188 GB value = 0.1079 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0266 GB dict = 1.08 MB all = 0.0327 GB } UnZip/Zip{ index = 10.4442 value = 4.0631 dict = 1.00 all = 4.1014 } Zip/UnZip{ index = 0.0957 value = 0.2461 dict = 1.00 all = 0.2438 } ---------------------------- total value len = 2252.013199 GB avg = 0.200 KB (by entry num) total key len = 307.039871 GB avg = 0.027 KB total ukey len = 237.466805 GB avg = 0.015 KB total ukey num = 15.744265024 Billion total entry num = 11.285578972 Billion write speed all = 31.758786723 MB/sec (with seq num) write speed all = 30.638321345 MB/sec (without seq num) 2024/11/24-07:18:10.053907 139957693548096 [compaction_job.cc:1948] [default] [JOB 43319] Generated table #296094: 940781 keys, 32724928 bytes, temperature: kWarm 2024/11/24-07:18:10.053996 139957693548096 EVENT_LOG_v1 {"time_micros": 1732403890053943, "cf_name": "default", "job": 43319, "event": "table_file_creation", "file_number": 296094, "file_size": 32724928, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4357187557, "largest_seqno": 4493437978, "table_properties": {"data_size": 26550064, "index_size": 1801536, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26341868, "raw_average_key_size": 28, "raw_value_size": 107875954, "raw_average_value_size": 114, "num_data_blocks": 1, "num_entries": 940781, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732403887, "oldest_key_time": 0, "file_creation_time": 1732403887, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 296094, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-07:18:10.091352 139957693548096 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296095.sst) /dev/shm/ToplingTemp/Topling-296260-3nJNI0 2024/11/24-07:18:10.976774 139957693548096 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296095.sst): first pass time = 0.89's, 151.593'MB/sec 2024/11/24-07:18:12.323002 139957693548096 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296095.sst): old prealloc_size = 147639500, real_size = 32771904 2024/11/24-07:18:12.323543 139957693548096 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296095.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 931897 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1081 GB zip-val = 0.0308 GB avg-val = 116.03 avg-zval = 33.01 2024/11/24-07:18:12.325468 139957693548096 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296095.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-07:18:13.199814 139957693548096 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296095.sst): second pass time = 1.35's, 80.369'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.88's, 42.066'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3447.873'MB/sec (index lex order gen) rebuild zvType time = 0.74's, 0.313'MB/sec write SST data time = 0.13's, 278.480'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 31110.162'MB/sec zip my value time = 1.35's, unzip length = 0.108'GB zip my value throughput = 80.369'MB/sec zip pipeline throughput = 80.369'MB/sec entries = 931897 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.03 avg-zval = 33.01 usrkeys = 931897 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.03 avg-zval = 33.01 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 931897 bytes = 3261648 } seq expand size = 6523279 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0308 GB dict = 1.08 MB all = 0.0369 GB } UnZip/Zip{ index = 10.5133 value = 3.5144 dict = 1.00 all = 3.6389 } Zip/UnZip{ index = 0.0951 value = 0.2845 dict = 1.00 all = 0.2748 } ---------------------------- total value len = 2252.127847 GB avg = 0.200 KB (by entry num) total key len = 307.065964 GB avg = 0.027 KB total ukey len = 237.485442 GB avg = 0.015 KB total ukey num = 15.745196921 Billion total entry num = 11.286510869 Billion write speed all = 31.759276780 MB/sec (with seq num) write speed all = 30.638763215 MB/sec (without seq num) 2024/11/24-07:18:13.245157 139957693548096 [compaction_job.cc:1948] [default] [JOB 43319] Generated table #296095: 931897 keys, 36884072 bytes, temperature: kWarm 2024/11/24-07:18:13.245232 139957693548096 EVENT_LOG_v1 {"time_micros": 1732403893245194, "cf_name": "default", "job": 43319, "event": "table_file_creation", "file_number": 296095, "file_size": 36884072, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4265679865, "largest_seqno": 4493438135, "table_properties": {"data_size": 30765936, "index_size": 1772800, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26093116, "raw_average_key_size": 28, "raw_value_size": 108124754, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 931897, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732403890, "oldest_key_time": 0, "file_creation_time": 1732403890, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 296095, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-07:18:13.284161 139957693548096 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296096.sst) /dev/shm/ToplingTemp/Topling-296260-u8lkTZ 2024/11/24-07:18:14.283272 139957693548096 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296096.sst): first pass time = 1.00's, 134.343'MB/sec 2024/11/24-07:18:15.602479 139957693548096 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296096.sst): old prealloc_size = 147639500, real_size = 31309536 2024/11/24-07:18:15.603065 139957693548096 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296096.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 919300 prefix = 4 raw-key = 0.0147 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1085 GB zip-val = 0.0293 GB avg-val = 118.00 avg-zval = 31.89 2024/11/24-07:18:15.604462 139957693548096 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296096.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-07:18:16.416756 139957693548096 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296096.sst): second pass time = 1.32's, 82.277'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.81's, 43.317'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3120.025'MB/sec (index lex order gen) rebuild zvType time = 0.68's, 0.336'MB/sec write SST data time = 0.13's, 270.066'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.085'MB, throughput = 33298.858'MB/sec zip my value time = 1.32's, unzip length = 0.108'GB zip my value throughput = 82.277'MB/sec zip pipeline throughput = 82.277'MB/sec entries = 919300 avg-key = 28.00 avg-zkey = 1.91 avg-val = 118.00 avg-zval = 31.89 usrkeys = 919300 avg-key = 20.00 avg-zkey = 1.91 avg-val = 125.00 avg-zval = 31.89 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 919300 bytes = 3102656 } seq expand size = 6435100 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0184 GB value = 0.1085 GB dict = 1.09 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0293 GB dict = 1.09 MB all = 0.0353 GB } UnZip/Zip{ index = 10.4458 value = 3.6999 dict = 1.00 all = 3.8053 } Zip/UnZip{ index = 0.0957 value = 0.2703 dict = 1.00 all = 0.2628 } ---------------------------- total value len = 2252.242760 GB avg = 0.200 KB (by entry num) total key len = 307.091704 GB avg = 0.027 KB total ukey len = 237.503828 GB avg = 0.015 KB total ukey num = 15.746116221 Billion total entry num = 11.287430169 Billion write speed all = 31.759754357 MB/sec (with seq num) write speed all = 30.639194259 MB/sec (without seq num) 2024/11/24-07:18:16.462992 139957693548096 [compaction_job.cc:1948] [default] [JOB 43319] Generated table #296096: 919300 keys, 35271346 bytes, temperature: kWarm 2024/11/24-07:18:16.463067 139957693548096 EVENT_LOG_v1 {"time_micros": 1732403896463031, "cf_name": "default", "job": 43319, "event": "table_file_creation", "file_number": 296096, "file_size": 35271346, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4324088917, "largest_seqno": 4443191687, "table_properties": {"data_size": 29319376, "index_size": 1760128, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25740400, "raw_average_key_size": 28, "raw_value_size": 108477400, "raw_average_value_size": 118, "num_data_blocks": 1, "num_entries": 919300, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 118, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732403893, "oldest_key_time": 0, "file_creation_time": 1732403893, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 296096, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-07:18:16.499900 139957693548096 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296097.sst) /dev/shm/ToplingTemp/Topling-296260-umyT1Y 2024/11/24-07:18:17.328612 139957693548096 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296097.sst): first pass time = 0.83's, 161.967'MB/sec 2024/11/24-07:18:18.620833 139957693548096 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296097.sst): old prealloc_size = 147639500, real_size = 29700352 2024/11/24-07:18:18.621407 139957693548096 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296097.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 934894 prefix = 4 raw-key = 0.0150 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1080 GB zip-val = 0.0277 GB avg-val = 115.56 avg-zval = 29.60 2024/11/24-07:18:18.622172 139957693548096 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296097.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-07:18:19.465471 139957693548096 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296097.sst): second pass time = 1.29's, 83.660'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 39.905'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3253.817'MB/sec (index lex order gen) rebuild zvType time = 0.71's, 0.329'MB/sec write SST data time = 0.13's, 250.787'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 36956.850'MB/sec zip my value time = 1.29's, unzip length = 0.108'GB zip my value throughput = 83.660'MB/sec zip pipeline throughput = 83.660'MB/sec entries = 934894 avg-key = 28.00 avg-zkey = 1.92 avg-val = 115.56 avg-zval = 29.60 usrkeys = 934894 avg-key = 20.00 avg-zkey = 1.92 avg-val = 122.56 avg-zval = 29.60 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 934894 bytes = 3155280 } seq expand size = 6544258 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0187 GB value = 0.1080 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0277 GB dict = 1.08 MB all = 0.0337 GB } UnZip/Zip{ index = 10.4423 value = 3.9038 dict = 1.00 all = 3.9822 } Zip/UnZip{ index = 0.0958 value = 0.2562 dict = 1.00 all = 0.2511 } ---------------------------- total value len = 2252.357345 GB avg = 0.200 KB (by entry num) total key len = 307.117881 GB avg = 0.027 KB total ukey len = 237.522526 GB avg = 0.015 KB total ukey num = 15.747051115 Billion total entry num = 11.288365063 Billion write speed all = 31.760299552 MB/sec (with seq num) write speed all = 30.639689038 MB/sec (without seq num) 2024/11/24-07:18:19.508074 139957693548096 [compaction_job.cc:1948] [default] [JOB 43319] Generated table #296097: 934894 keys, 33704162 bytes, temperature: kWarm 2024/11/24-07:18:19.508145 139957693548096 EVENT_LOG_v1 {"time_micros": 1732403899508110, "cf_name": "default", "job": 43319, "event": "table_file_creation", "file_number": 296097, "file_size": 33704162, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4416909859, "largest_seqno": 4493437994, "table_properties": {"data_size": 27675824, "index_size": 1790592, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26177032, "raw_average_key_size": 28, "raw_value_size": 108040700, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 934894, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732403896, "oldest_key_time": 0, "file_creation_time": 1732403896, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 296097, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-07:18:19.546370 139957693548096 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296098.sst) /dev/shm/ToplingTemp/Topling-296260-RGh5hY 2024/11/24-07:18:20.371196 139957693548096 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296098.sst): first pass time = 0.82's, 162.730'MB/sec 2024/11/24-07:18:21.706303 139957693548096 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296098.sst): old prealloc_size = 147639500, real_size = 32438096 2024/11/24-07:18:21.706870 139957693548096 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296098.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 922710 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1084 GB zip-val = 0.0305 GB avg-val = 117.46 avg-zval = 33.00 2024/11/24-07:18:21.708056 139957693548096 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296098.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-07:18:22.542496 139957693548096 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296098.sst): second pass time = 1.33's, 81.254'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 43.682'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3232.374'MB/sec (index lex order gen) rebuild zvType time = 0.70's, 0.328'MB/sec write SST data time = 0.13's, 275.530'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 32931.756'MB/sec zip my value time = 1.33's, unzip length = 0.108'GB zip my value throughput = 81.254'MB/sec zip pipeline throughput = 81.254'MB/sec entries = 922710 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.46 avg-zval = 33.00 usrkeys = 922710 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.46 avg-zval = 33.00 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 922710 bytes = 3229504 } seq expand size = 6458970 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0305 GB dict = 1.08 MB all = 0.0365 GB } UnZip/Zip{ index = 10.5132 value = 3.5591 dict = 1.00 all = 3.6746 } Zip/UnZip{ index = 0.0951 value = 0.2810 dict = 1.00 all = 0.2721 } ---------------------------- total value len = 2252.472185 GB avg = 0.200 KB (by entry num) total key len = 307.143717 GB avg = 0.027 KB total ukey len = 237.540981 GB avg = 0.015 KB total ukey num = 15.747973825 Billion total entry num = 11.289287773 Billion write speed all = 31.760832485 MB/sec (with seq num) write speed all = 30.640173162 MB/sec (without seq num) 2024/11/24-07:18:22.588795 139957693548096 [compaction_job.cc:1948] [default] [JOB 43319] Generated table #296098: 922710 keys, 36525630 bytes, temperature: kWarm 2024/11/24-07:18:22.588865 139957693548096 EVENT_LOG_v1 {"time_micros": 1732403902588830, "cf_name": "default", "job": 43319, "event": "table_file_creation", "file_number": 296098, "file_size": 36525630, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4265679880, "largest_seqno": 4493437810, "table_properties": {"data_size": 30451904, "index_size": 1755328, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25835880, "raw_average_key_size": 28, "raw_value_size": 108381856, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 922710, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732403899, "oldest_key_time": 0, "file_creation_time": 1732403899, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 296098, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-07:18:22.628779 139957693548096 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296099.sst) /dev/shm/ToplingTemp/Topling-296260-UdOGv1 2024/11/24-07:18:23.604567 139957693548096 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296099.sst): first pass time = 0.98's, 137.553'MB/sec 2024/11/24-07:18:24.911262 139957693548096 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296099.sst): old prealloc_size = 147639500, real_size = 31213248 2024/11/24-07:18:24.911846 139957693548096 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296099.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 919300 prefix = 4 raw-key = 0.0147 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1085 GB zip-val = 0.0292 GB avg-val = 118.00 avg-zval = 31.79 2024/11/24-07:18:24.912601 139957693548096 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296099.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-07:18:25.740656 139957693548096 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296099.sst): second pass time = 1.31's, 83.068'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.83's, 42.412'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3203.494'MB/sec (index lex order gen) rebuild zvType time = 0.70's, 0.330'MB/sec write SST data time = 0.13's, 266.245'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.085'MB, throughput = 34063.040'MB/sec zip my value time = 1.31's, unzip length = 0.108'GB zip my value throughput = 83.068'MB/sec zip pipeline throughput = 83.068'MB/sec entries = 919300 avg-key = 28.00 avg-zkey = 1.91 avg-val = 118.00 avg-zval = 31.79 usrkeys = 919300 avg-key = 20.00 avg-zkey = 1.91 avg-val = 125.00 avg-zval = 31.79 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 919300 bytes = 3102656 } seq expand size = 6435100 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0184 GB value = 0.1085 GB dict = 1.09 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0292 GB dict = 1.09 MB all = 0.0352 GB } UnZip/Zip{ index = 10.4458 value = 3.7120 dict = 1.00 all = 3.8157 } Zip/UnZip{ index = 0.0957 value = 0.2694 dict = 1.00 all = 0.2621 } ---------------------------- total value len = 2252.587098 GB avg = 0.200 KB (by entry num) total key len = 307.169457 GB avg = 0.027 KB total ukey len = 237.559367 GB avg = 0.015 KB total ukey num = 15.748893125 Billion total entry num = 11.290207073 Billion write speed all = 31.761317346 MB/sec (with seq num) write speed all = 30.640611241 MB/sec (without seq num) 2024/11/24-07:18:25.786486 139957693548096 [compaction_job.cc:1948] [default] [JOB 43319] Generated table #296099: 919300 keys, 35175090 bytes, temperature: kWarm 2024/11/24-07:18:25.786557 139957693548096 EVENT_LOG_v1 {"time_micros": 1732403905786522, "cf_name": "default", "job": 43319, "event": "table_file_creation", "file_number": 296099, "file_size": 35175090, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4359910446, "largest_seqno": 4473144111, "table_properties": {"data_size": 29223088, "index_size": 1760128, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25740400, "raw_average_key_size": 28, "raw_value_size": 108477400, "raw_average_value_size": 118, "num_data_blocks": 1, "num_entries": 919300, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 118, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732403902, "oldest_key_time": 0, "file_creation_time": 1732403902, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 296099, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-07:18:25.823303 139957693548096 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296100.sst) /dev/shm/ToplingTemp/Topling-296260-YNPqiX 2024/11/24-07:18:26.851940 139957693548096 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296100.sst): first pass time = 1.03's, 130.486'MB/sec 2024/11/24-07:18:28.200608 139957693548096 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296100.sst): old prealloc_size = 147639500, real_size = 31977600 2024/11/24-07:18:28.201199 139957693548096 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296100.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 933784 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1081 GB zip-val = 0.0300 GB avg-val = 115.74 avg-zval = 32.09 2024/11/24-07:18:28.201990 139957693548096 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296100.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-07:18:29.053928 139957693548096 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296100.sst): second pass time = 1.35's, 80.214'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.85's, 42.303'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3126.552'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 0.324'MB/sec write SST data time = 0.13's, 274.226'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 34788.323'MB/sec zip my value time = 1.35's, unzip length = 0.108'GB zip my value throughput = 80.214'MB/sec zip pipeline throughput = 80.214'MB/sec entries = 933784 avg-key = 28.00 avg-zkey = 1.90 avg-val = 115.74 avg-zval = 32.09 usrkeys = 933784 avg-key = 20.00 avg-zkey = 1.90 avg-val = 122.74 avg-zval = 32.09 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 933784 bytes = 3268256 } seq expand size = 6536488 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0187 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0300 GB dict = 1.08 MB all = 0.0361 GB } UnZip/Zip{ index = 10.5114 value = 3.6063 dict = 1.00 all = 3.7183 } Zip/UnZip{ index = 0.0951 value = 0.2773 dict = 1.00 all = 0.2689 } ---------------------------- total value len = 2252.701706 GB avg = 0.200 KB (by entry num) total key len = 307.195603 GB avg = 0.027 KB total ukey len = 237.578042 GB avg = 0.015 KB total ukey num = 15.749826909 Billion total entry num = 11.291140857 Billion write speed all = 31.761758063 MB/sec (with seq num) write speed all = 30.641005343 MB/sec (without seq num) 2024/11/24-07:18:29.099615 139957693548096 [compaction_job.cc:1948] [default] [JOB 43319] Generated table #296100: 933784 keys, 36096758 bytes, temperature: kWarm 2024/11/24-07:18:29.099685 139957693548096 EVENT_LOG_v1 {"time_micros": 1732403909099650, "cf_name": "default", "job": 43319, "event": "table_file_creation", "file_number": 296100, "file_size": 36096758, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4265679891, "largest_seqno": 4493438006, "table_properties": {"data_size": 29967280, "index_size": 1776704, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26145952, "raw_average_key_size": 28, "raw_value_size": 108071864, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 933784, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732403905, "oldest_key_time": 0, "file_creation_time": 1732403905, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 296100, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-07:18:29.135593 139957693548096 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296101.sst) /dev/shm/ToplingTemp/Topling-296260-F1rvX0 2024/11/24-07:18:30.068523 139957693548096 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296101.sst): first pass time = 0.93's, 143.874'MB/sec 2024/11/24-07:18:31.352664 139957693548096 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296101.sst): old prealloc_size = 147639500, real_size = 31372768 2024/11/24-07:18:31.353253 139957693548096 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296101.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 919300 prefix = 4 raw-key = 0.0147 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1085 GB zip-val = 0.0294 GB avg-val = 118.00 avg-zval = 31.96 2024/11/24-07:18:31.354008 139957693548096 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296101.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-07:18:32.180594 139957693548096 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296101.sst): second pass time = 1.28's, 84.550'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.83's, 42.680'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3117.914'MB/sec (index lex order gen) rebuild zvType time = 0.70's, 0.331'MB/sec write SST data time = 0.13's, 267.543'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.085'MB, throughput = 34662.641'MB/sec zip my value time = 1.28's, unzip length = 0.108'GB zip my value throughput = 84.550'MB/sec zip pipeline throughput = 84.550'MB/sec entries = 919300 avg-key = 28.00 avg-zkey = 1.91 avg-val = 118.00 avg-zval = 31.96 usrkeys = 919300 avg-key = 20.00 avg-zkey = 1.91 avg-val = 125.00 avg-zval = 31.96 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 919300 bytes = 3102656 } seq expand size = 6435100 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0184 GB value = 0.1085 GB dict = 1.09 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0294 GB dict = 1.09 MB all = 0.0353 GB } UnZip/Zip{ index = 10.4458 value = 3.6919 dict = 1.00 all = 3.7985 } Zip/UnZip{ index = 0.0957 value = 0.2709 dict = 1.00 all = 0.2633 } ---------------------------- total value len = 2252.816619 GB avg = 0.200 KB (by entry num) total key len = 307.221344 GB avg = 0.027 KB total ukey len = 237.596428 GB avg = 0.015 KB total ukey num = 15.750746209 Billion total entry num = 11.292060157 Billion write speed all = 31.762271022 MB/sec (with seq num) write speed all = 30.641470533 MB/sec (without seq num) 2024/11/24-07:18:32.224054 139957693548096 [compaction_job.cc:1948] [default] [JOB 43319] Generated table #296101: 919300 keys, 35334578 bytes, temperature: kWarm 2024/11/24-07:18:32.224125 139957693548096 EVENT_LOG_v1 {"time_micros": 1732403912224090, "cf_name": "default", "job": 43319, "event": "table_file_creation", "file_number": 296101, "file_size": 35334578, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4293384573, "largest_seqno": 4403187537, "table_properties": {"data_size": 29382608, "index_size": 1760128, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25740400, "raw_average_key_size": 28, "raw_value_size": 108477400, "raw_average_value_size": 118, "num_data_blocks": 1, "num_entries": 919300, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 118, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732403909, "oldest_key_time": 0, "file_creation_time": 1732403909, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 296101, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-07:18:32.261227 139957693548096 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296102.sst) /dev/shm/ToplingTemp/Topling-296260-yxNAHZ 2024/11/24-07:18:33.104813 139957693548096 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296102.sst): first pass time = 0.84's, 159.111'MB/sec 2024/11/24-07:18:34.406833 139957693548096 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296102.sst): old prealloc_size = 147639500, real_size = 30871728 2024/11/24-07:18:34.407390 139957693548096 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296102.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 924532 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.1083 GB zip-val = 0.0289 GB avg-val = 117.17 avg-zval = 31.21 2024/11/24-07:18:34.408143 139957693548096 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296102.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-07:18:35.223609 139957693548096 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296102.sst): second pass time = 1.30's, 83.277'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.82's, 42.665'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3331.904'MB/sec (index lex order gen) rebuild zvType time = 0.68's, 0.338'MB/sec write SST data time = 0.13's, 263.705'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.082'MB, throughput = 35566.736'MB/sec zip my value time = 1.30's, unzip length = 0.108'GB zip my value throughput = 83.277'MB/sec zip pipeline throughput = 83.277'MB/sec entries = 924532 avg-key = 28.00 avg-zkey = 1.93 avg-val = 117.17 avg-zval = 31.21 usrkeys = 924532 avg-key = 20.00 avg-zkey = 1.93 avg-val = 124.17 avg-zval = 31.21 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 924532 bytes = 3120304 } seq expand size = 6471724 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0289 GB dict = 1.08 MB all = 0.0348 GB } UnZip/Zip{ index = 10.3766 value = 3.7539 dict = 1.00 all = 3.8517 } Zip/UnZip{ index = 0.0964 value = 0.2664 dict = 1.00 all = 0.2596 } ---------------------------- total value len = 2252.931421 GB avg = 0.199 KB (by entry num) total key len = 307.247231 GB avg = 0.027 KB total ukey len = 237.614919 GB avg = 0.015 KB total ukey num = 15.751670741 Billion total entry num = 11.292984689 Billion write speed all = 31.762817360 MB/sec (with seq num) write speed all = 30.641967423 MB/sec (without seq num) 2024/11/24-07:18:35.266955 139957693548096 [compaction_job.cc:1948] [default] [JOB 43319] Generated table #296102: 924532 keys, 34846564 bytes, temperature: kWarm 2024/11/24-07:18:35.267041 139957693548096 EVENT_LOG_v1 {"time_micros": 1732403915267005, "cf_name": "default", "job": 43319, "event": "table_file_creation", "file_number": 296102, "file_size": 34846564, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4403187538, "largest_seqno": 4493438025, "table_properties": {"data_size": 28858464, "index_size": 1781952, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25886896, "raw_average_key_size": 28, "raw_value_size": 108330860, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 924532, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732403912, "oldest_key_time": 0, "file_creation_time": 1732403912, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 296102, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-07:18:35.301540 139957693548096 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296103.sst) /dev/shm/ToplingTemp/Topling-296260-WU85D0 2024/11/24-07:18:36.138787 139957693548096 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296103.sst): first pass time = 0.84's, 160.315'MB/sec 2024/11/24-07:18:37.480110 139957693548096 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296103.sst): old prealloc_size = 147639500, real_size = 33038096 2024/11/24-07:18:37.480645 139957693548096 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296103.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927388 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0310 GB avg-val = 116.73 avg-zval = 33.47 2024/11/24-07:18:37.481395 139957693548096 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296103.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-07:18:38.350123 139957693548096 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296103.sst): second pass time = 1.34's, 80.779'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.87's, 42.688'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3425.243'MB/sec (index lex order gen) rebuild zvType time = 0.74's, 0.315'MB/sec write SST data time = 0.13's, 278.755'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 27221.483'MB/sec zip my value time = 1.34's, unzip length = 0.108'GB zip my value throughput = 80.779'MB/sec zip pipeline throughput = 80.779'MB/sec entries = 927388 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.73 avg-zval = 33.47 usrkeys = 927388 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.73 avg-zval = 33.47 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927388 bytes = 3245872 } seq expand size = 6491716 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0310 GB dict = 1.08 MB all = 0.0371 GB } UnZip/Zip{ index = 10.5129 value = 3.4873 dict = 1.00 all = 3.6140 } Zip/UnZip{ index = 0.0951 value = 0.2868 dict = 1.00 all = 0.2767 } ---------------------------- total value len = 2253.046164 GB avg = 0.199 KB (by entry num) total key len = 307.273198 GB avg = 0.027 KB total ukey len = 237.633467 GB avg = 0.015 KB total ukey num = 15.752598129 Billion total entry num = 11.293912077 Billion write speed all = 31.763331001 MB/sec (with seq num) write speed all = 30.642432498 MB/sec (without seq num) 2024/11/24-07:18:38.397575 139957693548096 [compaction_job.cc:1948] [default] [JOB 43319] Generated table #296103: 927388 keys, 37138030 bytes, temperature: kWarm 2024/11/24-07:18:38.397645 139957693548096 EVENT_LOG_v1 {"time_micros": 1732403918397610, "cf_name": "default", "job": 43319, "event": "table_file_creation", "file_number": 296103, "file_size": 37138030, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4265679902, "largest_seqno": 4493434446, "table_properties": {"data_size": 31041792, "index_size": 1764288, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25966864, "raw_average_key_size": 28, "raw_value_size": 108250896, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927388, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732403915, "oldest_key_time": 0, "file_creation_time": 1732403915, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 296103, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-07:18:38.436647 139957693548096 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296104.sst) /dev/shm/ToplingTemp/Topling-296260-bGjAkX 2024/11/24-07:18:39.427684 139957693548096 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296104.sst): first pass time = 0.99's, 135.437'MB/sec 2024/11/24-07:18:40.726774 139957693548096 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296104.sst): old prealloc_size = 147639500, real_size = 31333264 2024/11/24-07:18:40.727328 139957693548096 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296104.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 919300 prefix = 4 raw-key = 0.0147 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1085 GB zip-val = 0.0293 GB avg-val = 118.00 avg-zval = 31.92 2024/11/24-07:18:40.728060 139957693548096 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296104.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-07:18:41.546089 139957693548096 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296104.sst): second pass time = 1.30's, 83.550'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.82's, 43.080'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3328.073'MB/sec (index lex order gen) rebuild zvType time = 0.69's, 0.334'MB/sec write SST data time = 0.13's, 269.661'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.085'MB, throughput = 32502.846'MB/sec zip my value time = 1.30's, unzip length = 0.108'GB zip my value throughput = 83.550'MB/sec zip pipeline throughput = 83.550'MB/sec entries = 919300 avg-key = 28.00 avg-zkey = 1.91 avg-val = 118.00 avg-zval = 31.92 usrkeys = 919300 avg-key = 20.00 avg-zkey = 1.91 avg-val = 125.00 avg-zval = 31.92 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 919300 bytes = 3102656 } seq expand size = 6435100 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0184 GB value = 0.1085 GB dict = 1.09 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0293 GB dict = 1.09 MB all = 0.0353 GB } UnZip/Zip{ index = 10.4458 value = 3.6969 dict = 1.00 all = 3.8027 } Zip/UnZip{ index = 0.0957 value = 0.2705 dict = 1.00 all = 0.2630 } ---------------------------- total value len = 2253.161076 GB avg = 0.199 KB (by entry num) total key len = 307.298938 GB avg = 0.027 KB total ukey len = 237.651853 GB avg = 0.015 KB total ukey num = 15.753517429 Billion total entry num = 11.294831377 Billion write speed all = 31.763816532 MB/sec (with seq num) write speed all = 30.642871234 MB/sec (without seq num) 2024/11/24-07:18:41.590922 139957693548096 [compaction_job.cc:1948] [default] [JOB 43319] Generated table #296104: 919300 keys, 35295090 bytes, temperature: kWarm 2024/11/24-07:18:41.591012 139957693548096 EVENT_LOG_v1 {"time_micros": 1732403921590967, "cf_name": "default", "job": 43319, "event": "table_file_creation", "file_number": 296104, "file_size": 35295090, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4339047074, "largest_seqno": 4450793137, "table_properties": {"data_size": 29343104, "index_size": 1760128, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25740400, "raw_average_key_size": 28, "raw_value_size": 108477400, "raw_average_value_size": 118, "num_data_blocks": 1, "num_entries": 919300, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 118, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732403918, "oldest_key_time": 0, "file_creation_time": 1732403918, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 296104, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-07:18:41.628768 139957693548096 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296105.sst) /dev/shm/ToplingTemp/Topling-296260-fIppsY 2024/11/24-07:18:42.646313 139957693548096 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296105.sst): first pass time = 1.02's, 131.908'MB/sec 2024/11/24-07:18:43.972331 139957693548096 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296105.sst): old prealloc_size = 147639500, real_size = 31055248 2024/11/24-07:18:43.972900 139957693548096 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296105.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 932667 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1081 GB zip-val = 0.0290 GB avg-val = 115.91 avg-zval = 31.15 2024/11/24-07:18:43.973686 139957693548096 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296105.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-07:18:44.817339 139957693548096 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296105.sst): second pass time = 1.33's, 81.576'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 41.622'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3245.885'MB/sec (index lex order gen) rebuild zvType time = 0.71's, 0.328'MB/sec write SST data time = 0.13's, 264.600'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 34187.879'MB/sec zip my value time = 1.33's, unzip length = 0.108'GB zip my value throughput = 81.576'MB/sec zip pipeline throughput = 81.576'MB/sec entries = 932667 avg-key = 28.00 avg-zkey = 1.90 avg-val = 115.91 avg-zval = 31.15 usrkeys = 932667 avg-key = 20.00 avg-zkey = 1.90 avg-val = 122.91 avg-zval = 31.15 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 932667 bytes = 3264352 } seq expand size = 6528669 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0187 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0290 GB dict = 1.08 MB all = 0.0352 GB } UnZip/Zip{ index = 10.5159 value = 3.7215 dict = 1.00 all = 3.8162 } Zip/UnZip{ index = 0.0951 value = 0.2687 dict = 1.00 all = 0.2620 } ---------------------------- total value len = 2253.275708 GB avg = 0.199 KB (by entry num) total key len = 307.325053 GB avg = 0.027 KB total ukey len = 237.670506 GB avg = 0.015 KB total ukey num = 15.754450096 Billion total entry num = 11.295764044 Billion write speed all = 31.764273521 MB/sec (with seq num) write speed all = 30.643281154 MB/sec (without seq num) 2024/11/24-07:18:44.861618 139957693548096 [compaction_job.cc:1948] [default] [JOB 43319] Generated table #296105: 932667 keys, 35170218 bytes, temperature: kWarm 2024/11/24-07:18:44.861687 139957693548096 EVENT_LOG_v1 {"time_micros": 1732403924861652, "cf_name": "default", "job": 43319, "event": "table_file_creation", "file_number": 296105, "file_size": 35170218, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4265679921, "largest_seqno": 4493438039, "table_properties": {"data_size": 29048064, "index_size": 1773824, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26114676, "raw_average_key_size": 28, "raw_value_size": 108103150, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 932667, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732403921, "oldest_key_time": 0, "file_creation_time": 1732403921, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 296105, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-07:18:44.900679 139957693548096 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296106.sst) /dev/shm/ToplingTemp/Topling-296260-QY1XZX 2024/11/24-07:18:45.838468 139957693548096 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296106.sst): first pass time = 0.94's, 143.127'MB/sec 2024/11/24-07:18:47.133153 139957693548096 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296106.sst): old prealloc_size = 147639500, real_size = 31329040 2024/11/24-07:18:47.133730 139957693548096 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296106.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 919300 prefix = 4 raw-key = 0.0147 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1085 GB zip-val = 0.0293 GB avg-val = 118.00 avg-zval = 31.91 2024/11/24-07:18:47.134503 139957693548096 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296106.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-07:18:47.951541 139957693548096 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296106.sst): second pass time = 1.29's, 83.836'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.82's, 43.124'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3180.740'MB/sec (index lex order gen) rebuild zvType time = 0.69's, 0.335'MB/sec write SST data time = 0.13's, 267.087'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.085'MB, throughput = 32851.217'MB/sec zip my value time = 1.29's, unzip length = 0.108'GB zip my value throughput = 83.836'MB/sec zip pipeline throughput = 83.836'MB/sec entries = 919300 avg-key = 28.00 avg-zkey = 1.91 avg-val = 118.00 avg-zval = 31.91 usrkeys = 919300 avg-key = 20.00 avg-zkey = 1.91 avg-val = 125.00 avg-zval = 31.91 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 919300 bytes = 3102656 } seq expand size = 6435100 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0184 GB value = 0.1085 GB dict = 1.09 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0293 GB dict = 1.09 MB all = 0.0353 GB } UnZip/Zip{ index = 10.4447 value = 3.6974 dict = 1.00 all = 3.8032 } Zip/UnZip{ index = 0.0957 value = 0.2705 dict = 1.00 all = 0.2629 } ---------------------------- total value len = 2253.390621 GB avg = 0.199 KB (by entry num) total key len = 307.350793 GB avg = 0.027 KB total ukey len = 237.688892 GB avg = 0.015 KB total ukey num = 15.755369396 Billion total entry num = 11.296683344 Billion write speed all = 31.764783313 MB/sec (with seq num) write speed all = 30.643743300 MB/sec (without seq num) 2024/11/24-07:18:47.995674 139957693548096 [compaction_job.cc:1948] [default] [JOB 43319] Generated table #296106: 919300 keys, 35290866 bytes, temperature: kWarm 2024/11/24-07:18:47.995745 139957693548096 EVENT_LOG_v1 {"time_micros": 1732403927995709, "cf_name": "default", "job": 43319, "event": "table_file_creation", "file_number": 296106, "file_size": 35290866, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4276672635, "largest_seqno": 4385448493, "table_properties": {"data_size": 29338688, "index_size": 1760320, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25740400, "raw_average_key_size": 28, "raw_value_size": 108477400, "raw_average_value_size": 118, "num_data_blocks": 1, "num_entries": 919300, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 118, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732403924, "oldest_key_time": 0, "file_creation_time": 1732403924, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 296106, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-07:18:48.031724 139957693548096 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296107.sst) /dev/shm/ToplingTemp/Topling-296260-iNCCA1 2024/11/24-07:18:48.914418 139957693548096 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296107.sst): first pass time = 0.88's, 152.062'MB/sec 2024/11/24-07:18:50.216829 139957693548096 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296107.sst): old prealloc_size = 147639500, real_size = 31295296 2024/11/24-07:18:50.217437 139957693548096 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296107.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 920468 prefix = 4 raw-key = 0.0147 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1084 GB zip-val = 0.0293 GB avg-val = 117.81 avg-zval = 31.83 2024/11/24-07:18:50.218187 139957693548096 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296107.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-07:18:51.051858 139957693548096 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296107.sst): second pass time = 1.30's, 83.313'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 42.227'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3022.877'MB/sec (index lex order gen) rebuild zvType time = 0.70's, 0.329'MB/sec write SST data time = 0.13's, 263.261'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.084'MB, throughput = 34435.608'MB/sec zip my value time = 1.30's, unzip length = 0.108'GB zip my value throughput = 83.313'MB/sec zip pipeline throughput = 83.313'MB/sec entries = 920468 avg-key = 28.00 avg-zkey = 1.91 avg-val = 117.81 avg-zval = 31.83 usrkeys = 920468 avg-key = 20.00 avg-zkey = 1.91 avg-val = 124.81 avg-zval = 31.83 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 920468 bytes = 3106592 } seq expand size = 6443276 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0184 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0293 GB dict = 1.08 MB all = 0.0353 GB } UnZip/Zip{ index = 10.4439 value = 3.7009 dict = 1.00 all = 3.8065 } Zip/UnZip{ index = 0.0957 value = 0.2702 dict = 1.00 all = 0.2627 } ---------------------------- total value len = 2253.505509 GB avg = 0.199 KB (by entry num) total key len = 307.376566 GB avg = 0.027 KB total ukey len = 237.707301 GB avg = 0.015 KB total ukey num = 15.756289864 Billion total entry num = 11.297603812 Billion write speed all = 31.765306518 MB/sec (with seq num) write speed all = 30.644218276 MB/sec (without seq num) 2024/11/24-07:18:51.095283 139957693548096 [compaction_job.cc:1948] [default] [JOB 43319] Generated table #296107: 920468 keys, 35260034 bytes, temperature: kWarm 2024/11/24-07:18:51.095352 139957693548096 EVENT_LOG_v1 {"time_micros": 1732403931095317, "cf_name": "default", "job": 43319, "event": "table_file_creation", "file_number": 296107, "file_size": 35260034, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4385448494, "largest_seqno": 4493438058, "table_properties": {"data_size": 29302320, "index_size": 1762688, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25773104, "raw_average_key_size": 28, "raw_value_size": 108444728, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 920468, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732403928, "oldest_key_time": 0, "file_creation_time": 1732403928, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 296107, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-07:18:51.139656 139957693548096 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296108.sst) /dev/shm/ToplingTemp/Topling-296260-PcPMMX 2024/11/24-07:18:52.115809 139957693548096 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296108.sst): first pass time = 0.98's, 137.503'MB/sec 2024/11/24-07:18:53.462404 139957693548096 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296108.sst): old prealloc_size = 147639500, real_size = 32828608 2024/11/24-07:18:53.462960 139957693548096 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296108.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 931483 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1081 GB zip-val = 0.0308 GB avg-val = 116.09 avg-zval = 33.09 2024/11/24-07:18:53.463767 139957693548096 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296108.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-07:18:54.333854 139957693548096 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296108.sst): second pass time = 1.35's, 80.355'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.87's, 42.390'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3425.867'MB/sec (index lex order gen) rebuild zvType time = 0.74's, 0.316'MB/sec write SST data time = 0.13's, 273.907'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 31695.918'MB/sec zip my value time = 1.35's, unzip length = 0.108'GB zip my value throughput = 80.355'MB/sec zip pipeline throughput = 80.355'MB/sec entries = 931483 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.09 avg-zval = 33.09 usrkeys = 931483 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.09 avg-zval = 33.09 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 931483 bytes = 3260208 } seq expand size = 6520381 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0308 GB dict = 1.08 MB all = 0.0369 GB } UnZip/Zip{ index = 10.5135 value = 3.5082 dict = 1.00 all = 3.6334 } Zip/UnZip{ index = 0.0951 value = 0.2850 dict = 1.00 all = 0.2752 } ---------------------------- total value len = 2253.620165 GB avg = 0.199 KB (by entry num) total key len = 307.402648 GB avg = 0.027 KB total ukey len = 237.725931 GB avg = 0.015 KB total ukey num = 15.757221347 Billion total entry num = 11.298535295 Billion write speed all = 31.765759057 MB/sec (with seq num) write speed all = 30.644624023 MB/sec (without seq num) 2024/11/24-07:18:54.379113 139957693548096 [compaction_job.cc:1948] [default] [JOB 43319] Generated table #296108: 931483 keys, 36939564 bytes, temperature: kWarm 2024/11/24-07:18:54.379181 139957693548096 EVENT_LOG_v1 {"time_micros": 1732403934379147, "cf_name": "default", "job": 43319, "event": "table_file_creation", "file_number": 296108, "file_size": 36939564, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4265679941, "largest_seqno": 4493437258, "table_properties": {"data_size": 30823600, "index_size": 1771968, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26081524, "raw_average_key_size": 28, "raw_value_size": 108136294, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 931483, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732403931, "oldest_key_time": 0, "file_creation_time": 1732403931, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 296108, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-07:18:54.416097 139957693548096 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296109.sst) /dev/shm/ToplingTemp/Topling-296260-maZKoX 2024/11/24-07:18:55.261154 139957693548096 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296109.sst): first pass time = 0.85's, 158.834'MB/sec 2024/11/24-07:18:56.566933 139957693548096 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296109.sst): old prealloc_size = 147639500, real_size = 31432704 2024/11/24-07:18:56.567520 139957693548096 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296109.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 919300 prefix = 4 raw-key = 0.0147 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.1085 GB zip-val = 0.0294 GB avg-val = 118.00 avg-zval = 32.01 2024/11/24-07:18:56.568300 139957693548096 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296109.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-07:18:57.396857 139957693548096 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296109.sst): second pass time = 1.31's, 83.124'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.83's, 42.649'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3143.840'MB/sec (index lex order gen) rebuild zvType time = 0.70's, 0.329'MB/sec write SST data time = 0.13's, 268.916'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.085'MB, throughput = 25840.955'MB/sec zip my value time = 1.31's, unzip length = 0.108'GB zip my value throughput = 83.124'MB/sec zip pipeline throughput = 83.124'MB/sec entries = 919300 avg-key = 28.00 avg-zkey = 1.93 avg-val = 118.00 avg-zval = 32.01 usrkeys = 919300 avg-key = 20.00 avg-zkey = 1.93 avg-val = 125.00 avg-zval = 32.01 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 919300 bytes = 3102656 } seq expand size = 6435100 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0184 GB value = 0.1085 GB dict = 1.09 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0294 GB dict = 1.09 MB all = 0.0354 GB } UnZip/Zip{ index = 10.3779 value = 3.6858 dict = 1.00 all = 3.7920 } Zip/UnZip{ index = 0.0964 value = 0.2713 dict = 1.00 all = 0.2637 } ---------------------------- total value len = 2253.735078 GB avg = 0.199 KB (by entry num) total key len = 307.428388 GB avg = 0.027 KB total ukey len = 237.744317 GB avg = 0.015 KB total ukey num = 15.758140647 Billion total entry num = 11.299454595 Billion write speed all = 31.766296783 MB/sec (with seq num) write speed all = 30.645113125 MB/sec (without seq num) 2024/11/24-07:18:57.440949 139957693548096 [compaction_job.cc:1948] [default] [JOB 43319] Generated table #296109: 919300 keys, 35394546 bytes, temperature: kWarm 2024/11/24-07:18:57.441034 139957693548096 EVENT_LOG_v1 {"time_micros": 1732403937440998, "cf_name": "default", "job": 43319, "event": "table_file_creation", "file_number": 296109, "file_size": 35394546, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4321886518, "largest_seqno": 4432955690, "table_properties": {"data_size": 29431024, "index_size": 1771648, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25740400, "raw_average_key_size": 28, "raw_value_size": 108477400, "raw_average_value_size": 118, "num_data_blocks": 1, "num_entries": 919300, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 118, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732403934, "oldest_key_time": 0, "file_creation_time": 1732403934, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 296109, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-07:18:57.478744 139957693548096 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296110.sst) /dev/shm/ToplingTemp/Topling-296260-KcgvH1 2024/11/24-07:18:58.470668 139957693548096 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296110.sst): first pass time = 0.99's, 135.315'MB/sec 2024/11/24-07:18:59.775704 139957693548096 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296110.sst): old prealloc_size = 147639500, real_size = 30129584 2024/11/24-07:18:59.776294 139957693548096 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296110.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 931347 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1081 GB zip-val = 0.0281 GB avg-val = 116.11 avg-zval = 30.19 2024/11/24-07:18:59.777055 139957693548096 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296110.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-07:19:00.603625 139957693548096 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296110.sst): second pass time = 1.30's, 82.915'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.83's, 41.075'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3155.699'MB/sec (index lex order gen) rebuild zvType time = 0.69's, 0.335'MB/sec write SST data time = 0.13's, 255.581'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 33041.645'MB/sec zip my value time = 1.30's, unzip length = 0.108'GB zip my value throughput = 82.915'MB/sec zip pipeline throughput = 82.915'MB/sec entries = 931347 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.11 avg-zval = 30.19 usrkeys = 931347 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.11 avg-zval = 30.19 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 931347 bytes = 3026896 } seq expand size = 6519429 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0281 GB dict = 1.08 MB all = 0.0340 GB } UnZip/Zip{ index = 10.4471 value = 3.8465 dict = 1.00 all = 3.9469 } Zip/UnZip{ index = 0.0957 value = 0.2600 dict = 1.00 all = 0.2534 } ---------------------------- total value len = 2253.849737 GB avg = 0.199 KB (by entry num) total key len = 307.454466 GB avg = 0.027 KB total ukey len = 237.762944 GB avg = 0.015 KB total ukey num = 15.759071994 Billion total entry num = 11.300385942 Billion write speed all = 31.766778873 MB/sec (with seq num) write speed all = 30.645547398 MB/sec (without seq num) 2024/11/24-07:19:00.646968 139957693548096 [compaction_job.cc:1948] [default] [JOB 43319] Generated table #296110: 931347 keys, 34005880 bytes, temperature: kWarm 2024/11/24-07:19:00.647055 139957693548096 EVENT_LOG_v1 {"time_micros": 1732403940647018, "cf_name": "default", "job": 43319, "event": "table_file_creation", "file_number": 296110, "file_size": 34005880, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4432955691, "largest_seqno": 4493438074, "table_properties": {"data_size": 28113568, "index_size": 1782976, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26077716, "raw_average_key_size": 28, "raw_value_size": 108140098, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 931347, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732403937, "oldest_key_time": 0, "file_creation_time": 1732403937, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 296110, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-07:19:00.689315 139957693548096 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296111.sst) /dev/shm/ToplingTemp/Topling-296260-HGZJAY 2024/11/24-07:19:01.689500 139957693548096 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296111.sst): first pass time = 1.00's, 134.198'MB/sec 2024/11/24-07:19:02.993852 139957693548096 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296111.sst): old prealloc_size = 147639500, real_size = 32027040 2024/11/24-07:19:02.994387 139957693548096 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296111.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 920732 prefix = 4 raw-key = 0.0147 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1084 GB zip-val = 0.0300 GB avg-val = 117.77 avg-zval = 32.62 2024/11/24-07:19:02.995219 139957693548096 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296111.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-07:19:03.834468 139957693548096 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296111.sst): second pass time = 1.30's, 83.188'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 42.958'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3463.425'MB/sec (index lex order gen) rebuild zvType time = 0.71's, 0.325'MB/sec write SST data time = 0.13's, 272.250'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.084'MB, throughput = 31405.712'MB/sec zip my value time = 1.30's, unzip length = 0.108'GB zip my value throughput = 83.188'MB/sec zip pipeline throughput = 83.188'MB/sec entries = 920732 avg-key = 28.00 avg-zkey = 1.91 avg-val = 117.77 avg-zval = 32.62 usrkeys = 920732 avg-key = 20.00 avg-zkey = 1.91 avg-val = 124.77 avg-zval = 32.62 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 920732 bytes = 3222576 } seq expand size = 6445124 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0184 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0300 GB dict = 1.08 MB all = 0.0361 GB } UnZip/Zip{ index = 10.4443 value = 3.6105 dict = 1.00 all = 3.7170 } Zip/UnZip{ index = 0.0957 value = 0.2770 dict = 1.00 all = 0.2690 } ---------------------------- total value len = 2253.964620 GB avg = 0.199 KB (by entry num) total key len = 307.480246 GB avg = 0.027 KB total ukey len = 237.781359 GB avg = 0.015 KB total ukey num = 15.759992726 Billion total entry num = 11.301306674 Billion write speed all = 31.767250521 MB/sec (with seq num) write speed all = 30.645972620 MB/sec (without seq num) 2024/11/24-07:19:03.879094 139957693548096 [compaction_job.cc:1948] [default] [JOB 43319] Generated table #296111: 920732 keys, 36109484 bytes, temperature: kWarm 2024/11/24-07:19:03.879166 139957693548096 EVENT_LOG_v1 {"time_micros": 1732403943879130, "cf_name": "default", "job": 43319, "event": "table_file_creation", "file_number": 296111, "file_size": 36109484, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4265679961, "largest_seqno": 4493437157, "table_properties": {"data_size": 30033552, "index_size": 1763136, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25780496, "raw_average_key_size": 28, "raw_value_size": 108437320, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 920732, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732403940, "oldest_key_time": 0, "file_creation_time": 1732403940, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 296111, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-07:19:03.917777 139957693548096 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296112.sst) /dev/shm/ToplingTemp/Topling-296260-Lq0pC0 2024/11/24-07:19:04.897943 139957693548096 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296112.sst): first pass time = 0.98's, 136.940'MB/sec 2024/11/24-07:19:06.212419 139957693548096 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296112.sst): old prealloc_size = 147639500, real_size = 31371776 2024/11/24-07:19:06.212954 139957693548096 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296112.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 919300 prefix = 4 raw-key = 0.0147 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1085 GB zip-val = 0.0294 GB avg-val = 118.00 avg-zval = 31.96 2024/11/24-07:19:06.213753 139957693548096 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296112.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-07:19:07.037802 139957693548096 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296112.sst): second pass time = 1.31's, 82.628'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.83's, 42.810'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3536.746'MB/sec (index lex order gen) rebuild zvType time = 0.69's, 0.332'MB/sec write SST data time = 0.13's, 268.113'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.085'MB, throughput = 34081.229'MB/sec zip my value time = 1.31's, unzip length = 0.108'GB zip my value throughput = 82.628'MB/sec zip pipeline throughput = 82.628'MB/sec entries = 919300 avg-key = 28.00 avg-zkey = 1.91 avg-val = 118.00 avg-zval = 31.96 usrkeys = 919300 avg-key = 20.00 avg-zkey = 1.91 avg-val = 125.00 avg-zval = 31.96 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 919300 bytes = 3102656 } seq expand size = 6435100 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0184 GB value = 0.1085 GB dict = 1.09 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0294 GB dict = 1.09 MB all = 0.0353 GB } UnZip/Zip{ index = 10.4447 value = 3.6920 dict = 1.00 all = 3.7986 } Zip/UnZip{ index = 0.0957 value = 0.2709 dict = 1.00 all = 0.2633 } ---------------------------- total value len = 2254.079532 GB avg = 0.199 KB (by entry num) total key len = 307.505987 GB avg = 0.027 KB total ukey len = 237.799745 GB avg = 0.015 KB total ukey num = 15.760912026 Billion total entry num = 11.302225974 Billion write speed all = 31.767732837 MB/sec (with seq num) write speed all = 30.646408275 MB/sec (without seq num) 2024/11/24-07:19:07.083094 139957693548096 [compaction_job.cc:1948] [default] [JOB 43319] Generated table #296112: 919300 keys, 35333618 bytes, temperature: kWarm 2024/11/24-07:19:07.083163 139957693548096 EVENT_LOG_v1 {"time_micros": 1732403947083127, "cf_name": "default", "job": 43319, "event": "table_file_creation", "file_number": 296112, "file_size": 35333618, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4367453447, "largest_seqno": 4480031817, "table_properties": {"data_size": 29381424, "index_size": 1760320, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25740400, "raw_average_key_size": 28, "raw_value_size": 108477400, "raw_average_value_size": 118, "num_data_blocks": 1, "num_entries": 919300, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 118, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732403943, "oldest_key_time": 0, "file_creation_time": 1732403943, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 296112, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-07:19:07.122231 139957693548096 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296113.sst) /dev/shm/ToplingTemp/Topling-296260-j8t3G1 2024/11/24-07:19:07.981879 139957693548096 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296113.sst): first pass time = 0.86's, 156.140'MB/sec 2024/11/24-07:19:09.295829 139957693548096 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296113.sst): old prealloc_size = 147639500, real_size = 32475984 2024/11/24-07:19:09.296390 139957693548096 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296113.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 932838 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1081 GB zip-val = 0.0305 GB avg-val = 115.88 avg-zval = 32.66 2024/11/24-07:19:09.298374 139957693548096 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296113.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-07:19:10.164463 139957693548096 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296113.sst): second pass time = 1.31's, 82.320'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.87's, 42.127'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3287.895'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.318'MB/sec write SST data time = 0.13's, 272.816'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 35552.147'MB/sec zip my value time = 1.31's, unzip length = 0.108'GB zip my value throughput = 82.320'MB/sec zip pipeline throughput = 82.320'MB/sec entries = 932838 avg-key = 28.00 avg-zkey = 1.90 avg-val = 115.88 avg-zval = 32.66 usrkeys = 932838 avg-key = 20.00 avg-zkey = 1.90 avg-val = 122.88 avg-zval = 32.66 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 932838 bytes = 3264944 } seq expand size = 6529866 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0187 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0305 GB dict = 1.08 MB all = 0.0366 GB } UnZip/Zip{ index = 10.5133 value = 3.5479 dict = 1.00 all = 3.6680 } Zip/UnZip{ index = 0.0951 value = 0.2819 dict = 1.00 all = 0.2726 } ---------------------------- total value len = 2254.194161 GB avg = 0.199 KB (by entry num) total key len = 307.532106 GB avg = 0.027 KB total ukey len = 237.818401 GB avg = 0.015 KB total ukey num = 15.761844864 Billion total entry num = 11.303158812 Billion write speed all = 31.768246501 MB/sec (with seq num) write speed all = 30.646872871 MB/sec (without seq num) 2024/11/24-07:19:10.209398 139957693548096 [compaction_job.cc:1948] [default] [JOB 43319] Generated table #296113: 932838 keys, 36591358 bytes, temperature: kWarm 2024/11/24-07:19:10.209474 139957693548096 EVENT_LOG_v1 {"time_micros": 1732403950209439, "cf_name": "default", "job": 43319, "event": "table_file_creation", "file_number": 296113, "file_size": 36591358, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4265679976, "largest_seqno": 4493438092, "table_properties": {"data_size": 30467968, "index_size": 1774592, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26119464, "raw_average_key_size": 28, "raw_value_size": 108098304, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 932838, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732403947, "oldest_key_time": 0, "file_creation_time": 1732403947, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 296113, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-07:19:10.248771 139957693548096 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296114.sst) /dev/shm/ToplingTemp/Topling-296260-ISji1Z 2024/11/24-07:19:10.430070 139957693548096 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296114.sst): first pass time = 0.18's, 246.162'MB/sec 2024/11/24-07:19:10.875101 139957693548096 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296114.sst): old prealloc_size = 147639500, real_size = 12125984 2024/11/24-07:19:10.875332 139957693548096 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296114.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 305611 prefix = 4 raw-key = 0.0049 GB zip-key = 0.0006 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.0361 GB zip-val = 0.0115 GB avg-val = 118.00 avg-zval = 37.51 2024/11/24-07:19:10.875625 139957693548096 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296114.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0007 GB, waited 0.000 sec, Key+Value = 0.045 GB 2024/11/24-07:19:11.154557 139957693548096 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00/296114.sst): second pass time = 0.44's, 81.160'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.28's, 47.999'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2870.913'MB/sec (index lex order gen) rebuild zvType time = 0.24's, 0.324'MB/sec write SST data time = 0.04's, 311.468'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.368'MB, throughput = 12433.645'MB/sec zip my value time = 0.44's, unzip length = 0.036'GB zip my value throughput = 81.160'MB/sec zip pipeline throughput = 81.160'MB/sec entries = 305611 avg-key = 28.00 avg-zkey = 1.92 avg-val = 118.00 avg-zval = 37.51 usrkeys = 305611 avg-key = 20.00 avg-zkey = 1.92 avg-val = 125.00 avg-zval = 37.51 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 305611 bytes = 993248 } seq expand size = 2139277 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0061 GB value = 0.0361 GB dict = 0.37 MB all = 0.0446 GB } __ZipSize{ index = 0.0006 GB value = 0.0115 GB dict = 0.37 MB all = 0.0134 GB } UnZip/Zip{ index = 10.4296 value = 3.1459 dict = 1.00 all = 3.3267 } Zip/UnZip{ index = 0.0959 value = 0.3179 dict = 1.00 all = 0.3006 } ---------------------------- total value len = 2254.232362 GB avg = 0.199 KB (by entry num) total key len = 307.540663 GB avg = 0.027 KB total ukey len = 237.824514 GB avg = 0.015 KB total ukey num = 15.762150475 Billion total entry num = 11.303464423 Billion write speed all = 31.768436294 MB/sec (with seq num) write speed all = 30.647046113 MB/sec (without seq num) 2024/11/24-07:19:11.175343 139957693548096 [compaction_job.cc:1948] [default] [JOB 43319] Generated table #296114: 305611 keys, 13412563 bytes, temperature: kWarm 2024/11/24-07:19:11.175403 139957693548096 EVENT_LOG_v1 {"time_micros": 1732403951175372, "cf_name": "default", "job": 43319, "event": "table_file_creation", "file_number": 296114, "file_size": 13412563, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4303544161, "largest_seqno": 4339385129, "table_properties": {"data_size": 11463376, "index_size": 586048, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 8557108, "raw_average_key_size": 28, "raw_value_size": 36062098, "raw_average_value_size": 118, "num_data_blocks": 1, "num_entries": 305611, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 118, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732403950, "oldest_key_time": 0, "file_creation_time": 1732403950, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 296114, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-07:19:11.190466 139957693548096 [compaction_job.cc:703] job-43319: subcompact[0], size: 0.897439 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43319/att-00 [296089,296090,296091,296092,296093,296094,296095,296096,296097,296098,296099,296100,296101,296102,296103,296104,296105,296106,296107,296108,296109,296110,296111,296112,296113,296114] 2024/11/24-07:19:11.334066 139957693548096 (Original Log Time 2024/11/24-07:17:50.392051) EVENT_LOG_v1 {"time_micros": 1732403870392014, "job": 43319, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [296027], "files_L3": [296086, 295987, 295988, 295989, 295990, 295991, 295992, 295993, 295994, 295995, 295996, 295997, 295998, 295999, 296000, 295952, 295953, 295954, 295955, 295956, 295957, 295958, 295959, 295960, 295961, 296048], "score": 0.974904, "input_data_size": 915839112, "oldest_snapshot_seqno": 4493831193} 2024/11/24-07:19:11.334070 139957693548096 (Original Log Time 2024/11/24-07:19:11.332447) [compaction_job.cc:2022] [default] [JOB 43319] Compacted 1@2 + 26@3 files to L3 => 897438613 bytes 2024/11/24-07:19:11.334071 139957693548096 (Original Log Time 2024/11/24-07:19:11.333990) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 26 0 0 0] max score 0.03, MB/sec: 11.3 rd, 11.1 wr, level 3, files in(1, 26) out(26 +0 blob) MB in(27.1, 846.3 +0.0 blob) out(855.9 +0.0 blob), read-write-amplify(63.9) write-amplify(31.6) OK, records in: 23587255, records dropped: 97943 output_compression: Snappy 2024/11/24-07:19:11.334075 139957693548096 (Original Log Time 2024/11/24-07:19:11.334040) EVENT_LOG_v1 {"time_micros": 1732403951334015, "cf": "default", "job": 43319, "event": "compaction_finished", "compaction_time_micros": 80798420, "compaction_time_cpu_micros": 35183451, "output_level": 3, "num_output_files": 26, "total_output_size": 897438613, "num_input_records": 23587255, "num_output_records": 23489312, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 613395342, "file_range_sync_nanos": 0, "file_fsync_nanos": 19713, "file_prepare_write_nanos": 69300, "lsm_state": [0, 0, 0, 26, 0, 0, 0]} 2024/11/24-07:19:11.468303 139957693548096 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732256054,"starts":1732403870,"executesMs":81090,"compactionJobId":43319,"attempt":0,"compactionInputRawBytes":3413972238,"compactionInputZipBytes":915839112,"compactionOutputRawBytes":0,"compactionOutputZipBytes":897438613,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-b2ed8f250466a6d041521c8054657ecb-c7c0627163feadee-00"}}, response = 2024/11/24-07:19:11.468388 139957693548096 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-43319/att-00: olev 3, work 81.090 s, result 7.721 ms, install 1.643 ms, input{raw 3.180 GiB zip 873.412 MiB}