2024/11/23-21:14:01.871770 139957609621056 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00: fork to child time = 0.007780 sec 2024/11/23-21:14:01.872482 139957609621056 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00 2024/11/23-21:14:01.881689 139957609621056 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00 2024/11/23-21:14:01.882596 139957609621056 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/23-21:14:01.882875 139957609621056 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/23-21:14:01.945078 139957609621056 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-35959/att-00/MANIFEST-206347 2024/11/23-21:14:02.014971 139957609621056 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-35959/att-00/MANIFEST-206347 succeeded,manifest_file_number is 206347, next_file_number is 281008, last_sequence is 4266098856, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 280777 2024/11/23-21:14:02.014993 139957609621056 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/23-21:14:02.015278 139957609621056 [version_set.cc:5721] Creating manifest 281008 2024/11/23-21:14:02.050258 139957609621056 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00: bottommost_level: fake = 1, rpc = 1 2024/11/23-21:14:02.072578 139957609621056 [compaction_job.cc:2437] [default] [JOB 35959] Compacting 13@3 + 107@4 files to L4, score -1.00, subcompactions 1 : 1 2024/11/23-21:14:02.072661 139957609621056 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 26900 Base level 3, inputs: [281004(36MB) 281005(14MB) 280912(35MB) 280913(35MB) 280914(36MB) 280915(34MB) 280917(20MB) 280981(40MB) 280982(40MB) 280983(40MB) 280984(40MB) 280985(40MB) 280986(40MB)], [280973(60MB) 280974(61MB) 280975(60MB) 280976(63MB) 280977(56MB) 280978(54MB) 280979(59MB) 280980(45MB) 278476(10MB) 276762(59MB) 278705(58MB) 278706(58MB) 278707(15MB) 272740(2610KB) 279146(57MB) 279147(54MB) 279148(10MB) 278275(53MB) 278276(56MB) 279904(30MB) 275670(9790KB) 203232(11MB) 197519(6613KB) 197520(29MB) 197522(39MB) 197592(61MB) 197599(39MB) 197663(34MB) 197672(39MB) 197676(61MB) 197747(39MB) 197753(34MB) 197815(39MB) 197826(39MB) 197828(61MB) 197903(34MB) 197905(39MB) 197967(39MB) 197980(61MB) 198047(39MB) 198056(34MB) 198123(39MB) 198135(39MB) 198136(31MB) 198196(39MB) 198211(37MB) 198266(39MB) 198286(38MB) 198290(39MB) 198356(37MB) 198365(39MB) 198429(39MB) 198438(35MB) 198440(39MB) 198507(30MB) 198512(39MB) 198577(39MB) 198587(35MB) 198588(39MB) 198650(33MB) 198659(39MB) 198716(39MB) 198728(32MB) 198737(39MB) 198813(33MB) 198814(39MB) 198878(39MB) 198885(32MB) 198891(39MB) 198956(36MB) 198963(39MB) 198971(39MB) 199043(36MB) 199045(39MB) 199046(30MB) 199117(39MB) 199119(39MB) 199182(33MB) 199194(39MB) 199195(33MB) 199250(39MB) 199271(39MB) 199333(33MB) 199342(39MB) 199346(36MB) 199404(39MB) 199421(39MB) 199492(30MB) 199500(39MB) 199502(36MB) 199556(39MB) 199574(39MB) 199629(30MB) 199645(39MB) 199654(36MB) 199707(39MB) 199711(39MB) 199777(30MB) 199787(39MB) 199800(39MB) 199852(39MB) 199860(39MB) 199926(33MB) 199939(39MB) 199944(32MB) 199996(39MB) 200003(39MB)] 2024/11/23-21:14:02.081090 139957609621056 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-21:14:02.081115 139957609621056 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-21:14:02.081130 139957609621056 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-21:14:02.081140 139957609621056 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-21:14:02.081145 139957609621056 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-21:14:03.159993 139957609621056 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281009.sst) /dev/shm/ToplingTemp/Topling-190888-xPhgLf 2024/11/23-21:14:04.498020 139957609621056 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281009.sst): first pass time = 1.34's, 200.628'MB/sec 2024/11/23-21:14:07.991853 139957609621056 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281009.sst): old prealloc_size = 295279001, real_size = 59536496 2024/11/23-21:14:07.993198 139957609621056 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281009.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1843379 prefix = 4 raw-key = 0.0295 GB zip-key = 0.0035 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.2168 GB zip-val = 0.0556 GB avg-val = 117.62 avg-zval = 30.15 2024/11/23-21:14:07.993281 139957609621056 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281009.sst: sumWaitingMem = 0.005 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0048 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:14:10.084232 139957609621056 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281009.sst): second pass time = 3.49's, 62.086'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 2.09's, 29.271'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2658.915'MB/sec (index lex order gen) rebuild zvType time = 1.79's, 0.257'MB/sec write SST data time = 0.30's, 205.023'MB/sec dict compress time = 0.00's, 2160306.000'MB/sec z-dict build time = 0.00's, sample length = 2.160'MB, throughput = 54172.877'MB/sec zip my value time = 3.49's, unzip length = 0.217'GB zip my value throughput = 62.086'MB/sec zip pipeline throughput = 66.223'MB/sec entries = 1843379 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.62 avg-zval = 30.15 usrkeys = 1843379 avg-key = 20.00 avg-zkey = 1.90 avg-val = 117.62 avg-zval = 30.15 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0369 GB value = 0.2168 GB dict = 2.16 MB all = 0.2684 GB } __ZipSize{ index = 0.0035 GB value = 0.0556 GB dict = 2.16 MB all = 0.0612 GB } UnZip/Zip{ index = 10.5181 value = 3.9017 dict = 1.00 all = 4.3829 } Zip/UnZip{ index = 0.0951 value = 0.2563 dict = 1.00 all = 0.2282 } ---------------------------- total value len = 9.065441 GB avg = 0.167 KB (by entry num) total key len = 1.492436 GB avg = 0.028 KB total ukey len = 1.034746 GB avg = 0.015 KB total ukey num = 0.067393814 Billion total entry num = 0.054201543 Billion write speed all = 0.238123224 MB/sec (with seq num) write speed all = 0.228343495 MB/sec (without seq num) 2024/11/23-21:14:10.159513 139957609621056 [compaction_job.cc:1948] [default] [JOB 35959] Generated table #281009: 1843379 keys, 61246390 bytes, temperature: kWarm 2024/11/23-21:14:10.159607 139957609621056 EVENT_LOG_v1 {"time_micros": 1732367650159551, "cf_name": "default", "job": 35959, "event": "table_file_creation", "file_number": 281009, "file_size": 61246390, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 55570336, "index_size": 3505152, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 51614612, "raw_average_key_size": 28, "raw_value_size": 216820958, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 1843379, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367643, "oldest_key_time": 0, "file_creation_time": 1732367643, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281009, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:14:10.226248 139957609621056 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281010.sst) /dev/shm/ToplingTemp/Topling-190888-QTCbtg 2024/11/23-21:14:12.283372 139957609621056 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281010.sst): first pass time = 2.06's, 130.493'MB/sec 2024/11/23-21:14:15.290465 139957609621056 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281010.sst): old prealloc_size = 295279001, real_size = 60722512 2024/11/23-21:14:15.291793 139957609621056 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281010.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1843266 prefix = 4 raw-key = 0.0295 GB zip-key = 0.0035 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.2168 GB zip-val = 0.0567 GB avg-val = 117.63 avg-zval = 30.78 2024/11/23-21:14:15.291860 139957609621056 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281010.sst: sumWaitingMem = 0.005 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0048 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:14:17.868227 139957609621056 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281010.sst): second pass time = 3.01's, 72.151'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 2.58's, 24.220'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2750.756'MB/sec (index lex order gen) rebuild zvType time = 1.92's, 0.240'MB/sec write SST data time = 0.66's, 95.180'MB/sec dict compress time = 0.00's, 2160232.000'MB/sec z-dict build time = 0.00's, sample length = 2.160'MB, throughput = 65503.260'MB/sec zip my value time = 3.01's, unzip length = 0.217'GB zip my value throughput = 72.151'MB/sec zip pipeline throughput = 72.151'MB/sec entries = 1843266 avg-key = 28.00 avg-zkey = 1.91 avg-val = 117.63 avg-zval = 30.78 usrkeys = 1843266 avg-key = 20.00 avg-zkey = 1.91 avg-val = 117.63 avg-zval = 30.78 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0369 GB value = 0.2168 GB dict = 2.16 MB all = 0.2684 GB } __ZipSize{ index = 0.0035 GB value = 0.0567 GB dict = 2.16 MB all = 0.0624 GB } UnZip/Zip{ index = 10.4482 value = 3.8218 dict = 1.00 all = 4.2996 } Zip/UnZip{ index = 0.0957 value = 0.2617 dict = 1.00 all = 0.2326 } ---------------------------- total value len = 9.282265 GB avg = 0.166 KB (by entry num) total key len = 1.544047 GB avg = 0.028 KB total ukey len = 1.071611 GB avg = 0.015 KB total ukey num = 0.069237080 Billion total entry num = 0.056044809 Billion write speed all = 0.244134682 MB/sec (with seq num) write speed all = 0.234024142 MB/sec (without seq num) 2024/11/23-21:14:17.950771 139957609621056 [compaction_job.cc:1948] [default] [JOB 35959] Generated table #281010: 1843266 keys, 62432300 bytes, temperature: kWarm 2024/11/23-21:14:17.950868 139957609621056 EVENT_LOG_v1 {"time_micros": 1732367657950814, "cf_name": "default", "job": 35959, "event": "table_file_creation", "file_number": 281010, "file_size": 62432300, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 56733120, "index_size": 3528384, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 51611448, "raw_average_key_size": 28, "raw_value_size": 216824128, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 1843266, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367650, "oldest_key_time": 0, "file_creation_time": 1732367650, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281010, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:14:18.105152 139957609621056 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281011.sst) /dev/shm/ToplingTemp/Topling-190888-wPFFPg 2024/11/23-21:14:20.078915 139957609621056 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281011.sst): first pass time = 1.97's, 136.006'MB/sec 2024/11/23-21:14:22.886420 139957609621056 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281011.sst): old prealloc_size = 295279001, real_size = 61029408 2024/11/23-21:14:22.887712 139957609621056 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281011.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1843085 prefix = 4 raw-key = 0.0295 GB zip-key = 0.0035 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.2168 GB zip-val = 0.0571 GB avg-val = 117.64 avg-zval = 30.96 2024/11/23-21:14:22.887763 139957609621056 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281011.sst: sumWaitingMem = 0.005 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0048 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:14:24.952303 139957609621056 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281011.sst): second pass time = 2.81's, 77.282'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 2.07's, 30.370'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2766.278'MB/sec (index lex order gen) rebuild zvType time = 1.57's, 0.293'MB/sec write SST data time = 0.49's, 127.969'MB/sec dict compress time = 0.00's, 2160428.000'MB/sec z-dict build time = 0.00's, sample length = 2.160'MB, throughput = 69344.503'MB/sec zip my value time = 2.81's, unzip length = 0.217'GB zip my value throughput = 77.282'MB/sec zip pipeline throughput = 77.282'MB/sec entries = 1843085 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.64 avg-zval = 30.96 usrkeys = 1843085 avg-key = 20.00 avg-zkey = 1.90 avg-val = 117.64 avg-zval = 30.96 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 8 UnZipSize{ index = 0.0369 GB value = 0.2168 GB dict = 2.16 MB all = 0.2684 GB } __ZipSize{ index = 0.0035 GB value = 0.0571 GB dict = 2.16 MB all = 0.0627 GB } UnZip/Zip{ index = 10.5172 value = 3.7998 dict = 1.00 all = 4.2786 } Zip/UnZip{ index = 0.0951 value = 0.2632 dict = 1.00 all = 0.2337 } ---------------------------- total value len = 9.499094 GB avg = 0.164 KB (by entry num) total key len = 1.595654 GB avg = 0.028 KB total ukey len = 1.108473 GB avg = 0.016 KB total ukey num = 0.071080165 Billion total entry num = 0.057887894 Billion write speed all = 0.250147977 MB/sec (with seq num) write speed all = 0.239706612 MB/sec (without seq num) 2024/11/23-21:14:25.034803 139957609621056 [compaction_job.cc:1948] [default] [JOB 35959] Generated table #281011: 1843085 keys, 62739440 bytes, temperature: kWarm 2024/11/23-21:14:25.034887 139957609621056 EVENT_LOG_v1 {"time_micros": 1732367665034838, "cf_name": "default", "job": 35959, "event": "table_file_creation", "file_number": 281011, "file_size": 62739440, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 57063568, "index_size": 3504896, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 51606380, "raw_average_key_size": 28, "raw_value_size": 216829214, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 1843085, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367658, "oldest_key_time": 0, "file_creation_time": 1732367658, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281011, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:14:25.118238 139957609621056 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281012.sst) /dev/shm/ToplingTemp/Topling-190888-3xtHyg 2024/11/23-21:14:27.686861 139957609621056 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281012.sst): first pass time = 2.57's, 104.507'MB/sec 2024/11/23-21:14:31.299067 139957609621056 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281012.sst): old prealloc_size = 295279001, real_size = 64602992 2024/11/23-21:14:31.300140 139957609621056 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281012.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1845756 prefix = 4 raw-key = 0.0295 GB zip-key = 0.0035 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.2168 GB zip-val = 0.0606 GB avg-val = 117.43 avg-zval = 32.84 2024/11/23-21:14:31.300180 139957609621056 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281012.sst: sumWaitingMem = 0.005 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0048 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:14:33.323557 139957609621056 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281012.sst): second pass time = 3.61's, 60.032'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 2.02's, 32.759'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3439.220'MB/sec (index lex order gen) rebuild zvType time = 1.57's, 0.294'MB/sec write SST data time = 0.45's, 145.801'MB/sec dict compress time = 0.00's, 2160026.000'MB/sec z-dict build time = 0.00's, sample length = 2.160'MB, throughput = 78233.466'MB/sec zip my value time = 3.61's, unzip length = 0.217'GB zip my value throughput = 60.032'MB/sec zip pipeline throughput = 119.485'MB/sec entries = 1845756 avg-key = 28.00 avg-zkey = 1.91 avg-val = 117.43 avg-zval = 32.84 usrkeys = 1845756 avg-key = 20.00 avg-zkey = 1.91 avg-val = 117.43 avg-zval = 32.84 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 11 UnZipSize{ index = 0.0369 GB value = 0.2168 GB dict = 2.16 MB all = 0.2684 GB } __ZipSize{ index = 0.0035 GB value = 0.0606 GB dict = 2.16 MB all = 0.0663 GB } UnZip/Zip{ index = 10.4479 value = 3.5763 dict = 1.00 all = 4.0476 } Zip/UnZip{ index = 0.0957 value = 0.2796 dict = 1.00 all = 0.2471 } ---------------------------- total value len = 9.715848 GB avg = 0.163 KB (by entry num) total key len = 1.647335 GB avg = 0.028 KB total ukey len = 1.145388 GB avg = 0.016 KB total ukey num = 0.072925921 Billion total entry num = 0.059733650 Billion write speed all = 0.256151917 MB/sec (with seq num) write speed all = 0.245379661 MB/sec (without seq num) 2024/11/23-21:14:33.408848 139957609621056 [compaction_job.cc:1948] [default] [JOB 35959] Generated table #281012: 1845756 keys, 66319198 bytes, temperature: kWarm 2024/11/23-21:14:33.408945 139957609621056 EVENT_LOG_v1 {"time_micros": 1732367673408892, "cf_name": "default", "job": 35959, "event": "table_file_creation", "file_number": 281012, "file_size": 66319198, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 60608096, "index_size": 3533248, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 51681168, "raw_average_key_size": 28, "raw_value_size": 216754296, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 1845756, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367665, "oldest_key_time": 0, "file_creation_time": 1732367665, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281012, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:14:33.490689 139957609621056 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281013.sst) /dev/shm/ToplingTemp/Topling-190888-QkfKNg 2024/11/23-21:14:35.226058 139957609621056 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281013.sst): first pass time = 1.74's, 154.690'MB/sec 2024/11/23-21:14:38.797603 139957609621056 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281013.sst): old prealloc_size = 295279001, real_size = 53751760 2024/11/23-21:14:38.798594 139957609621056 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281013.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1870604 prefix = 4 raw-key = 0.0299 GB zip-key = 0.0036 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.2161 GB zip-val = 0.0497 GB avg-val = 115.50 avg-zval = 26.58 2024/11/23-21:14:38.798633 139957609621056 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281013.sst: sumWaitingMem = 0.005 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0049 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:14:40.269585 139957609621056 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281013.sst): second pass time = 3.57's, 60.559'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.47's, 37.670'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3715.316'MB/sec (index lex order gen) rebuild zvType time = 1.23's, 0.381'MB/sec write SST data time = 0.24's, 227.034'MB/sec dict compress time = 0.00's, 2153762.000'MB/sec z-dict build time = 0.00's, sample length = 2.154'MB, throughput = 63502.831'MB/sec zip my value time = 3.57's, unzip length = 0.216'GB zip my value throughput = 60.559'MB/sec zip pipeline throughput = 131.271'MB/sec entries = 1870604 avg-key = 28.00 avg-zkey = 1.90 avg-val = 115.50 avg-zval = 26.58 usrkeys = 1870604 avg-key = 20.00 avg-zkey = 1.90 avg-val = 115.50 avg-zval = 26.58 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0374 GB value = 0.2161 GB dict = 2.15 MB all = 0.2684 GB } __ZipSize{ index = 0.0036 GB value = 0.0497 GB dict = 2.15 MB all = 0.0554 GB } UnZip/Zip{ index = 10.5196 value = 4.3449 dict = 1.00 all = 4.8412 } Zip/UnZip{ index = 0.0951 value = 0.2302 dict = 1.00 all = 0.2066 } ---------------------------- total value len = 9.931907 GB avg = 0.161 KB (by entry num) total key len = 1.699712 GB avg = 0.028 KB total ukey len = 1.182800 GB avg = 0.016 KB total ukey num = 0.074796525 Billion total entry num = 0.061604254 Billion write speed all = 0.262162015 MB/sec (with seq num) write speed all = 0.251054157 MB/sec (without seq num) 2024/11/23-21:14:40.350274 139957609621056 [compaction_job.cc:1948] [default] [JOB 35959] Generated table #281013: 1870604 keys, 55448358 bytes, temperature: kWarm 2024/11/23-21:14:40.350331 139957609621056 EVENT_LOG_v1 {"time_micros": 1732367680350298, "cf_name": "default", "job": 35959, "event": "table_file_creation", "file_number": 281013, "file_size": 55448358, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 49727488, "index_size": 3556416, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 52376912, "raw_average_key_size": 28, "raw_value_size": 216058684, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 1870604, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367673, "oldest_key_time": 0, "file_creation_time": 1732367673, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281013, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:14:40.401178 139957609621056 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281014.sst) /dev/shm/ToplingTemp/Topling-190888-vLBWqe 2024/11/23-21:14:41.921630 139957609621056 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281014.sst): first pass time = 1.52's, 176.553'MB/sec 2024/11/23-21:14:44.190771 139957609621056 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281014.sst): old prealloc_size = 295279001, real_size = 54990224 2024/11/23-21:14:44.191868 139957609621056 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281014.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1838600 prefix = 4 raw-key = 0.0294 GB zip-key = 0.0035 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.2170 GB zip-val = 0.0510 GB avg-val = 118.00 avg-zval = 27.74 2024/11/23-21:14:44.191907 139957609621056 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281014.sst: sumWaitingMem = 0.005 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0048 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:14:45.775166 139957609621056 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281014.sst): second pass time = 2.27's, 95.674'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.58's, 35.787'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3278.139'MB/sec (index lex order gen) rebuild zvType time = 1.33's, 0.345'MB/sec write SST data time = 0.25's, 224.398'MB/sec dict compress time = 0.00's, 2162232.000'MB/sec z-dict build time = 0.00's, sample length = 2.162'MB, throughput = 67990.441'MB/sec zip my value time = 2.27's, unzip length = 0.217'GB zip my value throughput = 95.674'MB/sec zip pipeline throughput = 95.674'MB/sec entries = 1838600 avg-key = 28.00 avg-zkey = 1.91 avg-val = 118.00 avg-zval = 27.74 usrkeys = 1838600 avg-key = 20.00 avg-zkey = 1.91 avg-val = 118.00 avg-zval = 27.74 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0368 GB value = 0.2170 GB dict = 2.16 MB all = 0.2684 GB } __ZipSize{ index = 0.0035 GB value = 0.0510 GB dict = 2.16 MB all = 0.0567 GB } UnZip/Zip{ index = 10.4502 value = 4.2530 dict = 1.00 all = 4.7344 } Zip/UnZip{ index = 0.0957 value = 0.2351 dict = 1.00 all = 0.2112 } ---------------------------- total value len = 10.148862 GB avg = 0.160 KB (by entry num) total key len = 1.751192 GB avg = 0.028 KB total ukey len = 1.219572 GB avg = 0.016 KB total ukey num = 0.076635125 Billion total entry num = 0.063442854 Billion write speed all = 0.268178937 MB/sec (with seq num) write speed all = 0.256740981 MB/sec (without seq num) 2024/11/23-21:14:45.843133 139957609621056 [compaction_job.cc:1948] [default] [JOB 35959] Generated table #281014: 1838600 keys, 56699468 bytes, temperature: kWarm 2024/11/23-21:14:45.843202 139957609621056 EVENT_LOG_v1 {"time_micros": 1732367685843166, "cf_name": "default", "job": 35959, "event": "table_file_creation", "file_number": 281014, "file_size": 56699468, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 51011584, "index_size": 3518784, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 51480800, "raw_average_key_size": 28, "raw_value_size": 216954800, "raw_average_value_size": 118, "num_data_blocks": 1, "num_entries": 1838600, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 118, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367680, "oldest_key_time": 0, "file_creation_time": 1732367680, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281014, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:14:45.896077 139957609621056 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281015.sst) /dev/shm/ToplingTemp/Topling-190888-IGQgRg 2024/11/23-21:14:47.656908 139957609621056 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281015.sst): first pass time = 1.76's, 152.451'MB/sec 2024/11/23-21:14:50.014679 139957609621056 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281015.sst): old prealloc_size = 295279001, real_size = 59674304 2024/11/23-21:14:50.015784 139957609621056 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281015.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1853676 prefix = 4 raw-key = 0.0297 GB zip-key = 0.0035 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.2165 GB zip-val = 0.0557 GB avg-val = 116.81 avg-zval = 30.04 2024/11/23-21:14:50.015842 139957609621056 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281015.sst: sumWaitingMem = 0.005 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0049 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:14:51.611552 139957609621056 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281015.sst): second pass time = 2.36's, 91.893'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.60's, 38.439'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3240.278'MB/sec (index lex order gen) rebuild zvType time = 1.34's, 0.345'MB/sec write SST data time = 0.25's, 241.780'MB/sec dict compress time = 0.00's, 2158680.000'MB/sec z-dict build time = 0.00's, sample length = 2.159'MB, throughput = 52716.306'MB/sec zip my value time = 2.36's, unzip length = 0.217'GB zip my value throughput = 91.893'MB/sec zip pipeline throughput = 91.893'MB/sec entries = 1853676 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.81 avg-zval = 30.04 usrkeys = 1853676 avg-key = 20.00 avg-zkey = 1.90 avg-val = 116.81 avg-zval = 30.04 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 8 UnZipSize{ index = 0.0371 GB value = 0.2165 GB dict = 2.16 MB all = 0.2684 GB } __ZipSize{ index = 0.0035 GB value = 0.0557 GB dict = 2.16 MB all = 0.0614 GB } UnZip/Zip{ index = 10.5164 value = 3.8885 dict = 1.00 all = 4.3733 } Zip/UnZip{ index = 0.0951 value = 0.2572 dict = 1.00 all = 0.2287 } ---------------------------- total value len = 10.365394 GB avg = 0.159 KB (by entry num) total key len = 1.803095 GB avg = 0.028 KB total ukey len = 1.256645 GB avg = 0.016 KB total ukey num = 0.078488801 Billion total entry num = 0.065296530 Billion write speed all = 0.274192320 MB/sec (with seq num) write speed all = 0.262421718 MB/sec (without seq num) 2024/11/23-21:14:51.683609 139957609621056 [compaction_job.cc:1948] [default] [JOB 35959] Generated table #281015: 1853676 keys, 61379932 bytes, temperature: kWarm 2024/11/23-21:14:51.683677 139957609621056 EVENT_LOG_v1 {"time_micros": 1732367691683641, "cf_name": "default", "job": 35959, "event": "table_file_creation", "file_number": 281015, "file_size": 61379932, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 55685360, "index_size": 3525312, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 51902928, "raw_average_key_size": 28, "raw_value_size": 216532604, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 1853676, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367685, "oldest_key_time": 0, "file_creation_time": 1732367685, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281015, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:14:51.739331 139957609621056 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281016.sst) /dev/shm/ToplingTemp/Topling-190888-cUBAbi 2024/11/23-21:14:53.519769 139957609621056 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281016.sst): first pass time = 1.78's, 150.773'MB/sec 2024/11/23-21:14:55.809395 139957609621056 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281016.sst): old prealloc_size = 295279001, real_size = 58530032 2024/11/23-21:14:55.810526 139957609621056 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281016.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1847816 prefix = 4 raw-key = 0.0296 GB zip-key = 0.0035 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.2167 GB zip-val = 0.0546 GB avg-val = 117.27 avg-zval = 29.52 2024/11/23-21:14:55.810567 139957609621056 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281016.sst: sumWaitingMem = 0.005 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0049 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:14:57.336758 139957609621056 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281016.sst): second pass time = 2.29's, 94.702'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.53's, 39.440'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3185.383'MB/sec (index lex order gen) rebuild zvType time = 1.27's, 0.362'MB/sec write SST data time = 0.25's, 239.371'MB/sec dict compress time = 0.00's, 2159696.000'MB/sec z-dict build time = 0.00's, sample length = 2.160'MB, throughput = 68731.971'MB/sec zip my value time = 2.29's, unzip length = 0.217'GB zip my value throughput = 94.702'MB/sec zip pipeline throughput = 94.702'MB/sec entries = 1847816 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.27 avg-zval = 29.52 usrkeys = 1847816 avg-key = 20.00 avg-zkey = 1.90 avg-val = 117.27 avg-zval = 29.52 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0370 GB value = 0.2167 GB dict = 2.16 MB all = 0.2684 GB } __ZipSize{ index = 0.0035 GB value = 0.0546 GB dict = 2.16 MB all = 0.0602 GB } UnZip/Zip{ index = 10.5194 value = 3.9721 dict = 1.00 all = 4.4562 } Zip/UnZip{ index = 0.0951 value = 0.2518 dict = 1.00 all = 0.2244 } ---------------------------- total value len = 10.582091 GB avg = 0.158 KB (by entry num) total key len = 1.854834 GB avg = 0.028 KB total ukey len = 1.293602 GB avg = 0.016 KB total ukey num = 0.080336617 Billion total entry num = 0.067144346 Billion write speed all = 0.280204824 MB/sec (with seq num) write speed all = 0.268102689 MB/sec (without seq num) 2024/11/23-21:14:57.406034 139957609621056 [compaction_job.cc:1948] [default] [JOB 35959] Generated table #281016: 1847816 keys, 60238164 bytes, temperature: kWarm 2024/11/23-21:14:57.406109 139957609621056 EVENT_LOG_v1 {"time_micros": 1732367697406066, "cf_name": "default", "job": 35959, "event": "table_file_creation", "file_number": 281016, "file_size": 60238164, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 54554720, "index_size": 3513152, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 51738848, "raw_average_key_size": 28, "raw_value_size": 216696696, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 1847816, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367691, "oldest_key_time": 0, "file_creation_time": 1732367691, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281016, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:14:57.458234 139957609621056 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281017.sst) /dev/shm/ToplingTemp/Topling-190888-DcyrWh 2024/11/23-21:14:59.688100 139957609621056 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281017.sst): first pass time = 2.23's, 120.384'MB/sec 2024/11/23-21:15:01.976195 139957609621056 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281017.sst): old prealloc_size = 295279001, real_size = 55086560 2024/11/23-21:15:01.977264 139957609621056 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281017.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1838600 prefix = 4 raw-key = 0.0294 GB zip-key = 0.0035 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.2170 GB zip-val = 0.0511 GB avg-val = 118.00 avg-zval = 27.80 2024/11/23-21:15:01.977308 139957609621056 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281017.sst: sumWaitingMem = 0.005 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0048 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:15:03.544789 139957609621056 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281017.sst): second pass time = 2.29's, 94.874'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.57's, 36.208'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3363.366'MB/sec (index lex order gen) rebuild zvType time = 1.31's, 0.350'MB/sec write SST data time = 0.25's, 224.612'MB/sec dict compress time = 0.00's, 2162232.000'MB/sec z-dict build time = 0.00's, sample length = 2.162'MB, throughput = 71055.932'MB/sec zip my value time = 2.29's, unzip length = 0.217'GB zip my value throughput = 94.874'MB/sec zip pipeline throughput = 94.874'MB/sec entries = 1838600 avg-key = 28.00 avg-zkey = 1.91 avg-val = 118.00 avg-zval = 27.80 usrkeys = 1838600 avg-key = 20.00 avg-zkey = 1.91 avg-val = 118.00 avg-zval = 27.80 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 8 UnZipSize{ index = 0.0368 GB value = 0.2170 GB dict = 2.16 MB all = 0.2684 GB } __ZipSize{ index = 0.0035 GB value = 0.0511 GB dict = 2.16 MB all = 0.0568 GB } UnZip/Zip{ index = 10.4502 value = 4.2450 dict = 1.00 all = 4.7263 } Zip/UnZip{ index = 0.0957 value = 0.2356 dict = 1.00 all = 0.2116 } ---------------------------- total value len = 10.799046 GB avg = 0.157 KB (by entry num) total key len = 1.906315 GB avg = 0.028 KB total ukey len = 1.330374 GB avg = 0.016 KB total ukey num = 0.082175217 Billion total entry num = 0.068982946 Billion write speed all = 0.286212666 MB/sec (with seq num) write speed all = 0.273780879 MB/sec (without seq num) 2024/11/23-21:15:03.611547 139957609621056 [compaction_job.cc:1948] [default] [JOB 35959] Generated table #281017: 1838600 keys, 56795788 bytes, temperature: kWarm 2024/11/23-21:15:03.611619 139957609621056 EVENT_LOG_v1 {"time_micros": 1732367703611582, "cf_name": "default", "job": 35959, "event": "table_file_creation", "file_number": 281017, "file_size": 56795788, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 51107920, "index_size": 3518784, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 51480800, "raw_average_key_size": 28, "raw_value_size": 216954800, "raw_average_value_size": 118, "num_data_blocks": 1, "num_entries": 1838600, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 118, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367697, "oldest_key_time": 0, "file_creation_time": 1732367697, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281017, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:15:03.678517 139957609621056 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281018.sst) /dev/shm/ToplingTemp/Topling-190888-ZAdDEe 2024/11/23-21:15:05.341764 139957609621056 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281018.sst): first pass time = 1.66's, 161.396'MB/sec 2024/11/23-21:15:07.649920 139957609621056 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281018.sst): old prealloc_size = 295279001, real_size = 59590768 2024/11/23-21:15:07.651041 139957609621056 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281018.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1846329 prefix = 4 raw-key = 0.0295 GB zip-key = 0.0035 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.2167 GB zip-val = 0.0556 GB avg-val = 117.39 avg-zval = 30.11 2024/11/23-21:15:07.651083 139957609621056 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281018.sst: sumWaitingMem = 0.005 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0048 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:15:09.196397 139957609621056 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281018.sst): second pass time = 2.31's, 93.952'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.55's, 39.639'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3214.959'MB/sec (index lex order gen) rebuild zvType time = 1.30's, 0.356'MB/sec write SST data time = 0.25's, 245.807'MB/sec dict compress time = 0.00's, 2159888.000'MB/sec z-dict build time = 0.00's, sample length = 2.160'MB, throughput = 66090.022'MB/sec zip my value time = 2.31's, unzip length = 0.217'GB zip my value throughput = 93.952'MB/sec zip pipeline throughput = 93.952'MB/sec entries = 1846329 avg-key = 28.00 avg-zkey = 1.91 avg-val = 117.39 avg-zval = 30.11 usrkeys = 1846329 avg-key = 20.00 avg-zkey = 1.91 avg-val = 117.39 avg-zval = 30.11 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0369 GB value = 0.2167 GB dict = 2.16 MB all = 0.2684 GB } __ZipSize{ index = 0.0035 GB value = 0.0556 GB dict = 2.16 MB all = 0.0613 GB } UnZip/Zip{ index = 10.4500 value = 3.8985 dict = 1.00 all = 4.3791 } Zip/UnZip{ index = 0.0957 value = 0.2565 dict = 1.00 all = 0.2284 } ---------------------------- total value len = 11.015784 GB avg = 0.156 KB (by entry num) total key len = 1.958012 GB avg = 0.028 KB total ukey len = 1.367300 GB avg = 0.016 KB total ukey num = 0.084021546 Billion total entry num = 0.070829275 Billion write speed all = 0.292222489 MB/sec (with seq num) write speed all = 0.279459590 MB/sec (without seq num) 2024/11/23-21:15:09.266014 139957609621056 [compaction_job.cc:1948] [default] [JOB 35959] Generated table #281018: 1846329 keys, 61299476 bytes, temperature: kWarm 2024/11/23-21:15:09.266083 139957609621056 EVENT_LOG_v1 {"time_micros": 1732367709266048, "cf_name": "default", "job": 35959, "event": "table_file_creation", "file_number": 281018, "file_size": 61299476, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 55595360, "index_size": 3533632, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 51697212, "raw_average_key_size": 28, "raw_value_size": 216738346, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 1846329, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367703, "oldest_key_time": 0, "file_creation_time": 1732367703, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281018, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:15:09.318732 139957609621056 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281019.sst) /dev/shm/ToplingTemp/Topling-190888-1hNsif 2024/11/23-21:15:11.435607 139957609621056 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281019.sst): first pass time = 2.12's, 126.809'MB/sec 2024/11/23-21:15:13.740788 139957609621056 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281019.sst): old prealloc_size = 295279001, real_size = 60031424 2024/11/23-21:15:13.741825 139957609621056 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281019.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1845890 prefix = 4 raw-key = 0.0295 GB zip-key = 0.0035 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.2168 GB zip-val = 0.0561 GB avg-val = 117.42 avg-zval = 30.37 2024/11/23-21:15:13.741865 139957609621056 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281019.sst: sumWaitingMem = 0.005 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0048 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:15:15.295591 139957609621056 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281019.sst): second pass time = 2.30's, 94.106'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.55's, 39.710'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3448.430'MB/sec (index lex order gen) rebuild zvType time = 1.30's, 0.355'MB/sec write SST data time = 0.25's, 243.786'MB/sec dict compress time = 0.00's, 2160104.000'MB/sec z-dict build time = 0.00's, sample length = 2.160'MB, throughput = 67238.498'MB/sec zip my value time = 2.30's, unzip length = 0.217'GB zip my value throughput = 94.106'MB/sec zip pipeline throughput = 94.106'MB/sec entries = 1845890 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.42 avg-zval = 30.37 usrkeys = 1845890 avg-key = 20.00 avg-zkey = 1.90 avg-val = 117.42 avg-zval = 30.37 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0369 GB value = 0.2168 GB dict = 2.16 MB all = 0.2684 GB } __ZipSize{ index = 0.0035 GB value = 0.0561 GB dict = 2.16 MB all = 0.0617 GB } UnZip/Zip{ index = 10.5178 value = 3.8664 dict = 1.00 all = 4.3478 } Zip/UnZip{ index = 0.0951 value = 0.2586 dict = 1.00 all = 0.2300 } ---------------------------- total value len = 11.232535 GB avg = 0.155 KB (by entry num) total key len = 2.009697 GB avg = 0.028 KB total ukey len = 1.404218 GB avg = 0.016 KB total ukey num = 0.085867436 Billion total entry num = 0.072675165 Billion write speed all = 0.298227775 MB/sec (with seq num) write speed all = 0.285134060 MB/sec (without seq num) 2024/11/23-21:15:15.370152 139957609621056 [compaction_job.cc:1948] [default] [JOB 35959] Generated table #281019: 1845890 keys, 61740460 bytes, temperature: kWarm 2024/11/23-21:15:15.370223 139957609621056 EVENT_LOG_v1 {"time_micros": 1732367715370186, "cf_name": "default", "job": 35959, "event": "table_file_creation", "file_number": 281019, "file_size": 61740460, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 56059760, "index_size": 3510016, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 51684920, "raw_average_key_size": 28, "raw_value_size": 216750620, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 1845890, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367709, "oldest_key_time": 0, "file_creation_time": 1732367709, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281019, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:15:15.428941 139957609621056 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281020.sst) /dev/shm/ToplingTemp/Topling-190888-ioi7Gg 2024/11/23-21:15:16.450425 139957609621056 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281020.sst): first pass time = 1.02's, 262.812'MB/sec 2024/11/23-21:15:18.710415 139957609621056 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281020.sst): old prealloc_size = 295279001, real_size = 55216512 2024/11/23-21:15:18.711452 139957609621056 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281020.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1839066 prefix = 4 raw-key = 0.0294 GB zip-key = 0.0035 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.2169 GB zip-val = 0.0512 GB avg-val = 117.96 avg-zval = 27.86 2024/11/23-21:15:18.711491 139957609621056 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281020.sst: sumWaitingMem = 0.005 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0048 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:15:20.264876 139957609621056 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281020.sst): second pass time = 2.26's, 96.045'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.55's, 36.622'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3465.211'MB/sec (index lex order gen) rebuild zvType time = 1.30's, 0.353'MB/sec write SST data time = 0.25's, 225.912'MB/sec dict compress time = 0.00's, 2162174.000'MB/sec z-dict build time = 0.00's, sample length = 2.162'MB, throughput = 70440.593'MB/sec zip my value time = 2.26's, unzip length = 0.217'GB zip my value throughput = 96.045'MB/sec zip pipeline throughput = 96.045'MB/sec entries = 1839066 avg-key = 28.00 avg-zkey = 1.91 avg-val = 117.96 avg-zval = 27.86 usrkeys = 1839066 avg-key = 20.00 avg-zkey = 1.91 avg-val = 117.96 avg-zval = 27.86 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0368 GB value = 0.2169 GB dict = 2.16 MB all = 0.2684 GB } __ZipSize{ index = 0.0035 GB value = 0.0512 GB dict = 2.16 MB all = 0.0569 GB } UnZip/Zip{ index = 10.4485 value = 4.2341 dict = 1.00 all = 4.7155 } Zip/UnZip{ index = 0.0957 value = 0.2362 dict = 1.00 all = 0.2121 } ---------------------------- total value len = 11.449477 GB avg = 0.154 KB (by entry num) total key len = 2.061191 GB avg = 0.028 KB total ukey len = 1.440999 GB avg = 0.016 KB total ukey num = 0.087706502 Billion total entry num = 0.074514231 Billion write speed all = 0.304239153 MB/sec (with seq num) write speed all = 0.290815600 MB/sec (without seq num) 2024/11/23-21:15:20.334553 139957609621056 [compaction_job.cc:1948] [default] [JOB 35959] Generated table #281020: 1839066 keys, 56925634 bytes, temperature: kWarm 2024/11/23-21:15:20.334623 139957609621056 EVENT_LOG_v1 {"time_micros": 1732367720334587, "cf_name": "default", "job": 35959, "event": "table_file_creation", "file_number": 281020, "file_size": 56925634, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 51236336, "index_size": 3520256, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 51493848, "raw_average_key_size": 28, "raw_value_size": 216941708, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 1839066, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367715, "oldest_key_time": 0, "file_creation_time": 1732367715, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281020, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:15:20.388080 139957609621056 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281021.sst) /dev/shm/ToplingTemp/Topling-190888-sm40xe 2024/11/23-21:15:22.621235 139957609621056 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281021.sst): first pass time = 2.23's, 120.207'MB/sec 2024/11/23-21:15:24.899629 139957609621056 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281021.sst): old prealloc_size = 295279001, real_size = 58214016 2024/11/23-21:15:24.900673 139957609621056 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281021.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1845641 prefix = 4 raw-key = 0.0295 GB zip-key = 0.0035 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.2168 GB zip-val = 0.0542 GB avg-val = 117.44 avg-zval = 29.39 2024/11/23-21:15:24.900714 139957609621056 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281021.sst: sumWaitingMem = 0.005 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0048 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:15:26.429061 139957609621056 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281021.sst): second pass time = 2.28's, 95.190'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.53's, 39.180'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3427.081'MB/sec (index lex order gen) rebuild zvType time = 1.28's, 0.362'MB/sec write SST data time = 0.25's, 237.189'MB/sec dict compress time = 0.00's, 2159650.000'MB/sec z-dict build time = 0.00's, sample length = 2.160'MB, throughput = 70198.277'MB/sec zip my value time = 2.28's, unzip length = 0.217'GB zip my value throughput = 95.190'MB/sec zip pipeline throughput = 95.190'MB/sec entries = 1845641 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.44 avg-zval = 29.39 usrkeys = 1845641 avg-key = 20.00 avg-zkey = 1.90 avg-val = 117.44 avg-zval = 29.39 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0369 GB value = 0.2168 GB dict = 2.16 MB all = 0.2684 GB } __ZipSize{ index = 0.0035 GB value = 0.0542 GB dict = 2.16 MB all = 0.0599 GB } UnZip/Zip{ index = 10.5189 value = 3.9960 dict = 1.00 all = 4.4797 } Zip/UnZip{ index = 0.0951 value = 0.2502 dict = 1.00 all = 0.2232 } ---------------------------- total value len = 11.666234 GB avg = 0.153 KB (by entry num) total key len = 2.112869 GB avg = 0.028 KB total ukey len = 1.477912 GB avg = 0.017 KB total ukey num = 0.089552143 Billion total entry num = 0.076359872 Billion write speed all = 0.310240838 MB/sec (with seq num) write speed all = 0.296486706 MB/sec (without seq num) 2024/11/23-21:15:26.499416 139957609621056 [compaction_job.cc:1948] [default] [JOB 35959] Generated table #281021: 1845641 keys, 59922662 bytes, temperature: kWarm 2024/11/23-21:15:26.499486 139957609621056 EVENT_LOG_v1 {"time_micros": 1732367726499450, "cf_name": "default", "job": 35959, "event": "table_file_creation", "file_number": 281021, "file_size": 59922662, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 54243248, "index_size": 3509184, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 51677948, "raw_average_key_size": 28, "raw_value_size": 216757538, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 1845641, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367720, "oldest_key_time": 0, "file_creation_time": 1732367720, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281021, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:15:26.554099 139957609621056 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281022.sst) /dev/shm/ToplingTemp/Topling-190888-PP15Td 2024/11/23-21:15:28.356359 139957609621056 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281022.sst): first pass time = 1.80's, 148.946'MB/sec 2024/11/23-21:15:30.676850 139957609621056 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281022.sst): old prealloc_size = 295279001, real_size = 60575376 2024/11/23-21:15:30.677909 139957609621056 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281022.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1846261 prefix = 4 raw-key = 0.0295 GB zip-key = 0.0035 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.2167 GB zip-val = 0.0566 GB avg-val = 117.39 avg-zval = 30.65 2024/11/23-21:15:30.677948 139957609621056 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281022.sst: sumWaitingMem = 0.005 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0048 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:15:32.245441 139957609621056 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281022.sst): second pass time = 2.32's, 93.454'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.57's, 39.708'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3409.114'MB/sec (index lex order gen) rebuild zvType time = 1.32's, 0.350'MB/sec write SST data time = 0.25's, 249.046'MB/sec dict compress time = 0.00's, 2159930.000'MB/sec z-dict build time = 0.00's, sample length = 2.160'MB, throughput = 62183.101'MB/sec zip my value time = 2.32's, unzip length = 0.217'GB zip my value throughput = 93.454'MB/sec zip pipeline throughput = 93.454'MB/sec entries = 1846261 avg-key = 28.00 avg-zkey = 1.91 avg-val = 117.39 avg-zval = 30.65 usrkeys = 1846261 avg-key = 20.00 avg-zkey = 1.91 avg-val = 117.39 avg-zval = 30.65 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 10 UnZipSize{ index = 0.0369 GB value = 0.2167 GB dict = 2.16 MB all = 0.2684 GB } __ZipSize{ index = 0.0035 GB value = 0.0566 GB dict = 2.16 MB all = 0.0623 GB } UnZip/Zip{ index = 10.4504 value = 3.8307 dict = 1.00 all = 4.3099 } Zip/UnZip{ index = 0.0957 value = 0.2611 dict = 1.00 all = 0.2320 } ---------------------------- total value len = 11.882974 GB avg = 0.152 KB (by entry num) total key len = 2.164564 GB avg = 0.028 KB total ukey len = 1.514837 GB avg = 0.017 KB total ukey num = 0.091398404 Billion total entry num = 0.078206133 Billion write speed all = 0.316243335 MB/sec (with seq num) write speed all = 0.302158494 MB/sec (without seq num) 2024/11/23-21:15:32.317058 139957609621056 [compaction_job.cc:1948] [default] [JOB 35959] Generated table #281022: 1846261 keys, 62284094 bytes, temperature: kWarm 2024/11/23-21:15:32.317134 139957609621056 EVENT_LOG_v1 {"time_micros": 1732367732317098, "cf_name": "default", "job": 35959, "event": "table_file_creation", "file_number": 281022, "file_size": 62284094, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 56580224, "index_size": 3533376, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 51695308, "raw_average_key_size": 28, "raw_value_size": 216740262, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 1846261, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367726, "oldest_key_time": 0, "file_creation_time": 1732367726, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281022, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:15:32.370545 139957609621056 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281023.sst) /dev/shm/ToplingTemp/Topling-190888-F1cz7f 2024/11/23-21:15:33.694464 139957609621056 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281023.sst): first pass time = 1.32's, 202.764'MB/sec 2024/11/23-21:15:35.970075 139957609621056 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281023.sst): old prealloc_size = 295279001, real_size = 54634672 2024/11/23-21:15:35.971104 139957609621056 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281023.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1844401 prefix = 4 raw-key = 0.0295 GB zip-key = 0.0035 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.2168 GB zip-val = 0.0506 GB avg-val = 117.54 avg-zval = 27.46 2024/11/23-21:15:35.971144 139957609621056 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281023.sst: sumWaitingMem = 0.005 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0048 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:15:37.511423 139957609621056 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281023.sst): second pass time = 2.27's, 95.318'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.54's, 36.553'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3538.678'MB/sec (index lex order gen) rebuild zvType time = 1.29's, 0.357'MB/sec write SST data time = 0.25's, 226.211'MB/sec dict compress time = 0.00's, 2159576.000'MB/sec z-dict build time = 0.00's, sample length = 2.160'MB, throughput = 56588.214'MB/sec zip my value time = 2.27's, unzip length = 0.217'GB zip my value throughput = 95.318'MB/sec zip pipeline throughput = 95.318'MB/sec entries = 1844401 avg-key = 28.00 avg-zkey = 1.91 avg-val = 117.54 avg-zval = 27.46 usrkeys = 1844401 avg-key = 20.00 avg-zkey = 1.91 avg-val = 117.54 avg-zval = 27.46 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0369 GB value = 0.2168 GB dict = 2.16 MB all = 0.2684 GB } __ZipSize{ index = 0.0035 GB value = 0.0506 GB dict = 2.16 MB all = 0.0563 GB } UnZip/Zip{ index = 10.4482 value = 4.2808 dict = 1.00 all = 4.7646 } Zip/UnZip{ index = 0.0957 value = 0.2336 dict = 1.00 all = 0.2099 } ---------------------------- total value len = 12.099767 GB avg = 0.151 KB (by entry num) total key len = 2.216207 GB avg = 0.028 KB total ukey len = 1.551725 GB avg = 0.017 KB total ukey num = 0.093242805 Billion total entry num = 0.080050534 Billion write speed all = 0.322248250 MB/sec (with seq num) write speed all = 0.307832944 MB/sec (without seq num) 2024/11/23-21:15:37.577286 139957609621056 [compaction_job.cc:1948] [default] [JOB 35959] Generated table #281023: 1844401 keys, 56339868 bytes, temperature: kWarm 2024/11/23-21:15:37.577355 139957609621056 EVENT_LOG_v1 {"time_micros": 1732367737577319, "cf_name": "default", "job": 35959, "event": "table_file_creation", "file_number": 281023, "file_size": 56339868, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 50642848, "index_size": 3530560, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 51643228, "raw_average_key_size": 28, "raw_value_size": 216792262, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 1844401, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367732, "oldest_key_time": 0, "file_creation_time": 1732367732, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281023, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:15:37.640383 139957609621056 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281024.sst) /dev/shm/ToplingTemp/Topling-190888-r6wa2e 2024/11/23-21:15:39.529920 139957609621056 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281024.sst): first pass time = 1.89's, 142.067'MB/sec 2024/11/23-21:15:41.802175 139957609621056 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281024.sst): old prealloc_size = 295279001, real_size = 56427600 2024/11/23-21:15:41.803141 139957609621056 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281024.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1840284 prefix = 4 raw-key = 0.0294 GB zip-key = 0.0035 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.2169 GB zip-val = 0.0525 GB avg-val = 117.87 avg-zval = 28.51 2024/11/23-21:15:41.803180 139957609621056 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281024.sst: sumWaitingMem = 0.005 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0048 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:15:43.338408 139957609621056 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281024.sst): second pass time = 2.27's, 95.511'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.54's, 37.846'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3706.303'MB/sec (index lex order gen) rebuild zvType time = 1.29's, 0.357'MB/sec write SST data time = 0.25's, 236.107'MB/sec dict compress time = 0.00's, 2161372.000'MB/sec z-dict build time = 0.00's, sample length = 2.161'MB, throughput = 67087.935'MB/sec zip my value time = 2.27's, unzip length = 0.217'GB zip my value throughput = 95.511'MB/sec zip pipeline throughput = 95.511'MB/sec entries = 1840284 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.87 avg-zval = 28.51 usrkeys = 1840284 avg-key = 20.00 avg-zkey = 1.90 avg-val = 117.87 avg-zval = 28.51 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 8 UnZipSize{ index = 0.0368 GB value = 0.2169 GB dict = 2.16 MB all = 0.2684 GB } __ZipSize{ index = 0.0035 GB value = 0.0525 GB dict = 2.16 MB all = 0.0581 GB } UnZip/Zip{ index = 10.5179 value = 4.1341 dict = 1.00 all = 4.6171 } Zip/UnZip{ index = 0.0951 value = 0.2419 dict = 1.00 all = 0.2166 } ---------------------------- total value len = 12.316674 GB avg = 0.150 KB (by entry num) total key len = 2.267735 GB avg = 0.028 KB total ukey len = 1.588531 GB avg = 0.017 KB total ukey num = 0.095083089 Billion total entry num = 0.081890818 Billion write speed all = 0.328247599 MB/sec (with seq num) write speed all = 0.313502832 MB/sec (without seq num) 2024/11/23-21:15:43.404678 139957609621056 [compaction_job.cc:1948] [default] [JOB 35959] Generated table #281024: 1840284 keys, 58139232 bytes, temperature: kWarm 2024/11/23-21:15:43.404748 139957609621056 EVENT_LOG_v1 {"time_micros": 1732367743404712, "cf_name": "default", "job": 35959, "event": "table_file_creation", "file_number": 281024, "file_size": 58139232, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 52468032, "index_size": 3499328, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 51527952, "raw_average_key_size": 28, "raw_value_size": 216907588, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 1840284, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367737, "oldest_key_time": 0, "file_creation_time": 1732367737, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281024, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:15:43.455631 139957609621056 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281025.sst) /dev/shm/ToplingTemp/Topling-190888-ntMUZf 2024/11/23-21:15:45.496189 139957609621056 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281025.sst): first pass time = 2.04's, 131.552'MB/sec 2024/11/23-21:15:47.819086 139957609621056 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281025.sst): old prealloc_size = 295279001, real_size = 60592064 2024/11/23-21:15:47.820038 139957609621056 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281025.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1846106 prefix = 4 raw-key = 0.0295 GB zip-key = 0.0035 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.2167 GB zip-val = 0.0566 GB avg-val = 117.41 avg-zval = 30.67 2024/11/23-21:15:47.820077 139957609621056 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281025.sst: sumWaitingMem = 0.005 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0048 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:15:49.381048 139957609621056 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281025.sst): second pass time = 2.32's, 93.360'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.56's, 39.887'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3807.089'MB/sec (index lex order gen) rebuild zvType time = 1.31's, 0.351'MB/sec write SST data time = 0.25's, 252.256'MB/sec dict compress time = 0.00's, 2159808.000'MB/sec z-dict build time = 0.00's, sample length = 2.160'MB, throughput = 62920.468'MB/sec zip my value time = 2.32's, unzip length = 0.217'GB zip my value throughput = 93.360'MB/sec zip pipeline throughput = 93.360'MB/sec entries = 1846106 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.41 avg-zval = 30.67 usrkeys = 1846106 avg-key = 20.00 avg-zkey = 1.90 avg-val = 117.41 avg-zval = 30.67 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0369 GB value = 0.2167 GB dict = 2.16 MB all = 0.2684 GB } __ZipSize{ index = 0.0035 GB value = 0.0566 GB dict = 2.16 MB all = 0.0623 GB } UnZip/Zip{ index = 10.5185 value = 3.8280 dict = 1.00 all = 4.3087 } Zip/UnZip{ index = 0.0951 value = 0.2612 dict = 1.00 all = 0.2321 } ---------------------------- total value len = 12.533419 GB avg = 0.150 KB (by entry num) total key len = 2.319426 GB avg = 0.028 KB total ukey len = 1.625453 GB avg = 0.017 KB total ukey num = 0.096929195 Billion total entry num = 0.083736924 Billion write speed all = 0.334243751 MB/sec (with seq num) write speed all = 0.319168636 MB/sec (without seq num) 2024/11/23-21:15:49.451725 139957609621056 [compaction_job.cc:1948] [default] [JOB 35959] Generated table #281025: 1846106 keys, 62300740 bytes, temperature: kWarm 2024/11/23-21:15:49.451794 139957609621056 EVENT_LOG_v1 {"time_micros": 1732367749451758, "cf_name": "default", "job": 35959, "event": "table_file_creation", "file_number": 281025, "file_size": 62300740, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 56620144, "index_size": 3510208, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 51690968, "raw_average_key_size": 28, "raw_value_size": 216744516, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 1846106, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367743, "oldest_key_time": 0, "file_creation_time": 1732367743, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281025, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:15:49.518347 139957609621056 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281026.sst) /dev/shm/ToplingTemp/Topling-190888-DiPsMh 2024/11/23-21:15:51.536811 139957609621056 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281026.sst): first pass time = 2.02's, 132.992'MB/sec 2024/11/23-21:15:53.894850 139957609621056 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281026.sst): old prealloc_size = 295279001, real_size = 56562736 2024/11/23-21:15:53.895850 139957609621056 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281026.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1847003 prefix = 4 raw-key = 0.0296 GB zip-key = 0.0035 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.2167 GB zip-val = 0.0526 GB avg-val = 117.34 avg-zval = 28.47 2024/11/23-21:15:53.895896 139957609621056 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281026.sst: sumWaitingMem = 0.005 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0048 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:15:55.409057 139957609621056 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281026.sst): second pass time = 2.36's, 91.953'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.51's, 38.488'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3591.212'MB/sec (index lex order gen) rebuild zvType time = 1.27's, 0.365'MB/sec write SST data time = 0.25's, 235.218'MB/sec dict compress time = 0.00's, 2158814.000'MB/sec z-dict build time = 0.00's, sample length = 2.159'MB, throughput = 66164.460'MB/sec zip my value time = 2.36's, unzip length = 0.217'GB zip my value throughput = 91.953'MB/sec zip pipeline throughput = 91.953'MB/sec entries = 1847003 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.34 avg-zval = 28.47 usrkeys = 1847003 avg-key = 20.00 avg-zkey = 1.90 avg-val = 117.34 avg-zval = 28.47 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0369 GB value = 0.2167 GB dict = 2.16 MB all = 0.2684 GB } __ZipSize{ index = 0.0035 GB value = 0.0526 GB dict = 2.16 MB all = 0.0583 GB } UnZip/Zip{ index = 10.5173 value = 4.1210 dict = 1.00 all = 4.6061 } Zip/UnZip{ index = 0.0951 value = 0.2427 dict = 1.00 all = 0.2171 } ---------------------------- total value len = 12.750138 GB avg = 0.149 KB (by entry num) total key len = 2.371142 GB avg = 0.028 KB total ukey len = 1.662393 GB avg = 0.017 KB total ukey num = 0.098776198 Billion total entry num = 0.085583927 Billion write speed all = 0.340238384 MB/sec (with seq num) write speed all = 0.324832844 MB/sec (without seq num) 2024/11/23-21:15:55.484014 139957609621056 [compaction_job.cc:1948] [default] [JOB 35959] Generated table #281026: 1847003 keys, 58277666 bytes, temperature: kWarm 2024/11/23-21:15:55.484104 139957609621056 EVENT_LOG_v1 {"time_micros": 1732367755484049, "cf_name": "default", "job": 35959, "event": "table_file_creation", "file_number": 281026, "file_size": 58277666, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 52588512, "index_size": 3512320, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 51716084, "raw_average_key_size": 28, "raw_value_size": 216719406, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 1847003, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367749, "oldest_key_time": 0, "file_creation_time": 1732367749, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281026, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:15:55.534513 139957609621056 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281027.sst) /dev/shm/ToplingTemp/Topling-190888-eIURBg 2024/11/23-21:15:55.954049 139957609621056 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281027.sst): first pass time = 0.42's, 158.726'MB/sec 2024/11/23-21:15:56.624933 139957609621056 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281027.sst): old prealloc_size = 295279001, real_size = 18186960 2024/11/23-21:15:56.625269 139957609621056 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281027.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 460000 prefix = 4 raw-key = 0.0074 GB zip-key = 0.0009 GB avg-key = 16.00 avg-zkey = 1.89 raw-val = 0.0537 GB zip-val = 0.0172 GB avg-val = 116.75 avg-zval = 37.40 2024/11/23-21:15:56.625312 139957609621056 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281027.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0011 GB, waited 0.000 sec, Key+Value = 0.067 GB 2024/11/23-21:15:56.970300 139957609621056 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281027.sst): second pass time = 0.67's, 80.139'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.35's, 53.915'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2758.957'MB/sec (index lex order gen) rebuild zvType time = 0.28's, 0.407'MB/sec write SST data time = 0.06's, 296.847'MB/sec dict compress time = 0.00's, 542114.000'MB/sec z-dict build time = 0.00's, sample length = 0.542'MB, throughput = 17807.509'MB/sec zip my value time = 0.67's, unzip length = 0.054'GB zip my value throughput = 80.139'MB/sec zip pipeline throughput = 80.139'MB/sec entries = 460000 avg-key = 28.00 avg-zkey = 1.89 avg-val = 116.75 avg-zval = 37.40 usrkeys = 460000 avg-key = 20.00 avg-zkey = 1.89 avg-val = 116.75 avg-zval = 37.40 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0092 GB value = 0.0537 GB dict = 0.54 MB all = 0.0666 GB } __ZipSize{ index = 0.0009 GB value = 0.0172 GB dict = 0.54 MB all = 0.0186 GB } UnZip/Zip{ index = 10.5761 value = 3.1220 dict = 1.00 all = 3.5761 } Zip/UnZip{ index = 0.0946 value = 0.3203 dict = 1.00 all = 0.2796 } ---------------------------- total value len = 12.803843 GB avg = 0.149 KB (by entry num) total key len = 2.384022 GB avg = 0.028 KB total ukey len = 1.671593 GB avg = 0.017 KB total ukey num = 0.099236198 Billion total entry num = 0.086043927 Billion write speed all = 0.341724588 MB/sec (with seq num) write speed all = 0.326236790 MB/sec (without seq num) 2024/11/23-21:15:56.998181 139957609621056 [compaction_job.cc:1948] [default] [JOB 35959] Generated table #281027: 460000 keys, 18619364 bytes, temperature: kWarm 2024/11/23-21:15:56.998251 139957609621056 EVENT_LOG_v1 {"time_micros": 1732367756998215, "cf_name": "default", "job": 35959, "event": "table_file_creation", "file_number": 281027, "file_size": 18619364, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 17201920, "index_size": 869888, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 12880000, "raw_average_key_size": 28, "raw_value_size": 53705164, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 460000, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367755, "oldest_key_time": 0, "file_creation_time": 1732367755, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281027, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:15:57.030525 139957609621056 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281028.sst) /dev/shm/ToplingTemp/Topling-190888-Rg1GOf 2024/11/23-21:15:57.466731 139957609621056 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281028.sst): first pass time = 0.44's, 19.031'MB/sec 2024/11/23-21:15:57.624041 139957609621056 [top_zip_table_builder.cc:2726] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281028.sst): part-0: reject ZipStore ratio = 1.032 2024/11/23-21:15:57.683389 139957609621056 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281028.sst): old prealloc_size = 295279001, real_size = 6796480 2024/11/23-21:15:57.683427 139957609621056 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281028.sst): index type = UintIndex_AllOne , store type = ZipOffsetBlobStore usrkeys = 100000 prefix = 4 raw-key = 0.0004 GB zip-key = 0.0000 GB avg-key = 4.00 avg-zkey = 0.00 raw-val = 0.0067 GB zip-val = 0.0068 GB avg-val = 67.01 avg-zval = 67.71 2024/11/23-21:15:57.698187 139957609621056 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281028.sst): second pass time = 0.16's, 42.781'MB/sec, value only(80.7% of KV) wait indexing time = 0.06's, remap KeyValue time = 0.01's, 458.408'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 7.961'MB/sec (index lex order gen) rebuild zvType time = 0.01's, 3.617'MB/sec write SST data time = 0.01's, 864.003'MB/sec dict compress time = 0.00's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.000'MB, throughput = 0.000'MB/sec zip my value time = 0.16's, unzip length = 0.007'GB zip my value throughput = 42.781'MB/sec zip pipeline throughput = 42.781'MB/sec entries = 100000 avg-key = 16.00 avg-zkey = 0.00 avg-val = 67.01 avg-zval = 67.71 usrkeys = 100000 avg-key = 8.00 avg-zkey = 0.00 avg-val = 67.01 avg-zval = 67.71 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 8 UnZipSize{ index = 0.0008 GB value = 0.0067 GB dict = 0.00 MB all = 0.0083 GB } __ZipSize{ index = 0.0000 GB value = 0.0068 GB dict = 0.00 MB all = 0.0068 GB } UnZip/Zip{ index =4166.6667 value = 0.9896 dict = 0.00 all = 1.2257 } Zip/UnZip{ index = 0.0002 value = 1.0105 dict = 0.00 all = 0.8159 } ---------------------------- total value len = 12.810544 GB avg = 0.149 KB (by entry num) total key len = 2.385622 GB avg = 0.028 KB total ukey len = 1.672393 GB avg = 0.017 KB total ukey num = 0.099336198 Billion total entry num = 0.086143927 Billion write speed all = 0.341905754 MB/sec (with seq num) write speed all = 0.326400209 MB/sec (without seq num) 2024/11/23-21:15:57.711912 139957609621056 [compaction_job.cc:1948] [default] [JOB 35959] Generated table #281028: 100000 keys, 6772487 bytes, temperature: kWarm 2024/11/23-21:15:57.711995 139957609621056 EVENT_LOG_v1 {"time_micros": 1732367757711948, "cf_name": "default", "job": 35959, "event": "table_file_creation", "file_number": 281028, "file_size": 6772487, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 6771152, "index_size": 192, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 1600000, "raw_average_key_size": 16, "raw_value_size": 6700718, "raw_average_value_size": 67, "num_data_blocks": 1, "num_entries": 100000, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 16, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-UintIndex_AllOne-ZipOffsetBlobStore", "creation_time": 1732367757, "oldest_key_time": 0, "file_creation_time": 1732367757, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281028, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:15:57.734447 139957609621056 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281029.sst) /dev/shm/ToplingTemp/Topling-190888-hgShPf 2024/11/23-21:15:59.409257 139957609621056 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281029.sst): first pass time = 1.67's, 160.282'MB/sec 2024/11/23-21:16:00.873205 139957609621056 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281029.sst): old prealloc_size = 295279001, real_size = 80475968 2024/11/23-21:16:00.873400 139957609621056 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281029.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258855 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.01 avg-zval = 308.96 2024/11/23-21:16:00.873452 139957609621056 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281029.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:16:01.197100 139957609621056 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281029.sst): second pass time = 1.46's, 180.005'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.32's, 256.595'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2511.640'MB/sec (index lex order gen) rebuild zvType time = 0.24's, 0.271'MB/sec write SST data time = 0.08's, 980.819'MB/sec dict compress time = 0.00's, 2688684.000'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 81148.221'MB/sec zip my value time = 1.46's, unzip length = 0.263'GB zip my value throughput = 180.005'MB/sec zip pipeline throughput = 180.005'MB/sec entries = 258855 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.01 avg-zval = 308.96 usrkeys = 258855 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.01 avg-zval = 308.96 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1229 value = 3.2918 dict = 1.00 all = 3.2302 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 13.073803 GB avg = 0.151 KB (by entry num) total key len = 2.390800 GB avg = 0.028 KB total ukey len = 1.675500 GB avg = 0.017 KB total ukey num = 0.099595053 Billion total entry num = 0.086402782 Billion write speed all = 0.347918027 MB/sec (with seq num) write speed all = 0.332367114 MB/sec (without seq num) 2024/11/23-21:16:01.293183 139957609621056 [compaction_job.cc:1948] [default] [JOB 35959] Generated table #281029: 258855 keys, 83102111 bytes, temperature: kWarm 2024/11/23-21:16:01.293254 139957609621056 EVENT_LOG_v1 {"time_micros": 1732367761293219, "cf_name": "default", "job": 35959, "event": "table_file_creation", "file_number": 281029, "file_size": 83102111, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79974960, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177100, "raw_average_key_size": 20, "raw_value_size": 263258606, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 258855, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367757, "oldest_key_time": 0, "file_creation_time": 1732367757, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281029, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:16:01.345966 139957609621056 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281030.sst) /dev/shm/ToplingTemp/Topling-190888-BNqEye 2024/11/23-21:16:02.241752 139957609621056 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281030.sst): first pass time = 0.90's, 299.686'MB/sec 2024/11/23-21:16:03.704044 139957609621056 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281030.sst): old prealloc_size = 295279001, real_size = 80485568 2024/11/23-21:16:03.704237 139957609621056 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281030.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258854 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.02 avg-zval = 308.99 2024/11/23-21:16:03.704274 139957609621056 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281030.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:16:04.021004 139957609621056 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281030.sst): second pass time = 1.46's, 180.207'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.32's, 262.245'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2565.150'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.279'MB/sec write SST data time = 0.08's, 978.959'MB/sec dict compress time = 0.00's, 2689298.000'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 78798.031'MB/sec zip my value time = 1.46's, unzip length = 0.263'GB zip my value throughput = 180.207'MB/sec zip pipeline throughput = 180.207'MB/sec entries = 258854 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.02 avg-zval = 308.99 usrkeys = 258854 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.02 avg-zval = 308.99 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1229 value = 3.2914 dict = 1.00 all = 3.2298 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 13.337061 GB avg = 0.154 KB (by entry num) total key len = 2.395977 GB avg = 0.028 KB total ukey len = 1.678606 GB avg = 0.017 KB total ukey num = 0.099853907 Billion total entry num = 0.086661636 Billion write speed all = 0.353934727 MB/sec (with seq num) write speed all = 0.338338216 MB/sec (without seq num) 2024/11/23-21:16:04.114435 139957609621056 [compaction_job.cc:1948] [default] [JOB 35959] Generated table #281030: 258854 keys, 83112325 bytes, temperature: kWarm 2024/11/23-21:16:04.114505 139957609621056 EVENT_LOG_v1 {"time_micros": 1732367764114470, "cf_name": "default", "job": 35959, "event": "table_file_creation", "file_number": 281030, "file_size": 83112325, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79984560, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177080, "raw_average_key_size": 20, "raw_value_size": 263258618, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 258854, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367761, "oldest_key_time": 0, "file_creation_time": 1732367761, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281030, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:16:04.171041 139957609621056 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281031.sst) /dev/shm/ToplingTemp/Topling-190888-ng9KKf 2024/11/23-21:16:05.355259 139957609621056 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281031.sst): first pass time = 1.18's, 226.685'MB/sec 2024/11/23-21:16:06.788778 139957609621056 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281031.sst): old prealloc_size = 295279001, real_size = 80475856 2024/11/23-21:16:06.788963 139957609621056 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281031.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258859 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.00 avg-zval = 308.95 2024/11/23-21:16:06.789026 139957609621056 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281031.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:16:07.103741 139957609621056 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281031.sst): second pass time = 1.43's, 183.810'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.31's, 263.858'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2441.351'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.279'MB/sec write SST data time = 0.08's, 1003.776'MB/sec dict compress time = 0.00's, 2688804.000'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 84075.045'MB/sec zip my value time = 1.43's, unzip length = 0.263'GB zip my value throughput = 183.810'MB/sec zip pipeline throughput = 183.810'MB/sec entries = 258859 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 308.95 usrkeys = 258859 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 308.95 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1230 value = 3.2918 dict = 1.00 all = 3.2302 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 13.600320 GB avg = 0.156 KB (by entry num) total key len = 2.401154 GB avg = 0.028 KB total ukey len = 1.681712 GB avg = 0.017 KB total ukey num = 0.100112766 Billion total entry num = 0.086920495 Billion write speed all = 0.359948569 MB/sec (with seq num) write speed all = 0.344306556 MB/sec (without seq num) 2024/11/23-21:16:07.198540 139957609621056 [compaction_job.cc:1948] [default] [JOB 35959] Generated table #281031: 258859 keys, 83102103 bytes, temperature: kWarm 2024/11/23-21:16:07.198610 139957609621056 EVENT_LOG_v1 {"time_micros": 1732367767198575, "cf_name": "default", "job": 35959, "event": "table_file_creation", "file_number": 281031, "file_size": 83102103, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79974848, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177180, "raw_average_key_size": 20, "raw_value_size": 263258593, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 258859, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367764, "oldest_key_time": 0, "file_creation_time": 1732367764, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281031, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:16:07.249425 139957609621056 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281032.sst) /dev/shm/ToplingTemp/Topling-190888-ZvY9Re 2024/11/23-21:16:08.951615 139957609621056 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281032.sst): first pass time = 1.70's, 157.705'MB/sec 2024/11/23-21:16:10.429565 139957609621056 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281032.sst): old prealloc_size = 295279001, real_size = 80483936 2024/11/23-21:16:10.429741 139957609621056 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281032.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258853 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.02 avg-zval = 308.99 2024/11/23-21:16:10.429780 139957609621056 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281032.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:16:10.747747 139957609621056 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281032.sst): second pass time = 1.48's, 178.275'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.32's, 261.222'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2866.921'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.277'MB/sec write SST data time = 0.08's, 985.348'MB/sec dict compress time = 0.00's, 2688278.000'MB/sec z-dict build time = 0.00's, sample length = 2.688'MB, throughput = 63784.891'MB/sec zip my value time = 1.48's, unzip length = 0.263'GB zip my value throughput = 178.275'MB/sec zip pipeline throughput = 178.275'MB/sec entries = 258853 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.02 avg-zval = 308.99 usrkeys = 258853 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.02 avg-zval = 308.99 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 8 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1228 value = 3.2914 dict = 1.00 all = 3.2299 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 13.863579 GB avg = 0.159 KB (by entry num) total key len = 2.406331 GB avg = 0.028 KB total ukey len = 1.684818 GB avg = 0.017 KB total ukey num = 0.100371619 Billion total entry num = 0.087179348 Billion write speed all = 0.365956970 MB/sec (with seq num) write speed all = 0.350269661 MB/sec (without seq num) 2024/11/23-21:16:10.842472 139957609621056 [compaction_job.cc:1948] [default] [JOB 35959] Generated table #281032: 258853 keys, 83109641 bytes, temperature: kWarm 2024/11/23-21:16:10.842542 139957609621056 EVENT_LOG_v1 {"time_micros": 1732367770842507, "cf_name": "default", "job": 35959, "event": "table_file_creation", "file_number": 281032, "file_size": 83109641, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79982928, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177060, "raw_average_key_size": 20, "raw_value_size": 263259298, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 258853, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367767, "oldest_key_time": 0, "file_creation_time": 1732367767, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281032, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:16:10.898877 139957609621056 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281033.sst) /dev/shm/ToplingTemp/Topling-190888-2Rqywh 2024/11/23-21:16:12.234446 139957609621056 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281033.sst): first pass time = 1.34's, 200.997'MB/sec 2024/11/23-21:16:13.697185 139957609621056 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281033.sst): old prealloc_size = 295279001, real_size = 80478624 2024/11/23-21:16:13.697357 139957609621056 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281033.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258858 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.00 avg-zval = 308.96 2024/11/23-21:16:13.697397 139957609621056 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281033.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:16:14.015374 139957609621056 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281033.sst): second pass time = 1.46's, 180.125'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.32's, 261.202'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2912.997'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.277'MB/sec write SST data time = 0.08's, 981.418'MB/sec dict compress time = 0.00's, 2689074.000'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 75353.752'MB/sec zip my value time = 1.46's, unzip length = 0.263'GB zip my value throughput = 180.125'MB/sec zip pipeline throughput = 180.125'MB/sec entries = 258858 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 308.96 usrkeys = 258858 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 308.96 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 8 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1230 value = 3.2917 dict = 1.00 all = 3.2301 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 14.126838 GB avg = 0.162 KB (by entry num) total key len = 2.411508 GB avg = 0.028 KB total ukey len = 1.687925 GB avg = 0.017 KB total ukey num = 0.100630477 Billion total entry num = 0.087438206 Billion write speed all = 0.371967522 MB/sec (with seq num) write speed all = 0.356234788 MB/sec (without seq num) 2024/11/23-21:16:14.108998 139957609621056 [compaction_job.cc:1948] [default] [JOB 35959] Generated table #281033: 258858 keys, 83105125 bytes, temperature: kWarm 2024/11/23-21:16:14.109065 139957609621056 EVENT_LOG_v1 {"time_micros": 1732367774109031, "cf_name": "default", "job": 35959, "event": "table_file_creation", "file_number": 281033, "file_size": 83105125, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79977616, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177160, "raw_average_key_size": 20, "raw_value_size": 263258581, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 258858, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367770, "oldest_key_time": 0, "file_creation_time": 1732367770, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281033, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:16:14.166106 139957609621056 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281034.sst) /dev/shm/ToplingTemp/Topling-190888-vdO6Kg 2024/11/23-21:16:15.675134 139957609621056 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281034.sst): first pass time = 1.51's, 177.892'MB/sec 2024/11/23-21:16:17.185274 139957609621056 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281034.sst): old prealloc_size = 295279001, real_size = 80485088 2024/11/23-21:16:17.185446 139957609621056 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281034.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258852 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.03 avg-zval = 309.00 2024/11/23-21:16:17.185482 139957609621056 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281034.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:16:17.504336 139957609621056 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281034.sst): second pass time = 1.51's, 174.470'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.32's, 260.504'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2941.427'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.277'MB/sec write SST data time = 0.09's, 972.513'MB/sec dict compress time = 0.00's, 2688618.000'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 80919.100'MB/sec zip my value time = 1.51's, unzip length = 0.263'GB zip my value throughput = 174.470'MB/sec zip pipeline throughput = 174.470'MB/sec entries = 258852 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.03 avg-zval = 309.00 usrkeys = 258852 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.03 avg-zval = 309.00 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 8 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1228 value = 3.2914 dict = 1.00 all = 3.2298 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 14.390097 GB avg = 0.164 KB (by entry num) total key len = 2.416685 GB avg = 0.028 KB total ukey len = 1.691031 GB avg = 0.017 KB total ukey num = 0.100889329 Billion total entry num = 0.087697058 Billion write speed all = 0.377975323 MB/sec (with seq num) write speed all = 0.362197253 MB/sec (without seq num) 2024/11/23-21:16:17.600423 139957609621056 [compaction_job.cc:1948] [default] [JOB 35959] Generated table #281034: 258852 keys, 83111133 bytes, temperature: kWarm 2024/11/23-21:16:17.600491 139957609621056 EVENT_LOG_v1 {"time_micros": 1732367777600457, "cf_name": "default", "job": 35959, "event": "table_file_creation", "file_number": 281034, "file_size": 83111133, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79984080, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177040, "raw_average_key_size": 20, "raw_value_size": 263259390, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 258852, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367774, "oldest_key_time": 0, "file_creation_time": 1732367774, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281034, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:16:17.659150 139957609621056 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281035.sst) /dev/shm/ToplingTemp/Topling-190888-7yEJhg 2024/11/23-21:16:18.788908 139957609621056 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281035.sst): first pass time = 1.13's, 237.612'MB/sec 2024/11/23-21:16:20.447510 139957609621056 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281035.sst): old prealloc_size = 295279001, real_size = 80476720 2024/11/23-21:16:20.447697 139957609621056 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281035.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258859 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.00 avg-zval = 308.95 2024/11/23-21:16:20.447739 139957609621056 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281035.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:16:20.793259 139957609621056 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281035.sst): second pass time = 1.66's, 158.861'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.35's, 240.370'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2595.315'MB/sec (index lex order gen) rebuild zvType time = 0.25's, 0.259'MB/sec write SST data time = 0.10's, 864.854'MB/sec dict compress time = 0.00's, 2689052.000'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 92837.977'MB/sec zip my value time = 1.66's, unzip length = 0.263'GB zip my value throughput = 158.861'MB/sec zip pipeline throughput = 158.861'MB/sec entries = 258859 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 308.95 usrkeys = 258859 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 308.95 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1230 value = 3.2917 dict = 1.00 all = 3.2302 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 14.653356 GB avg = 0.167 KB (by entry num) total key len = 2.421862 GB avg = 0.028 KB total ukey len = 1.694137 GB avg = 0.017 KB total ukey num = 0.101148188 Billion total entry num = 0.087955917 Billion write speed all = 0.383983908 MB/sec (with seq num) write speed all = 0.368160435 MB/sec (without seq num) 2024/11/23-21:16:20.890840 139957609621056 [compaction_job.cc:1948] [default] [JOB 35959] Generated table #281035: 258859 keys, 83103247 bytes, temperature: kWarm 2024/11/23-21:16:20.890900 139957609621056 EVENT_LOG_v1 {"time_micros": 1732367780890867, "cf_name": "default", "job": 35959, "event": "table_file_creation", "file_number": 281035, "file_size": 83103247, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79975712, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177180, "raw_average_key_size": 20, "raw_value_size": 263259161, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 258859, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367777, "oldest_key_time": 0, "file_creation_time": 1732367777, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281035, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:16:20.950610 139957609621056 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281036.sst) /dev/shm/ToplingTemp/Topling-190888-JHFfWg 2024/11/23-21:16:22.410038 139957609621056 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281036.sst): first pass time = 1.46's, 183.937'MB/sec 2024/11/23-21:16:24.699115 139957609621056 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281036.sst): old prealloc_size = 295279001, real_size = 80475760 2024/11/23-21:16:24.699306 139957609621056 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281036.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258861 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1016.99 avg-zval = 308.95 2024/11/23-21:16:24.699344 139957609621056 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281036.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:16:25.114499 139957609621056 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281036.sst): second pass time = 2.29's, 115.093'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.42's, 200.076'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2562.060'MB/sec (index lex order gen) rebuild zvType time = 0.29's, 0.226'MB/sec write SST data time = 0.13's, 645.943'MB/sec dict compress time = 0.00's, 2689008.000'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 66259.468'MB/sec zip my value time = 2.29's, unzip length = 0.263'GB zip my value throughput = 115.093'MB/sec zip pipeline throughput = 115.093'MB/sec entries = 258861 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1016.99 avg-zval = 308.95 usrkeys = 258861 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1016.99 avg-zval = 308.95 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1230 value = 3.2918 dict = 1.00 all = 3.2302 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 14.916615 GB avg = 0.169 KB (by entry num) total key len = 2.427039 GB avg = 0.028 KB total ukey len = 1.697243 GB avg = 0.017 KB total ukey num = 0.101407049 Billion total entry num = 0.088214778 Billion write speed all = 0.389982544 MB/sec (with seq num) write speed all = 0.374114044 MB/sec (without seq num) 2024/11/23-21:16:25.222806 139957609621056 [compaction_job.cc:1948] [default] [JOB 35959] Generated table #281036: 258861 keys, 83102243 bytes, temperature: kWarm 2024/11/23-21:16:25.222885 139957609621056 EVENT_LOG_v1 {"time_micros": 1732367785222838, "cf_name": "default", "job": 35959, "event": "table_file_creation", "file_number": 281036, "file_size": 83102243, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79974752, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177220, "raw_average_key_size": 20, "raw_value_size": 263258818, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 258861, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367780, "oldest_key_time": 0, "file_creation_time": 1732367780, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281036, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:16:25.336956 139957609621056 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281037.sst) /dev/shm/ToplingTemp/Topling-190888-tRAV9d 2024/11/23-21:16:26.622556 139957609621056 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281037.sst): first pass time = 1.29's, 208.827'MB/sec 2024/11/23-21:16:28.157710 139957609621056 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281037.sst): old prealloc_size = 295279001, real_size = 80480208 2024/11/23-21:16:28.157904 139957609621056 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281037.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258858 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.00 avg-zval = 308.97 2024/11/23-21:16:28.157945 139957609621056 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281037.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:16:28.484134 139957609621056 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281037.sst): second pass time = 1.53's, 171.660'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.33's, 254.616'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2564.878'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.278'MB/sec write SST data time = 0.09's, 889.719'MB/sec dict compress time = 0.00's, 2688178.000'MB/sec z-dict build time = 0.00's, sample length = 2.688'MB, throughput = 80036.264'MB/sec zip my value time = 1.53's, unzip length = 0.263'GB zip my value throughput = 171.660'MB/sec zip pipeline throughput = 171.660'MB/sec entries = 258858 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 308.97 usrkeys = 258858 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 308.97 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1230 value = 3.2916 dict = 1.00 all = 3.2301 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 15.179874 GB avg = 0.172 KB (by entry num) total key len = 2.432217 GB avg = 0.027 KB total ukey len = 1.700350 GB avg = 0.017 KB total ukey num = 0.101665907 Billion total entry num = 0.088473636 Billion write speed all = 0.395988489 MB/sec (with seq num) write speed all = 0.380074630 MB/sec (without seq num) 2024/11/23-21:16:28.578651 139957609621056 [compaction_job.cc:1948] [default] [JOB 35959] Generated table #281037: 258858 keys, 83105829 bytes, temperature: kWarm 2024/11/23-21:16:28.578716 139957609621056 EVENT_LOG_v1 {"time_micros": 1732367788578684, "cf_name": "default", "job": 35959, "event": "table_file_creation", "file_number": 281037, "file_size": 83105829, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79979200, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177160, "raw_average_key_size": 20, "raw_value_size": 263258967, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 258858, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367785, "oldest_key_time": 0, "file_creation_time": 1732367785, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281037, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:16:28.642390 139957609621056 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281038.sst) /dev/shm/ToplingTemp/Topling-190888-VvdYZe 2024/11/23-21:16:30.109567 139957609621056 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281038.sst): first pass time = 1.47's, 182.967'MB/sec 2024/11/23-21:16:31.720947 139957609621056 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281038.sst): old prealloc_size = 295279001, real_size = 80882816 2024/11/23-21:16:31.721165 139957609621056 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281038.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258858 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0804 GB avg-val =1017.00 avg-zval = 310.52 2024/11/23-21:16:31.721206 139957609621056 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281038.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:16:32.049973 139957609621056 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281038.sst): second pass time = 1.61's, 163.511'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.33's, 253.815'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2471.569'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.276'MB/sec write SST data time = 0.09's, 888.525'MB/sec dict compress time = 0.00's, 2689440.000'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 82551.337'MB/sec zip my value time = 1.61's, unzip length = 0.263'GB zip my value throughput = 163.511'MB/sec zip pipeline throughput = 169.248'MB/sec entries = 258858 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 310.52 usrkeys = 258858 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 310.52 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0804 GB dict = 2.69 MB all = 0.0835 GB } UnZip/Zip{ index = 7.1230 value = 3.2751 dict = 1.00 all = 3.2144 } Zip/UnZip{ index = 0.1404 value = 0.3053 dict = 1.00 all = 0.3111 } ---------------------------- total value len = 15.443133 GB avg = 0.174 KB (by entry num) total key len = 2.437394 GB avg = 0.027 KB total ukey len = 1.703456 GB avg = 0.017 KB total ukey num = 0.101924765 Billion total entry num = 0.088732494 Billion write speed all = 0.401991753 MB/sec (with seq num) write speed all = 0.386032612 MB/sec (without seq num) 2024/11/23-21:16:32.144693 139957609621056 [compaction_job.cc:1948] [default] [JOB 35959] Generated table #281038: 258858 keys, 83509715 bytes, temperature: kWarm 2024/11/23-21:16:32.144763 139957609621056 EVENT_LOG_v1 {"time_micros": 1732367792144727, "cf_name": "default", "job": 35959, "event": "table_file_creation", "file_number": 281038, "file_size": 83509715, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 80381808, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177160, "raw_average_key_size": 20, "raw_value_size": 263259050, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 258858, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367788, "oldest_key_time": 0, "file_creation_time": 1732367788, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281038, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:16:32.201567 139957609621056 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281039.sst) /dev/shm/ToplingTemp/Topling-190888-Uu66Oh 2024/11/23-21:16:33.502303 139957609621056 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281039.sst): first pass time = 1.30's, 206.378'MB/sec 2024/11/23-21:16:35.011687 139957609621056 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281039.sst): old prealloc_size = 295279001, real_size = 80479088 2024/11/23-21:16:35.011868 139957609621056 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281039.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258858 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.00 avg-zval = 308.97 2024/11/23-21:16:35.011906 139957609621056 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281039.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:16:35.332283 139957609621056 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281039.sst): second pass time = 1.51's, 174.561'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.32's, 259.239'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2782.573'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.281'MB/sec write SST data time = 0.09's, 925.199'MB/sec dict compress time = 0.00's, 2688000.000'MB/sec z-dict build time = 0.00's, sample length = 2.688'MB, throughput = 93479.395'MB/sec zip my value time = 1.51's, unzip length = 0.263'GB zip my value throughput = 174.561'MB/sec zip pipeline throughput = 174.561'MB/sec entries = 258858 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 308.97 usrkeys = 258858 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 308.97 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 8 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1230 value = 3.2916 dict = 1.00 all = 3.2301 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 15.706392 GB avg = 0.176 KB (by entry num) total key len = 2.442571 GB avg = 0.027 KB total ukey len = 1.706562 GB avg = 0.017 KB total ukey num = 0.102183623 Billion total entry num = 0.088991352 Billion write speed all = 0.407996645 MB/sec (with seq num) write speed all = 0.391992128 MB/sec (without seq num) 2024/11/23-21:16:35.425639 139957609621056 [compaction_job.cc:1948] [default] [JOB 35959] Generated table #281039: 258858 keys, 83104563 bytes, temperature: kWarm 2024/11/23-21:16:35.425705 139957609621056 EVENT_LOG_v1 {"time_micros": 1732367795425673, "cf_name": "default", "job": 35959, "event": "table_file_creation", "file_number": 281039, "file_size": 83104563, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79978080, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177160, "raw_average_key_size": 20, "raw_value_size": 263258616, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 258858, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367792, "oldest_key_time": 0, "file_creation_time": 1732367792, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281039, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:16:35.483151 139957609621056 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281040.sst) /dev/shm/ToplingTemp/Topling-190888-XrRDXg 2024/11/23-21:16:37.888911 139957609621056 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281040.sst): first pass time = 2.41's, 111.582'MB/sec 2024/11/23-21:16:39.338766 139957609621056 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281040.sst): old prealloc_size = 295279001, real_size = 80485040 2024/11/23-21:16:39.338955 139957609621056 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281040.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258853 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.02 avg-zval = 308.99 2024/11/23-21:16:39.339035 139957609621056 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281040.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:16:39.659000 139957609621056 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281040.sst): second pass time = 1.45's, 181.762'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.32's, 259.559'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2636.487'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.280'MB/sec write SST data time = 0.09's, 936.189'MB/sec dict compress time = 0.00's, 2688917.000'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 81258.258'MB/sec zip my value time = 1.45's, unzip length = 0.263'GB zip my value throughput = 181.762'MB/sec zip pipeline throughput = 181.762'MB/sec entries = 258853 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.02 avg-zval = 308.99 usrkeys = 258853 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.02 avg-zval = 308.99 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1228 value = 3.2914 dict = 1.00 all = 3.2298 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 15.969651 GB avg = 0.179 KB (by entry num) total key len = 2.447748 GB avg = 0.027 KB total ukey len = 1.709669 GB avg = 0.017 KB total ukey num = 0.102442476 Billion total entry num = 0.089250205 Billion write speed all = 0.413990935 MB/sec (with seq num) write speed all = 0.397941426 MB/sec (without seq num) 2024/11/23-21:16:39.753405 139957609621056 [compaction_job.cc:1948] [default] [JOB 35959] Generated table #281040: 258853 keys, 83111432 bytes, temperature: kWarm 2024/11/23-21:16:39.753474 139957609621056 EVENT_LOG_v1 {"time_micros": 1732367799753440, "cf_name": "default", "job": 35959, "event": "table_file_creation", "file_number": 281040, "file_size": 83111432, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79984032, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177060, "raw_average_key_size": 20, "raw_value_size": 263258888, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 258853, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367795, "oldest_key_time": 0, "file_creation_time": 1732367795, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281040, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:16:39.809813 139957609621056 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281041.sst) /dev/shm/ToplingTemp/Topling-190888-81nqae 2024/11/23-21:16:41.173469 139957609621056 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281041.sst): first pass time = 1.36's, 196.855'MB/sec 2024/11/23-21:16:42.615024 139957609621056 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281041.sst): old prealloc_size = 295279001, real_size = 80473648 2024/11/23-21:16:42.615225 139957609621056 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281041.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258863 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1016.98 avg-zval = 308.94 2024/11/23-21:16:42.615264 139957609621056 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281041.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:16:42.938601 139957609621056 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281041.sst): second pass time = 1.44's, 182.783'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.32's, 256.814'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2498.201'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.277'MB/sec write SST data time = 0.09's, 924.575'MB/sec dict compress time = 0.00's, 2689679.000'MB/sec z-dict build time = 0.00's, sample length = 2.690'MB, throughput = 78395.727'MB/sec zip my value time = 1.44's, unzip length = 0.263'GB zip my value throughput = 182.783'MB/sec zip pipeline throughput = 182.783'MB/sec entries = 258863 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1016.98 avg-zval = 308.94 usrkeys = 258863 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1016.98 avg-zval = 308.94 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1231 value = 3.2919 dict = 1.00 all = 3.2302 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 16.232909 GB avg = 0.181 KB (by entry num) total key len = 2.452925 GB avg = 0.027 KB total ukey len = 1.712775 GB avg = 0.017 KB total ukey num = 0.102701339 Billion total entry num = 0.089509068 Billion write speed all = 0.419993943 MB/sec (with seq num) write speed all = 0.403899070 MB/sec (without seq num) 2024/11/23-21:16:43.033824 139957609621056 [compaction_job.cc:1948] [default] [JOB 35959] Generated table #281041: 258863 keys, 83100802 bytes, temperature: kWarm 2024/11/23-21:16:43.033893 139957609621056 EVENT_LOG_v1 {"time_micros": 1732367803033858, "cf_name": "default", "job": 35959, "event": "table_file_creation", "file_number": 281041, "file_size": 83100802, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79972640, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177260, "raw_average_key_size": 20, "raw_value_size": 263258627, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 258863, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367799, "oldest_key_time": 0, "file_creation_time": 1732367799, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281041, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:16:43.088814 139957609621056 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281042.sst) /dev/shm/ToplingTemp/Topling-190888-TaNwIh 2024/11/23-21:16:44.464162 139957609621056 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281042.sst): first pass time = 1.38's, 195.182'MB/sec 2024/11/23-21:16:45.935812 139957609621056 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281042.sst): old prealloc_size = 295279001, real_size = 80485568 2024/11/23-21:16:45.936022 139957609621056 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281042.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258853 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.02 avg-zval = 309.00 2024/11/23-21:16:45.936076 139957609621056 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281042.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:16:46.261076 139957609621056 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281042.sst): second pass time = 1.47's, 179.044'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.33's, 255.541'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2250.272'MB/sec (index lex order gen) rebuild zvType time = 0.24's, 0.275'MB/sec write SST data time = 0.09's, 926.795'MB/sec dict compress time = 0.00's, 2688797.000'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 66699.668'MB/sec zip my value time = 1.47's, unzip length = 0.263'GB zip my value throughput = 179.044'MB/sec zip pipeline throughput = 179.044'MB/sec entries = 258853 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.02 avg-zval = 309.00 usrkeys = 258853 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.02 avg-zval = 309.00 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1228 value = 3.2914 dict = 1.00 all = 3.2298 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 16.496168 GB avg = 0.184 KB (by entry num) total key len = 2.458102 GB avg = 0.027 KB total ukey len = 1.715881 GB avg = 0.017 KB total ukey num = 0.102960192 Billion total entry num = 0.089767921 Billion write speed all = 0.425995648 MB/sec (with seq num) write speed all = 0.409855435 MB/sec (without seq num) 2024/11/23-21:16:46.356340 139957609621056 [compaction_job.cc:1948] [default] [JOB 35959] Generated table #281042: 258853 keys, 83111824 bytes, temperature: kWarm 2024/11/23-21:16:46.356409 139957609621056 EVENT_LOG_v1 {"time_micros": 1732367806356373, "cf_name": "default", "job": 35959, "event": "table_file_creation", "file_number": 281042, "file_size": 83111824, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79984560, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177060, "raw_average_key_size": 20, "raw_value_size": 263258489, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 258853, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367803, "oldest_key_time": 0, "file_creation_time": 1732367803, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281042, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:16:46.416424 139957609621056 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281043.sst) /dev/shm/ToplingTemp/Topling-190888-cbqBSd 2024/11/23-21:16:47.714354 139957609621056 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281043.sst): first pass time = 1.30's, 206.824'MB/sec 2024/11/23-21:16:49.224480 139957609621056 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281043.sst): old prealloc_size = 295279001, real_size = 80478432 2024/11/23-21:16:49.224671 139957609621056 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281043.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258860 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1016.99 avg-zval = 308.96 2024/11/23-21:16:49.224713 139957609621056 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281043.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:16:49.548444 139957609621056 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281043.sst): second pass time = 1.51's, 174.478'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.32's, 256.544'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2633.669'MB/sec (index lex order gen) rebuild zvType time = 0.24's, 0.275'MB/sec write SST data time = 0.09's, 936.963'MB/sec dict compress time = 0.00's, 2689003.000'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 79624.619'MB/sec zip my value time = 1.51's, unzip length = 0.263'GB zip my value throughput = 174.478'MB/sec zip pipeline throughput = 174.478'MB/sec entries = 258860 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1016.99 avg-zval = 308.96 usrkeys = 258860 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1016.99 avg-zval = 308.96 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 8 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1230 value = 3.2917 dict = 1.00 all = 3.2301 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 16.759426 GB avg = 0.186 KB (by entry num) total key len = 2.463280 GB avg = 0.027 KB total ukey len = 1.718988 GB avg = 0.017 KB total ukey num = 0.103219052 Billion total entry num = 0.090026781 Billion write speed all = 0.431996796 MB/sec (with seq num) write speed all = 0.415811236 MB/sec (without seq num) 2024/11/23-21:16:49.642626 139957609621056 [compaction_job.cc:1948] [default] [JOB 35959] Generated table #281043: 258860 keys, 83104862 bytes, temperature: kWarm 2024/11/23-21:16:49.642696 139957609621056 EVENT_LOG_v1 {"time_micros": 1732367809642661, "cf_name": "default", "job": 35959, "event": "table_file_creation", "file_number": 281043, "file_size": 83104862, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79977424, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177200, "raw_average_key_size": 20, "raw_value_size": 263258298, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 258860, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367806, "oldest_key_time": 0, "file_creation_time": 1732367806, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281043, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:16:49.699161 139957609621056 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281044.sst) /dev/shm/ToplingTemp/Topling-190888-eQd49g 2024/11/23-21:16:51.003293 139957609621056 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281044.sst): first pass time = 1.30's, 205.842'MB/sec 2024/11/23-21:16:52.489576 139957609621056 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281044.sst): old prealloc_size = 295279001, real_size = 80475504 2024/11/23-21:16:52.489772 139957609621056 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281044.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258860 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1016.99 avg-zval = 308.95 2024/11/23-21:16:52.489811 139957609621056 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281044.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:16:52.815876 139957609621056 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281044.sst): second pass time = 1.48's, 177.304'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.33's, 254.700'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2606.421'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.275'MB/sec write SST data time = 0.09's, 911.436'MB/sec dict compress time = 0.00's, 2689208.000'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 79701.491'MB/sec zip my value time = 1.48's, unzip length = 0.263'GB zip my value throughput = 177.304'MB/sec zip pipeline throughput = 177.304'MB/sec entries = 258860 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1016.99 avg-zval = 308.95 usrkeys = 258860 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1016.99 avg-zval = 308.95 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1230 value = 3.2918 dict = 1.00 all = 3.2302 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 17.022685 GB avg = 0.189 KB (by entry num) total key len = 2.468457 GB avg = 0.027 KB total ukey len = 1.722094 GB avg = 0.017 KB total ukey num = 0.103477912 Billion total entry num = 0.090285641 Billion write speed all = 0.437997265 MB/sec (with seq num) write speed all = 0.421766358 MB/sec (without seq num) 2024/11/23-21:16:52.911892 139957609621056 [compaction_job.cc:1948] [default] [JOB 35959] Generated table #281044: 258860 keys, 83102187 bytes, temperature: kWarm 2024/11/23-21:16:52.911963 139957609621056 EVENT_LOG_v1 {"time_micros": 1732367812911927, "cf_name": "default", "job": 35959, "event": "table_file_creation", "file_number": 281044, "file_size": 83102187, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79974496, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177200, "raw_average_key_size": 20, "raw_value_size": 263258804, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 258860, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367809, "oldest_key_time": 0, "file_creation_time": 1732367809, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281044, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:16:52.971477 139957609621056 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281045.sst) /dev/shm/ToplingTemp/Topling-190888-pX53Of 2024/11/23-21:16:54.358990 139957609621056 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281045.sst): first pass time = 1.39's, 193.472'MB/sec 2024/11/23-21:16:55.835087 139957609621056 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281045.sst): old prealloc_size = 295279001, real_size = 80481712 2024/11/23-21:16:55.835273 139957609621056 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281045.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258857 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.01 avg-zval = 308.98 2024/11/23-21:16:55.835312 139957609621056 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281045.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:16:56.159013 139957609621056 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281045.sst): second pass time = 1.47's, 178.495'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.32's, 256.593'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2868.581'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.276'MB/sec write SST data time = 0.09's, 930.514'MB/sec dict compress time = 0.00's, 2688364.000'MB/sec z-dict build time = 0.00's, sample length = 2.688'MB, throughput = 51703.285'MB/sec zip my value time = 1.47's, unzip length = 0.263'GB zip my value throughput = 178.495'MB/sec zip pipeline throughput = 178.495'MB/sec entries = 258857 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.01 avg-zval = 308.98 usrkeys = 258857 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.01 avg-zval = 308.98 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1229 value = 3.2915 dict = 1.00 all = 3.2300 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 17.285944 GB avg = 0.191 KB (by entry num) total key len = 2.473634 GB avg = 0.027 KB total ukey len = 1.725200 GB avg = 0.017 KB total ukey num = 0.103736769 Billion total entry num = 0.090544498 Billion write speed all = 0.443996106 MB/sec (with seq num) write speed all = 0.427719886 MB/sec (without seq num) 2024/11/23-21:16:56.256715 139957609621056 [compaction_job.cc:1948] [default] [JOB 35959] Generated table #281045: 258857 keys, 83107551 bytes, temperature: kWarm 2024/11/23-21:16:56.256787 139957609621056 EVENT_LOG_v1 {"time_micros": 1732367816256751, "cf_name": "default", "job": 35959, "event": "table_file_creation", "file_number": 281045, "file_size": 83107551, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79980704, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177140, "raw_average_key_size": 20, "raw_value_size": 263259211, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 258857, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367812, "oldest_key_time": 0, "file_creation_time": 1732367812, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281045, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:16:56.317654 139957609621056 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281046.sst) /dev/shm/ToplingTemp/Topling-190888-GiNAne 2024/11/23-21:16:57.694559 139957609621056 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281046.sst): first pass time = 1.38's, 194.962'MB/sec 2024/11/23-21:16:59.172649 139957609621056 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281046.sst): old prealloc_size = 295279001, real_size = 80473520 2024/11/23-21:16:59.172836 139957609621056 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281046.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258866 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1016.97 avg-zval = 308.93 2024/11/23-21:16:59.172875 139957609621056 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281046.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:16:59.501546 139957609621056 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281046.sst): second pass time = 1.48's, 178.280'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.33's, 252.684'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2694.179'MB/sec (index lex order gen) rebuild zvType time = 0.24's, 0.274'MB/sec write SST data time = 0.09's, 894.268'MB/sec dict compress time = 0.00's, 2689492.000'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 88229.243'MB/sec zip my value time = 1.48's, unzip length = 0.263'GB zip my value throughput = 178.280'MB/sec zip pipeline throughput = 178.280'MB/sec entries = 258866 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1016.97 avg-zval = 308.93 usrkeys = 258866 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1016.97 avg-zval = 308.93 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1232 value = 3.2919 dict = 1.00 all = 3.2303 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 17.549203 GB avg = 0.193 KB (by entry num) total key len = 2.478811 GB avg = 0.027 KB total ukey len = 1.728307 GB avg = 0.017 KB total ukey num = 0.103995635 Billion total entry num = 0.090803364 Billion write speed all = 0.449994039 MB/sec (with seq num) write speed all = 0.433672511 MB/sec (without seq num) 2024/11/23-21:16:59.597844 139957609621056 [compaction_job.cc:1948] [default] [JOB 35959] Generated table #281046: 258866 keys, 83100487 bytes, temperature: kWarm 2024/11/23-21:16:59.597913 139957609621056 EVENT_LOG_v1 {"time_micros": 1732367819597877, "cf_name": "default", "job": 35959, "event": "table_file_creation", "file_number": 281046, "file_size": 83100487, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79972512, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177320, "raw_average_key_size": 20, "raw_value_size": 263258476, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 258866, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367816, "oldest_key_time": 0, "file_creation_time": 1732367816, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281046, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:16:59.658702 139957609621056 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281047.sst) /dev/shm/ToplingTemp/Topling-190888-wKOong 2024/11/23-21:17:00.952519 139957609621056 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281047.sst): first pass time = 1.29's, 207.482'MB/sec 2024/11/23-21:17:02.479541 139957609621056 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281047.sst): old prealloc_size = 295279001, real_size = 80473888 2024/11/23-21:17:02.479736 139957609621056 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281047.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258865 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1016.97 avg-zval = 308.94 2024/11/23-21:17:02.479779 139957609621056 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281047.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:17:02.821341 139957609621056 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281047.sst): second pass time = 1.53's, 172.558'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.34's, 243.142'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2599.554'MB/sec (index lex order gen) rebuild zvType time = 0.25's, 0.262'MB/sec write SST data time = 0.09's, 875.335'MB/sec dict compress time = 0.00's, 2688760.000'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 85607.489'MB/sec zip my value time = 1.53's, unzip length = 0.263'GB zip my value throughput = 172.558'MB/sec zip pipeline throughput = 172.558'MB/sec entries = 258865 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1016.97 avg-zval = 308.94 usrkeys = 258865 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1016.97 avg-zval = 308.94 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 8 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1232 value = 3.2919 dict = 1.00 all = 3.2303 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 17.812461 GB avg = 0.196 KB (by entry num) total key len = 2.483988 GB avg = 0.027 KB total ukey len = 1.731413 GB avg = 0.017 KB total ukey num = 0.104254500 Billion total entry num = 0.091062229 Billion write speed all = 0.455991309 MB/sec (with seq num) write speed all = 0.439624472 MB/sec (without seq num) 2024/11/23-21:17:02.923073 139957609621056 [compaction_job.cc:1948] [default] [JOB 35959] Generated table #281047: 258865 keys, 83100075 bytes, temperature: kWarm 2024/11/23-21:17:02.923145 139957609621056 EVENT_LOG_v1 {"time_micros": 1732367822923111, "cf_name": "default", "job": 35959, "event": "table_file_creation", "file_number": 281047, "file_size": 83100075, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79972880, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177300, "raw_average_key_size": 20, "raw_value_size": 263258733, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 258865, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367819, "oldest_key_time": 0, "file_creation_time": 1732367819, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281047, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:17:02.980876 139957609621056 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281048.sst) /dev/shm/ToplingTemp/Topling-190888-6yWhJg 2024/11/23-21:17:04.245919 139957609621056 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281048.sst): first pass time = 1.27's, 212.202'MB/sec 2024/11/23-21:17:05.735516 139957609621056 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281048.sst): old prealloc_size = 295279001, real_size = 80480400 2024/11/23-21:17:05.735698 139957609621056 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281048.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258857 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.01 avg-zval = 308.97 2024/11/23-21:17:05.735736 139957609621056 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281048.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:17:06.059469 139957609621056 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281048.sst): second pass time = 1.49's, 176.901'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.32's, 256.558'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2732.893'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.278'MB/sec write SST data time = 0.09's, 915.193'MB/sec dict compress time = 0.00's, 2688758.000'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 69055.835'MB/sec zip my value time = 1.49's, unzip length = 0.263'GB zip my value throughput = 176.901'MB/sec zip pipeline throughput = 176.901'MB/sec entries = 258857 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.01 avg-zval = 308.97 usrkeys = 258857 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.01 avg-zval = 308.97 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1229 value = 3.2916 dict = 1.00 all = 3.2300 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 18.075720 GB avg = 0.198 KB (by entry num) total key len = 2.489166 GB avg = 0.027 KB total ukey len = 1.734519 GB avg = 0.017 KB total ukey num = 0.104513357 Billion total entry num = 0.091321086 Billion write speed all = 0.461988532 MB/sec (with seq num) write speed all = 0.445576364 MB/sec (without seq num) 2024/11/23-21:17:06.156996 139957609621056 [compaction_job.cc:1948] [default] [JOB 35959] Generated table #281048: 258857 keys, 83106601 bytes, temperature: kWarm 2024/11/23-21:17:06.157065 139957609621056 EVENT_LOG_v1 {"time_micros": 1732367826157030, "cf_name": "default", "job": 35959, "event": "table_file_creation", "file_number": 281048, "file_size": 83106601, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79979392, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177140, "raw_average_key_size": 20, "raw_value_size": 263258879, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 258857, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367822, "oldest_key_time": 0, "file_creation_time": 1732367822, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281048, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:17:06.219145 139957609621056 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281049.sst) /dev/shm/ToplingTemp/Topling-190888-tUDTTd 2024/11/23-21:17:08.572194 139957609621056 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281049.sst): first pass time = 2.35's, 114.082'MB/sec 2024/11/23-21:17:10.058770 139957609621056 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281049.sst): old prealloc_size = 295279001, real_size = 80479776 2024/11/23-21:17:10.058966 139957609621056 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281049.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258856 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.01 avg-zval = 308.97 2024/11/23-21:17:10.059086 139957609621056 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281049.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:17:10.389663 139957609621056 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281049.sst): second pass time = 1.49's, 177.269'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.33's, 251.177'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1854.583'MB/sec (index lex order gen) rebuild zvType time = 0.24's, 0.274'MB/sec write SST data time = 0.09's, 879.709'MB/sec dict compress time = 0.00's, 2688968.000'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 77478.476'MB/sec zip my value time = 1.49's, unzip length = 0.263'GB zip my value throughput = 177.269'MB/sec zip pipeline throughput = 177.269'MB/sec entries = 258856 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.01 avg-zval = 308.97 usrkeys = 258856 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.01 avg-zval = 308.97 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 8 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1229 value = 3.2916 dict = 1.00 all = 3.2300 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 18.338979 GB avg = 0.200 KB (by entry num) total key len = 2.494343 GB avg = 0.027 KB total ukey len = 1.737625 GB avg = 0.017 KB total ukey num = 0.104772213 Billion total entry num = 0.091579942 Billion write speed all = 0.467973401 MB/sec (with seq num) write speed all = 0.451516313 MB/sec (without seq num) 2024/11/23-21:17:10.487912 139957609621056 [compaction_job.cc:1948] [default] [JOB 35959] Generated table #281049: 258856 keys, 83106171 bytes, temperature: kWarm 2024/11/23-21:17:10.488003 139957609621056 EVENT_LOG_v1 {"time_micros": 1732367830487946, "cf_name": "default", "job": 35959, "event": "table_file_creation", "file_number": 281049, "file_size": 83106171, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79978768, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177120, "raw_average_key_size": 20, "raw_value_size": 263258827, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 258856, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367826, "oldest_key_time": 0, "file_creation_time": 1732367826, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281049, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:17:10.546280 139957609621056 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281050.sst) /dev/shm/ToplingTemp/Topling-190888-kxrJof 2024/11/23-21:17:11.796330 139957609621056 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281050.sst): first pass time = 1.25's, 214.747'MB/sec 2024/11/23-21:17:13.298125 139957609621056 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281050.sst): old prealloc_size = 295279001, real_size = 80481376 2024/11/23-21:17:13.298307 139957609621056 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281050.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258857 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.00 avg-zval = 308.98 2024/11/23-21:17:13.298348 139957609621056 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281050.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:17:13.623852 139957609621056 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281050.sst): second pass time = 1.50's, 175.442'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.33's, 255.149'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2725.753'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.277'MB/sec write SST data time = 0.09's, 901.449'MB/sec dict compress time = 0.00's, 2688921.000'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 66332.511'MB/sec zip my value time = 1.50's, unzip length = 0.263'GB zip my value throughput = 175.442'MB/sec zip pipeline throughput = 175.442'MB/sec entries = 258857 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 308.98 usrkeys = 258857 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 308.98 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 8 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1229 value = 3.2915 dict = 1.00 all = 3.2300 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 18.602238 GB avg = 0.203 KB (by entry num) total key len = 2.499520 GB avg = 0.027 KB total ukey len = 1.740732 GB avg = 0.017 KB total ukey num = 0.105031070 Billion total entry num = 0.091838799 Billion write speed all = 0.473968774 MB/sec (with seq num) write speed all = 0.457466367 MB/sec (without seq num) 2024/11/23-21:17:13.720550 139957609621056 [compaction_job.cc:1948] [default] [JOB 35959] Generated table #281050: 258857 keys, 83107724 bytes, temperature: kWarm 2024/11/23-21:17:13.720619 139957609621056 EVENT_LOG_v1 {"time_micros": 1732367833720582, "cf_name": "default", "job": 35959, "event": "table_file_creation", "file_number": 281050, "file_size": 83107724, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79980368, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177140, "raw_average_key_size": 20, "raw_value_size": 263258817, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 258857, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367830, "oldest_key_time": 0, "file_creation_time": 1732367830, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281050, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:17:13.775109 139957609621056 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281051.sst) /dev/shm/ToplingTemp/Topling-190888-5GQEbe 2024/11/23-21:17:15.166130 139957609621056 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281051.sst): first pass time = 1.39's, 192.983'MB/sec 2024/11/23-21:17:16.647672 139957609621056 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281051.sst): old prealloc_size = 295279001, real_size = 80477392 2024/11/23-21:17:16.647865 139957609621056 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281051.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258857 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.01 avg-zval = 308.96 2024/11/23-21:17:16.647905 139957609621056 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281051.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:17:16.972748 139957609621056 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281051.sst): second pass time = 1.48's, 177.858'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.33's, 255.662'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2626.641'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.277'MB/sec write SST data time = 0.09's, 906.824'MB/sec dict compress time = 0.00's, 2689241.000'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 83080.756'MB/sec zip my value time = 1.48's, unzip length = 0.263'GB zip my value throughput = 177.858'MB/sec zip pipeline throughput = 177.858'MB/sec entries = 258857 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.01 avg-zval = 308.96 usrkeys = 258857 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.01 avg-zval = 308.96 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1229 value = 3.2917 dict = 1.00 all = 3.2301 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 18.865497 GB avg = 0.205 KB (by entry num) total key len = 2.504697 GB avg = 0.027 KB total ukey len = 1.743838 GB avg = 0.017 KB total ukey num = 0.105289927 Billion total entry num = 0.092097656 Billion write speed all = 0.479962043 MB/sec (with seq num) write speed all = 0.463414368 MB/sec (without seq num) 2024/11/23-21:17:17.066918 139957609621056 [compaction_job.cc:1948] [default] [JOB 35959] Generated table #281051: 258857 keys, 83104076 bytes, temperature: kWarm 2024/11/23-21:17:17.067007 139957609621056 EVENT_LOG_v1 {"time_micros": 1732367837066953, "cf_name": "default", "job": 35959, "event": "table_file_creation", "file_number": 281051, "file_size": 83104076, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79976384, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177140, "raw_average_key_size": 20, "raw_value_size": 263259004, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 258857, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367833, "oldest_key_time": 0, "file_creation_time": 1732367833, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281051, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:17:17.123549 139957609621056 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281052.sst) /dev/shm/ToplingTemp/Topling-190888-OG81Hd 2024/11/23-21:17:18.546404 139957609621056 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281052.sst): first pass time = 1.42's, 188.665'MB/sec 2024/11/23-21:17:20.028532 139957609621056 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281052.sst): old prealloc_size = 295279001, real_size = 80481040 2024/11/23-21:17:20.028726 139957609621056 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281052.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258857 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.01 avg-zval = 308.97 2024/11/23-21:17:20.028764 139957609621056 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281052.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:17:20.351801 139957609621056 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281052.sst): second pass time = 1.48's, 177.793'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.32's, 257.094'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2584.364'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.277'MB/sec write SST data time = 0.09's, 928.573'MB/sec dict compress time = 0.00's, 2688265.000'MB/sec z-dict build time = 0.00's, sample length = 2.688'MB, throughput = 65264.992'MB/sec zip my value time = 1.48's, unzip length = 0.263'GB zip my value throughput = 177.793'MB/sec zip pipeline throughput = 177.793'MB/sec entries = 258857 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.01 avg-zval = 308.97 usrkeys = 258857 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.01 avg-zval = 308.97 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1229 value = 3.2916 dict = 1.00 all = 3.2300 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 19.128756 GB avg = 0.207 KB (by entry num) total key len = 2.509874 GB avg = 0.027 KB total ukey len = 1.746944 GB avg = 0.017 KB total ukey num = 0.105548784 Billion total entry num = 0.092356513 Billion write speed all = 0.485954081 MB/sec (with seq num) write speed all = 0.469361154 MB/sec (without seq num) 2024/11/23-21:17:20.446611 139957609621056 [compaction_job.cc:1948] [default] [JOB 35959] Generated table #281052: 258857 keys, 83106748 bytes, temperature: kWarm 2024/11/23-21:17:20.446677 139957609621056 EVENT_LOG_v1 {"time_micros": 1732367840446642, "cf_name": "default", "job": 35959, "event": "table_file_creation", "file_number": 281052, "file_size": 83106748, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79980032, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177140, "raw_average_key_size": 20, "raw_value_size": 263258946, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 258857, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367837, "oldest_key_time": 0, "file_creation_time": 1732367837, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281052, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:17:20.508031 139957609621056 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281053.sst) /dev/shm/ToplingTemp/Topling-190888-FgjCSh 2024/11/23-21:17:22.236990 139957609621056 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281053.sst): first pass time = 1.73's, 155.263'MB/sec 2024/11/23-21:17:23.769943 139957609621056 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281053.sst): old prealloc_size = 295279001, real_size = 80882176 2024/11/23-21:17:23.770151 139957609621056 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281053.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258861 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0804 GB avg-val =1016.99 avg-zval = 310.52 2024/11/23-21:17:23.770187 139957609621056 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281053.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:17:24.091238 139957609621056 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281053.sst): second pass time = 1.53's, 171.875'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.32's, 259.933'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2590.859'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.278'MB/sec write SST data time = 0.09's, 946.227'MB/sec dict compress time = 0.00's, 2689089.000'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 77989.820'MB/sec zip my value time = 1.53's, unzip length = 0.263'GB zip my value throughput = 171.875'MB/sec zip pipeline throughput = 171.875'MB/sec entries = 258861 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1016.99 avg-zval = 310.52 usrkeys = 258861 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1016.99 avg-zval = 310.52 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0804 GB dict = 2.69 MB all = 0.0835 GB } UnZip/Zip{ index = 7.1230 value = 3.2751 dict = 1.00 all = 3.2145 } Zip/UnZip{ index = 0.1404 value = 0.3053 dict = 1.00 all = 0.3111 } ---------------------------- total value len = 19.392014 GB avg = 0.209 KB (by entry num) total key len = 2.515051 GB avg = 0.027 KB total ukey len = 1.750051 GB avg = 0.017 KB total ukey num = 0.105807645 Billion total entry num = 0.092615374 Billion write speed all = 0.491941214 MB/sec (with seq num) write speed all = 0.475303178 MB/sec (without seq num) 2024/11/23-21:17:24.187860 139957609621056 [compaction_job.cc:1948] [default] [JOB 35959] Generated table #281053: 258861 keys, 83508724 bytes, temperature: kWarm 2024/11/23-21:17:24.187931 139957609621056 EVENT_LOG_v1 {"time_micros": 1732367844187895, "cf_name": "default", "job": 35959, "event": "table_file_creation", "file_number": 281053, "file_size": 83508724, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 80381168, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177220, "raw_average_key_size": 20, "raw_value_size": 263258267, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 258861, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367840, "oldest_key_time": 0, "file_creation_time": 1732367840, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281053, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:17:24.245949 139957609621056 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281054.sst) /dev/shm/ToplingTemp/Topling-190888-s7OTtg 2024/11/23-21:17:25.225365 139957609621056 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281054.sst): first pass time = 0.98's, 274.097'MB/sec 2024/11/23-21:17:26.660070 139957609621056 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281054.sst): old prealloc_size = 295279001, real_size = 80478304 2024/11/23-21:17:26.660270 139957609621056 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281054.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258857 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.00 avg-zval = 308.96 2024/11/23-21:17:26.660309 139957609621056 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281054.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:17:26.980532 139957609621056 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281054.sst): second pass time = 1.43's, 183.673'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.32's, 259.348'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2627.939'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.279'MB/sec write SST data time = 0.09's, 944.505'MB/sec dict compress time = 0.00's, 2689089.000'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 84052.418'MB/sec zip my value time = 1.43's, unzip length = 0.263'GB zip my value throughput = 183.673'MB/sec zip pipeline throughput = 183.673'MB/sec entries = 258857 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 308.96 usrkeys = 258857 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 308.96 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 8 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1229 value = 3.2917 dict = 1.00 all = 3.2301 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 19.655273 GB avg = 0.212 KB (by entry num) total key len = 2.520229 GB avg = 0.027 KB total ukey len = 1.753157 GB avg = 0.017 KB total ukey num = 0.106066502 Billion total entry num = 0.092874231 Billion write speed all = 0.497936859 MB/sec (with seq num) write speed all = 0.481253402 MB/sec (without seq num) 2024/11/23-21:17:27.077428 139957609621056 [compaction_job.cc:1948] [default] [JOB 35959] Generated table #281054: 258857 keys, 83104820 bytes, temperature: kWarm 2024/11/23-21:17:27.077492 139957609621056 EVENT_LOG_v1 {"time_micros": 1732367847077458, "cf_name": "default", "job": 35959, "event": "table_file_creation", "file_number": 281054, "file_size": 83104820, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79977296, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177140, "raw_average_key_size": 20, "raw_value_size": 263258853, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 258857, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367844, "oldest_key_time": 0, "file_creation_time": 1732367844, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281054, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:17:27.143130 139957609621056 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281055.sst) /dev/shm/ToplingTemp/Topling-190888-7VKYCd 2024/11/23-21:17:28.334872 139957609621056 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281055.sst): first pass time = 1.19's, 225.254'MB/sec 2024/11/23-21:17:29.832095 139957609621056 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281055.sst): old prealloc_size = 295279001, real_size = 80476480 2024/11/23-21:17:29.832289 139957609621056 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281055.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258862 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1016.99 avg-zval = 308.95 2024/11/23-21:17:29.832327 139957609621056 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281055.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:17:30.150567 139957609621056 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281055.sst): second pass time = 1.50's, 175.983'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.32's, 260.963'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2730.259'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.278'MB/sec write SST data time = 0.09's, 971.421'MB/sec dict compress time = 0.00's, 2689150.000'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 79157.836'MB/sec zip my value time = 1.50's, unzip length = 0.263'GB zip my value throughput = 175.983'MB/sec zip pipeline throughput = 175.983'MB/sec entries = 258862 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1016.99 avg-zval = 308.95 usrkeys = 258862 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1016.99 avg-zval = 308.95 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1231 value = 3.2917 dict = 1.00 all = 3.2302 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 19.918532 GB avg = 0.214 KB (by entry num) total key len = 2.525406 GB avg = 0.027 KB total ukey len = 1.756263 GB avg = 0.017 KB total ukey num = 0.106325364 Billion total entry num = 0.093133093 Billion write speed all = 0.503928551 MB/sec (with seq num) write speed all = 0.487199785 MB/sec (without seq num) 2024/11/23-21:17:30.246511 139957609621056 [compaction_job.cc:1948] [default] [JOB 35959] Generated table #281055: 258862 keys, 83103089 bytes, temperature: kWarm 2024/11/23-21:17:30.246577 139957609621056 EVENT_LOG_v1 {"time_micros": 1732367850246543, "cf_name": "default", "job": 35959, "event": "table_file_creation", "file_number": 281055, "file_size": 83103089, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79975472, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177240, "raw_average_key_size": 20, "raw_value_size": 263258849, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 258862, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367847, "oldest_key_time": 0, "file_creation_time": 1732367847, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281055, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:17:30.306618 139957609621056 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281056.sst) /dev/shm/ToplingTemp/Topling-190888-xgu5uf 2024/11/23-21:17:32.017382 139957609621056 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281056.sst): first pass time = 1.71's, 156.914'MB/sec 2024/11/23-21:17:33.501822 139957609621056 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281056.sst): old prealloc_size = 295279001, real_size = 80473536 2024/11/23-21:17:33.502023 139957609621056 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281056.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258864 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1016.98 avg-zval = 308.94 2024/11/23-21:17:33.502063 139957609621056 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281056.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:17:33.830006 139957609621056 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281056.sst): second pass time = 1.48's, 177.505'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.33's, 253.242'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2449.441'MB/sec (index lex order gen) rebuild zvType time = 0.24's, 0.274'MB/sec write SST data time = 0.09's, 906.084'MB/sec dict compress time = 0.00's, 2688847.000'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 80068.102'MB/sec zip my value time = 1.48's, unzip length = 0.263'GB zip my value throughput = 177.505'MB/sec zip pipeline throughput = 177.505'MB/sec entries = 258864 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1016.98 avg-zval = 308.94 usrkeys = 258864 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1016.98 avg-zval = 308.94 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1231 value = 3.2919 dict = 1.00 all = 3.2303 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 20.181790 GB avg = 0.216 KB (by entry num) total key len = 2.530583 GB avg = 0.027 KB total ukey len = 1.759370 GB avg = 0.017 KB total ukey num = 0.106584228 Billion total entry num = 0.093391957 Billion write speed all = 0.509913557 MB/sec (with seq num) write speed all = 0.493139679 MB/sec (without seq num) 2024/11/23-21:17:33.923782 139957609621056 [compaction_job.cc:1948] [default] [JOB 35959] Generated table #281056: 258864 keys, 83099842 bytes, temperature: kWarm 2024/11/23-21:17:33.923849 139957609621056 EVENT_LOG_v1 {"time_micros": 1732367853923814, "cf_name": "default", "job": 35959, "event": "table_file_creation", "file_number": 281056, "file_size": 83099842, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79972528, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177280, "raw_average_key_size": 20, "raw_value_size": 263258716, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 258864, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367850, "oldest_key_time": 0, "file_creation_time": 1732367850, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281056, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:17:33.980688 139957609621056 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281057.sst) /dev/shm/ToplingTemp/Topling-190888-uuepQd 2024/11/23-21:17:35.317553 139957609621056 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281057.sst): first pass time = 1.34's, 200.801'MB/sec 2024/11/23-21:17:36.790329 139957609621056 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281057.sst): old prealloc_size = 295279001, real_size = 80484752 2024/11/23-21:17:36.790516 139957609621056 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281057.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258852 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.02 avg-zval = 308.99 2024/11/23-21:17:36.790555 139957609621056 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281057.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:17:37.108694 139957609621056 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281057.sst): second pass time = 1.47's, 178.923'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.32's, 261.072'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2669.507'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.280'MB/sec write SST data time = 0.09's, 956.690'MB/sec dict compress time = 0.00's, 2688979.000'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 82158.911'MB/sec zip my value time = 1.47's, unzip length = 0.263'GB zip my value throughput = 178.923'MB/sec zip pipeline throughput = 178.923'MB/sec entries = 258852 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.02 avg-zval = 308.99 usrkeys = 258852 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.02 avg-zval = 308.99 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1228 value = 3.2914 dict = 1.00 all = 3.2298 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 20.445049 GB avg = 0.218 KB (by entry num) total key len = 2.535760 GB avg = 0.027 KB total ukey len = 1.762476 GB avg = 0.016 KB total ukey num = 0.106843080 Billion total entry num = 0.093650809 Billion write speed all = 0.515902213 MB/sec (with seq num) write speed all = 0.499083080 MB/sec (without seq num) 2024/11/23-21:17:37.204477 139957609621056 [compaction_job.cc:1948] [default] [JOB 35959] Generated table #281057: 258852 keys, 83111174 bytes, temperature: kWarm 2024/11/23-21:17:37.204544 139957609621056 EVENT_LOG_v1 {"time_micros": 1732367857204509, "cf_name": "default", "job": 35959, "event": "table_file_creation", "file_number": 281057, "file_size": 83111174, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79983744, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177040, "raw_average_key_size": 20, "raw_value_size": 263258847, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 258852, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367853, "oldest_key_time": 0, "file_creation_time": 1732367853, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281057, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:17:37.259289 139957609621056 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281058.sst) /dev/shm/ToplingTemp/Topling-190888-TAlmTf 2024/11/23-21:17:38.476191 139957609621056 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281058.sst): first pass time = 1.22's, 220.597'MB/sec 2024/11/23-21:17:39.931096 139957609621056 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281058.sst): old prealloc_size = 295279001, real_size = 80480192 2024/11/23-21:17:39.931291 139957609621056 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281058.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258860 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1016.99 avg-zval = 308.97 2024/11/23-21:17:39.931329 139957609621056 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281058.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:17:40.251358 139957609621056 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281058.sst): second pass time = 1.45's, 181.120'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.32's, 259.514'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2699.265'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.281'MB/sec write SST data time = 0.09's, 929.072'MB/sec dict compress time = 0.00's, 2688809.000'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 83239.707'MB/sec zip my value time = 1.45's, unzip length = 0.263'GB zip my value throughput = 181.120'MB/sec zip pipeline throughput = 181.120'MB/sec entries = 258860 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1016.99 avg-zval = 308.97 usrkeys = 258860 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1016.99 avg-zval = 308.97 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1230 value = 3.2916 dict = 1.00 all = 3.2300 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 20.708308 GB avg = 0.221 KB (by entry num) total key len = 2.540937 GB avg = 0.027 KB total ukey len = 1.765582 GB avg = 0.016 KB total ukey num = 0.107101940 Billion total entry num = 0.093909669 Billion write speed all = 0.521891589 MB/sec (with seq num) write speed all = 0.505027156 MB/sec (without seq num) 2024/11/23-21:17:40.346322 139957609621056 [compaction_job.cc:1948] [default] [JOB 35959] Generated table #281058: 258860 keys, 83106460 bytes, temperature: kWarm 2024/11/23-21:17:40.346388 139957609621056 EVENT_LOG_v1 {"time_micros": 1732367860346355, "cf_name": "default", "job": 35959, "event": "table_file_creation", "file_number": 281058, "file_size": 83106460, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79979184, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177200, "raw_average_key_size": 20, "raw_value_size": 263259038, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 258860, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367857, "oldest_key_time": 0, "file_creation_time": 1732367857, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281058, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:17:40.402288 139957609621056 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281059.sst) /dev/shm/ToplingTemp/Topling-190888-FBlGlh 2024/11/23-21:17:41.730644 139957609621056 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281059.sst): first pass time = 1.33's, 202.087'MB/sec 2024/11/23-21:17:43.196258 139957609621056 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281059.sst): old prealloc_size = 295279001, real_size = 80478416 2024/11/23-21:17:43.196440 139957609621056 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281059.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258859 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.00 avg-zval = 308.96 2024/11/23-21:17:43.196480 139957609621056 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281059.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:17:43.521069 139957609621056 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281059.sst): second pass time = 1.46's, 179.797'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.32's, 255.871'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2771.433'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.277'MB/sec write SST data time = 0.09's, 912.728'MB/sec dict compress time = 0.00's, 2689124.000'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 83721.171'MB/sec zip my value time = 1.46's, unzip length = 0.263'GB zip my value throughput = 179.797'MB/sec zip pipeline throughput = 179.797'MB/sec entries = 258859 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 308.96 usrkeys = 258859 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 308.96 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1230 value = 3.2917 dict = 1.00 all = 3.2301 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 20.971567 GB avg = 0.223 KB (by entry num) total key len = 2.546114 GB avg = 0.027 KB total ukey len = 1.768688 GB avg = 0.016 KB total ukey num = 0.107360799 Billion total entry num = 0.094168528 Billion write speed all = 0.527878600 MB/sec (with seq num) write speed all = 0.510968923 MB/sec (without seq num) 2024/11/23-21:17:43.616054 139957609621056 [compaction_job.cc:1948] [default] [JOB 35959] Generated table #281059: 258859 keys, 83104983 bytes, temperature: kWarm 2024/11/23-21:17:43.616129 139957609621056 EVENT_LOG_v1 {"time_micros": 1732367863616086, "cf_name": "default", "job": 35959, "event": "table_file_creation", "file_number": 281059, "file_size": 83104983, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79977408, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177180, "raw_average_key_size": 20, "raw_value_size": 263258451, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 258859, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367860, "oldest_key_time": 0, "file_creation_time": 1732367860, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281059, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:17:43.672282 139957609621056 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281060.sst) /dev/shm/ToplingTemp/Topling-190888-a59DMe 2024/11/23-21:17:44.923213 139957609621056 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281060.sst): first pass time = 1.25's, 214.596'MB/sec 2024/11/23-21:17:46.394432 139957609621056 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281060.sst): old prealloc_size = 295279001, real_size = 80473984 2024/11/23-21:17:46.394606 139957609621056 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281060.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258862 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1016.98 avg-zval = 308.94 2024/11/23-21:17:46.394644 139957609621056 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281060.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:17:46.719638 139957609621056 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281060.sst): second pass time = 1.47's, 179.097'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.33's, 255.547'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2835.180'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.276'MB/sec write SST data time = 0.09's, 917.772'MB/sec dict compress time = 0.00's, 2688563.000'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 79992.949'MB/sec zip my value time = 1.47's, unzip length = 0.263'GB zip my value throughput = 179.097'MB/sec zip pipeline throughput = 179.097'MB/sec entries = 258862 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1016.98 avg-zval = 308.94 usrkeys = 258862 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1016.98 avg-zval = 308.94 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1231 value = 3.2918 dict = 1.00 all = 3.2303 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 21.234825 GB avg = 0.225 KB (by entry num) total key len = 2.551292 GB avg = 0.027 KB total ukey len = 1.771795 GB avg = 0.016 KB total ukey num = 0.107619661 Billion total entry num = 0.094427390 Billion write speed all = 0.533865589 MB/sec (with seq num) write speed all = 0.516910645 MB/sec (without seq num) 2024/11/23-21:17:46.819757 139957609621056 [compaction_job.cc:1948] [default] [JOB 35959] Generated table #281060: 258862 keys, 83100006 bytes, temperature: kWarm 2024/11/23-21:17:46.819822 139957609621056 EVENT_LOG_v1 {"time_micros": 1732367866819788, "cf_name": "default", "job": 35959, "event": "table_file_creation", "file_number": 281060, "file_size": 83100006, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79972976, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177240, "raw_average_key_size": 20, "raw_value_size": 263258507, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 258862, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367863, "oldest_key_time": 0, "file_creation_time": 1732367863, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281060, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:17:46.875861 139957609621056 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281061.sst) /dev/shm/ToplingTemp/Topling-190888-jf84pg 2024/11/23-21:17:48.403098 139957609621056 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281061.sst): first pass time = 1.53's, 175.770'MB/sec 2024/11/23-21:17:49.902782 139957609621056 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281061.sst): old prealloc_size = 295279001, real_size = 80481296 2024/11/23-21:17:49.902955 139957609621056 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281061.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258857 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.01 avg-zval = 308.97 2024/11/23-21:17:49.903025 139957609621056 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281061.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:17:50.223593 139957609621056 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281061.sst): second pass time = 1.50's, 175.701'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.32's, 259.079'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2849.630'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.278'MB/sec write SST data time = 0.09's, 949.180'MB/sec dict compress time = 0.00's, 2689938.000'MB/sec z-dict build time = 0.00's, sample length = 2.690'MB, throughput = 83811.746'MB/sec zip my value time = 1.50's, unzip length = 0.263'GB zip my value throughput = 175.701'MB/sec zip pipeline throughput = 175.701'MB/sec entries = 258857 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.01 avg-zval = 308.97 usrkeys = 258857 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.01 avg-zval = 308.97 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1229 value = 3.2915 dict = 1.00 all = 3.2299 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 21.498084 GB avg = 0.227 KB (by entry num) total key len = 2.556469 GB avg = 0.027 KB total ukey len = 1.774901 GB avg = 0.016 KB total ukey num = 0.107878518 Billion total entry num = 0.094686247 Billion write speed all = 0.539848026 MB/sec (with seq num) write speed all = 0.522847940 MB/sec (without seq num) 2024/11/23-21:17:50.317039 139957609621056 [compaction_job.cc:1948] [default] [JOB 35959] Generated table #281061: 258857 keys, 83108677 bytes, temperature: kWarm 2024/11/23-21:17:50.317114 139957609621056 EVENT_LOG_v1 {"time_micros": 1732367870317072, "cf_name": "default", "job": 35959, "event": "table_file_creation", "file_number": 281061, "file_size": 83108677, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79980288, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177140, "raw_average_key_size": 20, "raw_value_size": 263258978, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 258857, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367866, "oldest_key_time": 0, "file_creation_time": 1732367866, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281061, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:17:50.372117 139957609621056 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281062.sst) /dev/shm/ToplingTemp/Topling-190888-Vv7hJg 2024/11/23-21:17:52.157628 139957609621056 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281062.sst): first pass time = 1.79's, 150.345'MB/sec 2024/11/23-21:17:53.693336 139957609621056 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281062.sst): old prealloc_size = 295279001, real_size = 80474832 2024/11/23-21:17:53.693526 139957609621056 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281062.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258862 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1016.98 avg-zval = 308.94 2024/11/23-21:17:53.693562 139957609621056 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281062.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:17:54.017283 139957609621056 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281062.sst): second pass time = 1.53's, 171.584'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.32's, 256.544'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2659.560'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.278'MB/sec write SST data time = 0.09's, 912.713'MB/sec dict compress time = 0.00's, 2688517.000'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 84216.170'MB/sec zip my value time = 1.53's, unzip length = 0.263'GB zip my value throughput = 171.584'MB/sec zip pipeline throughput = 171.584'MB/sec entries = 258862 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1016.98 avg-zval = 308.94 usrkeys = 258862 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1016.98 avg-zval = 308.94 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 8 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1231 value = 3.2918 dict = 1.00 all = 3.2302 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 21.761343 GB avg = 0.229 KB (by entry num) total key len = 2.561646 GB avg = 0.027 KB total ukey len = 1.778007 GB avg = 0.016 KB total ukey num = 0.108137380 Billion total entry num = 0.094945109 Billion write speed all = 0.545825968 MB/sec (with seq num) write speed all = 0.528780857 MB/sec (without seq num) 2024/11/23-21:17:54.114735 139957609621056 [compaction_job.cc:1948] [default] [JOB 35959] Generated table #281062: 258862 keys, 83100792 bytes, temperature: kWarm 2024/11/23-21:17:54.114806 139957609621056 EVENT_LOG_v1 {"time_micros": 1732367874114770, "cf_name": "default", "job": 35959, "event": "table_file_creation", "file_number": 281062, "file_size": 83100792, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79973824, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177240, "raw_average_key_size": 20, "raw_value_size": 263258686, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 258862, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367870, "oldest_key_time": 0, "file_creation_time": 1732367870, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281062, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:17:54.174853 139957609621056 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281063.sst) /dev/shm/ToplingTemp/Topling-190888-8M1MQf 2024/11/23-21:17:55.525173 139957609621056 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281063.sst): first pass time = 1.35's, 198.802'MB/sec 2024/11/23-21:17:57.036188 139957609621056 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281063.sst): old prealloc_size = 295279001, real_size = 80476672 2024/11/23-21:17:57.036369 139957609621056 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281063.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258860 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1016.99 avg-zval = 308.95 2024/11/23-21:17:57.036408 139957609621056 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281063.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:17:57.358884 139957609621056 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281063.sst): second pass time = 1.51's, 174.373'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.32's, 257.547'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2793.499'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.279'MB/sec write SST data time = 0.09's, 915.213'MB/sec dict compress time = 0.00's, 2689281.000'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 87510.364'MB/sec zip my value time = 1.51's, unzip length = 0.263'GB zip my value throughput = 174.373'MB/sec zip pipeline throughput = 174.373'MB/sec entries = 258860 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1016.99 avg-zval = 308.95 usrkeys = 258860 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1016.99 avg-zval = 308.95 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1230 value = 3.2917 dict = 1.00 all = 3.2301 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 22.024602 GB avg = 0.231 KB (by entry num) total key len = 2.566823 GB avg = 0.027 KB total ukey len = 1.781114 GB avg = 0.016 KB total ukey num = 0.108396240 Billion total entry num = 0.095203969 Billion write speed all = 0.551808500 MB/sec (with seq num) write speed all = 0.534718198 MB/sec (without seq num) 2024/11/23-21:17:57.452722 139957609621056 [compaction_job.cc:1948] [default] [JOB 35959] Generated table #281063: 258860 keys, 83103412 bytes, temperature: kWarm 2024/11/23-21:17:57.452790 139957609621056 EVENT_LOG_v1 {"time_micros": 1732367877452755, "cf_name": "default", "job": 35959, "event": "table_file_creation", "file_number": 281063, "file_size": 83103412, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79975664, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177200, "raw_average_key_size": 20, "raw_value_size": 263259114, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 258860, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367874, "oldest_key_time": 0, "file_creation_time": 1732367874, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281063, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:17:57.521398 139957609621056 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281064.sst) /dev/shm/ToplingTemp/Topling-190888-wSGCdh 2024/11/23-21:17:58.728500 139957609621056 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281064.sst): first pass time = 1.21's, 222.389'MB/sec 2024/11/23-21:18:00.227813 139957609621056 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281064.sst): old prealloc_size = 295279001, real_size = 80473984 2024/11/23-21:18:00.228024 139957609621056 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281064.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258866 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1016.97 avg-zval = 308.94 2024/11/23-21:18:00.228063 139957609621056 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281064.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:18:00.554640 139957609621056 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281064.sst): second pass time = 1.50's, 175.877'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.33's, 254.283'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2374.617'MB/sec (index lex order gen) rebuild zvType time = 0.24's, 0.275'MB/sec write SST data time = 0.09's, 907.102'MB/sec dict compress time = 0.00's, 2689117.000'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 79788.654'MB/sec zip my value time = 1.50's, unzip length = 0.263'GB zip my value throughput = 175.877'MB/sec zip pipeline throughput = 175.877'MB/sec entries = 258866 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1016.97 avg-zval = 308.94 usrkeys = 258866 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1016.97 avg-zval = 308.94 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1232 value = 3.2918 dict = 1.00 all = 3.2303 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 22.287861 GB avg = 0.233 KB (by entry num) total key len = 2.572001 GB avg = 0.027 KB total ukey len = 1.784220 GB avg = 0.016 KB total ukey num = 0.108655106 Billion total entry num = 0.095462835 Billion write speed all = 0.557791949 MB/sec (with seq num) write speed all = 0.540656407 MB/sec (without seq num) 2024/11/23-21:18:00.656930 139957609621056 [compaction_job.cc:1948] [default] [JOB 35959] Generated table #281064: 258866 keys, 83100560 bytes, temperature: kWarm 2024/11/23-21:18:00.657016 139957609621056 EVENT_LOG_v1 {"time_micros": 1732367880656964, "cf_name": "default", "job": 35959, "event": "table_file_creation", "file_number": 281064, "file_size": 83100560, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79972976, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177320, "raw_average_key_size": 20, "raw_value_size": 263258520, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 258866, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367877, "oldest_key_time": 0, "file_creation_time": 1732367877, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281064, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:18:00.716849 139957609621056 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281065.sst) /dev/shm/ToplingTemp/Topling-190888-JKVNrh 2024/11/23-21:18:02.133944 139957609621056 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281065.sst): first pass time = 1.42's, 189.433'MB/sec 2024/11/23-21:18:03.664672 139957609621056 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281065.sst): old prealloc_size = 295279001, real_size = 80479584 2024/11/23-21:18:03.664863 139957609621056 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281065.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258860 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1016.99 avg-zval = 308.96 2024/11/23-21:18:03.664902 139957609621056 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281065.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:18:03.988497 139957609621056 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281065.sst): second pass time = 1.53's, 172.145'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.32's, 256.654'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2661.540'MB/sec (index lex order gen) rebuild zvType time = 0.24's, 0.275'MB/sec write SST data time = 0.09's, 942.448'MB/sec dict compress time = 0.00's, 2688852.000'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 85979.983'MB/sec zip my value time = 1.53's, unzip length = 0.263'GB zip my value throughput = 172.145'MB/sec zip pipeline throughput = 172.145'MB/sec entries = 258860 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1016.99 avg-zval = 308.96 usrkeys = 258860 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1016.99 avg-zval = 308.96 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 8 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1230 value = 3.2916 dict = 1.00 all = 3.2300 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 22.551119 GB avg = 0.236 KB (by entry num) total key len = 2.577178 GB avg = 0.027 KB total ukey len = 1.787326 GB avg = 0.016 KB total ukey num = 0.108913966 Billion total entry num = 0.095721695 Billion write speed all = 0.563771525 MB/sec (with seq num) write speed all = 0.546590841 MB/sec (without seq num) 2024/11/23-21:18:04.085502 139957609621056 [compaction_job.cc:1948] [default] [JOB 35959] Generated table #281065: 258860 keys, 83105863 bytes, temperature: kWarm 2024/11/23-21:18:04.085573 139957609621056 EVENT_LOG_v1 {"time_micros": 1732367884085537, "cf_name": "default", "job": 35959, "event": "table_file_creation", "file_number": 281065, "file_size": 83105863, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79978576, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177200, "raw_average_key_size": 20, "raw_value_size": 263258476, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 258860, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367880, "oldest_key_time": 0, "file_creation_time": 1732367880, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281065, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:18:04.142888 139957609621056 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281066.sst) /dev/shm/ToplingTemp/Topling-190888-fsqAMf 2024/11/23-21:18:05.555061 139957609621056 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281066.sst): first pass time = 1.41's, 190.093'MB/sec 2024/11/23-21:18:07.032821 139957609621056 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281066.sst): old prealloc_size = 295279001, real_size = 80477600 2024/11/23-21:18:07.033041 139957609621056 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281066.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258858 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.00 avg-zval = 308.96 2024/11/23-21:18:07.033080 139957609621056 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281066.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:18:07.358358 139957609621056 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281066.sst): second pass time = 1.48's, 178.306'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.33's, 255.302'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2232.097'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.277'MB/sec write SST data time = 0.09's, 909.415'MB/sec dict compress time = 0.00's, 2689028.000'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 75496.322'MB/sec zip my value time = 1.48's, unzip length = 0.263'GB zip my value throughput = 178.306'MB/sec zip pipeline throughput = 178.306'MB/sec entries = 258858 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 308.96 usrkeys = 258858 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 308.96 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 8 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1230 value = 3.2917 dict = 1.00 all = 3.2301 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 22.814378 GB avg = 0.238 KB (by entry num) total key len = 2.582355 GB avg = 0.027 KB total ukey len = 1.790433 GB avg = 0.016 KB total ukey num = 0.109172824 Billion total entry num = 0.095980553 Billion write speed all = 0.569750996 MB/sec (with seq num) write speed all = 0.552525153 MB/sec (without seq num) 2024/11/23-21:18:07.454645 139957609621056 [compaction_job.cc:1948] [default] [JOB 35959] Generated table #281066: 258858 keys, 83104055 bytes, temperature: kWarm 2024/11/23-21:18:07.454725 139957609621056 EVENT_LOG_v1 {"time_micros": 1732367887454690, "cf_name": "default", "job": 35959, "event": "table_file_creation", "file_number": 281066, "file_size": 83104055, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79976592, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177160, "raw_average_key_size": 20, "raw_value_size": 263258438, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 258858, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367884, "oldest_key_time": 0, "file_creation_time": 1732367884, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281066, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:18:07.515387 139957609621056 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281067.sst) /dev/shm/ToplingTemp/Topling-190888-O94Akg 2024/11/23-21:18:08.626372 139957609621056 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281067.sst): first pass time = 1.11's, 241.629'MB/sec 2024/11/23-21:18:10.086134 139957609621056 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281067.sst): old prealloc_size = 295279001, real_size = 80480656 2024/11/23-21:18:10.086323 139957609621056 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281067.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258852 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.02 avg-zval = 308.98 2024/11/23-21:18:10.086364 139957609621056 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281067.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:18:10.413749 139957609621056 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281067.sst): second pass time = 1.46's, 180.510'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.33's, 253.682'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2711.112'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.277'MB/sec write SST data time = 0.09's, 888.693'MB/sec dict compress time = 0.00's, 2689141.000'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 68672.361'MB/sec zip my value time = 1.46's, unzip length = 0.263'GB zip my value throughput = 180.510'MB/sec zip pipeline throughput = 180.510'MB/sec entries = 258852 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.02 avg-zval = 308.98 usrkeys = 258852 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.02 avg-zval = 308.98 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1228 value = 3.2916 dict = 1.00 all = 3.2300 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 23.077636 GB avg = 0.240 KB (by entry num) total key len = 2.587532 GB avg = 0.027 KB total ukey len = 1.793539 GB avg = 0.016 KB total ukey num = 0.109431676 Billion total entry num = 0.096239405 Billion write speed all = 0.575733630 MB/sec (with seq num) write speed all = 0.558462515 MB/sec (without seq num) 2024/11/23-21:18:10.508090 139957609621056 [compaction_job.cc:1948] [default] [JOB 35959] Generated table #281067: 258852 keys, 83107240 bytes, temperature: kWarm 2024/11/23-21:18:10.508168 139957609621056 EVENT_LOG_v1 {"time_micros": 1732367890508133, "cf_name": "default", "job": 35959, "event": "table_file_creation", "file_number": 281067, "file_size": 83107240, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79979648, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177040, "raw_average_key_size": 20, "raw_value_size": 263258859, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 258852, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367887, "oldest_key_time": 0, "file_creation_time": 1732367887, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281067, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:18:10.574239 139957609621056 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281068.sst) /dev/shm/ToplingTemp/Topling-190888-eP2Gci 2024/11/23-21:18:11.832734 139957609621056 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281068.sst): first pass time = 1.26's, 213.307'MB/sec 2024/11/23-21:18:13.302884 139957609621056 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281068.sst): old prealloc_size = 295279001, real_size = 80482784 2024/11/23-21:18:13.303105 139957609621056 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281068.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258854 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.02 avg-zval = 308.98 2024/11/23-21:18:13.303157 139957609621056 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281068.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:18:13.629946 139957609621056 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281068.sst): second pass time = 1.47's, 179.232'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.33's, 254.126'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2090.364'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.276'MB/sec write SST data time = 0.09's, 900.116'MB/sec dict compress time = 0.00's, 2689212.000'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 88741.156'MB/sec zip my value time = 1.47's, unzip length = 0.263'GB zip my value throughput = 179.232'MB/sec zip pipeline throughput = 179.232'MB/sec entries = 258854 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.02 avg-zval = 308.98 usrkeys = 258854 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.02 avg-zval = 308.98 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 8 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1229 value = 3.2915 dict = 1.00 all = 3.2299 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 23.340895 GB avg = 0.242 KB (by entry num) total key len = 2.592709 GB avg = 0.027 KB total ukey len = 1.796645 GB avg = 0.016 KB total ukey num = 0.109690530 Billion total entry num = 0.096498259 Billion write speed all = 0.581713344 MB/sec (with seq num) write speed all = 0.564397023 MB/sec (without seq num) 2024/11/23-21:18:13.726155 139957609621056 [compaction_job.cc:1948] [default] [JOB 35959] Generated table #281068: 258854 keys, 83109423 bytes, temperature: kWarm 2024/11/23-21:18:13.726224 139957609621056 EVENT_LOG_v1 {"time_micros": 1732367893726189, "cf_name": "default", "job": 35959, "event": "table_file_creation", "file_number": 281068, "file_size": 83109423, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79981776, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177080, "raw_average_key_size": 20, "raw_value_size": 263258670, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 258854, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367890, "oldest_key_time": 0, "file_creation_time": 1732367890, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281068, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:18:13.786064 139957609621056 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281069.sst) /dev/shm/ToplingTemp/Topling-190888-P2YOdf 2024/11/23-21:18:14.525532 139957609621056 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281069.sst): first pass time = 0.74's, 213.410'MB/sec 2024/11/23-21:18:15.409685 139957609621056 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281069.sst): old prealloc_size = 295279001, real_size = 47417392 2024/11/23-21:18:15.409820 139957609621056 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281069.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 152171 prefix = 4 raw-key = 0.0012 GB zip-key = 0.0003 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1548 GB zip-val = 0.0471 GB avg-val =1017.00 avg-zval = 309.67 2024/11/23-21:18:15.409859 139957609621056 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281069.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.158 GB 2024/11/23-21:18:15.603698 139957609621056 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00/281069.sst): second pass time = 0.88's, 175.237'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.19's, 252.617'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2297.897'MB/sec (index lex order gen) rebuild zvType time = 0.14's, 0.274'MB/sec write SST data time = 0.05's, 891.144'MB/sec dict compress time = 0.00's, 1623666.000'MB/sec z-dict build time = 0.00's, sample length = 1.624'MB, throughput = 51182.612'MB/sec zip my value time = 0.88's, unzip length = 0.155'GB zip my value throughput = 175.237'MB/sec zip pipeline throughput = 175.237'MB/sec entries = 152171 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1017.00 avg-zval = 309.67 usrkeys = 152171 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1017.00 avg-zval = 309.67 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0018 GB value = 0.1548 GB dict = 1.62 MB all = 0.1578 GB } __ZipSize{ index = 0.0003 GB value = 0.0471 GB dict = 1.62 MB all = 0.0490 GB } UnZip/Zip{ index = 7.1064 value = 3.2842 dict = 1.00 all = 3.2201 } Zip/UnZip{ index = 0.1407 value = 0.3045 dict = 1.00 all = 0.3105 } ---------------------------- total value len = 23.495652 GB avg = 0.243 KB (by entry num) total key len = 2.595753 GB avg = 0.027 KB total ukey len = 1.798471 GB avg = 0.016 KB total ukey num = 0.109842701 Billion total entry num = 0.096650430 Billion write speed all = 0.585227041 MB/sec (with seq num) write speed all = 0.567884182 MB/sec (without seq num) 2024/11/23-21:18:15.663268 139957609621056 [compaction_job.cc:1948] [default] [JOB 35959] Generated table #281069: 152171 keys, 49004772 bytes, temperature: kWarm 2024/11/23-21:18:15.663336 139957609621056 EVENT_LOG_v1 {"time_micros": 1732367895663302, "cf_name": "default", "job": 35959, "event": "table_file_creation", "file_number": 281069, "file_size": 49004772, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 47122208, "index_size": 256960, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 3043420, "raw_average_key_size": 20, "raw_value_size": 154757292, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 152171, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367893, "oldest_key_time": 0, "file_creation_time": 1732367893, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281069, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:18:15.694648 139957609621056 [compaction_job.cc:703] job-35959: subcompact[0], size: 4.479943 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35959/att-00 [281009,281010,281011,281012,281013,281014,281015,281016,281017,281018,281019,281020,281021,281022,281023,281024,281025,281026,281027,281028,281029,281030,281031,281032,281033,281034,281035,281036,281037,281038,281039,281040,281041,281042,281043,281044,281045,281046,281047,281048,281049,281050,281051,281052,281053,281054,281055,281056,281057,281058,281059,281060,281061,281062,281063,281064,281065,281066,281067,281068,281069] 2024/11/23-21:18:16.345954 139957609621056 (Original Log Time 2024/11/23-21:14:02.072716) EVENT_LOG_v1 {"time_micros": 1732367642072674, "job": 35959, "event": "compaction_started", "compaction_reason": "ManualCompaction", "files_L3": [281004, 281005, 280912, 280913, 280914, 280915, 280917, 280981, 280982, 280983, 280984, 280985, 280986], "files_L4": [280973, 280974, 280975, 280976, 280977, 280978, 280979, 280980, 278476, 276762, 278705, 278706, 278707, 272740, 279146, 279147, 279148, 278275, 278276, 279904, 275670, 203232, 197519, 197520, 197522, 197592, 197599, 197663, 197672, 197676, 197747, 197753, 197815, 197826, 197828, 197903, 197905, 197967, 197980, 198047, 198056, 198123, 198135, 198136, 198196, 198211, 198266, 198286, 198290, 198356, 198365, 198429, 198438, 198440, 198507, 198512, 198577, 198587, 198588, 198650, 198659, 198716, 198728, 198737, 198813, 198814, 198878, 198885, 198891, 198956, 198963, 198971, 199043, 199045, 199046, 199117, 199119, 199182, 199194, 199195, 199250, 199271, 199333, 199342, 199346, 199404, 199421, 199492, 199500, 199502, 199556, 199574, 199629, 199645, 199654, 199707, 199711, 199777, 199787, 199800, 199852, 199860, 199926, 199939, 199944, 199996, 200003], "score": -1, "input_data_size": 4867471431, "oldest_snapshot_seqno": 4266098802} 2024/11/23-21:18:16.345962 139957609621056 (Original Log Time 2024/11/23-21:18:16.343660) [compaction_job.cc:2022] [default] [JOB 35959] Compacted 13@3 + 107@4 files to L4 => 4479943188 bytes 2024/11/23-21:18:16.345963 139957609621056 (Original Log Time 2024/11/23-21:18:16.345870) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 0 61 0 0] max score 0.02, MB/sec: 19.2 rd, 17.7 wr, level 4, files in(13, 107) out(61 +0 blob) MB in(456.5, 4185.5 +0.0 blob) out(4272.4 +0.0 blob), read-write-amplify(19.5) write-amplify(9.4) OK, records in: 46535143, records dropped: 2242877 output_compression: Snappy 2024/11/23-21:18:16.345966 139957609621056 (Original Log Time 2024/11/23-21:18:16.345925) EVENT_LOG_v1 {"time_micros": 1732367896345894, "cf": "default", "job": 35959, "event": "compaction_finished", "compaction_time_micros": 253621937, "compaction_time_cpu_micros": 80208419, "output_level": 4, "num_output_files": 61, "total_output_size": 4479943188, "num_input_records": 46535143, "num_output_records": 44292266, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 3068581491, "file_range_sync_nanos": 0, "file_fsync_nanos": 43497, "file_prepare_write_nanos": 147586, "lsm_state": [0, 0, 0, 0, 61, 0, 0]} 2024/11/23-21:18:16.487077 139957609621056 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732256054,"starts":1732367641,"executesMs":254463,"compactionJobId":35959,"attempt":0,"compactionInputRawBytes":16815485775,"compactionInputZipBytes":4867471431,"compactionOutputRawBytes":0,"compactionOutputZipBytes":4479943188,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-bc5b0843da69a93747948ff7bae3b21c-c79308627088c60e-00"}}, response = 2024/11/23-21:18:16.487197 139957609621056 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-35959/att-00: olev 4, work 254.464 s, result 7.777 ms, install 2.340 ms, input{raw 15.661 GiB zip 4.533 GiB}