2024/11/23-21:28:25.946350 139957231949376 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00: fork to child time = 0.007588 sec 2024/11/23-21:28:25.947068 139957231949376 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00 2024/11/23-21:28:25.954934 139957231949376 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00 2024/11/23-21:28:25.955805 139957231949376 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/23-21:28:25.956064 139957231949376 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/23-21:28:26.011416 139957231949376 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-36177/att-00/MANIFEST-206347 2024/11/23-21:28:26.042578 139957231949376 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-36177/att-00/MANIFEST-206347 succeeded,manifest_file_number is 206347, next_file_number is 281547, last_sequence is 4272952509, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 281331 2024/11/23-21:28:26.042584 139957231949376 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/23-21:28:26.043060 139957231949376 [version_set.cc:5721] Creating manifest 281547 2024/11/23-21:28:26.084337 139957231949376 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00: bottommost_level: fake = 1, rpc = 1 2024/11/23-21:28:26.108055 139957231949376 [compaction_job.cc:2437] [default] [JOB 36177] Compacting 2@3 + 79@4 files to L4, score -1.00, subcompactions 1 : 1 2024/11/23-21:28:26.108088 139957231949376 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 27076 Base level 3, inputs: [281540(19MB) 281541(40MB)], [281490(79MB) 281491(79MB) 281492(79MB) 281493(79MB) 281494(79MB) 281495(79MB) 281496(79MB) 281497(79MB) 281498(79MB) 281499(79MB) 281500(79MB) 281501(79MB) 281502(79MB) 281503(79MB) 281504(79MB) 281505(79MB) 281506(79MB) 281507(79MB) 281508(79MB) 281509(79MB) 281510(79MB) 281511(79MB) 281512(79MB) 281513(79MB) 281514(79MB) 281515(79MB) 281516(79MB) 281517(79MB) 281518(79MB) 281519(79MB) 281520(79MB) 281521(79MB) 281522(79MB) 281523(79MB) 281524(79MB) 281525(79MB) 281526(79MB) 281527(79MB) 281528(79MB) 281529(79MB) 281530(79MB) 281531(79MB) 281532(79MB) 281533(79MB) 281534(79MB) 281535(79MB) 281536(79MB) 281537(79MB) 281538(73MB) 223358(1471KB) 255711(30KB) 255708(681KB) 255481(586KB) 206772(39MB) 206775(39MB) 206773(39MB) 206774(39MB) 238186(1218KB) 211878(2833KB) 254044(1137KB) 245599(2797KB) 245343(619KB) 230044(184KB) 207566(39MB) 207568(39MB) 207569(39MB) 207570(39MB) 261283(676KB) 236339(751KB) 261152(621KB) 228698(1421KB) 260896(749KB) 243819(30KB) 243717(797KB) 243494(83KB) 208671(39MB) 208674(39MB) 208672(39MB) 208673(39MB)] 2024/11/23-21:28:26.113960 139957231949376 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-21:28:26.113998 139957231949376 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-21:28:26.114018 139957231949376 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-21:28:26.114029 139957231949376 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-21:28:26.114034 139957231949376 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-21:28:27.396055 139957231949376 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281548.sst) /dev/shm/ToplingTemp/Topling-194097-mOnVtT 2024/11/23-21:28:28.595684 139957231949376 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281548.sst): first pass time = 1.20's, 223.774'MB/sec 2024/11/23-21:28:30.132382 139957231949376 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281548.sst): old prealloc_size = 295279001, real_size = 80495856 2024/11/23-21:28:30.132579 139957231949376 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281548.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258859 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.00 avg-zval = 309.03 2024/11/23-21:28:30.132627 139957231949376 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281548.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:28:30.463074 139957231949376 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281548.sst): second pass time = 1.54's, 171.473'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.33's, 251.367'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2498.688'MB/sec (index lex order gen) rebuild zvType time = 0.24's, 0.268'MB/sec write SST data time = 0.09's, 930.042'MB/sec dict compress time = 0.00's, 2688894.000'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 61494.168'MB/sec zip my value time = 1.54's, unzip length = 0.263'GB zip my value throughput = 171.473'MB/sec zip pipeline throughput = 171.473'MB/sec entries = 258859 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 309.03 usrkeys = 258859 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 309.03 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1230 value = 3.2910 dict = 1.00 all = 3.2294 } Zip/UnZip{ index = 0.1404 value = 0.3039 dict = 1.00 all = 0.3097 } ---------------------------- total value len = 9.111879 GB avg = 0.173 KB (by entry num) total key len = 1.445998 GB avg = 0.027 KB total ukey len = 1.000984 GB avg = 0.015 KB total ukey num = 0.065809294 Billion total entry num = 0.052617023 Billion write speed all = 0.233590405 MB/sec (with seq num) write speed all = 0.224277297 MB/sec (without seq num) 2024/11/23-21:28:30.558411 139957231949376 [compaction_job.cc:1948] [default] [JOB 36177] Generated table #281548: 258859 keys, 83122225 bytes, temperature: kWarm 2024/11/23-21:28:30.558510 139957231949376 EVENT_LOG_v1 {"time_micros": 1732368510558448, "cf_name": "default", "job": 36177, "event": "table_file_creation", "file_number": 281548, "file_size": 83122225, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79994848, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177180, "raw_average_key_size": 20, "raw_value_size": 263259123, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 258859, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368507, "oldest_key_time": 0, "file_creation_time": 1732368507, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281548, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:28:30.615357 139957231949376 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281549.sst) /dev/shm/ToplingTemp/Topling-194097-zE86WU 2024/11/23-21:28:31.669306 139957231949376 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281549.sst): first pass time = 1.05's, 254.706'MB/sec 2024/11/23-21:28:33.200845 139957231949376 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281549.sst): old prealloc_size = 295279001, real_size = 81069696 2024/11/23-21:28:33.201047 139957231949376 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281549.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258859 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0806 GB avg-val =1017.00 avg-zval = 311.25 2024/11/23-21:28:33.201086 139957231949376 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281549.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:28:33.522892 139957231949376 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281549.sst): second pass time = 1.53's, 172.038'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.32's, 259.911'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2440.299'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.278'MB/sec write SST data time = 0.09's, 936.521'MB/sec dict compress time = 0.00's, 2689534.000'MB/sec z-dict build time = 0.00's, sample length = 2.690'MB, throughput = 78627.551'MB/sec zip my value time = 1.53's, unzip length = 0.263'GB zip my value throughput = 172.038'MB/sec zip pipeline throughput = 172.038'MB/sec entries = 258859 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 311.25 usrkeys = 258859 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 311.25 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0806 GB dict = 2.69 MB all = 0.0837 GB } UnZip/Zip{ index = 7.1230 value = 3.2675 dict = 1.00 all = 3.2072 } Zip/UnZip{ index = 0.1404 value = 0.3060 dict = 1.00 all = 0.3118 } ---------------------------- total value len = 9.375138 GB avg = 0.177 KB (by entry num) total key len = 1.451175 GB avg = 0.027 KB total ukey len = 1.004091 GB avg = 0.015 KB total ukey num = 0.066068153 Billion total entry num = 0.052875882 Billion write speed all = 0.239513273 MB/sec (with seq num) write speed all = 0.230154981 MB/sec (without seq num) 2024/11/23-21:28:33.618232 139957231949376 [compaction_job.cc:1948] [default] [JOB 36177] Generated table #281549: 258859 keys, 83696689 bytes, temperature: kWarm 2024/11/23-21:28:33.618302 139957231949376 EVENT_LOG_v1 {"time_micros": 1732368513618266, "cf_name": "default", "job": 36177, "event": "table_file_creation", "file_number": 281549, "file_size": 83696689, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 80568688, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177180, "raw_average_key_size": 20, "raw_value_size": 263258944, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 258859, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368510, "oldest_key_time": 0, "file_creation_time": 1732368510, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281549, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:28:33.680272 139957231949376 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281550.sst) /dev/shm/ToplingTemp/Topling-194097-75DQWR 2024/11/23-21:28:35.021468 139957231949376 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281550.sst): first pass time = 1.34's, 200.153'MB/sec 2024/11/23-21:28:36.471717 139957231949376 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281550.sst): old prealloc_size = 295279001, real_size = 80480080 2024/11/23-21:28:36.471896 139957231949376 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281550.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258859 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.00 avg-zval = 308.97 2024/11/23-21:28:36.471940 139957231949376 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281550.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:28:36.793393 139957231949376 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281550.sst): second pass time = 1.45's, 181.711'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.32's, 258.376'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2822.683'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.278'MB/sec write SST data time = 0.09's, 933.000'MB/sec dict compress time = 0.00's, 2689572.000'MB/sec z-dict build time = 0.00's, sample length = 2.690'MB, throughput = 83488.189'MB/sec zip my value time = 1.45's, unzip length = 0.263'GB zip my value throughput = 181.711'MB/sec zip pipeline throughput = 181.711'MB/sec entries = 258859 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 308.97 usrkeys = 258859 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 308.97 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1230 value = 3.2916 dict = 1.00 all = 3.2300 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 9.638396 GB avg = 0.181 KB (by entry num) total key len = 1.456353 GB avg = 0.027 KB total ukey len = 1.007197 GB avg = 0.015 KB total ukey num = 0.066327012 Billion total entry num = 0.053134741 Billion write speed all = 0.245434189 MB/sec (with seq num) write speed all = 0.236030762 MB/sec (without seq num) 2024/11/23-21:28:36.888053 139957231949376 [compaction_job.cc:1948] [default] [JOB 36177] Generated table #281550: 258859 keys, 83107095 bytes, temperature: kWarm 2024/11/23-21:28:36.888128 139957231949376 EVENT_LOG_v1 {"time_micros": 1732368516888089, "cf_name": "default", "job": 36177, "event": "table_file_creation", "file_number": 281550, "file_size": 83107095, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79979072, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177180, "raw_average_key_size": 20, "raw_value_size": 263258636, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 258859, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368513, "oldest_key_time": 0, "file_creation_time": 1732368513, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281550, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:28:36.945187 139957231949376 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281551.sst) /dev/shm/ToplingTemp/Topling-194097-IRczWR 2024/11/23-21:28:38.259708 139957231949376 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281551.sst): first pass time = 1.31's, 204.217'MB/sec 2024/11/23-21:28:39.757382 139957231949376 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281551.sst): old prealloc_size = 295279001, real_size = 80484640 2024/11/23-21:28:39.757567 139957231949376 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281551.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258855 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.01 avg-zval = 308.99 2024/11/23-21:28:39.757609 139957231949376 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281551.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:28:40.080058 139957231949376 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281551.sst): second pass time = 1.50's, 175.931'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.32's, 257.590'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2740.829'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.280'MB/sec write SST data time = 0.09's, 909.250'MB/sec dict compress time = 0.00's, 2689771.000'MB/sec z-dict build time = 0.00's, sample length = 2.690'MB, throughput = 78043.551'MB/sec zip my value time = 1.50's, unzip length = 0.263'GB zip my value throughput = 175.931'MB/sec zip pipeline throughput = 175.931'MB/sec entries = 258855 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.01 avg-zval = 308.99 usrkeys = 258855 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.01 avg-zval = 308.99 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 8 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1229 value = 3.2914 dict = 1.00 all = 3.2298 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 9.901655 GB avg = 0.185 KB (by entry num) total key len = 1.461530 GB avg = 0.027 KB total ukey len = 1.010303 GB avg = 0.015 KB total ukey num = 0.066585867 Billion total entry num = 0.053393596 Billion write speed all = 0.251354153 MB/sec (with seq num) write speed all = 0.241905603 MB/sec (without seq num) 2024/11/23-21:28:40.174835 139957231949376 [compaction_job.cc:1948] [default] [JOB 36177] Generated table #281551: 258855 keys, 83111838 bytes, temperature: kWarm 2024/11/23-21:28:40.174903 139957231949376 EVENT_LOG_v1 {"time_micros": 1732368520174868, "cf_name": "default", "job": 36177, "event": "table_file_creation", "file_number": 281551, "file_size": 83111838, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79983632, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177100, "raw_average_key_size": 20, "raw_value_size": 263258504, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 258855, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368516, "oldest_key_time": 0, "file_creation_time": 1732368516, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281551, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:28:40.233015 139957231949376 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281552.sst) /dev/shm/ToplingTemp/Topling-194097-nONmCT 2024/11/23-21:28:41.646761 139957231949376 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281552.sst): first pass time = 1.41's, 189.882'MB/sec 2024/11/23-21:28:43.096166 139957231949376 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281552.sst): old prealloc_size = 295279001, real_size = 80477248 2024/11/23-21:28:43.096361 139957231949376 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281552.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258861 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1016.99 avg-zval = 308.95 2024/11/23-21:28:43.096401 139957231949376 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281552.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:28:43.418858 139957231949376 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281552.sst): second pass time = 1.45's, 181.793'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.32's, 257.552'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2676.404'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.280'MB/sec write SST data time = 0.09's, 912.834'MB/sec dict compress time = 0.00's, 2689122.000'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 83440.549'MB/sec zip my value time = 1.45's, unzip length = 0.263'GB zip my value throughput = 181.793'MB/sec zip pipeline throughput = 181.793'MB/sec entries = 258861 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1016.99 avg-zval = 308.95 usrkeys = 258861 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1016.99 avg-zval = 308.95 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1230 value = 3.2917 dict = 1.00 all = 3.2301 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 10.164914 GB avg = 0.189 KB (by entry num) total key len = 1.466707 GB avg = 0.027 KB total ukey len = 1.013410 GB avg = 0.015 KB total ukey num = 0.066844728 Billion total entry num = 0.053652457 Billion write speed all = 0.257272971 MB/sec (with seq num) write speed all = 0.247779314 MB/sec (without seq num) 2024/11/23-21:28:43.513911 139957231949376 [compaction_job.cc:1948] [default] [JOB 36177] Generated table #281552: 258861 keys, 83103829 bytes, temperature: kWarm 2024/11/23-21:28:43.513995 139957231949376 EVENT_LOG_v1 {"time_micros": 1732368523513945, "cf_name": "default", "job": 36177, "event": "table_file_creation", "file_number": 281552, "file_size": 83103829, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79976240, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177220, "raw_average_key_size": 20, "raw_value_size": 263258881, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 258861, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368520, "oldest_key_time": 0, "file_creation_time": 1732368520, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281552, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:28:43.568617 139957231949376 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281553.sst) /dev/shm/ToplingTemp/Topling-194097-dOEriU 2024/11/23-21:28:44.986069 139957231949376 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281553.sst): first pass time = 1.42's, 189.385'MB/sec 2024/11/23-21:28:46.455232 139957231949376 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281553.sst): old prealloc_size = 295279001, real_size = 80481328 2024/11/23-21:28:46.455407 139957231949376 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281553.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258855 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.01 avg-zval = 308.98 2024/11/23-21:28:46.455452 139957231949376 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281553.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:28:46.776948 139957231949376 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281553.sst): second pass time = 1.47's, 179.358'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.32's, 258.338'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2919.158'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.278'MB/sec write SST data time = 0.09's, 933.139'MB/sec dict compress time = 0.00's, 2689200.000'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 80293.802'MB/sec zip my value time = 1.47's, unzip length = 0.263'GB zip my value throughput = 179.358'MB/sec zip pipeline throughput = 179.358'MB/sec entries = 258855 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.01 avg-zval = 308.98 usrkeys = 258855 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.01 avg-zval = 308.98 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1229 value = 3.2916 dict = 1.00 all = 3.2300 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 10.428173 GB avg = 0.193 KB (by entry num) total key len = 1.471884 GB avg = 0.027 KB total ukey len = 1.016516 GB avg = 0.015 KB total ukey num = 0.067103583 Billion total entry num = 0.053911312 Billion write speed all = 0.263190809 MB/sec (with seq num) write speed all = 0.253652057 MB/sec (without seq num) 2024/11/23-21:28:46.871871 139957231949376 [compaction_job.cc:1948] [default] [JOB 36177] Generated table #281553: 258855 keys, 83108003 bytes, temperature: kWarm 2024/11/23-21:28:46.871949 139957231949376 EVENT_LOG_v1 {"time_micros": 1732368526871908, "cf_name": "default", "job": 36177, "event": "table_file_creation", "file_number": 281553, "file_size": 83108003, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79980320, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177100, "raw_average_key_size": 20, "raw_value_size": 263259316, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 258855, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368523, "oldest_key_time": 0, "file_creation_time": 1732368523, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281553, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:28:46.929891 139957231949376 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281554.sst) /dev/shm/ToplingTemp/Topling-194097-H8QXHU 2024/11/23-21:28:48.346261 139957231949376 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281554.sst): first pass time = 1.42's, 189.529'MB/sec 2024/11/23-21:28:49.853505 139957231949376 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281554.sst): old prealloc_size = 295279001, real_size = 80481840 2024/11/23-21:28:49.853683 139957231949376 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281554.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258860 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1016.99 avg-zval = 308.97 2024/11/23-21:28:49.853722 139957231949376 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281554.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:28:50.177070 139957231949376 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281554.sst): second pass time = 1.51's, 174.843'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.32's, 256.884'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2811.147'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.279'MB/sec write SST data time = 0.09's, 907.646'MB/sec dict compress time = 0.00's, 2688896.000'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 79567.260'MB/sec zip my value time = 1.51's, unzip length = 0.263'GB zip my value throughput = 174.843'MB/sec zip pipeline throughput = 174.843'MB/sec entries = 258860 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1016.99 avg-zval = 308.97 usrkeys = 258860 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1016.99 avg-zval = 308.97 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1230 value = 3.2915 dict = 1.00 all = 3.2300 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 10.691432 GB avg = 0.197 KB (by entry num) total key len = 1.477061 GB avg = 0.027 KB total ukey len = 1.019622 GB avg = 0.015 KB total ukey num = 0.067362443 Billion total entry num = 0.054170172 Billion write speed all = 0.269107513 MB/sec (with seq num) write speed all = 0.259523681 MB/sec (without seq num) 2024/11/23-21:28:50.271498 139957231949376 [compaction_job.cc:1948] [default] [JOB 36177] Generated table #281554: 258860 keys, 83108211 bytes, temperature: kWarm 2024/11/23-21:28:50.271566 139957231949376 EVENT_LOG_v1 {"time_micros": 1732368530271531, "cf_name": "default", "job": 36177, "event": "table_file_creation", "file_number": 281554, "file_size": 83108211, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79980832, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177200, "raw_average_key_size": 20, "raw_value_size": 263258972, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 258860, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368526, "oldest_key_time": 0, "file_creation_time": 1732368526, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281554, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:28:50.326809 139957231949376 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281555.sst) /dev/shm/ToplingTemp/Topling-194097-oPWDpT 2024/11/23-21:28:51.507693 139957231949376 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281555.sst): first pass time = 1.18's, 227.327'MB/sec 2024/11/23-21:28:53.004650 139957231949376 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281555.sst): old prealloc_size = 295279001, real_size = 80473856 2024/11/23-21:28:53.004840 139957231949376 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281555.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258863 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1016.98 avg-zval = 308.94 2024/11/23-21:28:53.004879 139957231949376 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281555.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:28:53.333880 139957231949376 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281555.sst): second pass time = 1.50's, 176.054'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.33's, 252.429'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2635.722'MB/sec (index lex order gen) rebuild zvType time = 0.24's, 0.275'MB/sec write SST data time = 0.09's, 885.497'MB/sec dict compress time = 0.00's, 2689559.000'MB/sec z-dict build time = 0.00's, sample length = 2.690'MB, throughput = 86804.770'MB/sec zip my value time = 1.50's, unzip length = 0.263'GB zip my value throughput = 176.054'MB/sec zip pipeline throughput = 176.054'MB/sec entries = 258863 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1016.98 avg-zval = 308.94 usrkeys = 258863 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1016.98 avg-zval = 308.94 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1231 value = 3.2919 dict = 1.00 all = 3.2302 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 10.954691 GB avg = 0.201 KB (by entry num) total key len = 1.482239 GB avg = 0.027 KB total ukey len = 1.022728 GB avg = 0.015 KB total ukey num = 0.067621306 Billion total entry num = 0.054429035 Billion write speed all = 0.275024804 MB/sec (with seq num) write speed all = 0.265395846 MB/sec (without seq num) 2024/11/23-21:28:53.428958 139957231949376 [compaction_job.cc:1948] [default] [JOB 36177] Generated table #281555: 258863 keys, 83100874 bytes, temperature: kWarm 2024/11/23-21:28:53.429042 139957231949376 EVENT_LOG_v1 {"time_micros": 1732368533429006, "cf_name": "default", "job": 36177, "event": "table_file_creation", "file_number": 281555, "file_size": 83100874, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79972848, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177260, "raw_average_key_size": 20, "raw_value_size": 263258800, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 258863, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368530, "oldest_key_time": 0, "file_creation_time": 1732368530, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281555, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:28:53.485413 139957231949376 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281556.sst) /dev/shm/ToplingTemp/Topling-194097-548pXU 2024/11/23-21:28:54.846902 139957231949376 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281556.sst): first pass time = 1.36's, 197.170'MB/sec 2024/11/23-21:28:56.305992 139957231949376 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281556.sst): old prealloc_size = 295279001, real_size = 80485664 2024/11/23-21:28:56.306174 139957231949376 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281556.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258854 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.02 avg-zval = 309.00 2024/11/23-21:28:56.306223 139957231949376 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281556.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:28:56.634054 139957231949376 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281556.sst): second pass time = 1.46's, 180.581'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.33's, 253.348'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2751.950'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.276'MB/sec write SST data time = 0.09's, 892.502'MB/sec dict compress time = 0.00's, 2689076.000'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 86044.925'MB/sec zip my value time = 1.46's, unzip length = 0.263'GB zip my value throughput = 180.581'MB/sec zip pipeline throughput = 180.581'MB/sec entries = 258854 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.02 avg-zval = 309.00 usrkeys = 258854 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.02 avg-zval = 309.00 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 8 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1229 value = 3.2914 dict = 1.00 all = 3.2298 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 11.217950 GB avg = 0.205 KB (by entry num) total key len = 1.487416 GB avg = 0.027 KB total ukey len = 1.025835 GB avg = 0.015 KB total ukey num = 0.067880160 Billion total entry num = 0.054687889 Billion write speed all = 0.280940370 MB/sec (with seq num) write speed all = 0.271266324 MB/sec (without seq num) 2024/11/23-21:28:56.737604 139957231949376 [compaction_job.cc:1948] [default] [JOB 36177] Generated table #281556: 258854 keys, 83112167 bytes, temperature: kWarm 2024/11/23-21:28:56.737679 139957231949376 EVENT_LOG_v1 {"time_micros": 1732368536737640, "cf_name": "default", "job": 36177, "event": "table_file_creation", "file_number": 281556, "file_size": 83112167, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79984656, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177080, "raw_average_key_size": 20, "raw_value_size": 263258565, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 258854, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368533, "oldest_key_time": 0, "file_creation_time": 1732368533, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281556, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:28:56.799473 139957231949376 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281557.sst) /dev/shm/ToplingTemp/Topling-194097-eju52T 2024/11/23-21:28:58.171684 139957231949376 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281557.sst): first pass time = 1.37's, 195.630'MB/sec 2024/11/23-21:28:59.656418 139957231949376 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281557.sst): old prealloc_size = 295279001, real_size = 80481328 2024/11/23-21:28:59.656592 139957231949376 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281557.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258854 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.02 avg-zval = 308.98 2024/11/23-21:28:59.656633 139957231949376 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281557.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:28:59.983357 139957231949376 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281557.sst): second pass time = 1.48's, 177.492'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.33's, 254.217'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2937.979'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.277'MB/sec write SST data time = 0.09's, 892.027'MB/sec dict compress time = 0.00's, 2688749.000'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 83981.416'MB/sec zip my value time = 1.48's, unzip length = 0.263'GB zip my value throughput = 177.492'MB/sec zip pipeline throughput = 177.492'MB/sec entries = 258854 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.02 avg-zval = 308.98 usrkeys = 258854 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.02 avg-zval = 308.98 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1229 value = 3.2915 dict = 1.00 all = 3.2300 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 11.481208 GB avg = 0.209 KB (by entry num) total key len = 1.492593 GB avg = 0.027 KB total ukey len = 1.028941 GB avg = 0.015 KB total ukey num = 0.068139014 Billion total entry num = 0.054946743 Billion write speed all = 0.286854765 MB/sec (with seq num) write speed all = 0.277135648 MB/sec (without seq num) 2024/11/23-21:29:00.082226 139957231949376 [compaction_job.cc:1948] [default] [JOB 36177] Generated table #281557: 258854 keys, 83107552 bytes, temperature: kWarm 2024/11/23-21:29:00.082294 139957231949376 EVENT_LOG_v1 {"time_micros": 1732368540082260, "cf_name": "default", "job": 36177, "event": "table_file_creation", "file_number": 281557, "file_size": 83107552, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79980320, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177080, "raw_average_key_size": 20, "raw_value_size": 263258756, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 258854, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368536, "oldest_key_time": 0, "file_creation_time": 1732368536, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281557, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:29:00.138732 139957231949376 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281558.sst) /dev/shm/ToplingTemp/Topling-194097-TzPjfW 2024/11/23-21:29:01.245118 139957231949376 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281558.sst): first pass time = 1.11's, 242.634'MB/sec 2024/11/23-21:29:02.874476 139957231949376 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281558.sst): old prealloc_size = 295279001, real_size = 80481424 2024/11/23-21:29:02.874667 139957231949376 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281558.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258853 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.02 avg-zval = 308.98 2024/11/23-21:29:02.874711 139957231949376 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281558.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:29:03.216731 139957231949376 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281558.sst): second pass time = 1.63's, 161.742'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.34's, 242.824'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2621.541'MB/sec (index lex order gen) rebuild zvType time = 0.24's, 0.264'MB/sec write SST data time = 0.10's, 855.591'MB/sec dict compress time = 0.00's, 2688828.000'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 85046.432'MB/sec zip my value time = 1.63's, unzip length = 0.263'GB zip my value throughput = 161.742'MB/sec zip pipeline throughput = 161.742'MB/sec entries = 258853 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.02 avg-zval = 308.98 usrkeys = 258853 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.02 avg-zval = 308.98 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 8 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1228 value = 3.2915 dict = 1.00 all = 3.2300 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 11.744467 GB avg = 0.213 KB (by entry num) total key len = 1.497770 GB avg = 0.027 KB total ukey len = 1.032047 GB avg = 0.015 KB total ukey num = 0.068397867 Billion total entry num = 0.055205596 Billion write speed all = 0.292769041 MB/sec (with seq num) write speed all = 0.283004836 MB/sec (without seq num) 2024/11/23-21:29:03.314451 139957231949376 [compaction_job.cc:1948] [default] [JOB 36177] Generated table #281558: 258853 keys, 83107695 bytes, temperature: kWarm 2024/11/23-21:29:03.314510 139957231949376 EVENT_LOG_v1 {"time_micros": 1732368543314477, "cf_name": "default", "job": 36177, "event": "table_file_creation", "file_number": 281558, "file_size": 83107695, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79980416, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177060, "raw_average_key_size": 20, "raw_value_size": 263259095, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 258853, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368540, "oldest_key_time": 0, "file_creation_time": 1732368540, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281558, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:29:03.407913 139957231949376 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281559.sst) /dev/shm/ToplingTemp/Topling-194097-YicSZU 2024/11/23-21:29:04.564622 139957231949376 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281559.sst): first pass time = 1.16's, 232.076'MB/sec 2024/11/23-21:29:06.984002 139957231949376 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281559.sst): old prealloc_size = 295279001, real_size = 80480880 2024/11/23-21:29:06.984237 139957231949376 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281559.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258854 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.02 avg-zval = 308.98 2024/11/23-21:29:06.984288 139957231949376 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281559.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:29:07.582102 139957231949376 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281559.sst): second pass time = 2.42's, 108.896'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.60's, 138.959'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2073.813'MB/sec (index lex order gen) rebuild zvType time = 0.46's, 0.140'MB/sec write SST data time = 0.14's, 609.627'MB/sec dict compress time = 0.00's, 2689180.000'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 74112.719'MB/sec zip my value time = 2.42's, unzip length = 0.263'GB zip my value throughput = 108.896'MB/sec zip pipeline throughput = 144.235'MB/sec entries = 258854 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.02 avg-zval = 308.98 usrkeys = 258854 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.02 avg-zval = 308.98 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1229 value = 3.2916 dict = 1.00 all = 3.2300 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 12.007726 GB avg = 0.216 KB (by entry num) total key len = 1.502947 GB avg = 0.027 KB total ukey len = 1.035153 GB avg = 0.015 KB total ukey num = 0.068656721 Billion total entry num = 0.055464450 Billion write speed all = 0.298674988 MB/sec (with seq num) write speed all = 0.288865947 MB/sec (without seq num) 2024/11/23-21:29:07.688776 139957231949376 [compaction_job.cc:1948] [default] [JOB 36177] Generated table #281559: 258854 keys, 83107535 bytes, temperature: kWarm 2024/11/23-21:29:07.688865 139957231949376 EVENT_LOG_v1 {"time_micros": 1732368547688818, "cf_name": "default", "job": 36177, "event": "table_file_creation", "file_number": 281559, "file_size": 83107535, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79979872, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177080, "raw_average_key_size": 20, "raw_value_size": 263258656, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 258854, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368543, "oldest_key_time": 0, "file_creation_time": 1732368543, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281559, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:29:07.847759 139957231949376 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281560.sst) /dev/shm/ToplingTemp/Topling-194097-MO8iyT 2024/11/23-21:29:09.070637 139957231949376 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281560.sst): first pass time = 1.22's, 219.518'MB/sec 2024/11/23-21:29:11.156758 139957231949376 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281560.sst): old prealloc_size = 295279001, real_size = 80474064 2024/11/23-21:29:11.156924 139957231949376 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281560.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258862 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1016.98 avg-zval = 308.94 2024/11/23-21:29:11.156957 139957231949376 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281560.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:29:11.518103 139957231949376 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281560.sst): second pass time = 2.08's, 126.281'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.36's, 229.982'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2993.315'MB/sec (index lex order gen) rebuild zvType time = 0.26's, 0.246'MB/sec write SST data time = 0.10's, 849.961'MB/sec dict compress time = 0.00's, 2689061.000'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 94102.079'MB/sec zip my value time = 2.08's, unzip length = 0.263'GB zip my value throughput = 126.281'MB/sec zip pipeline throughput = 126.281'MB/sec entries = 258862 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1016.98 avg-zval = 308.94 usrkeys = 258862 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1016.98 avg-zval = 308.94 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1231 value = 3.2918 dict = 1.00 all = 3.2303 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 12.270984 GB avg = 0.220 KB (by entry num) total key len = 1.508124 GB avg = 0.027 KB total ukey len = 1.038260 GB avg = 0.015 KB total ukey num = 0.068915583 Billion total entry num = 0.055723312 Billion write speed all = 0.304582685 MB/sec (with seq num) write speed all = 0.294728721 MB/sec (without seq num) 2024/11/23-21:29:11.648219 139957231949376 [compaction_job.cc:1948] [default] [JOB 36177] Generated table #281560: 258862 keys, 83100568 bytes, temperature: kWarm 2024/11/23-21:29:11.648271 139957231949376 EVENT_LOG_v1 {"time_micros": 1732368551648240, "cf_name": "default", "job": 36177, "event": "table_file_creation", "file_number": 281560, "file_size": 83100568, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79973056, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177240, "raw_average_key_size": 20, "raw_value_size": 263258445, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 258862, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368547, "oldest_key_time": 0, "file_creation_time": 1732368547, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281560, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:29:11.723460 139957231949376 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281561.sst) /dev/shm/ToplingTemp/Topling-194097-JtJUqS 2024/11/23-21:29:12.951466 139957231949376 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281561.sst): first pass time = 1.23's, 218.600'MB/sec 2024/11/23-21:29:14.783464 139957231949376 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281561.sst): old prealloc_size = 295279001, real_size = 80486384 2024/11/23-21:29:14.783698 139957231949376 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281561.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258854 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.02 avg-zval = 309.00 2024/11/23-21:29:14.783752 139957231949376 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281561.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:29:15.184204 139957231949376 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281561.sst): second pass time = 1.83's, 143.852'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.40's, 207.412'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2068.816'MB/sec (index lex order gen) rebuild zvType time = 0.30's, 0.216'MB/sec write SST data time = 0.10's, 824.230'MB/sec dict compress time = 0.00's, 2688698.000'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 84150.668'MB/sec zip my value time = 1.83's, unzip length = 0.263'GB zip my value throughput = 143.852'MB/sec zip pipeline throughput = 155.135'MB/sec entries = 258854 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.02 avg-zval = 309.00 usrkeys = 258854 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.02 avg-zval = 309.00 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1229 value = 3.2913 dict = 1.00 all = 3.2298 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 12.534243 GB avg = 0.224 KB (by entry num) total key len = 1.513301 GB avg = 0.027 KB total ukey len = 1.041366 GB avg = 0.015 KB total ukey num = 0.069174437 Billion total entry num = 0.055982166 Billion write speed all = 0.310491204 MB/sec (with seq num) write speed all = 0.300592266 MB/sec (without seq num) 2024/11/23-21:29:15.324000 139957231949376 [compaction_job.cc:1948] [default] [JOB 36177] Generated table #281561: 258854 keys, 83112557 bytes, temperature: kWarm 2024/11/23-21:29:15.324068 139957231949376 EVENT_LOG_v1 {"time_micros": 1732368555324032, "cf_name": "default", "job": 36177, "event": "table_file_creation", "file_number": 281561, "file_size": 83112557, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79985376, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177080, "raw_average_key_size": 20, "raw_value_size": 263258470, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 258854, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368551, "oldest_key_time": 0, "file_creation_time": 1732368551, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281561, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:29:15.383290 139957231949376 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281562.sst) /dev/shm/ToplingTemp/Topling-194097-vvjxrS 2024/11/23-21:29:16.799180 139957231949376 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281562.sst): first pass time = 1.42's, 189.592'MB/sec 2024/11/23-21:29:18.342455 139957231949376 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281562.sst): old prealloc_size = 295279001, real_size = 80477424 2024/11/23-21:29:18.342621 139957231949376 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281562.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258856 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.01 avg-zval = 308.96 2024/11/23-21:29:18.342656 139957231949376 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281562.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:29:18.692046 139957231949376 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281562.sst): second pass time = 1.54's, 170.722'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.35's, 237.748'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3042.983'MB/sec (index lex order gen) rebuild zvType time = 0.25's, 0.257'MB/sec write SST data time = 0.10's, 852.282'MB/sec dict compress time = 0.00's, 2689355.000'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 84305.799'MB/sec zip my value time = 1.54's, unzip length = 0.263'GB zip my value throughput = 170.722'MB/sec zip pipeline throughput = 170.722'MB/sec entries = 258856 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.01 avg-zval = 308.96 usrkeys = 258856 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.01 avg-zval = 308.96 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1229 value = 3.2917 dict = 1.00 all = 3.2301 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 12.797502 GB avg = 0.228 KB (by entry num) total key len = 1.518478 GB avg = 0.027 KB total ukey len = 1.044472 GB avg = 0.015 KB total ukey num = 0.069433293 Billion total entry num = 0.056241022 Billion write speed all = 0.316399888 MB/sec (with seq num) write speed all = 0.306455949 MB/sec (without seq num) 2024/11/23-21:29:18.793757 139957231949376 [compaction_job.cc:1948] [default] [JOB 36177] Generated table #281562: 258856 keys, 83104254 bytes, temperature: kWarm 2024/11/23-21:29:18.793852 139957231949376 EVENT_LOG_v1 {"time_micros": 1732368558793799, "cf_name": "default", "job": 36177, "event": "table_file_creation", "file_number": 281562, "file_size": 83104254, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79976416, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177120, "raw_average_key_size": 20, "raw_value_size": 263259158, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 258856, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368555, "oldest_key_time": 0, "file_creation_time": 1732368555, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281562, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:29:18.853850 139957231949376 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281563.sst) /dev/shm/ToplingTemp/Topling-194097-uOjTvW 2024/11/23-21:29:20.087756 139957231949376 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281563.sst): first pass time = 1.23's, 217.557'MB/sec 2024/11/23-21:29:21.880945 139957231949376 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281563.sst): old prealloc_size = 295279001, real_size = 80475088 2024/11/23-21:29:21.881144 139957231949376 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281563.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258861 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1016.99 avg-zval = 308.95 2024/11/23-21:29:21.881184 139957231949376 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281563.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:29:22.210482 139957231949376 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281563.sst): second pass time = 1.79's, 146.942'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.33's, 252.196'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2722.010'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.279'MB/sec write SST data time = 0.10's, 854.466'MB/sec dict compress time = 0.00's, 2689283.000'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 82943.682'MB/sec zip my value time = 1.79's, unzip length = 0.263'GB zip my value throughput = 146.942'MB/sec zip pipeline throughput = 146.942'MB/sec entries = 258861 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1016.99 avg-zval = 308.95 usrkeys = 258861 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1016.99 avg-zval = 308.95 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1230 value = 3.2918 dict = 1.00 all = 3.2302 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 13.060761 GB avg = 0.231 KB (by entry num) total key len = 1.523655 GB avg = 0.027 KB total ukey len = 1.047579 GB avg = 0.015 KB total ukey num = 0.069692154 Billion total entry num = 0.056499883 Billion write speed all = 0.322307582 MB/sec (with seq num) write speed all = 0.312318651 MB/sec (without seq num) 2024/11/23-21:29:22.309437 139957231949376 [compaction_job.cc:1948] [default] [JOB 36177] Generated table #281563: 258861 keys, 83101814 bytes, temperature: kWarm 2024/11/23-21:29:22.309524 139957231949376 EVENT_LOG_v1 {"time_micros": 1732368562309480, "cf_name": "default", "job": 36177, "event": "table_file_creation", "file_number": 281563, "file_size": 83101814, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79974080, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177220, "raw_average_key_size": 20, "raw_value_size": 263259169, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 258861, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368558, "oldest_key_time": 0, "file_creation_time": 1732368558, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281563, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:29:22.365674 139957231949376 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281564.sst) /dev/shm/ToplingTemp/Topling-194097-DEo85R 2024/11/23-21:29:23.539714 139957231949376 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281564.sst): first pass time = 1.17's, 228.651'MB/sec 2024/11/23-21:29:25.348183 139957231949376 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281564.sst): old prealloc_size = 295279001, real_size = 80475632 2024/11/23-21:29:25.348364 139957231949376 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281564.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258858 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.00 avg-zval = 308.95 2024/11/23-21:29:25.348404 139957231949376 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281564.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:29:25.670786 139957231949376 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281564.sst): second pass time = 1.81's, 145.682'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.32's, 257.617'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2984.179'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.280'MB/sec write SST data time = 0.09's, 913.227'MB/sec dict compress time = 0.00's, 2688291.000'MB/sec z-dict build time = 0.00's, sample length = 2.688'MB, throughput = 78220.758'MB/sec zip my value time = 1.81's, unzip length = 0.263'GB zip my value throughput = 145.682'MB/sec zip pipeline throughput = 178.516'MB/sec entries = 258858 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 308.95 usrkeys = 258858 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 308.95 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1230 value = 3.2918 dict = 1.00 all = 3.2302 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 13.324021 GB avg = 0.235 KB (by entry num) total key len = 1.528833 GB avg = 0.027 KB total ukey len = 1.050685 GB avg = 0.015 KB total ukey num = 0.069951012 Billion total entry num = 0.056758741 Billion write speed all = 0.328214781 MB/sec (with seq num) write speed all = 0.318180853 MB/sec (without seq num) 2024/11/23-21:29:25.769366 139957231949376 [compaction_job.cc:1948] [default] [JOB 36177] Generated table #281564: 258858 keys, 83101398 bytes, temperature: kWarm 2024/11/23-21:29:25.769433 139957231949376 EVENT_LOG_v1 {"time_micros": 1732368565769396, "cf_name": "default", "job": 36177, "event": "table_file_creation", "file_number": 281564, "file_size": 83101398, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79974624, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177160, "raw_average_key_size": 20, "raw_value_size": 263259289, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 258858, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368562, "oldest_key_time": 0, "file_creation_time": 1732368562, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281564, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:29:25.824639 139957231949376 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281565.sst) /dev/shm/ToplingTemp/Topling-194097-X10NyS 2024/11/23-21:29:26.891916 139957231949376 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281565.sst): first pass time = 1.07's, 251.523'MB/sec 2024/11/23-21:29:28.626803 139957231949376 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281565.sst): old prealloc_size = 295279001, real_size = 80481456 2024/11/23-21:29:28.627015 139957231949376 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281565.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258853 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.02 avg-zval = 308.98 2024/11/23-21:29:28.627056 139957231949376 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281565.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:29:28.952304 139957231949376 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281565.sst): second pass time = 1.73's, 151.884'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.33's, 255.340'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2331.590'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.278'MB/sec write SST data time = 0.09's, 896.886'MB/sec dict compress time = 0.00's, 2689500.000'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 88589.875'MB/sec zip my value time = 1.73's, unzip length = 0.263'GB zip my value throughput = 151.884'MB/sec zip pipeline throughput = 151.884'MB/sec entries = 258853 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.02 avg-zval = 308.98 usrkeys = 258853 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.02 avg-zval = 308.98 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1228 value = 3.2915 dict = 1.00 all = 3.2299 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 13.587279 GB avg = 0.238 KB (by entry num) total key len = 1.534010 GB avg = 0.027 KB total ukey len = 1.053791 GB avg = 0.015 KB total ukey num = 0.070209865 Billion total entry num = 0.057017594 Billion write speed all = 0.334122375 MB/sec (with seq num) write speed all = 0.324043417 MB/sec (without seq num) 2024/11/23-21:29:29.048105 139957231949376 [compaction_job.cc:1948] [default] [JOB 36177] Generated table #281565: 258853 keys, 83108431 bytes, temperature: kWarm 2024/11/23-21:29:29.048174 139957231949376 EVENT_LOG_v1 {"time_micros": 1732368569048138, "cf_name": "default", "job": 36177, "event": "table_file_creation", "file_number": 281565, "file_size": 83108431, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79980448, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177060, "raw_average_key_size": 20, "raw_value_size": 263258399, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 258853, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368565, "oldest_key_time": 0, "file_creation_time": 1732368565, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281565, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:29:29.105022 139957231949376 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281566.sst) /dev/shm/ToplingTemp/Topling-194097-70btIU 2024/11/23-21:29:30.432427 139957231949376 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281566.sst): first pass time = 1.33's, 202.233'MB/sec 2024/11/23-21:29:31.887064 139957231949376 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281566.sst): old prealloc_size = 295279001, real_size = 80475648 2024/11/23-21:29:31.887263 139957231949376 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281566.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258860 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1016.99 avg-zval = 308.95 2024/11/23-21:29:31.887303 139957231949376 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281566.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:29:32.209784 139957231949376 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281566.sst): second pass time = 1.45's, 181.169'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.32's, 257.527'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2479.452'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.277'MB/sec write SST data time = 0.09's, 931.874'MB/sec dict compress time = 0.00's, 2689566.000'MB/sec z-dict build time = 0.00's, sample length = 2.690'MB, throughput = 79615.357'MB/sec zip my value time = 1.45's, unzip length = 0.263'GB zip my value throughput = 181.169'MB/sec zip pipeline throughput = 181.169'MB/sec entries = 258860 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1016.99 avg-zval = 308.95 usrkeys = 258860 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1016.99 avg-zval = 308.95 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1230 value = 3.2918 dict = 1.00 all = 3.2302 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 13.850537 GB avg = 0.242 KB (by entry num) total key len = 1.539187 GB avg = 0.027 KB total ukey len = 1.056897 GB avg = 0.015 KB total ukey num = 0.070468725 Billion total entry num = 0.057276454 Billion write speed all = 0.340029295 MB/sec (with seq num) write speed all = 0.329905308 MB/sec (without seq num) 2024/11/23-21:29:32.304920 139957231949376 [compaction_job.cc:1948] [default] [JOB 36177] Generated table #281566: 258860 keys, 83102673 bytes, temperature: kWarm 2024/11/23-21:29:32.305003 139957231949376 EVENT_LOG_v1 {"time_micros": 1732368572304955, "cf_name": "default", "job": 36177, "event": "table_file_creation", "file_number": 281566, "file_size": 83102673, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79974640, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177200, "raw_average_key_size": 20, "raw_value_size": 263258399, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 258860, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368569, "oldest_key_time": 0, "file_creation_time": 1732368569, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281566, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:29:32.367460 139957231949376 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281567.sst) /dev/shm/ToplingTemp/Topling-194097-1PefOV 2024/11/23-21:29:33.372070 139957231949376 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281567.sst): first pass time = 1.00's, 267.215'MB/sec 2024/11/23-21:29:34.794941 139957231949376 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281567.sst): old prealloc_size = 295279001, real_size = 80485264 2024/11/23-21:29:34.795150 139957231949376 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281567.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258851 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.03 avg-zval = 309.00 2024/11/23-21:29:34.795187 139957231949376 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281567.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:29:35.118426 139957231949376 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281567.sst): second pass time = 1.42's, 185.211'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.32's, 256.941'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2646.615'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.280'MB/sec write SST data time = 0.09's, 905.067'MB/sec dict compress time = 0.00's, 2688325.000'MB/sec z-dict build time = 0.00's, sample length = 2.688'MB, throughput = 81496.499'MB/sec zip my value time = 1.42's, unzip length = 0.263'GB zip my value throughput = 185.211'MB/sec zip pipeline throughput = 185.211'MB/sec entries = 258851 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.03 avg-zval = 309.00 usrkeys = 258851 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.03 avg-zval = 309.00 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1228 value = 3.2914 dict = 1.00 all = 3.2298 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 14.113796 GB avg = 0.245 KB (by entry num) total key len = 1.544364 GB avg = 0.027 KB total ukey len = 1.060004 GB avg = 0.015 KB total ukey num = 0.070727576 Billion total entry num = 0.057535305 Billion write speed all = 0.345938031 MB/sec (with seq num) write speed all = 0.335768944 MB/sec (without seq num) 2024/11/23-21:29:35.215705 139957231949376 [compaction_job.cc:1948] [default] [JOB 36177] Generated table #281567: 258851 keys, 83111032 bytes, temperature: kWarm 2024/11/23-21:29:35.215775 139957231949376 EVENT_LOG_v1 {"time_micros": 1732368575215740, "cf_name": "default", "job": 36177, "event": "table_file_creation", "file_number": 281567, "file_size": 83111032, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79984256, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177020, "raw_average_key_size": 20, "raw_value_size": 263258561, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 258851, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368572, "oldest_key_time": 0, "file_creation_time": 1732368572, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281567, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:29:35.273911 139957231949376 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281568.sst) /dev/shm/ToplingTemp/Topling-194097-Lgz9WV 2024/11/23-21:29:36.350894 139957231949376 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281568.sst): first pass time = 1.08's, 249.257'MB/sec 2024/11/23-21:29:37.800439 139957231949376 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281568.sst): old prealloc_size = 295279001, real_size = 80481264 2024/11/23-21:29:37.800640 139957231949376 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281568.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258859 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.00 avg-zval = 308.97 2024/11/23-21:29:37.800678 139957231949376 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281568.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:29:38.124544 139957231949376 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281568.sst): second pass time = 1.45's, 181.793'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.32's, 256.442'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2447.310'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.278'MB/sec write SST data time = 0.09's, 911.757'MB/sec dict compress time = 0.00's, 2689193.000'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 80133.288'MB/sec zip my value time = 1.45's, unzip length = 0.263'GB zip my value throughput = 181.793'MB/sec zip pipeline throughput = 181.793'MB/sec entries = 258859 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 308.97 usrkeys = 258859 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 308.97 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1230 value = 3.2915 dict = 1.00 all = 3.2300 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 14.377054 GB avg = 0.249 KB (by entry num) total key len = 1.549541 GB avg = 0.027 KB total ukey len = 1.063110 GB avg = 0.015 KB total ukey num = 0.070986435 Billion total entry num = 0.057794164 Billion write speed all = 0.351845250 MB/sec (with seq num) write speed all = 0.341631089 MB/sec (without seq num) 2024/11/23-21:29:38.220228 139957231949376 [compaction_job.cc:1948] [default] [JOB 36177] Generated table #281568: 258859 keys, 83107932 bytes, temperature: kWarm 2024/11/23-21:29:38.220295 139957231949376 EVENT_LOG_v1 {"time_micros": 1732368578220261, "cf_name": "default", "job": 36177, "event": "table_file_creation", "file_number": 281568, "file_size": 83107932, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79980256, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177180, "raw_average_key_size": 20, "raw_value_size": 263258374, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 258859, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368575, "oldest_key_time": 0, "file_creation_time": 1732368575, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281568, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:29:38.276600 139957231949376 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281569.sst) /dev/shm/ToplingTemp/Topling-194097-mrxOLS 2024/11/23-21:29:39.541712 139957231949376 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281569.sst): first pass time = 1.27's, 212.190'MB/sec 2024/11/23-21:29:40.995317 139957231949376 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281569.sst): old prealloc_size = 295279001, real_size = 80479472 2024/11/23-21:29:40.995497 139957231949376 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281569.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258856 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.01 avg-zval = 308.97 2024/11/23-21:29:40.995534 139957231949376 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281569.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:29:41.319954 139957231949376 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281569.sst): second pass time = 1.45's, 181.267'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.32's, 256.016'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2780.941'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.278'MB/sec write SST data time = 0.09's, 907.157'MB/sec dict compress time = 0.00's, 2689175.000'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 66514.346'MB/sec zip my value time = 1.45's, unzip length = 0.263'GB zip my value throughput = 181.267'MB/sec zip pipeline throughput = 181.267'MB/sec entries = 258856 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.01 avg-zval = 308.97 usrkeys = 258856 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.01 avg-zval = 308.97 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1229 value = 3.2916 dict = 1.00 all = 3.2300 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 14.640313 GB avg = 0.252 KB (by entry num) total key len = 1.554718 GB avg = 0.027 KB total ukey len = 1.066216 GB avg = 0.015 KB total ukey num = 0.071245291 Billion total entry num = 0.058053020 Billion write speed all = 0.357750189 MB/sec (with seq num) write speed all = 0.347491003 MB/sec (without seq num) 2024/11/23-21:29:41.415340 139957231949376 [compaction_job.cc:1948] [default] [JOB 36177] Generated table #281569: 258856 keys, 83106122 bytes, temperature: kWarm 2024/11/23-21:29:41.415408 139957231949376 EVENT_LOG_v1 {"time_micros": 1732368581415373, "cf_name": "default", "job": 36177, "event": "table_file_creation", "file_number": 281569, "file_size": 83106122, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79978464, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177120, "raw_average_key_size": 20, "raw_value_size": 263258462, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 258856, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368578, "oldest_key_time": 0, "file_creation_time": 1732368578, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281569, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:29:41.473810 139957231949376 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281570.sst) /dev/shm/ToplingTemp/Topling-194097-sNJnCS 2024/11/23-21:29:42.797531 139957231949376 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281570.sst): first pass time = 1.32's, 202.795'MB/sec 2024/11/23-21:29:44.267615 139957231949376 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281570.sst): old prealloc_size = 295279001, real_size = 80478048 2024/11/23-21:29:44.267804 139957231949376 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281570.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258857 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.01 avg-zval = 308.96 2024/11/23-21:29:44.267842 139957231949376 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281570.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:29:44.587158 139957231949376 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281570.sst): second pass time = 1.47's, 179.251'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.32's, 260.090'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2632.413'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.280'MB/sec write SST data time = 0.09's, 941.244'MB/sec dict compress time = 0.00's, 2688524.000'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 74824.636'MB/sec zip my value time = 1.47's, unzip length = 0.263'GB zip my value throughput = 179.251'MB/sec zip pipeline throughput = 179.251'MB/sec entries = 258857 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.01 avg-zval = 308.96 usrkeys = 258857 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.01 avg-zval = 308.96 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 8 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1229 value = 3.2917 dict = 1.00 all = 3.2301 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 14.903572 GB avg = 0.256 KB (by entry num) total key len = 1.559895 GB avg = 0.027 KB total ukey len = 1.069323 GB avg = 0.015 KB total ukey num = 0.071504148 Billion total entry num = 0.058311877 Billion write speed all = 0.363653734 MB/sec (with seq num) write speed all = 0.353349546 MB/sec (without seq num) 2024/11/23-21:29:44.682878 139957231949376 [compaction_job.cc:1948] [default] [JOB 36177] Generated table #281570: 258857 keys, 83103999 bytes, temperature: kWarm 2024/11/23-21:29:44.682947 139957231949376 EVENT_LOG_v1 {"time_micros": 1732368584682912, "cf_name": "default", "job": 36177, "event": "table_file_creation", "file_number": 281570, "file_size": 83103999, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79977040, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177140, "raw_average_key_size": 20, "raw_value_size": 263259200, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 258857, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368581, "oldest_key_time": 0, "file_creation_time": 1732368581, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281570, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:29:44.744299 139957231949376 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281571.sst) /dev/shm/ToplingTemp/Topling-194097-7juoGT 2024/11/23-21:29:46.017392 139957231949376 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281571.sst): first pass time = 1.27's, 210.859'MB/sec 2024/11/23-21:29:47.480833 139957231949376 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281571.sst): old prealloc_size = 295279001, real_size = 80474144 2024/11/23-21:29:47.481030 139957231949376 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281571.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258862 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1016.98 avg-zval = 308.94 2024/11/23-21:29:47.481069 139957231949376 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281571.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:29:47.803418 139957231949376 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281571.sst): second pass time = 1.46's, 180.058'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.32's, 257.626'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2504.341'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.277'MB/sec write SST data time = 0.09's, 937.129'MB/sec dict compress time = 0.00's, 2689122.000'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 84156.037'MB/sec zip my value time = 1.46's, unzip length = 0.263'GB zip my value throughput = 180.058'MB/sec zip pipeline throughput = 180.058'MB/sec entries = 258862 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1016.98 avg-zval = 308.94 usrkeys = 258862 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1016.98 avg-zval = 308.94 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 8 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1231 value = 3.2918 dict = 1.00 all = 3.2302 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 15.166830 GB avg = 0.259 KB (by entry num) total key len = 1.565073 GB avg = 0.027 KB total ukey len = 1.072429 GB avg = 0.015 KB total ukey num = 0.071763010 Billion total entry num = 0.058570739 Billion write speed all = 0.369556830 MB/sec (with seq num) write speed all = 0.359207635 MB/sec (without seq num) 2024/11/23-21:29:47.899430 139957231949376 [compaction_job.cc:1948] [default] [JOB 36177] Generated table #281571: 258862 keys, 83100693 bytes, temperature: kWarm 2024/11/23-21:29:47.899498 139957231949376 EVENT_LOG_v1 {"time_micros": 1732368587899461, "cf_name": "default", "job": 36177, "event": "table_file_creation", "file_number": 281571, "file_size": 83100693, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79973136, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177240, "raw_average_key_size": 20, "raw_value_size": 263258531, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 258862, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368584, "oldest_key_time": 0, "file_creation_time": 1732368584, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281571, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:29:47.956813 139957231949376 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281572.sst) /dev/shm/ToplingTemp/Topling-194097-0wTUWV 2024/11/23-21:29:49.261367 139957231949376 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281572.sst): first pass time = 1.30's, 205.775'MB/sec 2024/11/23-21:29:50.778996 139957231949376 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281572.sst): old prealloc_size = 295279001, real_size = 80484128 2024/11/23-21:29:50.779177 139957231949376 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281572.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258853 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.02 avg-zval = 308.99 2024/11/23-21:29:50.779228 139957231949376 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281572.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:29:51.104028 139957231949376 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281572.sst): second pass time = 1.52's, 173.619'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.33's, 255.709'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2739.503'MB/sec (index lex order gen) rebuild zvType time = 0.24's, 0.273'MB/sec write SST data time = 0.09's, 943.478'MB/sec dict compress time = 0.00's, 2688940.000'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 74337.609'MB/sec zip my value time = 1.52's, unzip length = 0.263'GB zip my value throughput = 173.619'MB/sec zip pipeline throughput = 173.619'MB/sec entries = 258853 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.02 avg-zval = 308.99 usrkeys = 258853 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.02 avg-zval = 308.99 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 7 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1228 value = 3.2914 dict = 1.00 all = 3.2299 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 15.430089 GB avg = 0.262 KB (by entry num) total key len = 1.570250 GB avg = 0.027 KB total ukey len = 1.075535 GB avg = 0.015 KB total ukey num = 0.072021863 Billion total entry num = 0.058829592 Billion write speed all = 0.375458387 MB/sec (with seq num) write speed all = 0.365064212 MB/sec (without seq num) 2024/11/23-21:29:51.199677 139957231949376 [compaction_job.cc:1948] [default] [JOB 36177] Generated table #281572: 258853 keys, 83110495 bytes, temperature: kWarm 2024/11/23-21:29:51.199745 139957231949376 EVENT_LOG_v1 {"time_micros": 1732368591199710, "cf_name": "default", "job": 36177, "event": "table_file_creation", "file_number": 281572, "file_size": 83110495, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79983120, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177060, "raw_average_key_size": 20, "raw_value_size": 263258647, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 258853, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368587, "oldest_key_time": 0, "file_creation_time": 1732368587, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281572, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:29:51.271151 139957231949376 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281573.sst) /dev/shm/ToplingTemp/Topling-194097-kinm0U 2024/11/23-21:29:52.582964 139957231949376 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281573.sst): first pass time = 1.31's, 204.636'MB/sec 2024/11/23-21:29:54.046246 139957231949376 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281573.sst): old prealloc_size = 295279001, real_size = 80487392 2024/11/23-21:29:54.046434 139957231949376 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281573.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258854 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.02 avg-zval = 309.00 2024/11/23-21:29:54.046473 139957231949376 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281573.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:29:54.369102 139957231949376 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281573.sst): second pass time = 1.46's, 180.083'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.32's, 257.447'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2683.982'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.276'MB/sec write SST data time = 0.09's, 938.606'MB/sec dict compress time = 0.00's, 2688837.000'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 78669.271'MB/sec zip my value time = 1.46's, unzip length = 0.263'GB zip my value throughput = 180.083'MB/sec zip pipeline throughput = 180.083'MB/sec entries = 258854 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.02 avg-zval = 309.00 usrkeys = 258854 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.02 avg-zval = 309.00 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 8 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1229 value = 3.2913 dict = 1.00 all = 3.2297 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 15.693348 GB avg = 0.266 KB (by entry num) total key len = 1.575427 GB avg = 0.027 KB total ukey len = 1.078641 GB avg = 0.015 KB total ukey num = 0.072280717 Billion total entry num = 0.059088446 Billion write speed all = 0.381359390 MB/sec (with seq num) write speed all = 0.370920232 MB/sec (without seq num) 2024/11/23-21:29:54.466295 139957231949376 [compaction_job.cc:1948] [default] [JOB 36177] Generated table #281573: 258854 keys, 83113656 bytes, temperature: kWarm 2024/11/23-21:29:54.466363 139957231949376 EVENT_LOG_v1 {"time_micros": 1732368594466329, "cf_name": "default", "job": 36177, "event": "table_file_creation", "file_number": 281573, "file_size": 83113656, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79986384, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177080, "raw_average_key_size": 20, "raw_value_size": 263258938, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 258854, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368591, "oldest_key_time": 0, "file_creation_time": 1732368591, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281573, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:29:54.522018 139957231949376 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281574.sst) /dev/shm/ToplingTemp/Topling-194097-OPl1iS 2024/11/23-21:29:55.535729 139957231949376 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281574.sst): first pass time = 1.01's, 264.816'MB/sec 2024/11/23-21:29:57.044959 139957231949376 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281574.sst): old prealloc_size = 295279001, real_size = 80477600 2024/11/23-21:29:57.045170 139957231949376 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281574.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258859 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.00 avg-zval = 308.96 2024/11/23-21:29:57.045225 139957231949376 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281574.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:29:57.365706 139957231949376 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281574.sst): second pass time = 1.51's, 174.588'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.32's, 259.112'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2641.837'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.279'MB/sec write SST data time = 0.09's, 940.723'MB/sec dict compress time = 0.00's, 2688802.000'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 75777.189'MB/sec zip my value time = 1.51's, unzip length = 0.263'GB zip my value throughput = 174.588'MB/sec zip pipeline throughput = 174.588'MB/sec entries = 258859 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 308.96 usrkeys = 258859 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 308.96 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 8 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1230 value = 3.2917 dict = 1.00 all = 3.2301 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 15.956607 GB avg = 0.269 KB (by entry num) total key len = 1.580604 GB avg = 0.027 KB total ukey len = 1.081748 GB avg = 0.015 KB total ukey num = 0.072539576 Billion total entry num = 0.059347305 Billion write speed all = 0.387261835 MB/sec (with seq num) write speed all = 0.376777638 MB/sec (without seq num) 2024/11/23-21:29:57.460730 139957231949376 [compaction_job.cc:1948] [default] [JOB 36177] Generated table #281574: 258859 keys, 83103829 bytes, temperature: kWarm 2024/11/23-21:29:57.460818 139957231949376 EVENT_LOG_v1 {"time_micros": 1732368597460766, "cf_name": "default", "job": 36177, "event": "table_file_creation", "file_number": 281574, "file_size": 83103829, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79976592, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177180, "raw_average_key_size": 20, "raw_value_size": 263258717, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 258859, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368594, "oldest_key_time": 0, "file_creation_time": 1732368594, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281574, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:29:57.522651 139957231949376 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281575.sst) /dev/shm/ToplingTemp/Topling-194097-qUavJT 2024/11/23-21:29:58.678129 139957231949376 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281575.sst): first pass time = 1.16's, 232.325'MB/sec 2024/11/23-21:30:00.209069 139957231949376 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281575.sst): old prealloc_size = 295279001, real_size = 81136224 2024/11/23-21:30:00.209274 139957231949376 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281575.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258856 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0806 GB avg-val =1017.01 avg-zval = 311.51 2024/11/23-21:30:00.209314 139957231949376 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281575.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:30:00.537549 139957231949376 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281575.sst): second pass time = 1.53's, 172.122'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.33's, 255.019'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2415.402'MB/sec (index lex order gen) rebuild zvType time = 0.24's, 0.275'MB/sec write SST data time = 0.09's, 900.838'MB/sec dict compress time = 0.00's, 2689414.000'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 80738.937'MB/sec zip my value time = 1.53's, unzip length = 0.263'GB zip my value throughput = 172.122'MB/sec zip pipeline throughput = 172.122'MB/sec entries = 258856 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.01 avg-zval = 311.51 usrkeys = 258856 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.01 avg-zval = 311.51 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 8 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0806 GB dict = 2.69 MB all = 0.0838 GB } UnZip/Zip{ index = 7.1229 value = 3.2648 dict = 1.00 all = 3.2047 } Zip/UnZip{ index = 0.1404 value = 0.3063 dict = 1.00 all = 0.3120 } ---------------------------- total value len = 16.219865 GB avg = 0.272 KB (by entry num) total key len = 1.585781 GB avg = 0.027 KB total ukey len = 1.084854 GB avg = 0.015 KB total ukey num = 0.072798432 Billion total entry num = 0.059606161 Billion write speed all = 0.393161969 MB/sec (with seq num) write speed all = 0.382632780 MB/sec (without seq num) 2024/11/23-21:30:00.633554 139957231949376 [compaction_job.cc:1948] [default] [JOB 36177] Generated table #281575: 258856 keys, 83763065 bytes, temperature: kWarm 2024/11/23-21:30:00.633624 139957231949376 EVENT_LOG_v1 {"time_micros": 1732368600633589, "cf_name": "default", "job": 36177, "event": "table_file_creation", "file_number": 281575, "file_size": 83763065, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 80635216, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177120, "raw_average_key_size": 20, "raw_value_size": 263258369, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 258856, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368597, "oldest_key_time": 0, "file_creation_time": 1732368597, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281575, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:30:00.691455 139957231949376 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281576.sst) /dev/shm/ToplingTemp/Topling-194097-SSoIwU 2024/11/23-21:30:02.038126 139957231949376 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281576.sst): first pass time = 1.35's, 199.339'MB/sec 2024/11/23-21:30:03.542188 139957231949376 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281576.sst): old prealloc_size = 295279001, real_size = 80481200 2024/11/23-21:30:03.542394 139957231949376 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281576.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258856 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.01 avg-zval = 308.98 2024/11/23-21:30:03.542435 139957231949376 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281576.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:30:03.872283 139957231949376 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281576.sst): second pass time = 1.50's, 175.197'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.33's, 251.786'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2626.752'MB/sec (index lex order gen) rebuild zvType time = 0.24's, 0.275'MB/sec write SST data time = 0.09's, 877.901'MB/sec dict compress time = 0.00's, 2688955.000'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 82359.490'MB/sec zip my value time = 1.50's, unzip length = 0.263'GB zip my value throughput = 175.197'MB/sec zip pipeline throughput = 175.197'MB/sec entries = 258856 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.01 avg-zval = 308.98 usrkeys = 258856 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.01 avg-zval = 308.98 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1229 value = 3.2915 dict = 1.00 all = 3.2300 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 16.483124 GB avg = 0.275 KB (by entry num) total key len = 1.590958 GB avg = 0.027 KB total ukey len = 1.087960 GB avg = 0.015 KB total ukey num = 0.073057288 Billion total entry num = 0.059865017 Billion write speed all = 0.399059842 MB/sec (with seq num) write speed all = 0.388485707 MB/sec (without seq num) 2024/11/23-21:30:03.971137 139957231949376 [compaction_job.cc:1948] [default] [JOB 36177] Generated table #281576: 258856 keys, 83107630 bytes, temperature: kWarm 2024/11/23-21:30:03.971215 139957231949376 EVENT_LOG_v1 {"time_micros": 1732368603971169, "cf_name": "default", "job": 36177, "event": "table_file_creation", "file_number": 281576, "file_size": 83107630, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79980192, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177120, "raw_average_key_size": 20, "raw_value_size": 263258447, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 258856, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368600, "oldest_key_time": 0, "file_creation_time": 1732368600, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281576, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:30:04.028345 139957231949376 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281577.sst) /dev/shm/ToplingTemp/Topling-194097-zhY72T 2024/11/23-21:30:05.367417 139957231949376 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281577.sst): first pass time = 1.34's, 200.471'MB/sec 2024/11/23-21:30:06.822846 139957231949376 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281577.sst): old prealloc_size = 295279001, real_size = 80476464 2024/11/23-21:30:06.823064 139957231949376 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281577.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258857 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.00 avg-zval = 308.96 2024/11/23-21:30:06.823106 139957231949376 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281577.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:30:07.150457 139957231949376 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281577.sst): second pass time = 1.45's, 181.058'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.33's, 253.682'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2240.227'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.278'MB/sec write SST data time = 0.09's, 880.360'MB/sec dict compress time = 0.00's, 2689076.000'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 87967.418'MB/sec zip my value time = 1.45's, unzip length = 0.263'GB zip my value throughput = 181.058'MB/sec zip pipeline throughput = 181.058'MB/sec entries = 258857 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 308.96 usrkeys = 258857 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 308.96 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1229 value = 3.2917 dict = 1.00 all = 3.2302 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 16.746382 GB avg = 0.279 KB (by entry num) total key len = 1.596135 GB avg = 0.027 KB total ukey len = 1.091067 GB avg = 0.015 KB total ukey num = 0.073316145 Billion total entry num = 0.060123874 Billion write speed all = 0.404957361 MB/sec (with seq num) write speed all = 0.394338271 MB/sec (without seq num) 2024/11/23-21:30:07.246337 139957231949376 [compaction_job.cc:1948] [default] [JOB 36177] Generated table #281577: 258857 keys, 83103015 bytes, temperature: kWarm 2024/11/23-21:30:07.246407 139957231949376 EVENT_LOG_v1 {"time_micros": 1732368607246372, "cf_name": "default", "job": 36177, "event": "table_file_creation", "file_number": 281577, "file_size": 83103015, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79975456, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177140, "raw_average_key_size": 20, "raw_value_size": 263258764, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 258857, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368604, "oldest_key_time": 0, "file_creation_time": 1732368604, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281577, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:30:07.304300 139957231949376 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281578.sst) /dev/shm/ToplingTemp/Topling-194097-33eA4S 2024/11/23-21:30:08.589704 139957231949376 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281578.sst): first pass time = 1.29's, 208.841'MB/sec 2024/11/23-21:30:10.113432 139957231949376 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281578.sst): old prealloc_size = 295279001, real_size = 80481488 2024/11/23-21:30:10.113611 139957231949376 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281578.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258858 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.00 avg-zval = 308.97 2024/11/23-21:30:10.113650 139957231949376 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281578.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:30:10.442482 139957231949376 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281578.sst): second pass time = 1.52's, 172.935'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.33's, 252.589'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2803.232'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.276'MB/sec write SST data time = 0.09's, 877.224'MB/sec dict compress time = 0.00's, 2689166.000'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 86435.009'MB/sec zip my value time = 1.52's, unzip length = 0.263'GB zip my value throughput = 172.935'MB/sec zip pipeline throughput = 172.935'MB/sec entries = 258858 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 308.97 usrkeys = 258858 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 308.97 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1230 value = 3.2915 dict = 1.00 all = 3.2300 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 17.009642 GB avg = 0.282 KB (by entry num) total key len = 1.601312 GB avg = 0.027 KB total ukey len = 1.094173 GB avg = 0.015 KB total ukey num = 0.073575003 Billion total entry num = 0.060382732 Billion write speed all = 0.410853912 MB/sec (with seq num) write speed all = 0.400189878 MB/sec (without seq num) 2024/11/23-21:30:10.536737 139957231949376 [compaction_job.cc:1948] [default] [JOB 36177] Generated table #281578: 258858 keys, 83108097 bytes, temperature: kWarm 2024/11/23-21:30:10.536807 139957231949376 EVENT_LOG_v1 {"time_micros": 1732368610536772, "cf_name": "default", "job": 36177, "event": "table_file_creation", "file_number": 281578, "file_size": 83108097, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79980480, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177160, "raw_average_key_size": 20, "raw_value_size": 263259301, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 258858, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368607, "oldest_key_time": 0, "file_creation_time": 1732368607, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281578, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:30:10.593148 139957231949376 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281579.sst) /dev/shm/ToplingTemp/Topling-194097-rrh7aU 2024/11/23-21:30:11.872730 139957231949376 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281579.sst): first pass time = 1.28's, 209.790'MB/sec 2024/11/23-21:30:13.350424 139957231949376 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281579.sst): old prealloc_size = 295279001, real_size = 80480752 2024/11/23-21:30:13.350614 139957231949376 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281579.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258857 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.00 avg-zval = 308.97 2024/11/23-21:30:13.350652 139957231949376 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281579.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:30:13.679285 139957231949376 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281579.sst): second pass time = 1.48's, 178.326'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.33's, 252.729'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2679.331'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.276'MB/sec write SST data time = 0.09's, 880.389'MB/sec dict compress time = 0.00's, 2688249.000'MB/sec z-dict build time = 0.00's, sample length = 2.688'MB, throughput = 83639.246'MB/sec zip my value time = 1.48's, unzip length = 0.263'GB zip my value throughput = 178.326'MB/sec zip pipeline throughput = 178.326'MB/sec entries = 258857 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 308.97 usrkeys = 258857 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 308.97 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1229 value = 3.2916 dict = 1.00 all = 3.2300 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 17.272900 GB avg = 0.285 KB (by entry num) total key len = 1.606490 GB avg = 0.026 KB total ukey len = 1.097279 GB avg = 0.015 KB total ukey num = 0.073833860 Billion total entry num = 0.060641589 Billion write speed all = 0.416750097 MB/sec (with seq num) write speed all = 0.406041112 MB/sec (without seq num) 2024/11/23-21:30:13.774790 139957231949376 [compaction_job.cc:1948] [default] [JOB 36177] Generated table #281579: 258857 keys, 83106476 bytes, temperature: kWarm 2024/11/23-21:30:13.774858 139957231949376 EVENT_LOG_v1 {"time_micros": 1732368613774824, "cf_name": "default", "job": 36177, "event": "table_file_creation", "file_number": 281579, "file_size": 83106476, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79979744, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177140, "raw_average_key_size": 20, "raw_value_size": 263258507, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 258857, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368610, "oldest_key_time": 0, "file_creation_time": 1732368610, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281579, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:30:13.835442 139957231949376 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281580.sst) /dev/shm/ToplingTemp/Topling-194097-Hb4ozS 2024/11/23-21:30:15.115895 139957231949376 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281580.sst): first pass time = 1.28's, 209.649'MB/sec 2024/11/23-21:30:16.581147 139957231949376 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281580.sst): old prealloc_size = 295279001, real_size = 80479984 2024/11/23-21:30:16.581347 139957231949376 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281580.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258859 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.00 avg-zval = 308.97 2024/11/23-21:30:16.581387 139957231949376 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281580.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:30:16.907846 139957231949376 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281580.sst): second pass time = 1.46's, 179.839'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.33's, 254.400'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2499.619'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.277'MB/sec write SST data time = 0.09's, 897.187'MB/sec dict compress time = 0.00's, 2689014.000'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 87082.289'MB/sec zip my value time = 1.46's, unzip length = 0.263'GB zip my value throughput = 179.839'MB/sec zip pipeline throughput = 179.839'MB/sec entries = 258859 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 308.97 usrkeys = 258859 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 308.97 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 8 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1230 value = 3.2916 dict = 1.00 all = 3.2300 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 17.536159 GB avg = 0.288 KB (by entry num) total key len = 1.611667 GB avg = 0.026 KB total ukey len = 1.100385 GB avg = 0.015 KB total ukey num = 0.074092719 Billion total entry num = 0.060900448 Billion write speed all = 0.422645527 MB/sec (with seq num) write speed all = 0.411891595 MB/sec (without seq num) 2024/11/23-21:30:17.012446 139957231949376 [compaction_job.cc:1948] [default] [JOB 36177] Generated table #281580: 258859 keys, 83106473 bytes, temperature: kWarm 2024/11/23-21:30:17.012516 139957231949376 EVENT_LOG_v1 {"time_micros": 1732368617012480, "cf_name": "default", "job": 36177, "event": "table_file_creation", "file_number": 281580, "file_size": 83106473, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79978976, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177180, "raw_average_key_size": 20, "raw_value_size": 263258966, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 258859, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368613, "oldest_key_time": 0, "file_creation_time": 1732368613, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281580, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:30:17.071817 139957231949376 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281581.sst) /dev/shm/ToplingTemp/Topling-194097-L5OBnS 2024/11/23-21:30:18.504158 139957231949376 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281581.sst): first pass time = 1.43's, 187.417'MB/sec 2024/11/23-21:30:20.021742 139957231949376 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281581.sst): old prealloc_size = 295279001, real_size = 80479632 2024/11/23-21:30:20.021935 139957231949376 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281581.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258859 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.00 avg-zval = 308.97 2024/11/23-21:30:20.021973 139957231949376 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281581.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:30:20.350071 139957231949376 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281581.sst): second pass time = 1.52's, 173.640'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.33's, 253.138'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2589.736'MB/sec (index lex order gen) rebuild zvType time = 0.24's, 0.275'MB/sec write SST data time = 0.09's, 897.272'MB/sec dict compress time = 0.00's, 2689079.000'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 86974.546'MB/sec zip my value time = 1.52's, unzip length = 0.263'GB zip my value throughput = 173.640'MB/sec zip pipeline throughput = 173.640'MB/sec entries = 258859 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 308.97 usrkeys = 258859 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 308.97 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1230 value = 3.2916 dict = 1.00 all = 3.2300 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 17.799418 GB avg = 0.291 KB (by entry num) total key len = 1.616844 GB avg = 0.026 KB total ukey len = 1.103492 GB avg = 0.015 KB total ukey num = 0.074351578 Billion total entry num = 0.061159307 Billion write speed all = 0.428538095 MB/sec (with seq num) write speed all = 0.417739273 MB/sec (without seq num) 2024/11/23-21:30:20.448190 139957231949376 [compaction_job.cc:1948] [default] [JOB 36177] Generated table #281581: 258859 keys, 83106154 bytes, temperature: kWarm 2024/11/23-21:30:20.448266 139957231949376 EVENT_LOG_v1 {"time_micros": 1732368620448230, "cf_name": "default", "job": 36177, "event": "table_file_creation", "file_number": 281581, "file_size": 83106154, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79978624, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177180, "raw_average_key_size": 20, "raw_value_size": 263258926, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 258859, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368617, "oldest_key_time": 0, "file_creation_time": 1732368617, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281581, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:30:20.513465 139957231949376 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281582.sst) /dev/shm/ToplingTemp/Topling-194097-9YhnCS 2024/11/23-21:30:21.745711 139957231949376 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281582.sst): first pass time = 1.23's, 217.850'MB/sec 2024/11/23-21:30:23.285264 139957231949376 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281582.sst): old prealloc_size = 295279001, real_size = 80480896 2024/11/23-21:30:23.285451 139957231949376 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281582.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258853 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.02 avg-zval = 308.98 2024/11/23-21:30:23.285491 139957231949376 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281582.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:30:23.608061 139957231949376 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281582.sst): second pass time = 1.54's, 171.149'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.32's, 257.479'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2653.088'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.278'MB/sec write SST data time = 0.09's, 928.840'MB/sec dict compress time = 0.00's, 2689567.000'MB/sec z-dict build time = 0.00's, sample length = 2.690'MB, throughput = 68532.730'MB/sec zip my value time = 1.54's, unzip length = 0.263'GB zip my value throughput = 171.149'MB/sec zip pipeline throughput = 171.149'MB/sec entries = 258853 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.02 avg-zval = 308.98 usrkeys = 258853 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.02 avg-zval = 308.98 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1228 value = 3.2916 dict = 1.00 all = 3.2300 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 18.062677 GB avg = 0.294 KB (by entry num) total key len = 1.622021 GB avg = 0.026 KB total ukey len = 1.106598 GB avg = 0.015 KB total ukey num = 0.074610431 Billion total entry num = 0.061418160 Billion write speed all = 0.434431532 MB/sec (with seq num) write speed all = 0.423587785 MB/sec (without seq num) 2024/11/23-21:30:23.704989 139957231949376 [compaction_job.cc:1948] [default] [JOB 36177] Generated table #281582: 258853 keys, 83107922 bytes, temperature: kWarm 2024/11/23-21:30:23.705062 139957231949376 EVENT_LOG_v1 {"time_micros": 1732368623705026, "cf_name": "default", "job": 36177, "event": "table_file_creation", "file_number": 281582, "file_size": 83107922, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79979888, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177060, "raw_average_key_size": 20, "raw_value_size": 263258957, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 258853, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368620, "oldest_key_time": 0, "file_creation_time": 1732368620, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281582, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:30:23.768523 139957231949376 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281583.sst) /dev/shm/ToplingTemp/Topling-194097-8Xgg8R 2024/11/23-21:30:25.018256 139957231949376 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281583.sst): first pass time = 1.25's, 214.802'MB/sec 2024/11/23-21:30:26.468964 139957231949376 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281583.sst): old prealloc_size = 295279001, real_size = 80481616 2024/11/23-21:30:26.469172 139957231949376 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281583.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258860 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1016.99 avg-zval = 308.97 2024/11/23-21:30:26.469227 139957231949376 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281583.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:30:26.796231 139957231949376 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281583.sst): second pass time = 1.45's, 181.632'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.33's, 253.969'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2751.603'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.276'MB/sec write SST data time = 0.09's, 896.981'MB/sec dict compress time = 0.00's, 2689161.000'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 90328.205'MB/sec zip my value time = 1.45's, unzip length = 0.263'GB zip my value throughput = 181.632'MB/sec zip pipeline throughput = 181.632'MB/sec entries = 258860 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1016.99 avg-zval = 308.97 usrkeys = 258860 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1016.99 avg-zval = 308.97 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1230 value = 3.2915 dict = 1.00 all = 3.2300 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 18.325936 GB avg = 0.297 KB (by entry num) total key len = 1.627198 GB avg = 0.026 KB total ukey len = 1.109704 GB avg = 0.015 KB total ukey num = 0.074869291 Billion total entry num = 0.061677020 Billion write speed all = 0.440324797 MB/sec (with seq num) write speed all = 0.429436113 MB/sec (without seq num) 2024/11/23-21:30:26.908400 139957231949376 [compaction_job.cc:1948] [default] [JOB 36177] Generated table #281583: 258860 keys, 83108220 bytes, temperature: kWarm 2024/11/23-21:30:26.908472 139957231949376 EVENT_LOG_v1 {"time_micros": 1732368626908435, "cf_name": "default", "job": 36177, "event": "table_file_creation", "file_number": 281583, "file_size": 83108220, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79980608, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177200, "raw_average_key_size": 20, "raw_value_size": 263258692, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 258860, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368623, "oldest_key_time": 0, "file_creation_time": 1732368623, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281583, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:30:26.968125 139957231949376 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281584.sst) /dev/shm/ToplingTemp/Topling-194097-GTXwfW 2024/11/23-21:30:28.260995 139957231949376 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281584.sst): first pass time = 1.29's, 207.634'MB/sec 2024/11/23-21:30:29.719576 139957231949376 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281584.sst): old prealloc_size = 295279001, real_size = 80475904 2024/11/23-21:30:29.719769 139957231949376 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281584.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258858 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.00 avg-zval = 308.95 2024/11/23-21:30:29.719809 139957231949376 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281584.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:30:30.048602 139957231949376 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281584.sst): second pass time = 1.46's, 180.662'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.33's, 252.585'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2595.114'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.276'MB/sec write SST data time = 0.09's, 882.338'MB/sec dict compress time = 0.00's, 2689036.000'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 79580.823'MB/sec zip my value time = 1.46's, unzip length = 0.263'GB zip my value throughput = 180.662'MB/sec zip pipeline throughput = 180.662'MB/sec entries = 258858 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 308.95 usrkeys = 258858 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 308.95 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1230 value = 3.2918 dict = 1.00 all = 3.2302 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 18.589194 GB avg = 0.300 KB (by entry num) total key len = 1.632375 GB avg = 0.026 KB total ukey len = 1.112811 GB avg = 0.015 KB total ukey num = 0.075128149 Billion total entry num = 0.061935878 Billion write speed all = 0.446216595 MB/sec (with seq num) write speed all = 0.435282996 MB/sec (without seq num) 2024/11/23-21:30:30.158518 139957231949376 [compaction_job.cc:1948] [default] [JOB 36177] Generated table #281584: 258858 keys, 83102399 bytes, temperature: kWarm 2024/11/23-21:30:30.158587 139957231949376 EVENT_LOG_v1 {"time_micros": 1732368630158552, "cf_name": "default", "job": 36177, "event": "table_file_creation", "file_number": 281584, "file_size": 83102399, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79974896, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177160, "raw_average_key_size": 20, "raw_value_size": 263258482, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 258858, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368626, "oldest_key_time": 0, "file_creation_time": 1732368626, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281584, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:30:30.215864 139957231949376 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281585.sst) /dev/shm/ToplingTemp/Topling-194097-a0FisT 2024/11/23-21:30:31.283395 139957231949376 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281585.sst): first pass time = 1.07's, 251.466'MB/sec 2024/11/23-21:30:32.750663 139957231949376 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281585.sst): old prealloc_size = 295279001, real_size = 80472816 2024/11/23-21:30:32.750855 139957231949376 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281585.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258864 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1016.98 avg-zval = 308.93 2024/11/23-21:30:32.750895 139957231949376 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281585.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:30:33.079174 139957231949376 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281585.sst): second pass time = 1.47's, 179.584'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.33's, 252.974'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2624.665'MB/sec (index lex order gen) rebuild zvType time = 0.24's, 0.274'MB/sec write SST data time = 0.09's, 899.976'MB/sec dict compress time = 0.00's, 2688808.000'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 66120.939'MB/sec zip my value time = 1.47's, unzip length = 0.263'GB zip my value throughput = 179.584'MB/sec zip pipeline throughput = 179.584'MB/sec entries = 258864 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1016.98 avg-zval = 308.93 usrkeys = 258864 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1016.98 avg-zval = 308.93 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1231 value = 3.2919 dict = 1.00 all = 3.2303 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 18.852453 GB avg = 0.303 KB (by entry num) total key len = 1.637553 GB avg = 0.026 KB total ukey len = 1.115917 GB avg = 0.015 KB total ukey num = 0.075387013 Billion total entry num = 0.062194742 Billion write speed all = 0.452109777 MB/sec (with seq num) write speed all = 0.441131214 MB/sec (without seq num) 2024/11/23-21:30:33.186883 139957231949376 [compaction_job.cc:1948] [default] [JOB 36177] Generated table #281585: 258864 keys, 83099099 bytes, temperature: kWarm 2024/11/23-21:30:33.186953 139957231949376 EVENT_LOG_v1 {"time_micros": 1732368633186917, "cf_name": "default", "job": 36177, "event": "table_file_creation", "file_number": 281585, "file_size": 83099099, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79971808, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177280, "raw_average_key_size": 20, "raw_value_size": 263259088, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 258864, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368630, "oldest_key_time": 0, "file_creation_time": 1732368630, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281585, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:30:33.242890 139957231949376 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281586.sst) /dev/shm/ToplingTemp/Topling-194097-n3lJYT 2024/11/23-21:30:34.667040 139957231949376 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281586.sst): first pass time = 1.42's, 188.494'MB/sec 2024/11/23-21:30:36.161740 139957231949376 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281586.sst): old prealloc_size = 295279001, real_size = 80476912 2024/11/23-21:30:36.161932 139957231949376 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281586.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258864 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1016.98 avg-zval = 308.95 2024/11/23-21:30:36.161970 139957231949376 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281586.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:30:36.491705 139957231949376 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281586.sst): second pass time = 1.49's, 176.288'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.33's, 251.872'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2618.236'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.276'MB/sec write SST data time = 0.10's, 872.317'MB/sec dict compress time = 0.00's, 2689453.000'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 69324.733'MB/sec zip my value time = 1.49's, unzip length = 0.263'GB zip my value throughput = 176.288'MB/sec zip pipeline throughput = 176.288'MB/sec entries = 258864 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1016.98 avg-zval = 308.95 usrkeys = 258864 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1016.98 avg-zval = 308.95 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 8 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1231 value = 3.2917 dict = 1.00 all = 3.2301 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 19.115712 GB avg = 0.306 KB (by entry num) total key len = 1.642730 GB avg = 0.026 KB total ukey len = 1.119023 GB avg = 0.015 KB total ukey num = 0.075645877 Billion total entry num = 0.062453606 Billion write speed all = 0.457998306 MB/sec (with seq num) write speed all = 0.446974880 MB/sec (without seq num) 2024/11/23-21:30:36.592919 139957231949376 [compaction_job.cc:1948] [default] [JOB 36177] Generated table #281586: 258864 keys, 83103840 bytes, temperature: kWarm 2024/11/23-21:30:36.593009 139957231949376 EVENT_LOG_v1 {"time_micros": 1732368636592952, "cf_name": "default", "job": 36177, "event": "table_file_creation", "file_number": 281586, "file_size": 83103840, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79975904, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177280, "raw_average_key_size": 20, "raw_value_size": 263258915, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 258864, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368633, "oldest_key_time": 0, "file_creation_time": 1732368633, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281586, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:30:36.649826 139957231949376 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281587.sst) /dev/shm/ToplingTemp/Topling-194097-MLitCT 2024/11/23-21:30:38.068789 139957231949376 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281587.sst): first pass time = 1.42's, 189.183'MB/sec 2024/11/23-21:30:39.562291 139957231949376 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281587.sst): old prealloc_size = 295279001, real_size = 80476752 2024/11/23-21:30:39.562475 139957231949376 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281587.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258864 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1016.98 avg-zval = 308.95 2024/11/23-21:30:39.562512 139957231949376 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281587.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:30:39.882959 139957231949376 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281587.sst): second pass time = 1.49's, 176.409'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.32's, 259.174'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2771.538'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.279'MB/sec write SST data time = 0.09's, 940.770'MB/sec dict compress time = 0.00's, 2688598.000'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 83318.293'MB/sec zip my value time = 1.49's, unzip length = 0.263'GB zip my value throughput = 176.409'MB/sec zip pipeline throughput = 176.409'MB/sec entries = 258864 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1016.98 avg-zval = 308.95 usrkeys = 258864 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1016.98 avg-zval = 308.95 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1231 value = 3.2917 dict = 1.00 all = 3.2302 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 19.378971 GB avg = 0.309 KB (by entry num) total key len = 1.647907 GB avg = 0.026 KB total ukey len = 1.122130 GB avg = 0.015 KB total ukey num = 0.075904741 Billion total entry num = 0.062712470 Billion write speed all = 0.463886170 MB/sec (with seq num) write speed all = 0.452817880 MB/sec (without seq num) 2024/11/23-21:30:39.980959 139957231949376 [compaction_job.cc:1948] [default] [JOB 36177] Generated table #281587: 258864 keys, 83102793 bytes, temperature: kWarm 2024/11/23-21:30:39.981037 139957231949376 EVENT_LOG_v1 {"time_micros": 1732368639981002, "cf_name": "default", "job": 36177, "event": "table_file_creation", "file_number": 281587, "file_size": 83102793, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79975744, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177280, "raw_average_key_size": 20, "raw_value_size": 263259021, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 258864, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368636, "oldest_key_time": 0, "file_creation_time": 1732368636, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281587, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:30:40.038155 139957231949376 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281588.sst) /dev/shm/ToplingTemp/Topling-194097-OeJrfV 2024/11/23-21:30:41.083223 139957231949376 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281588.sst): first pass time = 1.05's, 256.872'MB/sec 2024/11/23-21:30:42.595868 139957231949376 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281588.sst): old prealloc_size = 295279001, real_size = 80555424 2024/11/23-21:30:42.596100 139957231949376 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281588.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258857 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0801 GB avg-val =1017.00 avg-zval = 309.26 2024/11/23-21:30:42.596140 139957231949376 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281588.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:30:42.922519 139957231949376 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281588.sst): second pass time = 1.51's, 174.194'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.33's, 254.668'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2083.235'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.277'MB/sec write SST data time = 0.09's, 898.568'MB/sec dict compress time = 0.00's, 2688997.000'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 75210.388'MB/sec zip my value time = 1.51's, unzip length = 0.263'GB zip my value throughput = 174.194'MB/sec zip pipeline throughput = 174.194'MB/sec entries = 258857 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 309.26 usrkeys = 258857 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 309.26 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 8 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0801 GB dict = 2.69 MB all = 0.0832 GB } UnZip/Zip{ index = 7.1229 value = 3.2885 dict = 1.00 all = 3.2271 } Zip/UnZip{ index = 0.1404 value = 0.3041 dict = 1.00 all = 0.3099 } ---------------------------- total value len = 19.642230 GB avg = 0.312 KB (by entry num) total key len = 1.653084 GB avg = 0.026 KB total ukey len = 1.125236 GB avg = 0.015 KB total ukey num = 0.076163598 Billion total entry num = 0.062971327 Billion write speed all = 0.469776781 MB/sec (with seq num) write speed all = 0.458663551 MB/sec (without seq num) 2024/11/23-21:30:43.021567 139957231949376 [compaction_job.cc:1948] [default] [JOB 36177] Generated table #281588: 258857 keys, 83181848 bytes, temperature: kWarm 2024/11/23-21:30:43.021638 139957231949376 EVENT_LOG_v1 {"time_micros": 1732368643021602, "cf_name": "default", "job": 36177, "event": "table_file_creation", "file_number": 281588, "file_size": 83181848, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 80054416, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177140, "raw_average_key_size": 20, "raw_value_size": 263258459, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 258857, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368640, "oldest_key_time": 0, "file_creation_time": 1732368640, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281588, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:30:43.081815 139957231949376 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281589.sst) /dev/shm/ToplingTemp/Topling-194097-Wd9KGU 2024/11/23-21:30:44.392686 139957231949376 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281589.sst): first pass time = 1.31's, 204.783'MB/sec 2024/11/23-21:30:45.926637 139957231949376 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281589.sst): old prealloc_size = 295279001, real_size = 81079776 2024/11/23-21:30:45.926826 139957231949376 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281589.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258861 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0806 GB avg-val =1016.99 avg-zval = 311.28 2024/11/23-21:30:45.926863 139957231949376 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281589.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:30:46.252097 139957231949376 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281589.sst): second pass time = 1.53's, 171.783'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.33's, 257.214'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2653.314'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.276'MB/sec write SST data time = 0.09's, 918.937'MB/sec dict compress time = 0.00's, 2689317.000'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 85709.819'MB/sec zip my value time = 1.53's, unzip length = 0.263'GB zip my value throughput = 171.783'MB/sec zip pipeline throughput = 171.783'MB/sec entries = 258861 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1016.99 avg-zval = 311.28 usrkeys = 258861 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1016.99 avg-zval = 311.28 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 8 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0806 GB dict = 2.69 MB all = 0.0837 GB } UnZip/Zip{ index = 7.1230 value = 3.2671 dict = 1.00 all = 3.2069 } Zip/UnZip{ index = 0.1404 value = 0.3061 dict = 1.00 all = 0.3118 } ---------------------------- total value len = 19.905488 GB avg = 0.315 KB (by entry num) total key len = 1.658262 GB avg = 0.026 KB total ukey len = 1.128342 GB avg = 0.015 KB total ukey num = 0.076422459 Billion total entry num = 0.063230188 Billion write speed all = 0.475663565 MB/sec (with seq num) write speed all = 0.464505470 MB/sec (without seq num) 2024/11/23-21:30:46.350619 139957231949376 [compaction_job.cc:1948] [default] [JOB 36177] Generated table #281589: 258861 keys, 83706520 bytes, temperature: kWarm 2024/11/23-21:30:46.350687 139957231949376 EVENT_LOG_v1 {"time_micros": 1732368646350652, "cf_name": "default", "job": 36177, "event": "table_file_creation", "file_number": 281589, "file_size": 83706520, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 80578768, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177220, "raw_average_key_size": 20, "raw_value_size": 263258622, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 258861, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368643, "oldest_key_time": 0, "file_creation_time": 1732368643, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281589, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:30:46.411611 139957231949376 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281590.sst) /dev/shm/ToplingTemp/Topling-194097-37mvJS 2024/11/23-21:30:47.671393 139957231949376 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281590.sst): first pass time = 1.26's, 213.088'MB/sec 2024/11/23-21:30:49.169897 139957231949376 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281590.sst): old prealloc_size = 295279001, real_size = 80480800 2024/11/23-21:30:49.170109 139957231949376 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281590.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258857 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.01 avg-zval = 308.97 2024/11/23-21:30:49.170151 139957231949376 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281590.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:30:49.496048 139957231949376 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281590.sst): second pass time = 1.50's, 175.846'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.33's, 254.831'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2332.488'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.278'MB/sec write SST data time = 0.09's, 894.248'MB/sec dict compress time = 0.00's, 2688746.000'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 82860.674'MB/sec zip my value time = 1.50's, unzip length = 0.263'GB zip my value throughput = 175.846'MB/sec zip pipeline throughput = 175.846'MB/sec entries = 258857 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.01 avg-zval = 308.97 usrkeys = 258857 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.01 avg-zval = 308.97 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 8 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1229 value = 3.2916 dict = 1.00 all = 3.2300 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 20.168747 GB avg = 0.318 KB (by entry num) total key len = 1.663439 GB avg = 0.026 KB total ukey len = 1.131449 GB avg = 0.015 KB total ukey num = 0.076681316 Billion total entry num = 0.063489045 Billion write speed all = 0.481550399 MB/sec (with seq num) write speed all = 0.470347426 MB/sec (without seq num) 2024/11/23-21:30:49.594494 139957231949376 [compaction_job.cc:1948] [default] [JOB 36177] Generated table #281590: 258857 keys, 83106973 bytes, temperature: kWarm 2024/11/23-21:30:49.594563 139957231949376 EVENT_LOG_v1 {"time_micros": 1732368649594528, "cf_name": "default", "job": 36177, "event": "table_file_creation", "file_number": 281590, "file_size": 83106973, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79979792, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177140, "raw_average_key_size": 20, "raw_value_size": 263258932, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 258857, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368646, "oldest_key_time": 0, "file_creation_time": 1732368646, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281590, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:30:49.654896 139957231949376 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281591.sst) /dev/shm/ToplingTemp/Topling-194097-KnYWnW 2024/11/23-21:30:50.842915 139957231949376 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281591.sst): first pass time = 1.19's, 225.960'MB/sec 2024/11/23-21:30:52.297880 139957231949376 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281591.sst): old prealloc_size = 295279001, real_size = 80483552 2024/11/23-21:30:52.298099 139957231949376 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281591.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258857 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.01 avg-zval = 308.98 2024/11/23-21:30:52.298143 139957231949376 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281591.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:30:52.626031 139957231949376 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281591.sst): second pass time = 1.45's, 181.112'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.33's, 253.295'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2231.115'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.276'MB/sec write SST data time = 0.09's, 892.351'MB/sec dict compress time = 0.00's, 2688849.000'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 86416.487'MB/sec zip my value time = 1.45's, unzip length = 0.263'GB zip my value throughput = 181.112'MB/sec zip pipeline throughput = 181.112'MB/sec entries = 258857 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.01 avg-zval = 308.98 usrkeys = 258857 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.01 avg-zval = 308.98 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 8 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1229 value = 3.2915 dict = 1.00 all = 3.2299 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 20.432006 GB avg = 0.321 KB (by entry num) total key len = 1.668616 GB avg = 0.026 KB total ukey len = 1.134555 GB avg = 0.015 KB total ukey num = 0.076940173 Billion total entry num = 0.063747902 Billion write speed all = 0.487437617 MB/sec (with seq num) write speed all = 0.476189743 MB/sec (without seq num) 2024/11/23-21:30:52.724970 139957231949376 [compaction_job.cc:1948] [default] [JOB 36177] Generated table #281591: 258857 keys, 83109828 bytes, temperature: kWarm 2024/11/23-21:30:52.725059 139957231949376 EVENT_LOG_v1 {"time_micros": 1732368652725023, "cf_name": "default", "job": 36177, "event": "table_file_creation", "file_number": 281591, "file_size": 83109828, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79982544, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177140, "raw_average_key_size": 20, "raw_value_size": 263258962, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 258857, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368649, "oldest_key_time": 0, "file_creation_time": 1732368649, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281591, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:30:52.784885 139957231949376 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281592.sst) /dev/shm/ToplingTemp/Topling-194097-2lFfsT 2024/11/23-21:30:54.168531 139957231949376 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281592.sst): first pass time = 1.38's, 194.013'MB/sec 2024/11/23-21:30:55.637761 139957231949376 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281592.sst): old prealloc_size = 295279001, real_size = 80478320 2024/11/23-21:30:55.637951 139957231949376 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281592.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258859 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.00 avg-zval = 308.96 2024/11/23-21:30:55.638010 139957231949376 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281592.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:30:55.959242 139957231949376 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281592.sst): second pass time = 1.47's, 179.363'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.32's, 258.532'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2565.814'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.280'MB/sec write SST data time = 0.09's, 925.960'MB/sec dict compress time = 0.00's, 2688965.000'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 89020.890'MB/sec zip my value time = 1.47's, unzip length = 0.263'GB zip my value throughput = 179.363'MB/sec zip pipeline throughput = 179.363'MB/sec entries = 258859 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 308.96 usrkeys = 258859 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 308.96 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1230 value = 3.2917 dict = 1.00 all = 3.2301 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 20.695265 GB avg = 0.323 KB (by entry num) total key len = 1.673793 GB avg = 0.026 KB total ukey len = 1.137661 GB avg = 0.015 KB total ukey num = 0.077199032 Billion total entry num = 0.064006761 Billion write speed all = 0.493321811 MB/sec (with seq num) write speed all = 0.482029094 MB/sec (without seq num) 2024/11/23-21:30:56.056580 139957231949376 [compaction_job.cc:1948] [default] [JOB 36177] Generated table #281592: 258859 keys, 83104760 bytes, temperature: kWarm 2024/11/23-21:30:56.056646 139957231949376 EVENT_LOG_v1 {"time_micros": 1732368656056612, "cf_name": "default", "job": 36177, "event": "table_file_creation", "file_number": 281592, "file_size": 83104760, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79977312, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177180, "raw_average_key_size": 20, "raw_value_size": 263258958, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 258859, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368652, "oldest_key_time": 0, "file_creation_time": 1732368652, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281592, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:30:56.113370 139957231949376 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281593.sst) /dev/shm/ToplingTemp/Topling-194097-bdYBzS 2024/11/23-21:30:57.540623 139957231949376 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281593.sst): first pass time = 1.43's, 188.084'MB/sec 2024/11/23-21:30:59.030361 139957231949376 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281593.sst): old prealloc_size = 295279001, real_size = 80478448 2024/11/23-21:30:59.030538 139957231949376 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281593.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258858 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.00 avg-zval = 308.96 2024/11/23-21:30:59.030577 139957231949376 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281593.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:30:59.352722 139957231949376 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281593.sst): second pass time = 1.49's, 176.872'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.32's, 257.819'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2819.507'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.279'MB/sec write SST data time = 0.09's, 920.333'MB/sec dict compress time = 0.00's, 2688573.000'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 80210.418'MB/sec zip my value time = 1.49's, unzip length = 0.263'GB zip my value throughput = 176.872'MB/sec zip pipeline throughput = 176.872'MB/sec entries = 258858 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 308.96 usrkeys = 258858 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 308.96 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1230 value = 3.2917 dict = 1.00 all = 3.2301 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 20.958524 GB avg = 0.326 KB (by entry num) total key len = 1.678970 GB avg = 0.026 KB total ukey len = 1.140767 GB avg = 0.015 KB total ukey num = 0.077457890 Billion total entry num = 0.064265619 Billion write speed all = 0.499204479 MB/sec (with seq num) write speed all = 0.487866940 MB/sec (without seq num) 2024/11/23-21:30:59.451870 139957231949376 [compaction_job.cc:1948] [default] [JOB 36177] Generated table #281593: 258858 keys, 83104496 bytes, temperature: kWarm 2024/11/23-21:30:59.451938 139957231949376 EVENT_LOG_v1 {"time_micros": 1732368659451903, "cf_name": "default", "job": 36177, "event": "table_file_creation", "file_number": 281593, "file_size": 83104496, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79977440, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177160, "raw_average_key_size": 20, "raw_value_size": 263259083, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 258858, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368656, "oldest_key_time": 0, "file_creation_time": 1732368656, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281593, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:30:59.514054 139957231949376 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281594.sst) /dev/shm/ToplingTemp/Topling-194097-jgVNOU 2024/11/23-21:31:00.693110 139957231949376 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281594.sst): first pass time = 1.18's, 227.679'MB/sec 2024/11/23-21:31:02.241439 139957231949376 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281594.sst): old prealloc_size = 295279001, real_size = 81136928 2024/11/23-21:31:02.241618 139957231949376 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281594.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258856 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0806 GB avg-val =1017.01 avg-zval = 311.51 2024/11/23-21:31:02.241656 139957231949376 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281594.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:31:02.570043 139957231949376 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281594.sst): second pass time = 1.55's, 170.162'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.33's, 254.926'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2812.779'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.276'MB/sec write SST data time = 0.09's, 888.029'MB/sec dict compress time = 0.00's, 2689113.000'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 85311.792'MB/sec zip my value time = 1.55's, unzip length = 0.263'GB zip my value throughput = 170.162'MB/sec zip pipeline throughput = 170.162'MB/sec entries = 258856 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.01 avg-zval = 311.51 usrkeys = 258856 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.01 avg-zval = 311.51 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 8 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0806 GB dict = 2.69 MB all = 0.0838 GB } UnZip/Zip{ index = 7.1229 value = 3.2648 dict = 1.00 all = 3.2047 } Zip/UnZip{ index = 0.1404 value = 0.3063 dict = 1.00 all = 0.3120 } ---------------------------- total value len = 21.221784 GB avg = 0.329 KB (by entry num) total key len = 1.684147 GB avg = 0.026 KB total ukey len = 1.143874 GB avg = 0.015 KB total ukey num = 0.077716746 Billion total entry num = 0.064524475 Billion write speed all = 0.505088233 MB/sec (with seq num) write speed all = 0.493705835 MB/sec (without seq num) 2024/11/23-21:31:02.672147 139957231949376 [compaction_job.cc:1948] [default] [JOB 36177] Generated table #281594: 258856 keys, 83763468 bytes, temperature: kWarm 2024/11/23-21:31:02.672230 139957231949376 EVENT_LOG_v1 {"time_micros": 1732368662672184, "cf_name": "default", "job": 36177, "event": "table_file_creation", "file_number": 281594, "file_size": 83763468, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 80635920, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177120, "raw_average_key_size": 20, "raw_value_size": 263259311, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 258856, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368659, "oldest_key_time": 0, "file_creation_time": 1732368659, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281594, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:31:02.727903 139957231949376 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281595.sst) /dev/shm/ToplingTemp/Topling-194097-IFk9dW 2024/11/23-21:31:04.065966 139957231949376 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281595.sst): first pass time = 1.34's, 200.623'MB/sec 2024/11/23-21:31:05.525105 139957231949376 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281595.sst): old prealloc_size = 295279001, real_size = 80481328 2024/11/23-21:31:05.525298 139957231949376 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281595.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258856 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.01 avg-zval = 308.98 2024/11/23-21:31:05.525339 139957231949376 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281595.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:31:05.852041 139957231949376 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281595.sst): second pass time = 1.46's, 180.573'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.33's, 254.219'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2539.384'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.279'MB/sec write SST data time = 0.10's, 873.947'MB/sec dict compress time = 0.00's, 2689130.000'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 89619.743'MB/sec zip my value time = 1.46's, unzip length = 0.263'GB zip my value throughput = 180.573'MB/sec zip pipeline throughput = 180.573'MB/sec entries = 258856 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.01 avg-zval = 308.98 usrkeys = 258856 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.01 avg-zval = 308.98 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1229 value = 3.2915 dict = 1.00 all = 3.2300 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 21.485043 GB avg = 0.332 KB (by entry num) total key len = 1.689324 GB avg = 0.026 KB total ukey len = 1.146980 GB avg = 0.015 KB total ukey num = 0.077975602 Billion total entry num = 0.064783331 Billion write speed all = 0.510970418 MB/sec (with seq num) write speed all = 0.499543184 MB/sec (without seq num) 2024/11/23-21:31:05.949452 139957231949376 [compaction_job.cc:1948] [default] [JOB 36177] Generated table #281595: 258856 keys, 83108189 bytes, temperature: kWarm 2024/11/23-21:31:05.949522 139957231949376 EVENT_LOG_v1 {"time_micros": 1732368665949486, "cf_name": "default", "job": 36177, "event": "table_file_creation", "file_number": 281595, "file_size": 83108189, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79980320, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177120, "raw_average_key_size": 20, "raw_value_size": 263259090, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 258856, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368662, "oldest_key_time": 0, "file_creation_time": 1732368662, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281595, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:31:06.005707 139957231949376 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281596.sst) /dev/shm/ToplingTemp/Topling-194097-nUIueT 2024/11/23-21:31:06.922925 139957231949376 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281596.sst): first pass time = 0.92's, 292.677'MB/sec 2024/11/23-21:31:08.384459 139957231949376 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281596.sst): old prealloc_size = 295279001, real_size = 80481936 2024/11/23-21:31:08.384646 139957231949376 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281596.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258858 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.00 avg-zval = 308.98 2024/11/23-21:31:08.384687 139957231949376 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281596.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:31:08.712316 139957231949376 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281596.sst): second pass time = 1.46's, 180.289'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.33's, 253.511'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2704.438'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.277'MB/sec write SST data time = 0.09's, 884.908'MB/sec dict compress time = 0.00's, 2689592.000'MB/sec z-dict build time = 0.00's, sample length = 2.690'MB, throughput = 62118.158'MB/sec zip my value time = 1.46's, unzip length = 0.263'GB zip my value throughput = 180.289'MB/sec zip pipeline throughput = 180.289'MB/sec entries = 258858 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 308.98 usrkeys = 258858 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 308.98 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1230 value = 3.2915 dict = 1.00 all = 3.2299 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 21.748301 GB avg = 0.334 KB (by entry num) total key len = 1.694502 GB avg = 0.026 KB total ukey len = 1.150086 GB avg = 0.015 KB total ukey num = 0.078234460 Billion total entry num = 0.065042189 Billion write speed all = 0.516856553 MB/sec (with seq num) write speed all = 0.505384381 MB/sec (without seq num) 2024/11/23-21:31:08.812356 139957231949376 [compaction_job.cc:1948] [default] [JOB 36177] Generated table #281596: 258858 keys, 83108971 bytes, temperature: kWarm 2024/11/23-21:31:08.812428 139957231949376 EVENT_LOG_v1 {"time_micros": 1732368668812392, "cf_name": "default", "job": 36177, "event": "table_file_creation", "file_number": 281596, "file_size": 83108971, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79980928, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177160, "raw_average_key_size": 20, "raw_value_size": 263258794, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 258858, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368665, "oldest_key_time": 0, "file_creation_time": 1732368665, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281596, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:31:08.871640 139957231949376 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281597.sst) /dev/shm/ToplingTemp/Topling-194097-2kIJ1U 2024/11/23-21:31:10.256338 139957231949376 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281597.sst): first pass time = 1.38's, 193.865'MB/sec 2024/11/23-21:31:11.747965 139957231949376 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281597.sst): old prealloc_size = 295279001, real_size = 80471776 2024/11/23-21:31:11.748176 139957231949376 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281597.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258864 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1016.98 avg-zval = 308.93 2024/11/23-21:31:11.748228 139957231949376 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281597.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:31:12.075441 139957231949376 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281597.sst): second pass time = 1.49's, 176.640'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.33's, 253.770'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2780.958'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.276'MB/sec write SST data time = 0.09's, 892.512'MB/sec dict compress time = 0.00's, 2689345.000'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 85929.802'MB/sec zip my value time = 1.49's, unzip length = 0.263'GB zip my value throughput = 176.640'MB/sec zip pipeline throughput = 176.640'MB/sec entries = 258864 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1016.98 avg-zval = 308.93 usrkeys = 258864 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1016.98 avg-zval = 308.93 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 8 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1231 value = 3.2919 dict = 1.00 all = 3.2303 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 22.011560 GB avg = 0.337 KB (by entry num) total key len = 1.699679 GB avg = 0.026 KB total ukey len = 1.153193 GB avg = 0.015 KB total ukey num = 0.078493324 Billion total entry num = 0.065301053 Billion write speed all = 0.522736145 MB/sec (with seq num) write speed all = 0.511219169 MB/sec (without seq num) 2024/11/23-21:31:12.177799 139957231949376 [compaction_job.cc:1948] [default] [JOB 36177] Generated table #281597: 258864 keys, 83098548 bytes, temperature: kWarm 2024/11/23-21:31:12.177869 139957231949376 EVENT_LOG_v1 {"time_micros": 1732368672177833, "cf_name": "default", "job": 36177, "event": "table_file_creation", "file_number": 281597, "file_size": 83098548, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79970768, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177280, "raw_average_key_size": 20, "raw_value_size": 263258451, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 258864, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368668, "oldest_key_time": 0, "file_creation_time": 1732368668, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281597, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:31:12.235603 139957231949376 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281598.sst) /dev/shm/ToplingTemp/Topling-194097-4z6hVU 2024/11/23-21:31:13.608807 139957231949376 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281598.sst): first pass time = 1.37's, 195.488'MB/sec 2024/11/23-21:31:15.098541 139957231949376 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281598.sst): old prealloc_size = 295279001, real_size = 80478432 2024/11/23-21:31:15.098730 139957231949376 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281598.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258858 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.00 avg-zval = 308.96 2024/11/23-21:31:15.098775 139957231949376 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281598.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:31:15.428324 139957231949376 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281598.sst): second pass time = 1.49's, 176.868'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.33's, 252.016'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2681.391'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.276'MB/sec write SST data time = 0.10's, 870.823'MB/sec dict compress time = 0.00's, 2689231.000'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 69487.378'MB/sec zip my value time = 1.49's, unzip length = 0.263'GB zip my value throughput = 176.868'MB/sec zip pipeline throughput = 176.868'MB/sec entries = 258858 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 308.96 usrkeys = 258858 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 308.96 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 8 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1230 value = 3.2917 dict = 1.00 all = 3.2301 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 22.274819 GB avg = 0.340 KB (by entry num) total key len = 1.704856 GB avg = 0.026 KB total ukey len = 1.156299 GB avg = 0.015 KB total ukey num = 0.078752182 Billion total entry num = 0.065559911 Billion write speed all = 0.528615001 MB/sec (with seq num) write speed all = 0.517053225 MB/sec (without seq num) 2024/11/23-21:31:15.527291 139957231949376 [compaction_job.cc:1948] [default] [JOB 36177] Generated table #281598: 258858 keys, 83105090 bytes, temperature: kWarm 2024/11/23-21:31:15.527363 139957231949376 EVENT_LOG_v1 {"time_micros": 1732368675527327, "cf_name": "default", "job": 36177, "event": "table_file_creation", "file_number": 281598, "file_size": 83105090, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79977424, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177160, "raw_average_key_size": 20, "raw_value_size": 263259317, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 258858, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368672, "oldest_key_time": 0, "file_creation_time": 1732368672, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281598, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:31:15.586847 139957231949376 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281599.sst) /dev/shm/ToplingTemp/Topling-194097-qvtYNT 2024/11/23-21:31:17.111233 139957231949376 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281599.sst): first pass time = 1.52's, 176.100'MB/sec 2024/11/23-21:31:18.610424 139957231949376 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281599.sst): old prealloc_size = 295279001, real_size = 80480176 2024/11/23-21:31:18.610606 139957231949376 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281599.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258855 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.01 avg-zval = 308.97 2024/11/23-21:31:18.610644 139957231949376 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281599.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:31:18.942119 139957231949376 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281599.sst): second pass time = 1.50's, 175.744'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.33's, 250.569'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2764.230'MB/sec (index lex order gen) rebuild zvType time = 0.24's, 0.270'MB/sec write SST data time = 0.09's, 909.219'MB/sec dict compress time = 0.00's, 2688869.000'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 84988.590'MB/sec zip my value time = 1.50's, unzip length = 0.263'GB zip my value throughput = 175.744'MB/sec zip pipeline throughput = 175.744'MB/sec entries = 258855 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.01 avg-zval = 308.97 usrkeys = 258855 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.01 avg-zval = 308.97 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1229 value = 3.2916 dict = 1.00 all = 3.2300 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 22.538078 GB avg = 0.342 KB (by entry num) total key len = 1.710033 GB avg = 0.026 KB total ukey len = 1.159405 GB avg = 0.015 KB total ukey num = 0.079011037 Billion total entry num = 0.065818766 Billion write speed all = 0.534491077 MB/sec (with seq num) write speed all = 0.522884550 MB/sec (without seq num) 2024/11/23-21:31:19.041837 139957231949376 [compaction_job.cc:1948] [default] [JOB 36177] Generated table #281599: 258855 keys, 83106520 bytes, temperature: kWarm 2024/11/23-21:31:19.041907 139957231949376 EVENT_LOG_v1 {"time_micros": 1732368679041872, "cf_name": "default", "job": 36177, "event": "table_file_creation", "file_number": 281599, "file_size": 83106520, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79979168, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177100, "raw_average_key_size": 20, "raw_value_size": 263258689, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 258855, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368675, "oldest_key_time": 0, "file_creation_time": 1732368675, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281599, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:31:19.097889 139957231949376 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281600.sst) /dev/shm/ToplingTemp/Topling-194097-WkkGOU 2024/11/23-21:31:20.505854 139957231949376 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281600.sst): first pass time = 1.41's, 190.660'MB/sec 2024/11/23-21:31:21.989399 139957231949376 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281600.sst): old prealloc_size = 295279001, real_size = 80480416 2024/11/23-21:31:21.989600 139957231949376 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281600.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258858 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.00 avg-zval = 308.97 2024/11/23-21:31:21.989641 139957231949376 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281600.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:31:22.313302 139957231949376 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281600.sst): second pass time = 1.48's, 177.603'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.32's, 256.598'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2495.442'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.277'MB/sec write SST data time = 0.09's, 922.835'MB/sec dict compress time = 0.00's, 2688939.000'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 81820.198'MB/sec zip my value time = 1.48's, unzip length = 0.263'GB zip my value throughput = 177.603'MB/sec zip pipeline throughput = 177.603'MB/sec entries = 258858 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 308.97 usrkeys = 258858 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 308.97 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 8 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1230 value = 3.2916 dict = 1.00 all = 3.2300 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 22.801336 GB avg = 0.345 KB (by entry num) total key len = 1.715210 GB avg = 0.026 KB total ukey len = 1.162512 GB avg = 0.015 KB total ukey num = 0.079269895 Billion total entry num = 0.066077624 Billion write speed all = 0.540367937 MB/sec (with seq num) write speed all = 0.528716629 MB/sec (without seq num) 2024/11/23-21:31:22.410611 139957231949376 [compaction_job.cc:1948] [default] [JOB 36177] Generated table #281600: 258858 keys, 83106782 bytes, temperature: kWarm 2024/11/23-21:31:22.410682 139957231949376 EVENT_LOG_v1 {"time_micros": 1732368682410646, "cf_name": "default", "job": 36177, "event": "table_file_creation", "file_number": 281600, "file_size": 83106782, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79979408, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177160, "raw_average_key_size": 20, "raw_value_size": 263258433, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 258858, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368679, "oldest_key_time": 0, "file_creation_time": 1732368679, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281600, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:31:22.482012 139957231949376 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281601.sst) /dev/shm/ToplingTemp/Topling-194097-ksCifS 2024/11/23-21:31:23.895632 139957231949376 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281601.sst): first pass time = 1.41's, 189.899'MB/sec 2024/11/23-21:31:25.372448 139957231949376 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281601.sst): old prealloc_size = 295279001, real_size = 80481040 2024/11/23-21:31:25.372633 139957231949376 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281601.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258853 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.02 avg-zval = 308.98 2024/11/23-21:31:25.372674 139957231949376 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281601.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:31:25.699202 139957231949376 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281601.sst): second pass time = 1.48's, 178.423'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.33's, 254.367'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2698.681'MB/sec (index lex order gen) rebuild zvType time = 0.24's, 0.275'MB/sec write SST data time = 0.09's, 912.223'MB/sec dict compress time = 0.00's, 2689718.000'MB/sec z-dict build time = 0.00's, sample length = 2.690'MB, throughput = 78981.589'MB/sec zip my value time = 1.48's, unzip length = 0.263'GB zip my value throughput = 178.423'MB/sec zip pipeline throughput = 178.423'MB/sec entries = 258853 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.02 avg-zval = 308.98 usrkeys = 258853 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.02 avg-zval = 308.98 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1228 value = 3.2916 dict = 1.00 all = 3.2300 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 23.064595 GB avg = 0.348 KB (by entry num) total key len = 1.720387 GB avg = 0.026 KB total ukey len = 1.165618 GB avg = 0.015 KB total ukey num = 0.079528748 Billion total entry num = 0.066336477 Billion write speed all = 0.546243760 MB/sec (with seq num) write speed all = 0.534547682 MB/sec (without seq num) 2024/11/23-21:31:25.795649 139957231949376 [compaction_job.cc:1948] [default] [JOB 36177] Generated table #281601: 258853 keys, 83108201 bytes, temperature: kWarm 2024/11/23-21:31:25.795719 139957231949376 EVENT_LOG_v1 {"time_micros": 1732368685795684, "cf_name": "default", "job": 36177, "event": "table_file_creation", "file_number": 281601, "file_size": 83108201, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79980032, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177060, "raw_average_key_size": 20, "raw_value_size": 263259121, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 258853, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368682, "oldest_key_time": 0, "file_creation_time": 1732368682, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281601, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:31:25.855871 139957231949376 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281602.sst) /dev/shm/ToplingTemp/Topling-194097-vQc9WR 2024/11/23-21:31:27.218234 139957231949376 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281602.sst): first pass time = 1.36's, 197.043'MB/sec 2024/11/23-21:31:28.733467 139957231949376 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281602.sst): old prealloc_size = 295279001, real_size = 80477808 2024/11/23-21:31:28.733641 139957231949376 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281602.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258863 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1016.98 avg-zval = 308.95 2024/11/23-21:31:28.733681 139957231949376 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281602.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:31:29.055373 139957231949376 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281602.sst): second pass time = 1.51's, 173.885'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.32's, 258.178'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2930.753'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.278'MB/sec write SST data time = 0.09's, 932.232'MB/sec dict compress time = 0.00's, 2688753.000'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 82659.647'MB/sec zip my value time = 1.51's, unzip length = 0.263'GB zip my value throughput = 173.885'MB/sec zip pipeline throughput = 173.885'MB/sec entries = 258863 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1016.98 avg-zval = 308.95 usrkeys = 258863 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1016.98 avg-zval = 308.95 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1231 value = 3.2917 dict = 1.00 all = 3.2301 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 23.327854 GB avg = 0.350 KB (by entry num) total key len = 1.725565 GB avg = 0.026 KB total ukey len = 1.168724 GB avg = 0.015 KB total ukey num = 0.079787611 Billion total entry num = 0.066595340 Billion write speed all = 0.552119062 MB/sec (with seq num) write speed all = 0.540378211 MB/sec (without seq num) 2024/11/23-21:31:29.151263 139957231949376 [compaction_job.cc:1948] [default] [JOB 36177] Generated table #281602: 258863 keys, 83104036 bytes, temperature: kWarm 2024/11/23-21:31:29.151330 139957231949376 EVENT_LOG_v1 {"time_micros": 1732368689151295, "cf_name": "default", "job": 36177, "event": "table_file_creation", "file_number": 281602, "file_size": 83104036, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79976800, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177260, "raw_average_key_size": 20, "raw_value_size": 263258696, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 258863, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368685, "oldest_key_time": 0, "file_creation_time": 1732368685, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281602, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:31:29.208103 139957231949376 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281603.sst) /dev/shm/ToplingTemp/Topling-194097-b9ClXV 2024/11/23-21:31:29.352660 139957231949376 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281603.sst): first pass time = 0.14's, 743.074'MB/sec 2024/11/23-21:31:30.018751 139957231949376 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281603.sst): old prealloc_size = 295279001, real_size = 32344368 2024/11/23-21:31:30.018859 139957231949376 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281603.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 103555 prefix = 4 raw-key = 0.0008 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1053 GB zip-val = 0.0321 GB avg-val =1017.00 avg-zval = 310.39 2024/11/23-21:31:30.018895 139957231949376 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281603.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0002 GB, waited 0.000 sec, Key+Value = 0.107 GB 2024/11/23-21:31:30.148136 139957231949376 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00/281603.sst): second pass time = 0.66's, 158.428'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.13's, 258.304'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2001.209'MB/sec (index lex order gen) rebuild zvType time = 0.09's, 0.273'MB/sec write SST data time = 0.03's, 965.869'MB/sec dict compress time = 0.00's, 1094178.000'MB/sec z-dict build time = 0.00's, sample length = 1.094'MB, throughput = 32398.010'MB/sec zip my value time = 0.66's, unzip length = 0.105'GB zip my value throughput = 158.428'MB/sec zip pipeline throughput = 158.428'MB/sec entries = 103555 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1017.00 avg-zval = 310.39 usrkeys = 103555 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1017.00 avg-zval = 310.39 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0012 GB value = 0.1053 GB dict = 1.09 MB all = 0.1074 GB } __ZipSize{ index = 0.0002 GB value = 0.0321 GB dict = 1.09 MB all = 0.0334 GB } UnZip/Zip{ index = 7.0838 value = 3.2765 dict = 1.00 all = 3.2138 } Zip/UnZip{ index = 0.1412 value = 0.3052 dict = 1.00 all = 0.3112 } ---------------------------- total value len = 23.433170 GB avg = 0.351 KB (by entry num) total key len = 1.727636 GB avg = 0.026 KB total ukey len = 1.169967 GB avg = 0.015 KB total ukey num = 0.079891166 Billion total entry num = 0.066698895 Billion write speed all = 0.554472260 MB/sec (with seq num) write speed all = 0.542713435 MB/sec (without seq num) 2024/11/23-21:31:30.190106 139957231949376 [compaction_job.cc:1948] [default] [JOB 36177] Generated table #281603: 103555 keys, 33414227 bytes, temperature: kWarm 2024/11/23-21:31:30.190172 139957231949376 EVENT_LOG_v1 {"time_micros": 1732368690190139, "cf_name": "default", "job": 36177, "event": "table_file_creation", "file_number": 281603, "file_size": 33414227, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 32142880, "index_size": 175424, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2071100, "raw_average_key_size": 20, "raw_value_size": 105315458, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 103555, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368689, "oldest_key_time": 0, "file_creation_time": 1732368689, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281603, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:31:30.213550 139957231949376 [compaction_job.cc:703] job-36177: subcompact[0], size: 4.606847 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36177/att-00 [281548,281549,281550,281551,281552,281553,281554,281555,281556,281557,281558,281559,281560,281561,281562,281563,281564,281565,281566,281567,281568,281569,281570,281571,281572,281573,281574,281575,281576,281577,281578,281579,281580,281581,281582,281583,281584,281585,281586,281587,281588,281589,281590,281591,281592,281593,281594,281595,281596,281597,281598,281599,281600,281601,281602,281603] 2024/11/23-21:31:30.831880 139957231949376 (Original Log Time 2024/11/23-21:28:26.108149) EVENT_LOG_v1 {"time_micros": 1732368506108105, "job": 36177, "event": "compaction_started", "compaction_reason": "ManualCompaction", "files_L3": [281540, 281541], "files_L4": [281490, 281491, 281492, 281493, 281494, 281495, 281496, 281497, 281498, 281499, 281500, 281501, 281502, 281503, 281504, 281505, 281506, 281507, 281508, 281509, 281510, 281511, 281512, 281513, 281514, 281515, 281516, 281517, 281518, 281519, 281520, 281521, 281522, 281523, 281524, 281525, 281526, 281527, 281528, 281529, 281530, 281531, 281532, 281533, 281534, 281535, 281536, 281537, 281538, 223358, 255711, 255708, 255481, 206772, 206775, 206773, 206774, 238186, 211878, 254044, 245599, 245343, 230044, 207566, 207568, 207569, 207570, 261283, 236339, 261152, 228698, 260896, 243819, 243717, 243494, 208671, 208674, 208672, 208673], "score": -1, "input_data_size": 4649382788, "oldest_snapshot_seqno": 4272952489} 2024/11/23-21:31:30.831886 139957231949376 (Original Log Time 2024/11/23-21:31:30.829677) [compaction_job.cc:2022] [default] [JOB 36177] Compacted 2@3 + 79@4 files to L4 => 4606846806 bytes 2024/11/23-21:31:30.831887 139957231949376 (Original Log Time 2024/11/23-21:31:30.831802) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 0 56 0 0] max score 0.02, MB/sec: 25.3 rd, 25.0 wr, level 4, files in(2, 79) out(56 +0 blob) MB in(59.8, 4374.2 +0.0 blob) out(4393.4 +0.0 blob), read-write-amplify(147.6) write-amplify(73.5) OK, records in: 14462079, records dropped: 121348 output_compression: Snappy 2024/11/23-21:31:30.831891 139957231949376 (Original Log Time 2024/11/23-21:31:30.831853) EVENT_LOG_v1 {"time_micros": 1732368690831825, "cf": "default", "job": 36177, "event": "compaction_finished", "compaction_time_micros": 184105405, "compaction_time_cpu_micros": 39467712, "output_level": 4, "num_output_files": 56, "total_output_size": 4606846806, "num_input_records": 14462079, "num_output_records": 14340731, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 3142101081, "file_range_sync_nanos": 0, "file_fsync_nanos": 39488, "file_prepare_write_nanos": 130110, "lsm_state": [0, 0, 0, 0, 56, 0, 0]} 2024/11/23-21:31:30.955539 139957231949376 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732256054,"starts":1732368505,"executesMs":184875,"compactionJobId":36177,"attempt":0,"compactionInputRawBytes":14997201221,"compactionInputZipBytes":4649382788,"compactionOutputRawBytes":0,"compactionOutputZipBytes":4606846806,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-02ecc2d57ffe57607f6be5ab2050ec09-d35253dd9e8e787c-00"}}, response = 2024/11/23-21:31:30.955620 139957231949376 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-36177/att-00: olev 4, work 184.875 s, result 7.797 ms, install 2.228 ms, input{raw 13.967 GiB zip 4.330 GiB}