2024/11/23-17:09:57.199144 139957525694016 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00: fork to child time = 0.007804 sec 2024/11/23-17:09:57.199885 139957525694016 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00 2024/11/23-17:09:57.208928 139957525694016 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00 2024/11/23-17:09:57.209853 139957525694016 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/23-17:09:57.210136 139957525694016 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/23-17:09:57.267172 139957525694016 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-31568/att-00/MANIFEST-206347 2024/11/23-17:09:57.300242 139957525694016 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-31568/att-00/MANIFEST-206347 succeeded,manifest_file_number is 206347, next_file_number is 271480, last_sequence is 4136372828, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 271328 2024/11/23-17:09:57.300252 139957525694016 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/23-17:09:57.300380 139957525694016 [version_set.cc:5721] Creating manifest 271480 2024/11/23-17:09:57.335511 139957525694016 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/23-17:09:57.360058 139957525694016 [compaction_job.cc:2437] [default] [JOB 31568] Compacting 1@2 + 22@3 files to L3, score 1.00, subcompactions 1 : 1 2024/11/23-17:09:57.360077 139957525694016 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 23619 Base level 2, inputs: [271465(31MB)], [271384(40MB) 271385(40MB) 271386(40MB) 271387(40MB) 271388(40MB) 271389(40MB) 271390(40MB) 271391(40MB) 271392(40MB) 271393(40MB) 271394(40MB) 271395(40MB) 271396(40MB) 271397(40MB) 271398(40MB) 271399(40MB) 271400(40MB) 271401(40MB) 271402(40MB) 271403(40MB) 271404(39MB) 271473(39MB)] 2024/11/23-17:09:57.367168 139957525694016 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-17:09:57.367197 139957525694016 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-17:09:57.367217 139957525694016 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-17:09:57.367223 139957525694016 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-17:09:57.367235 139957525694016 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-17:09:58.267942 139957525694016 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271481.sst) /dev/shm/ToplingTemp/Topling-127549-AcuaNS 2024/11/23-17:09:58.505885 139957525694016 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271481.sst): first pass time = 0.24's, 564.269'MB/sec 2024/11/23-17:09:59.304520 139957525694016 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271481.sst): old prealloc_size = 147639500, real_size = 40605648 2024/11/23-17:09:59.304641 139957525694016 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271481.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.81 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1016.99 avg-zval = 311.67 2024/11/23-17:09:59.305024 139957525694016 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271481.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-17:09:59.468898 139957525694016 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271481.sst): second pass time = 0.80's, 165.123'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 258.176'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2302.494'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.269'MB/sec write SST data time = 0.04's, 962.428'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 46816.847'MB/sec zip my value time = 0.80's, unzip length = 0.132'GB zip my value throughput = 165.123'MB/sec zip pipeline throughput = 165.123'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.81 avg-val = 1016.99 avg-zval = 311.67 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.81 avg-val = 1023.99 avg-zval = 311.67 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129431 bytes = 485376 } seq expand size = 906017 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 6.6470 value = 3.2631 dict = 1.00 all = 3.1627 } Zip/UnZip{ index = 0.1504 value = 0.3065 dict = 1.00 all = 0.3162 } ---------------------------- total value len = 8.981156 GB avg = 0.171 KB (by entry num) total key len = 1.443410 GB avg = 0.028 KB total ukey len = 0.999431 GB avg = 0.015 KB total ukey num = 0.065679866 Billion total entry num = 0.052487595 Billion write speed all = 0.351146158 MB/sec (with seq num) write speed all = 0.337002015 MB/sec (without seq num) 2024/11/23-17:09:59.519901 139957525694016 [compaction_job.cc:1948] [default] [JOB 31568] Generated table #271481: 129431 keys, 42438188 bytes, temperature: kWarm 2024/11/23-17:09:59.520004 139957525694016 EVENT_LOG_v1 {"time_micros": 1732352999519933, "cf_name": "default", "job": 31568, "event": "table_file_creation", "file_number": 271481, "file_size": 42438188, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237877277, "largest_seqno": 4136222065, "table_properties": {"data_size": 40339456, "index_size": 233664, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131629769, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352998, "oldest_key_time": 0, "file_creation_time": 1732352998, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 271481, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-17:09:59.558413 139957525694016 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271482.sst) /dev/shm/ToplingTemp/Topling-127549-ZPXj7S 2024/11/23-17:10:00.220579 139957525694016 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271482.sst): first pass time = 0.66's, 202.711'MB/sec 2024/11/23-17:10:01.046744 139957525694016 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271482.sst): old prealloc_size = 147639500, real_size = 40862928 2024/11/23-17:10:01.046872 139957525694016 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271482.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129433 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.74 raw-val = 0.1316 GB zip-val = 0.0406 GB avg-val =1016.97 avg-zval = 313.72 2024/11/23-17:10:01.047038 139957525694016 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271482.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-17:10:01.208088 139957525694016 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271482.sst): second pass time = 0.82's, 159.621'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 264.661'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2102.669'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.278'MB/sec write SST data time = 0.04's, 954.929'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 47724.836'MB/sec zip my value time = 0.82's, unzip length = 0.132'GB zip my value throughput = 159.621'MB/sec zip pipeline throughput = 159.621'MB/sec entries = 129433 avg-key = 20.00 avg-zkey = 1.74 avg-val = 1016.97 avg-zval = 313.72 usrkeys = 129433 avg-key = 12.00 avg-zkey = 1.74 avg-val = 1023.97 avg-zval = 313.72 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129433 bytes = 485392 } seq expand size = 906031 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0406 GB dict = 1.38 MB all = 0.0427 GB } UnZip/Zip{ index = 6.8945 value = 3.2417 dict = 1.00 all = 3.1436 } Zip/UnZip{ index = 0.1450 value = 0.3085 dict = 1.00 all = 0.3181 } ---------------------------- total value len = 9.113692 GB avg = 0.173 KB (by entry num) total key len = 1.445998 GB avg = 0.027 KB total ukey len = 1.000984 GB avg = 0.015 KB total ukey num = 0.065809299 Billion total entry num = 0.052617028 Billion write speed all = 0.355676925 MB/sec (with seq num) write speed all = 0.341498734 MB/sec (without seq num) 2024/11/23-17:10:01.260087 139957525694016 [compaction_job.cc:1948] [default] [JOB 31568] Generated table #271482: 129433 keys, 42696036 bytes, temperature: kWarm 2024/11/23-17:10:01.260158 139957525694016 EVENT_LOG_v1 {"time_micros": 1732353001260121, "cf_name": "default", "job": 31568, "event": "table_file_creation", "file_number": 271482, "file_size": 42696036, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237868195, "largest_seqno": 4136218296, "table_properties": {"data_size": 40605120, "index_size": 225280, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588660, "raw_average_key_size": 20, "raw_value_size": 131629927, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129433, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352999, "oldest_key_time": 0, "file_creation_time": 1732352999, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 271482, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-17:10:01.301326 139957525694016 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271483.sst) /dev/shm/ToplingTemp/Topling-127549-boLGvT 2024/11/23-17:10:01.843833 139957525694016 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271483.sst): first pass time = 0.54's, 247.419'MB/sec 2024/11/23-17:10:02.787141 139957525694016 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271483.sst): old prealloc_size = 147639500, real_size = 40581072 2024/11/23-17:10:02.787260 139957525694016 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271483.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129432 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.81 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1016.98 avg-zval = 311.47 2024/11/23-17:10:02.787419 139957525694016 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271483.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-17:10:02.950111 139957525694016 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271483.sst): second pass time = 0.94's, 139.682'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 260.288'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2403.460'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.275'MB/sec write SST data time = 0.05's, 935.244'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 37479.472'MB/sec zip my value time = 0.94's, unzip length = 0.132'GB zip my value throughput = 139.682'MB/sec zip pipeline throughput = 153.042'MB/sec entries = 129432 avg-key = 20.00 avg-zkey = 1.81 avg-val = 1016.98 avg-zval = 311.47 usrkeys = 129432 avg-key = 12.00 avg-zkey = 1.81 avg-val = 1023.98 avg-zval = 311.47 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129432 bytes = 485392 } seq expand size = 906024 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 6.6380 value = 3.2651 dict = 1.00 all = 3.1645 } Zip/UnZip{ index = 0.1506 value = 0.3063 dict = 1.00 all = 0.3160 } ---------------------------- total value len = 9.246227 GB avg = 0.175 KB (by entry num) total key len = 1.448587 GB avg = 0.027 KB total ukey len = 1.002538 GB avg = 0.015 KB total ukey num = 0.065938731 Billion total entry num = 0.052746460 Billion write speed all = 0.360207101 MB/sec (with seq num) write speed all = 0.345994867 MB/sec (without seq num) 2024/11/23-17:10:03.002552 139957525694016 [compaction_job.cc:1948] [default] [JOB 31568] Generated table #271483: 129432 keys, 42413397 bytes, temperature: kWarm 2024/11/23-17:10:03.002614 139957525694016 EVENT_LOG_v1 {"time_micros": 1732353003002582, "cf_name": "default", "job": 31568, "event": "table_file_creation", "file_number": 271483, "file_size": 42413397, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237873554, "largest_seqno": 4136220721, "table_properties": {"data_size": 40314560, "index_size": 233984, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588640, "raw_average_key_size": 20, "raw_value_size": 131629187, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129432, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732353001, "oldest_key_time": 0, "file_creation_time": 1732353001, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 271483, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-17:10:03.042190 139957525694016 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271484.sst) /dev/shm/ToplingTemp/Topling-127549-aZjuoR 2024/11/23-17:10:03.904899 139957525694016 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271484.sst): first pass time = 0.86's, 155.584'MB/sec 2024/11/23-17:10:04.799830 139957525694016 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271484.sst): old prealloc_size = 147639500, real_size = 40873584 2024/11/23-17:10:04.799952 139957525694016 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271484.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129433 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.74 raw-val = 0.1316 GB zip-val = 0.0406 GB avg-val =1016.97 avg-zval = 313.80 2024/11/23-17:10:04.800126 139957525694016 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271484.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-17:10:04.962640 139957525694016 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271484.sst): second pass time = 0.89's, 147.218'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 262.342'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2260.010'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.274'MB/sec write SST data time = 0.04's, 957.790'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 44703.329'MB/sec zip my value time = 0.89's, unzip length = 0.132'GB zip my value throughput = 147.218'MB/sec zip pipeline throughput = 147.218'MB/sec entries = 129433 avg-key = 20.00 avg-zkey = 1.74 avg-val = 1016.97 avg-zval = 313.80 usrkeys = 129433 avg-key = 12.00 avg-zkey = 1.74 avg-val = 1023.97 avg-zval = 313.80 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129433 bytes = 485392 } seq expand size = 906031 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0406 GB dict = 1.38 MB all = 0.0427 GB } UnZip/Zip{ index = 6.9004 value = 3.2408 dict = 1.00 all = 3.1428 } Zip/UnZip{ index = 0.1449 value = 0.3086 dict = 1.00 all = 0.3182 } ---------------------------- total value len = 9.378762 GB avg = 0.177 KB (by entry num) total key len = 1.451176 GB avg = 0.027 KB total ukey len = 1.004091 GB avg = 0.015 KB total ukey num = 0.066068164 Billion total entry num = 0.052875893 Billion write speed all = 0.364733429 MB/sec (with seq num) write speed all = 0.350487285 MB/sec (without seq num) 2024/11/23-17:10:05.019024 139957525694016 [compaction_job.cc:1948] [default] [JOB 31568] Generated table #271484: 129433 keys, 42706229 bytes, temperature: kWarm 2024/11/23-17:10:05.019095 139957525694016 EVENT_LOG_v1 {"time_micros": 1732353005019060, "cf_name": "default", "job": 31568, "event": "table_file_creation", "file_number": 271484, "file_size": 42706229, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237868596, "largest_seqno": 4136196396, "table_properties": {"data_size": 40615968, "index_size": 225088, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588660, "raw_average_key_size": 20, "raw_value_size": 131629339, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129433, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732353003, "oldest_key_time": 0, "file_creation_time": 1732353003, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 271484, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-17:10:05.060142 139957525694016 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271485.sst) /dev/shm/ToplingTemp/Topling-127549-5zNeaQ 2024/11/23-17:10:05.748800 139957525694016 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271485.sst): first pass time = 0.69's, 194.908'MB/sec 2024/11/23-17:10:06.713880 139957525694016 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271485.sst): old prealloc_size = 147639500, real_size = 40585616 2024/11/23-17:10:06.714019 139957525694016 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271485.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.81 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1016.98 avg-zval = 311.51 2024/11/23-17:10:06.714185 139957525694016 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271485.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-17:10:06.877899 139957525694016 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271485.sst): second pass time = 0.96's, 136.591'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 258.647'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1998.616'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.273'MB/sec write SST data time = 0.05's, 931.568'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 46324.635'MB/sec zip my value time = 0.96's, unzip length = 0.132'GB zip my value throughput = 136.591'MB/sec zip pipeline throughput = 161.549'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.81 avg-val = 1016.98 avg-zval = 311.51 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.81 avg-val = 1023.98 avg-zval = 311.51 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129431 bytes = 485376 } seq expand size = 906017 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 6.6398 value = 3.2647 dict = 1.00 all = 3.1642 } Zip/UnZip{ index = 0.1506 value = 0.3063 dict = 1.00 all = 0.3160 } ---------------------------- total value len = 9.511297 GB avg = 0.179 KB (by entry num) total key len = 1.453764 GB avg = 0.027 KB total ukey len = 1.005644 GB avg = 0.015 KB total ukey num = 0.066197595 Billion total entry num = 0.053005324 Billion write speed all = 0.369260351 MB/sec (with seq num) write speed all = 0.354980257 MB/sec (without seq num) 2024/11/23-17:10:06.932048 139957525694016 [compaction_job.cc:1948] [default] [JOB 31568] Generated table #271485: 129431 keys, 42417985 bytes, temperature: kWarm 2024/11/23-17:10:06.932106 139957525694016 EVENT_LOG_v1 {"time_micros": 1732353006932075, "cf_name": "default", "job": 31568, "event": "table_file_creation", "file_number": 271485, "file_size": 42417985, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237869923, "largest_seqno": 4136200690, "table_properties": {"data_size": 40319168, "index_size": 233920, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131629364, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732353005, "oldest_key_time": 0, "file_creation_time": 1732353005, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 271485, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-17:10:06.971710 139957525694016 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271486.sst) /dev/shm/ToplingTemp/Topling-127549-S4k3nR 2024/11/23-17:10:07.800538 139957525694016 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271486.sst): first pass time = 0.83's, 161.944'MB/sec 2024/11/23-17:10:08.623440 139957525694016 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271486.sst): old prealloc_size = 147639500, real_size = 40585184 2024/11/23-17:10:08.623609 139957525694016 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271486.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.81 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1016.98 avg-zval = 311.51 2024/11/23-17:10:08.623788 139957525694016 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271486.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-17:10:08.803126 139957525694016 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271486.sst): second pass time = 0.82's, 160.242'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.18's, 236.087'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1786.206'MB/sec (index lex order gen) rebuild zvType time = 0.13's, 0.244'MB/sec write SST data time = 0.05's, 899.182'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 40193.231'MB/sec zip my value time = 0.82's, unzip length = 0.132'GB zip my value throughput = 160.242'MB/sec zip pipeline throughput = 160.242'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.81 avg-val = 1016.98 avg-zval = 311.51 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.81 avg-val = 1023.98 avg-zval = 311.51 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129431 bytes = 485376 } seq expand size = 906017 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 6.6379 value = 3.2647 dict = 1.00 all = 3.1642 } Zip/UnZip{ index = 0.1506 value = 0.3063 dict = 1.00 all = 0.3160 } ---------------------------- total value len = 9.643833 GB avg = 0.181 KB (by entry num) total key len = 1.456353 GB avg = 0.027 KB total ukey len = 1.007197 GB avg = 0.015 KB total ukey num = 0.066327026 Billion total entry num = 0.053134755 Billion write speed all = 0.373786557 MB/sec (with seq num) write speed all = 0.359472521 MB/sec (without seq num) 2024/11/23-17:10:08.858048 139957525694016 [compaction_job.cc:1948] [default] [JOB 31568] Generated table #271486: 129431 keys, 42417558 bytes, temperature: kWarm 2024/11/23-17:10:08.858117 139957525694016 EVENT_LOG_v1 {"time_micros": 1732353008858083, "cf_name": "default", "job": 31568, "event": "table_file_creation", "file_number": 271486, "file_size": 42417558, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237881756, "largest_seqno": 4136222139, "table_properties": {"data_size": 40318672, "index_size": 233984, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131629136, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732353006, "oldest_key_time": 0, "file_creation_time": 1732353006, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 271486, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-17:10:08.896808 139957525694016 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271487.sst) /dev/shm/ToplingTemp/Topling-127549-DUeflR 2024/11/23-17:10:09.444076 139957525694016 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271487.sst): first pass time = 0.55's, 245.270'MB/sec 2024/11/23-17:10:10.528661 139957525694016 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271487.sst): old prealloc_size = 147639500, real_size = 41080864 2024/11/23-17:10:10.528811 139957525694016 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271487.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129427 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.72 raw-val = 0.1316 GB zip-val = 0.0408 GB avg-val =1017.02 avg-zval = 315.44 2024/11/23-17:10:10.529011 139957525694016 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271487.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-17:10:10.713392 139957525694016 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271487.sst): second pass time = 1.08's, 121.462'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.18's, 232.325'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1739.985'MB/sec (index lex order gen) rebuild zvType time = 0.14's, 0.232'MB/sec write SST data time = 0.05's, 946.472'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 35818.428'MB/sec zip my value time = 1.08's, unzip length = 0.132'GB zip my value throughput = 121.462'MB/sec zip pipeline throughput = 191.430'MB/sec entries = 129427 avg-key = 20.00 avg-zkey = 1.72 avg-val = 1017.02 avg-zval = 315.44 usrkeys = 129427 avg-key = 12.00 avg-zkey = 1.72 avg-val = 1024.02 avg-zval = 315.44 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129427 bytes = 485360 } seq expand size = 905989 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0408 GB dict = 1.38 MB all = 0.0429 GB } UnZip/Zip{ index = 6.9815 value = 3.2242 dict = 1.00 all = 3.1276 } Zip/UnZip{ index = 0.1432 value = 0.3102 dict = 1.00 all = 0.3197 } ---------------------------- total value len = 9.776369 GB avg = 0.184 KB (by entry num) total key len = 1.458941 GB avg = 0.027 KB total ukey len = 1.008750 GB avg = 0.015 KB total ukey num = 0.066456453 Billion total entry num = 0.053264182 Billion write speed all = 0.378312387 MB/sec (with seq num) write speed all = 0.363964407 MB/sec (without seq num) 2024/11/23-17:10:10.776673 139957525694016 [compaction_job.cc:1948] [default] [JOB 31568] Generated table #271487: 129427 keys, 42913665 bytes, temperature: kWarm 2024/11/23-17:10:10.776741 139957525694016 EVENT_LOG_v1 {"time_micros": 1732353010776705, "cf_name": "default", "job": 31568, "event": "table_file_creation", "file_number": 271487, "file_size": 42913665, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237882779, "largest_seqno": 4136139540, "table_properties": {"data_size": 40825872, "index_size": 222464, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588540, "raw_average_key_size": 20, "raw_value_size": 131629863, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129427, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732353008, "oldest_key_time": 0, "file_creation_time": 1732353008, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 271487, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-17:10:10.816283 139957525694016 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271488.sst) /dev/shm/ToplingTemp/Topling-127549-oFg7PR 2024/11/23-17:10:11.321848 139957525694016 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271488.sst): first pass time = 0.51's, 265.505'MB/sec 2024/11/23-17:10:12.325709 139957525694016 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271488.sst): old prealloc_size = 147639500, real_size = 40897312 2024/11/23-17:10:12.325832 139957525694016 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271488.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.73 raw-val = 0.1316 GB zip-val = 0.0406 GB avg-val =1016.99 avg-zval = 313.99 2024/11/23-17:10:12.326005 139957525694016 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271488.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-17:10:12.487755 139957525694016 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271488.sst): second pass time = 1.00's, 131.314'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 263.726'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2231.411'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.272'MB/sec write SST data time = 0.04's, 996.974'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 47306.879'MB/sec zip my value time = 1.00's, unzip length = 0.132'GB zip my value throughput = 131.314'MB/sec zip pipeline throughput = 151.673'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.73 avg-val = 1016.99 avg-zval = 313.99 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.73 avg-val = 1023.99 avg-zval = 313.99 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129431 bytes = 485376 } seq expand size = 906017 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0406 GB dict = 1.38 MB all = 0.0427 GB } UnZip/Zip{ index = 6.9219 value = 3.2389 dict = 1.00 all = 3.1411 } Zip/UnZip{ index = 0.1445 value = 0.3087 dict = 1.00 all = 0.3184 } ---------------------------- total value len = 9.908904 GB avg = 0.186 KB (by entry num) total key len = 1.461530 GB avg = 0.027 KB total ukey len = 1.010303 GB avg = 0.015 KB total ukey num = 0.066585884 Billion total entry num = 0.053393613 Billion write speed all = 0.382839382 MB/sec (with seq num) write speed all = 0.368457396 MB/sec (without seq num) 2024/11/23-17:10:12.543351 139957525694016 [compaction_job.cc:1948] [default] [JOB 31568] Generated table #271488: 129431 keys, 42730207 bytes, temperature: kWarm 2024/11/23-17:10:12.543408 139957525694016 EVENT_LOG_v1 {"time_micros": 1732353012543376, "cf_name": "default", "job": 31568, "event": "table_file_creation", "file_number": 271488, "file_size": 42730207, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237868290, "largest_seqno": 4136224119, "table_properties": {"data_size": 40640400, "index_size": 224384, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131629617, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732353010, "oldest_key_time": 0, "file_creation_time": 1732353010, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 271488, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-17:10:12.580574 139957525694016 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271489.sst) /dev/shm/ToplingTemp/Topling-127549-UmebgS 2024/11/23-17:10:13.133477 139957525694016 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271489.sst): first pass time = 0.55's, 242.766'MB/sec 2024/11/23-17:10:14.001345 139957525694016 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271489.sst): old prealloc_size = 147639500, real_size = 40956752 2024/11/23-17:10:14.001486 139957525694016 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271489.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129432 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.73 raw-val = 0.1316 GB zip-val = 0.0407 GB avg-val =1016.98 avg-zval = 314.45 2024/11/23-17:10:14.001648 139957525694016 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271489.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-17:10:14.167853 139957525694016 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271489.sst): second pass time = 0.87's, 151.806'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.17's, 257.020'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1906.919'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.267'MB/sec write SST data time = 0.05's, 946.455'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 45260.750'MB/sec zip my value time = 0.87's, unzip length = 0.132'GB zip my value throughput = 151.806'MB/sec zip pipeline throughput = 151.806'MB/sec entries = 129432 avg-key = 20.00 avg-zkey = 1.73 avg-val = 1016.98 avg-zval = 314.45 usrkeys = 129432 avg-key = 12.00 avg-zkey = 1.73 avg-val = 1023.98 avg-zval = 314.45 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129432 bytes = 485392 } seq expand size = 906024 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0407 GB dict = 1.38 MB all = 0.0428 GB } UnZip/Zip{ index = 6.9339 value = 3.2341 dict = 1.00 all = 3.1367 } Zip/UnZip{ index = 0.1442 value = 0.3092 dict = 1.00 all = 0.3188 } ---------------------------- total value len = 10.041440 GB avg = 0.188 KB (by entry num) total key len = 1.464119 GB avg = 0.027 KB total ukey len = 1.011857 GB avg = 0.015 KB total ukey num = 0.066715316 Billion total entry num = 0.053523045 Billion write speed all = 0.387367058 MB/sec (with seq num) write speed all = 0.372951024 MB/sec (without seq num) 2024/11/23-17:10:14.223808 139957525694016 [compaction_job.cc:1948] [default] [JOB 31568] Generated table #271489: 129432 keys, 42789392 bytes, temperature: kWarm 2024/11/23-17:10:14.223882 139957525694016 EVENT_LOG_v1 {"time_micros": 1732353014223845, "cf_name": "default", "job": 31568, "event": "table_file_creation", "file_number": 271489, "file_size": 42789392, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237911757, "largest_seqno": 4136224127, "table_properties": {"data_size": 40700224, "index_size": 224000, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588640, "raw_average_key_size": 20, "raw_value_size": 131629354, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129432, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732353012, "oldest_key_time": 0, "file_creation_time": 1732353012, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 271489, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-17:10:14.271170 139957525694016 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271490.sst) /dev/shm/ToplingTemp/Topling-127549-sRKX1O 2024/11/23-17:10:14.907376 139957525694016 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271490.sst): first pass time = 0.64's, 210.985'MB/sec 2024/11/23-17:10:15.854381 139957525694016 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271490.sst): old prealloc_size = 147639500, real_size = 40591232 2024/11/23-17:10:15.854549 139957525694016 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271490.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.81 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1016.99 avg-zval = 311.55 2024/11/23-17:10:15.854735 139957525694016 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271490.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-17:10:16.063896 139957525694016 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271490.sst): second pass time = 0.95's, 139.251'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.21's, 202.501'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1600.285'MB/sec (index lex order gen) rebuild zvType time = 0.16's, 0.202'MB/sec write SST data time = 0.05's, 857.090'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 46831.277'MB/sec zip my value time = 0.95's, unzip length = 0.132'GB zip my value throughput = 139.251'MB/sec zip pipeline throughput = 153.932'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.81 avg-val = 1016.99 avg-zval = 311.55 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.81 avg-val = 1023.99 avg-zval = 311.55 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129431 bytes = 485376 } seq expand size = 906017 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 6.6398 value = 3.2642 dict = 1.00 all = 3.1637 } Zip/UnZip{ index = 0.1506 value = 0.3063 dict = 1.00 all = 0.3161 } ---------------------------- total value len = 10.173975 GB avg = 0.190 KB (by entry num) total key len = 1.466707 GB avg = 0.027 KB total ukey len = 1.013410 GB avg = 0.015 KB total ukey num = 0.066844747 Billion total entry num = 0.053652476 Billion write speed all = 0.391891386 MB/sec (with seq num) write speed all = 0.377441413 MB/sec (without seq num) 2024/11/23-17:10:16.115907 139957525694016 [compaction_job.cc:1948] [default] [JOB 31568] Generated table #271490: 129431 keys, 42424119 bytes, temperature: kWarm 2024/11/23-17:10:16.115970 139957525694016 EVENT_LOG_v1 {"time_micros": 1732353016115938, "cf_name": "default", "job": 31568, "event": "table_file_creation", "file_number": 271490, "file_size": 42424119, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237873877, "largest_seqno": 4136221913, "table_properties": {"data_size": 40324784, "index_size": 233920, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131629793, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732353014, "oldest_key_time": 0, "file_creation_time": 1732353014, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 271490, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-17:10:16.154717 139957525694016 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271491.sst) /dev/shm/ToplingTemp/Topling-127549-c5ly3P 2024/11/23-17:10:16.706237 139957525694016 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271491.sst): first pass time = 0.55's, 243.379'MB/sec 2024/11/23-17:10:17.535514 139957525694016 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271491.sst): old prealloc_size = 147639500, real_size = 40584208 2024/11/23-17:10:17.535652 139957525694016 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271491.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129429 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.81 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1017.00 avg-zval = 311.50 2024/11/23-17:10:17.535831 139957525694016 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271491.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-17:10:17.697634 139957525694016 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271491.sst): second pass time = 0.83's, 158.929'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 261.669'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2081.338'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.274'MB/sec write SST data time = 0.04's, 969.767'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 46142.245'MB/sec zip my value time = 0.83's, unzip length = 0.132'GB zip my value throughput = 158.929'MB/sec zip pipeline throughput = 158.929'MB/sec entries = 129429 avg-key = 20.00 avg-zkey = 1.81 avg-val = 1017.00 avg-zval = 311.50 usrkeys = 129429 avg-key = 12.00 avg-zkey = 1.81 avg-val = 1024.00 avg-zval = 311.50 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129429 bytes = 485376 } seq expand size = 906003 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 6.6378 value = 3.2648 dict = 1.00 all = 3.1643 } Zip/UnZip{ index = 0.1507 value = 0.3063 dict = 1.00 all = 0.3160 } ---------------------------- total value len = 10.306511 GB avg = 0.192 KB (by entry num) total key len = 1.469296 GB avg = 0.027 KB total ukey len = 1.014963 GB avg = 0.015 KB total ukey num = 0.066974176 Billion total entry num = 0.053781905 Billion write speed all = 0.396418629 MB/sec (with seq num) write speed all = 0.381934595 MB/sec (without seq num) 2024/11/23-17:10:17.750368 139957525694016 [compaction_job.cc:1948] [default] [JOB 31568] Generated table #271491: 129429 keys, 42416644 bytes, temperature: kWarm 2024/11/23-17:10:17.750432 139957525694016 EVENT_LOG_v1 {"time_micros": 1732353017750399, "cf_name": "default", "job": 31568, "event": "table_file_creation", "file_number": 271491, "file_size": 42416644, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237872082, "largest_seqno": 4136222170, "table_properties": {"data_size": 40317696, "index_size": 233984, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588580, "raw_average_key_size": 20, "raw_value_size": 131629622, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129429, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732353016, "oldest_key_time": 0, "file_creation_time": 1732353016, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 271491, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-17:10:17.787923 139957525694016 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271492.sst) /dev/shm/ToplingTemp/Topling-127549-t5gqSS 2024/11/23-17:10:18.542294 139957525694016 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271492.sst): first pass time = 0.75's, 177.929'MB/sec 2024/11/23-17:10:19.462777 139957525694016 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271492.sst): old prealloc_size = 147639500, real_size = 41003920 2024/11/23-17:10:19.462900 139957525694016 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271492.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.74 raw-val = 0.1316 GB zip-val = 0.0407 GB avg-val =1016.99 avg-zval = 314.81 2024/11/23-17:10:19.463074 139957525694016 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271492.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-17:10:19.625405 139957525694016 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271492.sst): second pass time = 0.92's, 143.192'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 263.445'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2233.800'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.274'MB/sec write SST data time = 0.04's, 967.638'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 47297.004'MB/sec zip my value time = 0.92's, unzip length = 0.132'GB zip my value throughput = 143.192'MB/sec zip pipeline throughput = 143.192'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.74 avg-val = 1016.99 avg-zval = 314.81 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.74 avg-val = 1023.99 avg-zval = 314.81 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129431 bytes = 485376 } seq expand size = 906017 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0407 GB dict = 1.38 MB all = 0.0428 GB } UnZip/Zip{ index = 6.9081 value = 3.2304 dict = 1.00 all = 3.1332 } Zip/UnZip{ index = 0.1448 value = 0.3096 dict = 1.00 all = 0.3192 } ---------------------------- total value len = 10.439046 GB avg = 0.194 KB (by entry num) total key len = 1.471885 GB avg = 0.027 KB total ukey len = 1.016516 GB avg = 0.015 KB total ukey num = 0.067103607 Billion total entry num = 0.053911336 Billion write speed all = 0.400941403 MB/sec (with seq num) write speed all = 0.386423454 MB/sec (without seq num) 2024/11/23-17:10:19.679097 139957525694016 [compaction_job.cc:1948] [default] [JOB 31568] Generated table #271492: 129431 keys, 42836969 bytes, temperature: kWarm 2024/11/23-17:10:19.679167 139957525694016 EVENT_LOG_v1 {"time_micros": 1732353019679131, "cf_name": "default", "job": 31568, "event": "table_file_creation", "file_number": 271492, "file_size": 42836969, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237888398, "largest_seqno": 4136219954, "table_properties": {"data_size": 40746560, "index_size": 224832, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131629473, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732353017, "oldest_key_time": 0, "file_creation_time": 1732353017, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 271492, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-17:10:19.722916 139957525694016 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271493.sst) /dev/shm/ToplingTemp/Topling-127549-DK5FOS 2024/11/23-17:10:20.258820 139957525694016 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271493.sst): first pass time = 0.54's, 250.472'MB/sec 2024/11/23-17:10:21.091544 139957525694016 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271493.sst): old prealloc_size = 147639500, real_size = 40724368 2024/11/23-17:10:21.091674 139957525694016 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271493.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129425 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.79 raw-val = 0.1316 GB zip-val = 0.0405 GB avg-val =1017.04 avg-zval = 312.62 2024/11/23-17:10:21.091836 139957525694016 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271493.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-17:10:21.257395 139957525694016 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271493.sst): second pass time = 0.83's, 158.209'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.17's, 256.633'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2077.918'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.267'MB/sec write SST data time = 0.04's, 950.915'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 48311.148'MB/sec zip my value time = 0.83's, unzip length = 0.132'GB zip my value throughput = 158.209'MB/sec zip pipeline throughput = 158.209'MB/sec entries = 129425 avg-key = 20.00 avg-zkey = 1.79 avg-val = 1017.04 avg-zval = 312.62 usrkeys = 129425 avg-key = 12.00 avg-zkey = 1.79 avg-val = 1024.04 avg-zval = 312.62 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129425 bytes = 485360 } seq expand size = 905975 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0405 GB dict = 1.38 MB all = 0.0426 GB } UnZip/Zip{ index = 6.7111 value = 3.2533 dict = 1.00 all = 3.1538 } Zip/UnZip{ index = 0.1490 value = 0.3074 dict = 1.00 all = 0.3171 } ---------------------------- total value len = 10.571582 GB avg = 0.196 KB (by entry num) total key len = 1.474473 GB avg = 0.027 KB total ukey len = 1.018069 GB avg = 0.015 KB total ukey num = 0.067233032 Billion total entry num = 0.054040761 Billion write speed all = 0.405467634 MB/sec (with seq num) write speed all = 0.390915631 MB/sec (without seq num) 2024/11/23-17:10:21.310071 139957525694016 [compaction_job.cc:1948] [default] [JOB 31568] Generated table #271493: 129425 keys, 42557533 bytes, temperature: kWarm 2024/11/23-17:10:21.310142 139957525694016 EVENT_LOG_v1 {"time_micros": 1732353021310106, "cf_name": "default", "job": 31568, "event": "table_file_creation", "file_number": 271493, "file_size": 42557533, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237871365, "largest_seqno": 4136214310, "table_properties": {"data_size": 40460416, "index_size": 231424, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588500, "raw_average_key_size": 20, "raw_value_size": 131629848, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129425, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732353019, "oldest_key_time": 0, "file_creation_time": 1732353019, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 271493, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-17:10:21.350520 139957525694016 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271494.sst) /dev/shm/ToplingTemp/Topling-127549-DuJOtR 2024/11/23-17:10:22.062724 139957525694016 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271494.sst): first pass time = 0.71's, 188.465'MB/sec 2024/11/23-17:10:22.834125 139957525694016 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271494.sst): old prealloc_size = 147639500, real_size = 40517952 2024/11/23-17:10:22.834242 139957525694016 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271494.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129428 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.74 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1017.01 avg-zval = 311.07 2024/11/23-17:10:22.834353 139957525694016 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271494.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-17:10:22.992181 139957525694016 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271494.sst): second pass time = 0.77's, 170.797'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 266.387'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2292.076'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.279'MB/sec write SST data time = 0.04's, 1004.919'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 48074.714'MB/sec zip my value time = 0.77's, unzip length = 0.132'GB zip my value throughput = 170.797'MB/sec zip pipeline throughput = 170.797'MB/sec entries = 129428 avg-key = 20.00 avg-zkey = 1.74 avg-val = 1017.01 avg-zval = 311.07 usrkeys = 129428 avg-key = 12.00 avg-zkey = 1.74 avg-val = 1020.08 avg-zval = 311.07 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 56792 bytes = 212992 } seq expand size = 397544 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0421 GB } UnZip/Zip{ index = 6.9080 value = 3.2694 dict = 1.00 all = 3.1882 } Zip/UnZip{ index = 0.1448 value = 0.3059 dict = 1.00 all = 0.3137 } ---------------------------- total value len = 10.703609 GB avg = 0.198 KB (by entry num) total key len = 1.477062 GB avg = 0.027 KB total ukey len = 1.019622 GB avg = 0.015 KB total ukey num = 0.067362460 Billion total entry num = 0.054170189 Billion write speed all = 0.409974817 MB/sec (with seq num) write speed all = 0.395388813 MB/sec (without seq num) 2024/11/23-17:10:23.044537 139957525694016 [compaction_job.cc:1948] [default] [JOB 31568] Generated table #271494: 129428 keys, 42098268 bytes, temperature: kWarm 2024/11/23-17:10:23.044605 139957525694016 EVENT_LOG_v1 {"time_micros": 1732353023044571, "cf_name": "default", "job": 31568, "event": "table_file_creation", "file_number": 271494, "file_size": 42098268, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4136206137, "table_properties": {"data_size": 40260592, "index_size": 224832, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588560, "raw_average_key_size": 20, "raw_value_size": 131629191, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129428, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732353021, "oldest_key_time": 0, "file_creation_time": 1732353021, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 271494, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-17:10:23.081879 139957525694016 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271495.sst) /dev/shm/ToplingTemp/Topling-127549-H2QKXQ 2024/11/23-17:10:23.807170 139957525694016 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271495.sst): first pass time = 0.73's, 185.064'MB/sec 2024/11/23-17:10:24.617224 139957525694016 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271495.sst): old prealloc_size = 147639500, real_size = 40968288 2024/11/23-17:10:24.617346 139957525694016 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271495.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129434 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.70 raw-val = 0.1316 GB zip-val = 0.0407 GB avg-val =1016.97 avg-zval = 314.56 2024/11/23-17:10:24.617506 139957525694016 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271495.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-17:10:24.779754 139957525694016 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271495.sst): second pass time = 0.81's, 162.637'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 262.814'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2281.975'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.274'MB/sec write SST data time = 0.04's, 965.670'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 45090.478'MB/sec zip my value time = 0.81's, unzip length = 0.132'GB zip my value throughput = 162.637'MB/sec zip pipeline throughput = 162.637'MB/sec entries = 129434 avg-key = 20.00 avg-zkey = 1.70 avg-val = 1016.97 avg-zval = 314.56 usrkeys = 129434 avg-key = 12.00 avg-zkey = 1.70 avg-val = 1022.35 avg-zval = 314.56 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 99588 bytes = 373472 } seq expand size = 697116 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0407 GB dict = 1.38 MB all = 0.0427 GB } UnZip/Zip{ index = 7.0467 value = 3.2329 dict = 1.00 all = 3.1426 } Zip/UnZip{ index = 0.1419 value = 0.3093 dict = 1.00 all = 0.3182 } ---------------------------- total value len = 10.835936 GB avg = 0.200 KB (by entry num) total key len = 1.479650 GB avg = 0.027 KB total ukey len = 1.021176 GB avg = 0.015 KB total ukey num = 0.067491894 Billion total entry num = 0.054299623 Billion write speed all = 0.414490851 MB/sec (with seq num) write speed all = 0.399870875 MB/sec (without seq num) 2024/11/23-17:10:24.831651 139957525694016 [compaction_job.cc:1948] [default] [JOB 31568] Generated table #271495: 129434 keys, 42709420 bytes, temperature: kWarm 2024/11/23-17:10:24.831723 139957525694016 EVENT_LOG_v1 {"time_micros": 1732353024831687, "cf_name": "default", "job": 31568, "event": "table_file_creation", "file_number": 271495, "file_size": 42709420, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4136209193, "table_properties": {"data_size": 40715344, "index_size": 220416, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588680, "raw_average_key_size": 20, "raw_value_size": 131630022, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129434, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732353023, "oldest_key_time": 0, "file_creation_time": 1732353023, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 271495, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-17:10:24.869717 139957525694016 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271496.sst) /dev/shm/ToplingTemp/Topling-127549-Q6aJRP 2024/11/23-17:10:25.508678 139957525694016 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271496.sst): first pass time = 0.64's, 210.069'MB/sec 2024/11/23-17:10:26.428738 139957525694016 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271496.sst): old prealloc_size = 147639500, real_size = 40638352 2024/11/23-17:10:26.428866 139957525694016 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271496.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129427 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.75 raw-val = 0.1316 GB zip-val = 0.0404 GB avg-val =1017.02 avg-zval = 311.99 2024/11/23-17:10:26.428999 139957525694016 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271496.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-17:10:26.589381 139957525694016 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271496.sst): second pass time = 0.92's, 143.178'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 263.352'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2175.414'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.275'MB/sec write SST data time = 0.04's, 989.283'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 50123.309'MB/sec zip my value time = 0.92's, unzip length = 0.132'GB zip my value throughput = 143.178'MB/sec zip pipeline throughput = 143.178'MB/sec entries = 129427 avg-key = 20.00 avg-zkey = 1.75 avg-val = 1017.02 avg-zval = 311.99 usrkeys = 129427 avg-key = 12.00 avg-zkey = 1.75 avg-val = 1021.25 avg-zval = 311.99 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 78287 bytes = 293584 } seq expand size = 548009 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0404 GB dict = 1.38 MB all = 0.0423 GB } UnZip/Zip{ index = 6.8630 value = 3.2598 dict = 1.00 all = 3.1730 } Zip/UnZip{ index = 0.1457 value = 0.3068 dict = 1.00 all = 0.3152 } ---------------------------- total value len = 10.968113 GB avg = 0.202 KB (by entry num) total key len = 1.482239 GB avg = 0.027 KB total ukey len = 1.022729 GB avg = 0.015 KB total ukey num = 0.067621321 Billion total entry num = 0.054429050 Billion write speed all = 0.419000982 MB/sec (with seq num) write speed all = 0.404347051 MB/sec (without seq num) 2024/11/23-17:10:26.641495 139957525694016 [compaction_job.cc:1948] [default] [JOB 31568] Generated table #271496: 129427 keys, 42299589 bytes, temperature: kWarm 2024/11/23-17:10:26.641564 139957525694016 EVENT_LOG_v1 {"time_micros": 1732353026641529, "cf_name": "default", "job": 31568, "event": "table_file_creation", "file_number": 271496, "file_size": 42299589, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4136210678, "table_properties": {"data_size": 40379520, "index_size": 226304, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588540, "raw_average_key_size": 20, "raw_value_size": 131629237, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129427, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732353024, "oldest_key_time": 0, "file_creation_time": 1732353024, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 271496, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-17:10:26.676816 139957525694016 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271497.sst) /dev/shm/ToplingTemp/Topling-127549-Y94G3P 2024/11/23-17:10:27.189309 139957525694016 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271497.sst): first pass time = 0.51's, 261.910'MB/sec 2024/11/23-17:10:28.028820 139957525694016 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271497.sst): old prealloc_size = 147639500, real_size = 41071088 2024/11/23-17:10:28.028940 139957525694016 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271497.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129425 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.72 raw-val = 0.1316 GB zip-val = 0.0408 GB avg-val =1017.03 avg-zval = 315.37 2024/11/23-17:10:28.029130 139957525694016 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271497.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-17:10:28.190281 139957525694016 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271497.sst): second pass time = 0.84's, 157.073'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 265.704'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2285.691'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.275'MB/sec write SST data time = 0.04's, 983.237'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 48501.056'MB/sec zip my value time = 0.84's, unzip length = 0.132'GB zip my value throughput = 157.073'MB/sec zip pipeline throughput = 157.073'MB/sec entries = 129425 avg-key = 20.00 avg-zkey = 1.72 avg-val = 1017.03 avg-zval = 315.37 usrkeys = 129425 avg-key = 12.00 avg-zkey = 1.72 avg-val = 1023.60 avg-zval = 315.37 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 121520 bytes = 455712 } seq expand size = 850640 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0408 GB dict = 1.38 MB all = 0.0429 GB } UnZip/Zip{ index = 6.9894 value = 3.2249 dict = 1.00 all = 3.1290 } Zip/UnZip{ index = 0.1431 value = 0.3101 dict = 1.00 all = 0.3196 } ---------------------------- total value len = 11.100593 GB avg = 0.203 KB (by entry num) total key len = 1.484827 GB avg = 0.027 KB total ukey len = 1.024282 GB avg = 0.015 KB total ukey num = 0.067750746 Billion total entry num = 0.054558475 Billion write speed all = 0.423523725 MB/sec (with seq num) write speed all = 0.408835740 MB/sec (without seq num) 2024/11/23-17:10:28.242002 139957525694016 [compaction_job.cc:1948] [default] [JOB 31568] Generated table #271497: 129425 keys, 42894877 bytes, temperature: kWarm 2024/11/23-17:10:28.242072 139957525694016 EVENT_LOG_v1 {"time_micros": 1732353028242035, "cf_name": "default", "job": 31568, "event": "table_file_creation", "file_number": 271497, "file_size": 42894877, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4136217424, "table_properties": {"data_size": 40816352, "index_size": 222208, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588500, "raw_average_key_size": 20, "raw_value_size": 131629371, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129425, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732353026, "oldest_key_time": 0, "file_creation_time": 1732353026, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 271497, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-17:10:28.280235 139957525694016 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271498.sst) /dev/shm/ToplingTemp/Topling-127549-WBCGmR 2024/11/23-17:10:28.995619 139957525694016 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271498.sst): first pass time = 0.72's, 187.629'MB/sec 2024/11/23-17:10:29.936861 139957525694016 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271498.sst): old prealloc_size = 147639500, real_size = 40529824 2024/11/23-17:10:29.937034 139957525694016 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271498.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129429 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.75 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1017.01 avg-zval = 311.14 2024/11/23-17:10:29.937146 139957525694016 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271498.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-17:10:30.102859 139957525694016 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271498.sst): second pass time = 0.94's, 139.960'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.17's, 253.844'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1500.869'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.266'MB/sec write SST data time = 0.04's, 955.880'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 47894.022'MB/sec zip my value time = 0.94's, unzip length = 0.132'GB zip my value throughput = 139.960'MB/sec zip pipeline throughput = 164.793'MB/sec entries = 129429 avg-key = 20.00 avg-zkey = 1.75 avg-val = 1017.01 avg-zval = 311.14 usrkeys = 129429 avg-key = 12.00 avg-zkey = 1.75 avg-val = 1020.40 avg-zval = 311.14 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 62757 bytes = 235360 } seq expand size = 439299 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0421 GB } UnZip/Zip{ index = 6.8631 value = 3.2686 dict = 1.00 all = 3.1856 } Zip/UnZip{ index = 0.1457 value = 0.3059 dict = 1.00 all = 0.3139 } ---------------------------- total value len = 11.232663 GB avg = 0.205 KB (by entry num) total key len = 1.487416 GB avg = 0.027 KB total ukey len = 1.025835 GB avg = 0.015 KB total ukey num = 0.067880175 Billion total entry num = 0.054687904 Billion write speed all = 0.428027675 MB/sec (with seq num) write speed all = 0.413305793 MB/sec (without seq num) 2024/11/23-17:10:30.154800 139957525694016 [compaction_job.cc:1948] [default] [JOB 31568] Generated table #271498: 129429 keys, 42132790 bytes, temperature: kWarm 2024/11/23-17:10:30.154873 139957525694016 EVENT_LOG_v1 {"time_micros": 1732353030154836, "cf_name": "default", "job": 31568, "event": "table_file_creation", "file_number": 271498, "file_size": 42132790, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4136210614, "table_properties": {"data_size": 40270992, "index_size": 226304, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588580, "raw_average_key_size": 20, "raw_value_size": 131630024, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129429, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732353028, "oldest_key_time": 0, "file_creation_time": 1732353028, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 271498, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-17:10:30.191650 139957525694016 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271499.sst) /dev/shm/ToplingTemp/Topling-127549-6HunHS 2024/11/23-17:10:30.724127 139957525694016 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271499.sst): first pass time = 0.53's, 252.082'MB/sec 2024/11/23-17:10:31.531759 139957525694016 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271499.sst): old prealloc_size = 147639500, real_size = 40628656 2024/11/23-17:10:31.531885 139957525694016 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271499.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129429 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.73 raw-val = 0.1316 GB zip-val = 0.0404 GB avg-val =1017.00 avg-zval = 311.93 2024/11/23-17:10:31.532000 139957525694016 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271499.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-17:10:31.700128 139957525694016 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271499.sst): second pass time = 0.81's, 163.129'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.17's, 250.473'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2173.545'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.263'MB/sec write SST data time = 0.05's, 932.085'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 46741.664'MB/sec zip my value time = 0.81's, unzip length = 0.132'GB zip my value throughput = 163.129'MB/sec zip pipeline throughput = 163.129'MB/sec entries = 129429 avg-key = 20.00 avg-zkey = 1.73 avg-val = 1017.00 avg-zval = 311.93 usrkeys = 129429 avg-key = 12.00 avg-zkey = 1.73 avg-val = 1019.45 avg-zval = 311.93 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 45223 bytes = 169600 } seq expand size = 316561 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0404 GB dict = 1.38 MB all = 0.0422 GB } UnZip/Zip{ index = 6.9357 value = 3.2604 dict = 1.00 all = 3.1831 } Zip/UnZip{ index = 0.1442 value = 0.3067 dict = 1.00 all = 0.3142 } ---------------------------- total value len = 11.364609 GB avg = 0.207 KB (by entry num) total key len = 1.490004 GB avg = 0.027 KB total ukey len = 1.027388 GB avg = 0.015 KB total ukey num = 0.068009604 Billion total entry num = 0.054817333 Billion write speed all = 0.432531485 MB/sec (with seq num) write speed all = 0.417775555 MB/sec (without seq num) 2024/11/23-17:10:31.754128 139957525694016 [compaction_job.cc:1948] [default] [JOB 31568] Generated table #271499: 129429 keys, 42165958 bytes, temperature: kWarm 2024/11/23-17:10:31.754195 139957525694016 EVENT_LOG_v1 {"time_micros": 1732353031754162, "cf_name": "default", "job": 31568, "event": "table_file_creation", "file_number": 271499, "file_size": 42165958, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4136200695, "table_properties": {"data_size": 40372192, "index_size": 223936, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588580, "raw_average_key_size": 20, "raw_value_size": 131629453, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129429, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732353030, "oldest_key_time": 0, "file_creation_time": 1732353030, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 271499, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-17:10:31.798747 139957525694016 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271500.sst) /dev/shm/ToplingTemp/Topling-127549-Z302cT 2024/11/23-17:10:32.470464 139957525694016 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271500.sst): first pass time = 0.67's, 199.826'MB/sec 2024/11/23-17:10:33.374558 139957525694016 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271500.sst): old prealloc_size = 147639500, real_size = 40474624 2024/11/23-17:10:33.374699 139957525694016 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271500.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129432 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.72 raw-val = 0.1316 GB zip-val = 0.0402 GB avg-val =1016.98 avg-zval = 310.74 2024/11/23-17:10:33.374812 139957525694016 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271500.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-17:10:33.583494 139957525694016 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271500.sst): second pass time = 0.90's, 145.727'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.21's, 200.923'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1875.022'MB/sec (index lex order gen) rebuild zvType time = 0.16's, 0.197'MB/sec write SST data time = 0.04's, 950.325'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 43643.767'MB/sec zip my value time = 0.90's, unzip length = 0.132'GB zip my value throughput = 145.727'MB/sec zip pipeline throughput = 170.912'MB/sec entries = 129432 avg-key = 20.00 avg-zkey = 1.72 avg-val = 1016.98 avg-zval = 310.74 usrkeys = 129432 avg-key = 12.00 avg-zkey = 1.72 avg-val = 1018.92 avg-zval = 310.74 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 35794 bytes = 134240 } seq expand size = 250558 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0402 GB dict = 1.38 MB all = 0.0420 GB } UnZip/Zip{ index = 6.9677 value = 3.2728 dict = 1.00 all = 3.1975 } Zip/UnZip{ index = 0.1435 value = 0.3055 dict = 1.00 all = 0.3127 } ---------------------------- total value len = 11.496489 GB avg = 0.209 KB (by entry num) total key len = 1.492593 GB avg = 0.027 KB total ukey len = 1.028941 GB avg = 0.015 KB total ukey num = 0.068139036 Billion total entry num = 0.054946765 Billion write speed all = 0.437028395 MB/sec (with seq num) write speed all = 0.422238561 MB/sec (without seq num) 2024/11/23-17:10:33.634867 139957525694016 [compaction_job.cc:1948] [default] [JOB 31568] Generated table #271500: 129432 keys, 41976512 bytes, temperature: kWarm 2024/11/23-17:10:33.634937 139957525694016 EVENT_LOG_v1 {"time_micros": 1732353033634902, "cf_name": "default", "job": 31568, "event": "table_file_creation", "file_number": 271500, "file_size": 41976512, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4136204789, "table_properties": {"data_size": 40219184, "index_size": 222912, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588640, "raw_average_key_size": 20, "raw_value_size": 131629739, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129432, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732353031, "oldest_key_time": 0, "file_creation_time": 1732353031, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 271500, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-17:10:33.674240 139957525694016 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271501.sst) /dev/shm/ToplingTemp/Topling-127549-AXcMjR 2024/11/23-17:10:34.174560 139957525694016 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271501.sst): first pass time = 0.50's, 268.282'MB/sec 2024/11/23-17:10:34.957537 139957525694016 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271501.sst): old prealloc_size = 147639500, real_size = 40463056 2024/11/23-17:10:34.957659 139957525694016 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271501.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129428 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.72 raw-val = 0.1316 GB zip-val = 0.0402 GB avg-val =1017.01 avg-zval = 310.66 2024/11/23-17:10:34.957742 139957525694016 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271501.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-17:10:35.119182 139957525694016 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271501.sst): second pass time = 0.78's, 168.503'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 259.492'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2205.516'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.273'MB/sec write SST data time = 0.04's, 972.270'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 48573.781'MB/sec zip my value time = 0.78's, unzip length = 0.132'GB zip my value throughput = 168.503'MB/sec zip pipeline throughput = 168.503'MB/sec entries = 129428 avg-key = 20.00 avg-zkey = 1.72 avg-val = 1017.01 avg-zval = 310.66 usrkeys = 129428 avg-key = 12.00 avg-zkey = 1.72 avg-val = 1018.61 avg-zval = 310.66 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 29524 bytes = 110736 } seq expand size = 206668 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0402 GB dict = 1.38 MB all = 0.0419 GB } UnZip/Zip{ index = 6.9936 value = 3.2737 dict = 1.00 all = 3.2002 } Zip/UnZip{ index = 0.1430 value = 0.3055 dict = 1.00 all = 0.3125 } ---------------------------- total value len = 11.628325 GB avg = 0.211 KB (by entry num) total key len = 1.495182 GB avg = 0.027 KB total ukey len = 1.030494 GB avg = 0.015 KB total ukey num = 0.068268464 Billion total entry num = 0.055076193 Billion write speed all = 0.441528410 MB/sec (with seq num) write speed all = 0.426704504 MB/sec (without seq num) 2024/11/23-17:10:35.174327 139957525694016 [compaction_job.cc:1948] [default] [JOB 31568] Generated table #271501: 129428 keys, 41941056 bytes, temperature: kWarm 2024/11/23-17:10:35.174390 139957525694016 EVENT_LOG_v1 {"time_micros": 1732353035174356, "cf_name": "default", "job": 31568, "event": "table_file_creation", "file_number": 271501, "file_size": 41941056, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4136215229, "table_properties": {"data_size": 40208448, "index_size": 222080, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588560, "raw_average_key_size": 20, "raw_value_size": 131629416, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129428, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732353033, "oldest_key_time": 0, "file_creation_time": 1732353033, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 271501, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-17:10:35.213506 139957525694016 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271502.sst) /dev/shm/ToplingTemp/Topling-127549-kmEJ8P 2024/11/23-17:10:35.796177 139957525694016 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271502.sst): first pass time = 0.58's, 229.333'MB/sec 2024/11/23-17:10:36.639941 139957525694016 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271502.sst): old prealloc_size = 147639500, real_size = 40917760 2024/11/23-17:10:36.640075 139957525694016 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271502.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 128851 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.71 raw-val = 0.1310 GB zip-val = 0.0407 GB avg-val =1016.99 avg-zval = 315.60 2024/11/23-17:10:36.640227 139957525694016 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271502.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-17:10:36.803813 139957525694016 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00/271502.sst): second pass time = 0.84's, 155.592'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 260.784'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2198.989'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.273'MB/sec write SST data time = 0.05's, 931.268'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.373'MB, throughput = 45145.446'MB/sec zip my value time = 0.84's, unzip length = 0.131'GB zip my value throughput = 155.592'MB/sec zip pipeline throughput = 155.592'MB/sec entries = 128851 avg-key = 20.00 avg-zkey = 1.71 avg-val = 1016.99 avg-zval = 315.60 usrkeys = 128851 avg-key = 12.00 avg-zkey = 1.71 avg-val = 1023.41 avg-zval = 315.60 TagRS{ kinds = RS_Key0_TagN bytes = 20240 } TagArray{ size = 118185 bytes = 443216 } seq expand size = 827295 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0015 GB value = 0.1310 GB dict = 1.37 MB all = 0.1336 GB } __ZipSize{ index = 0.0002 GB value = 0.0407 GB dict = 1.37 MB all = 0.0427 GB } UnZip/Zip{ index = 7.0374 value = 3.2224 dict = 1.00 all = 3.1275 } Zip/UnZip{ index = 0.1421 value = 0.3103 dict = 1.00 all = 0.3197 } ---------------------------- total value len = 11.760193 GB avg = 0.213 KB (by entry num) total key len = 1.497759 GB avg = 0.027 KB total ukey len = 1.032041 GB avg = 0.015 KB total ukey num = 0.068397315 Billion total entry num = 0.055205044 Billion write speed all = 0.446026392 MB/sec (with seq num) write speed all = 0.431168648 MB/sec (without seq num) 2024/11/23-17:10:36.861921 139957525694016 [compaction_job.cc:1948] [default] [JOB 31568] Generated table #271502: 128851 keys, 42723592 bytes, temperature: kWarm 2024/11/23-17:10:36.862024 139957525694016 EVENT_LOG_v1 {"time_micros": 1732353036861963, "cf_name": "default", "job": 31568, "event": "table_file_creation", "file_number": 271502, "file_size": 42723592, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4136224104, "table_properties": {"data_size": 40665648, "index_size": 219712, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2577020, "raw_average_key_size": 20, "raw_value_size": 131040174, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 128851, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732353035, "oldest_key_time": 0, "file_creation_time": 1732353035, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 271502, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-17:10:36.901361 139957525694016 [compaction_job.cc:703] job-31568: subcompact[0], size: 0.934700 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31568/att-00 [271481,271482,271483,271484,271485,271486,271487,271488,271489,271490,271491,271492,271493,271494,271495,271496,271497,271498,271499,271500,271501,271502] 2024/11/23-17:10:37.166715 139957525694016 (Original Log Time 2024/11/23-17:09:57.360136) EVENT_LOG_v1 {"time_micros": 1732352997360094, "job": 31568, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [271465], "files_L3": [271384, 271385, 271386, 271387, 271388, 271389, 271390, 271391, 271392, 271393, 271394, 271395, 271396, 271397, 271398, 271399, 271400, 271401, 271402, 271403, 271404, 271473], "score": 0.998536, "input_data_size": 966419785, "oldest_snapshot_seqno": 4136372781} 2024/11/23-17:10:37.166723 139957525694016 (Original Log Time 2024/11/23-17:10:37.164958) [compaction_job.cc:2022] [default] [JOB 31568] Compacted 1@2 + 22@3 files to L3 => 934699984 bytes 2024/11/23-17:10:37.166724 139957525694016 (Original Log Time 2024/11/23-17:10:37.166617) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 22 0 0 0] max score 0.03, MB/sec: 24.4 rd, 23.6 wr, level 3, files in(1, 22) out(22 +0 blob) MB in(31.2, 890.5 +0.0 blob) out(891.4 +0.0 blob), read-write-amplify(58.1) write-amplify(28.6) OK, records in: 2875802, records dropped: 28922 output_compression: Snappy 2024/11/23-17:10:37.166728 139957525694016 (Original Log Time 2024/11/23-17:10:37.166687) EVENT_LOG_v1 {"time_micros": 1732353037166664, "cf": "default", "job": 31568, "event": "compaction_finished", "compaction_time_micros": 39541244, "compaction_time_cpu_micros": 8182544, "output_level": 3, "num_output_files": 22, "total_output_size": 934699984, "num_input_records": 2875802, "num_output_records": 2846880, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 631151423, "file_range_sync_nanos": 0, "file_fsync_nanos": 15031, "file_prepare_write_nanos": 46127, "lsm_state": [0, 0, 0, 22, 0, 0, 0]} 2024/11/23-17:10:37.307876 139957525694016 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732256054,"starts":1732352997,"executesMs":39959,"compactionJobId":31568,"attempt":0,"compactionInputRawBytes":2982191616,"compactionInputZipBytes":966419785,"compactionOutputRawBytes":0,"compactionOutputZipBytes":934699984,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-3741d5ccc3b74171cdf089b4d1f2063a-0f736366a0194892-00"}}, response = 2024/11/23-17:10:37.307954 139957525694016 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-31568/att-00: olev 3, work 39.960 s, result 6.001 ms, install 1.786 ms, input{raw 2.777 GiB zip 921.650 MiB}