2024/11/22-14:21:47.546935 140025213425216 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00: fork to child time = 0.009250 sec 2024/11/22-14:21:47.547758 140025213425216 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00 2024/11/22-14:21:47.556728 140025213425216 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00 2024/11/22-14:21:47.557862 140025213425216 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/22-14:21:47.558125 140025213425216 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/22-14:21:47.610637 140025213425216 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-00358/att-00/MANIFEST-206347 2024/11/22-14:21:47.624392 140025213425216 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-00358/att-00/MANIFEST-206347 succeeded,manifest_file_number is 206347, next_file_number is 206953, last_sequence is 3279914318, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 206776 2024/11/22-14:21:47.624401 140025213425216 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/22-14:21:47.624630 140025213425216 [version_set.cc:5721] Creating manifest 206953 2024/11/22-14:21:47.657611 140025213425216 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/22-14:21:47.682879 140025213425216 [compaction_job.cc:2437] [default] [JOB 358] Compacting 1@2 + 30@3 files to L3, score 0.82, subcompactions 1 : 1 2024/11/22-14:21:47.682908 140025213425216 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 293 Base level 2, inputs: [206931(12MB)], [206950(40MB) 206951(1393KB) 206891(8589KB) 206844(39MB) 206874(39MB) 206873(39MB) 206876(39MB) 206875(39MB) 206878(39MB) 206877(39MB) 206879(39MB) 206881(39MB) 206880(40MB) 206884(39MB) 206882(39MB) 206883(39MB) 206885(39MB) 206886(39MB) 206887(39MB) 206894(39MB) 206892(39MB) 206893(39MB) 206896(39MB) 206895(39MB) 206897(39MB) 206898(39MB) 206900(39MB) 206901(39MB) 206902(39MB) 206903(39MB)] 2024/11/22-14:21:47.687332 140025213425216 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/22-14:21:47.687362 140025213425216 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/22-14:21:47.687381 140025213425216 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/22-14:21:47.687386 140025213425216 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/22-14:21:47.687397 140025213425216 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/22-14:21:48.084033 140025213425216 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206954.sst) /dev/shm/ToplingTemp/Topling-137374-gsze8M 2024/11/22-14:21:48.276452 140025213425216 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206954.sst): first pass time = 0.19's, 697.683'MB/sec 2024/11/22-14:21:50.957292 140025213425216 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206954.sst): old prealloc_size = 147639500, real_size = 40584704 2024/11/22-14:21:50.957424 140025213425216 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206954.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129428 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.70 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1017.01 avg-zval = 311.62 2024/11/22-14:21:50.957541 140025213425216 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206954.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-14:21:51.146642 140025213425216 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206954.sst): second pass time = 2.68's, 49.113'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.19's, 222.410'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2009.210'MB/sec (index lex order gen) rebuild zvType time = 0.14's, 0.233'MB/sec write SST data time = 0.05's, 831.540'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 41392.491'MB/sec zip my value time = 2.68's, unzip length = 0.132'GB zip my value throughput = 49.113'MB/sec zip pipeline throughput = 142.111'MB/sec entries = 129428 avg-key = 20.00 avg-zkey = 1.70 avg-val = 1017.01 avg-zval = 311.62 usrkeys = 129428 avg-key = 12.00 avg-zkey = 1.70 avg-val = 1019.70 avg-zval = 311.62 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 49757 bytes = 161728 } seq expand size = 348299 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0421 GB } UnZip/Zip{ index = 7.0628 value = 3.2636 dict = 1.00 all = 3.1870 } Zip/UnZip{ index = 0.1416 value = 0.3064 dict = 1.00 all = 0.3138 } ---------------------------- total value len = 0.131978 GB avg = 1.020 KB (by entry num) total key len = 0.002589 GB avg = 0.020 KB total ukey len = 0.001553 GB avg = 0.012 KB total ukey num = 0.000129428 Billion total entry num = 0.000129428 Billion write speed all = 0.006807255 MB/sec (with seq num) write speed all = 0.006754877 MB/sec (without seq num) 2024/11/22-14:21:51.183401 140025213425216 [compaction_job.cc:1948] [default] [JOB 358] Generated table #206954: 129428 keys, 42114290 bytes, temperature: kWarm 2024/11/22-14:21:51.183514 140025213425216 EVENT_LOG_v1 {"time_micros": 1732256511183441, "cf_name": "default", "job": 358, "event": "table_file_creation", "file_number": 206954, "file_size": 42114290, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3279754151, "table_properties": {"data_size": 40332272, "index_size": 219904, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588560, "raw_average_key_size": 20, "raw_value_size": 131629311, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129428, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732256508, "oldest_key_time": 0, "file_creation_time": 1732256508, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 206954, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-14:21:51.232493 140025213425216 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206955.sst) /dev/shm/ToplingTemp/Topling-137374-lSOLyO 2024/11/22-14:21:51.834893 140025213425216 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206955.sst): first pass time = 0.60's, 222.825'MB/sec 2024/11/22-14:21:53.377328 140025213425216 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206955.sst): old prealloc_size = 147639500, real_size = 40360128 2024/11/22-14:21:53.377468 140025213425216 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206955.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129427 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.70 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1017.02 avg-zval = 309.89 2024/11/22-14:21:53.377546 140025213425216 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206955.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-14:21:53.612842 140025213425216 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206955.sst): second pass time = 1.54's, 85.379'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.24's, 177.216'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1915.002'MB/sec (index lex order gen) rebuild zvType time = 0.17's, 0.195'MB/sec write SST data time = 0.07's, 601.320'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 47510.345'MB/sec zip my value time = 1.54's, unzip length = 0.132'GB zip my value throughput = 85.379'MB/sec zip pipeline throughput = 153.741'MB/sec entries = 129427 avg-key = 20.00 avg-zkey = 1.70 avg-val = 1017.02 avg-zval = 309.89 usrkeys = 129427 avg-key = 12.00 avg-zkey = 1.70 avg-val = 1017.06 avg-zval = 309.89 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 717 bytes = 2256 } seq expand size = 5019 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0689 value = 3.2819 dict = 1.00 all = 3.2163 } Zip/UnZip{ index = 0.1415 value = 0.3047 dict = 1.00 all = 0.3109 } ---------------------------- total value len = 0.263612 GB avg = 1.018 KB (by entry num) total key len = 0.005177 GB avg = 0.020 KB total ukey len = 0.003106 GB avg = 0.012 KB total ukey num = 0.000258855 Billion total entry num = 0.000258855 Billion write speed all = 0.013595468 MB/sec (with seq num) write speed all = 0.013490724 MB/sec (without seq num) 2024/11/22-14:21:53.651611 140025213425216 [compaction_job.cc:1948] [default] [JOB 358] Generated table #206955: 129427 keys, 41729991 bytes, temperature: kWarm 2024/11/22-14:21:53.651691 140025213425216 EVENT_LOG_v1 {"time_micros": 1732256513651649, "cf_name": "default", "job": 358, "event": "table_file_creation", "file_number": 206955, "file_size": 41729991, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3279738396, "table_properties": {"data_size": 40107888, "index_size": 219712, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588540, "raw_average_key_size": 20, "raw_value_size": 131629689, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129427, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732256511, "oldest_key_time": 0, "file_creation_time": 1732256511, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 206955, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-14:21:53.722399 140025213425216 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206956.sst) /dev/shm/ToplingTemp/Topling-137374-OpG0LK 2024/11/22-14:21:54.295521 140025213425216 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206956.sst): first pass time = 0.57's, 234.209'MB/sec 2024/11/22-14:21:55.203670 140025213425216 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206956.sst): old prealloc_size = 147639500, real_size = 40353952 2024/11/22-14:21:55.203801 140025213425216 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206956.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129428 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1017.01 avg-zval = 309.84 2024/11/22-14:21:55.203852 140025213425216 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206956.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-14:21:55.371064 140025213425216 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206956.sst): second pass time = 0.90's, 146.760'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.17's, 249.295'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2049.165'MB/sec (index lex order gen) rebuild zvType time = 0.10's, 0.309'MB/sec write SST data time = 0.06's, 667.914'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 40137.911'MB/sec zip my value time = 0.90's, unzip length = 0.132'GB zip my value throughput = 146.760'MB/sec zip pipeline throughput = 146.760'MB/sec entries = 129428 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1017.01 avg-zval = 309.84 usrkeys = 129428 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1017.01 avg-zval = 309.84 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 14 bytes = 48 } seq expand size = 98 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0979 value = 3.2823 dict = 1.00 all = 3.2170 } Zip/UnZip{ index = 0.1409 value = 0.3047 dict = 1.00 all = 0.3109 } ---------------------------- total value len = 0.395242 GB avg = 1.018 KB (by entry num) total key len = 0.007766 GB avg = 0.020 KB total ukey len = 0.004659 GB avg = 0.012 KB total ukey num = 0.000388283 Billion total entry num = 0.000388283 Billion write speed all = 0.020382466 MB/sec (with seq num) write speed all = 0.020225364 MB/sec (without seq num) 2024/11/22-14:21:55.409121 140025213425216 [compaction_job.cc:1948] [default] [JOB 358] Generated table #206956: 129428 keys, 41722055 bytes, temperature: kWarm 2024/11/22-14:21:55.409214 140025213425216 EVENT_LOG_v1 {"time_micros": 1732256515409171, "cf_name": "default", "job": 358, "event": "table_file_creation", "file_number": 206956, "file_size": 41722055, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3279550842, "table_properties": {"data_size": 40102608, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588560, "raw_average_key_size": 20, "raw_value_size": 131629637, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129428, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732256513, "oldest_key_time": 0, "file_creation_time": 1732256513, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 206956, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-14:21:55.466024 140025213425216 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206957.sst) /dev/shm/ToplingTemp/Topling-137374-J88jzO 2024/11/22-14:21:56.073222 140025213425216 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206957.sst): first pass time = 0.61's, 221.063'MB/sec 2024/11/22-14:21:56.884941 140025213425216 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206957.sst): old prealloc_size = 147639500, real_size = 40355232 2024/11/22-14:21:56.885058 140025213425216 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206957.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129428 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1017.01 avg-zval = 309.85 2024/11/22-14:21:56.885118 140025213425216 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206957.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-14:21:57.038794 140025213425216 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206957.sst): second pass time = 0.81's, 162.285'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.15's, 271.228'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2337.653'MB/sec (index lex order gen) rebuild zvType time = 0.10's, 0.309'MB/sec write SST data time = 0.05's, 851.162'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 47793.729'MB/sec zip my value time = 0.81's, unzip length = 0.132'GB zip my value throughput = 162.285'MB/sec zip pipeline throughput = 162.285'MB/sec entries = 129428 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1017.01 avg-zval = 309.85 usrkeys = 129428 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1017.01 avg-zval = 309.85 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 13 bytes = 48 } seq expand size = 91 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0979 value = 3.2822 dict = 1.00 all = 3.2169 } Zip/UnZip{ index = 0.1409 value = 0.3047 dict = 1.00 all = 0.3109 } ---------------------------- total value len = 0.526872 GB avg = 1.018 KB (by entry num) total key len = 0.010354 GB avg = 0.020 KB total ukey len = 0.006213 GB avg = 0.012 KB total ukey num = 0.000517711 Billion total entry num = 0.000517711 Billion write speed all = 0.027168372 MB/sec (with seq num) write speed all = 0.026958920 MB/sec (without seq num) 2024/11/22-14:21:57.074766 140025213425216 [compaction_job.cc:1948] [default] [JOB 358] Generated table #206957: 129428 keys, 41722900 bytes, temperature: kWarm 2024/11/22-14:21:57.074838 140025213425216 EVENT_LOG_v1 {"time_micros": 1732256517074806, "cf_name": "default", "job": 358, "event": "table_file_creation", "file_number": 206957, "file_size": 41722900, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3279584728, "table_properties": {"data_size": 40103888, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588560, "raw_average_key_size": 20, "raw_value_size": 131629468, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129428, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732256515, "oldest_key_time": 0, "file_creation_time": 1732256515, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 206957, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-14:21:57.114410 140025213425216 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206958.sst) /dev/shm/ToplingTemp/Topling-137374-Dr3u0K 2024/11/22-14:21:57.619732 140025213425216 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206958.sst): first pass time = 0.51's, 265.631'MB/sec 2024/11/22-14:21:58.439881 140025213425216 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206958.sst): old prealloc_size = 147639500, real_size = 40354880 2024/11/22-14:21:58.439995 140025213425216 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206958.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129430 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1016.99 avg-zval = 309.85 2024/11/22-14:21:58.440051 140025213425216 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206958.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-14:21:58.594187 140025213425216 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206958.sst): second pass time = 0.82's, 160.619'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.15's, 270.415'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2442.852'MB/sec (index lex order gen) rebuild zvType time = 0.10's, 0.311'MB/sec write SST data time = 0.05's, 831.529'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 42633.344'MB/sec zip my value time = 0.82's, unzip length = 0.132'GB zip my value throughput = 160.619'MB/sec zip pipeline throughput = 160.619'MB/sec entries = 129430 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1016.99 avg-zval = 309.85 usrkeys = 129430 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1016.99 avg-zval = 309.85 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 16 bytes = 64 } seq expand size = 112 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0980 value = 3.2822 dict = 1.00 all = 3.2169 } Zip/UnZip{ index = 0.1409 value = 0.3047 dict = 1.00 all = 0.3109 } ---------------------------- total value len = 0.658501 GB avg = 1.018 KB (by entry num) total key len = 0.012943 GB avg = 0.020 KB total ukey len = 0.007766 GB avg = 0.012 KB total ukey num = 0.000647141 Billion total entry num = 0.000647141 Billion write speed all = 0.033953327 MB/sec (with seq num) write speed all = 0.033691532 MB/sec (without seq num) 2024/11/22-14:21:58.632519 140025213425216 [compaction_job.cc:1948] [default] [JOB 358] Generated table #206958: 129430 keys, 41722975 bytes, temperature: kWarm 2024/11/22-14:21:58.632580 140025213425216 EVENT_LOG_v1 {"time_micros": 1732256518632549, "cf_name": "default", "job": 358, "event": "table_file_creation", "file_number": 206958, "file_size": 41722975, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3279711549, "table_properties": {"data_size": 40103536, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588600, "raw_average_key_size": 20, "raw_value_size": 131629402, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129430, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732256517, "oldest_key_time": 0, "file_creation_time": 1732256517, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 206958, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-14:21:58.670485 140025213425216 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206959.sst) /dev/shm/ToplingTemp/Topling-137374-Xw9b7J 2024/11/22-14:21:59.217518 140025213425216 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206959.sst): first pass time = 0.55's, 245.376'MB/sec 2024/11/22-14:22:00.255317 140025213425216 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206959.sst): old prealloc_size = 147639500, real_size = 40356352 2024/11/22-14:22:00.255436 140025213425216 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206959.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129429 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1017.00 avg-zval = 309.86 2024/11/22-14:22:00.255488 140025213425216 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206959.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-14:22:00.409162 140025213425216 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206959.sst): second pass time = 1.04's, 126.919'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.15's, 271.229'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2322.173'MB/sec (index lex order gen) rebuild zvType time = 0.11's, 0.307'MB/sec write SST data time = 0.05's, 862.771'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 34935.441'MB/sec zip my value time = 1.04's, unzip length = 0.132'GB zip my value throughput = 126.919'MB/sec zip pipeline throughput = 160.869'MB/sec entries = 129429 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1017.00 avg-zval = 309.86 usrkeys = 129429 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1017.01 avg-zval = 309.86 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 19 bytes = 64 } seq expand size = 133 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0980 value = 3.2821 dict = 1.00 all = 3.2168 } Zip/UnZip{ index = 0.1409 value = 0.3047 dict = 1.00 all = 0.3109 } ---------------------------- total value len = 0.790131 GB avg = 1.017 KB (by entry num) total key len = 0.015531 GB avg = 0.020 KB total ukey len = 0.009319 GB avg = 0.012 KB total ukey num = 0.000776570 Billion total entry num = 0.000776570 Billion write speed all = 0.040736700 MB/sec (with seq num) write speed all = 0.040422575 MB/sec (without seq num) 2024/11/22-14:22:00.443387 140025213425216 [compaction_job.cc:1948] [default] [JOB 358] Generated table #206959: 129429 keys, 41723860 bytes, temperature: kWarm 2024/11/22-14:22:00.443445 140025213425216 EVENT_LOG_v1 {"time_micros": 1732256520443415, "cf_name": "default", "job": 358, "event": "table_file_creation", "file_number": 206959, "file_size": 41723860, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3279725347, "table_properties": {"data_size": 40105008, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588580, "raw_average_key_size": 20, "raw_value_size": 131629817, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129429, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732256518, "oldest_key_time": 0, "file_creation_time": 1732256518, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 206959, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-14:22:00.481311 140025213425216 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206960.sst) /dev/shm/ToplingTemp/Topling-137374-554WTL 2024/11/22-14:22:01.052530 140025213425216 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206960.sst): first pass time = 0.57's, 234.984'MB/sec 2024/11/22-14:22:01.846892 140025213425216 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206960.sst): old prealloc_size = 147639500, real_size = 40357904 2024/11/22-14:22:01.847007 140025213425216 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206960.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129425 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1017.03 avg-zval = 309.88 2024/11/22-14:22:01.847079 140025213425216 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206960.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-14:22:01.999281 140025213425216 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206960.sst): second pass time = 0.79's, 165.823'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.15's, 273.839'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2434.345'MB/sec (index lex order gen) rebuild zvType time = 0.10's, 0.313'MB/sec write SST data time = 0.05's, 851.485'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 45481.968'MB/sec zip my value time = 0.79's, unzip length = 0.132'GB zip my value throughput = 165.823'MB/sec zip pipeline throughput = 165.823'MB/sec entries = 129425 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1017.03 avg-zval = 309.88 usrkeys = 129425 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1017.03 avg-zval = 309.88 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 10 bytes = 32 } seq expand size = 70 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0977 value = 3.2820 dict = 1.00 all = 3.2166 } Zip/UnZip{ index = 0.1409 value = 0.3047 dict = 1.00 all = 0.3109 } ---------------------------- total value len = 0.921761 GB avg = 1.017 KB (by entry num) total key len = 0.018120 GB avg = 0.020 KB total ukey len = 0.010872 GB avg = 0.012 KB total ukey num = 0.000905995 Billion total entry num = 0.000905995 Billion write speed all = 0.047519353 MB/sec (with seq num) write speed all = 0.047152904 MB/sec (without seq num) 2024/11/22-14:22:02.036816 140025213425216 [compaction_job.cc:1948] [default] [JOB 358] Generated table #206960: 129425 keys, 41726069 bytes, temperature: kWarm 2024/11/22-14:22:02.036896 140025213425216 EVENT_LOG_v1 {"time_micros": 1732256522036864, "cf_name": "default", "job": 358, "event": "table_file_creation", "file_number": 206960, "file_size": 41726069, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3279499980, "table_properties": {"data_size": 40106560, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588500, "raw_average_key_size": 20, "raw_value_size": 131629633, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129425, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732256520, "oldest_key_time": 0, "file_creation_time": 1732256520, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 206960, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-14:22:02.075560 140025213425216 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206961.sst) /dev/shm/ToplingTemp/Topling-137374-bKPL8N 2024/11/22-14:22:02.558691 140025213425216 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206961.sst): first pass time = 0.48's, 277.831'MB/sec 2024/11/22-14:22:03.473995 140025213425216 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206961.sst): old prealloc_size = 147639500, real_size = 40352976 2024/11/22-14:22:03.474153 140025213425216 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206961.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1016.98 avg-zval = 309.83 2024/11/22-14:22:03.474227 140025213425216 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206961.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-14:22:03.673635 140025213425216 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206961.sst): second pass time = 0.91's, 144.190'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.20's, 208.980'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1933.208'MB/sec (index lex order gen) rebuild zvType time = 0.15's, 0.218'MB/sec write SST data time = 0.05's, 815.652'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 42560.288'MB/sec zip my value time = 0.91's, unzip length = 0.132'GB zip my value throughput = 144.190'MB/sec zip pipeline throughput = 186.904'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1016.98 avg-zval = 309.83 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1016.99 avg-zval = 309.83 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 17 bytes = 64 } seq expand size = 119 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0981 value = 3.2824 dict = 1.00 all = 3.2171 } Zip/UnZip{ index = 0.1409 value = 0.3047 dict = 1.00 all = 0.3108 } ---------------------------- total value len = 1.053390 GB avg = 1.017 KB (by entry num) total key len = 0.020709 GB avg = 0.020 KB total ukey len = 0.012425 GB avg = 0.012 KB total ukey num = 0.001035426 Billion total entry num = 0.001035426 Billion write speed all = 0.054300676 MB/sec (with seq num) write speed all = 0.053881911 MB/sec (without seq num) 2024/11/22-14:22:03.710050 140025213425216 [compaction_job.cc:1948] [default] [JOB 358] Generated table #206961: 129431 keys, 41720736 bytes, temperature: kWarm 2024/11/22-14:22:03.710115 140025213425216 EVENT_LOG_v1 {"time_micros": 1732256523710083, "cf_name": "default", "job": 358, "event": "table_file_creation", "file_number": 206961, "file_size": 41720736, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3279522663, "table_properties": {"data_size": 40101632, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131629318, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732256522, "oldest_key_time": 0, "file_creation_time": 1732256522, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 206961, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-14:22:03.746813 140025213425216 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206962.sst) /dev/shm/ToplingTemp/Topling-137374-tvuyDN 2024/11/22-14:22:04.203178 140025213425216 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206962.sst): first pass time = 0.46's, 294.135'MB/sec 2024/11/22-14:22:05.012855 140025213425216 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206962.sst): old prealloc_size = 147639500, real_size = 40352128 2024/11/22-14:22:05.012969 140025213425216 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206962.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129432 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1016.98 avg-zval = 309.82 2024/11/22-14:22:05.013033 140025213425216 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206962.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-14:22:05.163809 140025213425216 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206962.sst): second pass time = 0.81's, 162.694'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.15's, 276.422'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2398.299'MB/sec (index lex order gen) rebuild zvType time = 0.10's, 0.311'MB/sec write SST data time = 0.05's, 888.529'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 43974.153'MB/sec zip my value time = 0.81's, unzip length = 0.132'GB zip my value throughput = 162.694'MB/sec zip pipeline throughput = 162.694'MB/sec entries = 129432 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1016.98 avg-zval = 309.82 usrkeys = 129432 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1016.98 avg-zval = 309.82 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 13 bytes = 48 } seq expand size = 91 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0981 value = 3.2825 dict = 1.00 all = 3.2171 } Zip/UnZip{ index = 0.1409 value = 0.3046 dict = 1.00 all = 0.3108 } ---------------------------- total value len = 1.185020 GB avg = 1.017 KB (by entry num) total key len = 0.023297 GB avg = 0.020 KB total ukey len = 0.013978 GB avg = 0.012 KB total ukey num = 0.001164858 Billion total entry num = 0.001164858 Billion write speed all = 0.061081442 MB/sec (with seq num) write speed all = 0.060610366 MB/sec (without seq num) 2024/11/22-14:22:05.200100 140025213425216 [compaction_job.cc:1948] [default] [JOB 358] Generated table #206962: 129432 keys, 41719949 bytes, temperature: kWarm 2024/11/22-14:22:05.200161 140025213425216 EVENT_LOG_v1 {"time_micros": 1732256525200129, "cf_name": "default", "job": 358, "event": "table_file_creation", "file_number": 206962, "file_size": 41719949, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3279725771, "table_properties": {"data_size": 40100784, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588640, "raw_average_key_size": 20, "raw_value_size": 131629753, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129432, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732256523, "oldest_key_time": 0, "file_creation_time": 1732256523, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 206962, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-14:22:05.248447 140025213425216 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206963.sst) /dev/shm/ToplingTemp/Topling-137374-ZX8uTL 2024/11/22-14:22:05.745482 140025213425216 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206963.sst): first pass time = 0.50's, 270.057'MB/sec 2024/11/22-14:22:06.573561 140025213425216 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206963.sst): old prealloc_size = 147639500, real_size = 40354112 2024/11/22-14:22:06.573680 140025213425216 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206963.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129429 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1017.00 avg-zval = 309.84 2024/11/22-14:22:06.573734 140025213425216 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206963.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-14:22:06.724355 140025213425216 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206963.sst): second pass time = 0.83's, 159.249'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.15's, 276.692'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2355.215'MB/sec (index lex order gen) rebuild zvType time = 0.10's, 0.314'MB/sec write SST data time = 0.05's, 878.575'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 41471.709'MB/sec zip my value time = 0.83's, unzip length = 0.132'GB zip my value throughput = 159.249'MB/sec zip pipeline throughput = 159.249'MB/sec entries = 129429 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1017.00 avg-zval = 309.84 usrkeys = 129429 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1017.01 avg-zval = 309.84 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 15 bytes = 48 } seq expand size = 105 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0980 value = 3.2823 dict = 1.00 all = 3.2170 } Zip/UnZip{ index = 0.1409 value = 0.3047 dict = 1.00 all = 0.3108 } ---------------------------- total value len = 1.316650 GB avg = 1.017 KB (by entry num) total key len = 0.025886 GB avg = 0.020 KB total ukey len = 0.015531 GB avg = 0.012 KB total ukey num = 0.001294287 Billion total entry num = 0.001294287 Billion write speed all = 0.067860951 MB/sec (with seq num) write speed all = 0.067337574 MB/sec (without seq num) 2024/11/22-14:22:06.759573 140025213425216 [compaction_job.cc:1948] [default] [JOB 358] Generated table #206963: 129429 keys, 41721810 bytes, temperature: kWarm 2024/11/22-14:22:06.759636 140025213425216 EVENT_LOG_v1 {"time_micros": 1732256526759604, "cf_name": "default", "job": 358, "event": "table_file_creation", "file_number": 206963, "file_size": 41721810, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3279498954, "table_properties": {"data_size": 40102768, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588580, "raw_average_key_size": 20, "raw_value_size": 131629927, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129429, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732256525, "oldest_key_time": 0, "file_creation_time": 1732256525, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 206963, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-14:22:06.801083 140025213425216 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206964.sst) /dev/shm/ToplingTemp/Topling-137374-WHD86N 2024/11/22-14:22:07.331871 140025213425216 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206964.sst): first pass time = 0.53's, 252.890'MB/sec 2024/11/22-14:22:08.127251 140025213425216 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206964.sst): old prealloc_size = 147639500, real_size = 40579776 2024/11/22-14:22:08.127376 140025213425216 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206964.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129428 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1017.01 avg-zval = 311.59 2024/11/22-14:22:08.127441 140025213425216 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206964.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-14:22:08.298232 140025213425216 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206964.sst): second pass time = 0.79's, 165.701'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.17's, 245.349'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2159.439'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.267'MB/sec write SST data time = 0.05's, 842.570'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 36493.739'MB/sec zip my value time = 0.79's, unzip length = 0.132'GB zip my value throughput = 165.701'MB/sec zip pipeline throughput = 165.701'MB/sec entries = 129428 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1017.01 avg-zval = 311.59 usrkeys = 129428 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1017.01 avg-zval = 311.59 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 16 bytes = 64 } seq expand size = 112 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0419 GB } UnZip/Zip{ index = 7.0979 value = 3.2639 dict = 1.00 all = 3.1996 } Zip/UnZip{ index = 0.1409 value = 0.3064 dict = 1.00 all = 0.3125 } ---------------------------- total value len = 1.448280 GB avg = 1.017 KB (by entry num) total key len = 0.028474 GB avg = 0.020 KB total ukey len = 0.017085 GB avg = 0.012 KB total ukey num = 0.001423715 Billion total entry num = 0.001423715 Billion write speed all = 0.074639313 MB/sec (with seq num) write speed all = 0.074063644 MB/sec (without seq num) 2024/11/22-14:22:08.334654 140025213425216 [compaction_job.cc:1948] [default] [JOB 358] Generated table #206964: 129428 keys, 41948013 bytes, temperature: kWarm 2024/11/22-14:22:08.334722 140025213425216 EVENT_LOG_v1 {"time_micros": 1732256528334686, "cf_name": "default", "job": 358, "event": "table_file_creation", "file_number": 206964, "file_size": 41948013, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3279740114, "table_properties": {"data_size": 40328432, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588560, "raw_average_key_size": 20, "raw_value_size": 131629386, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129428, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732256526, "oldest_key_time": 0, "file_creation_time": 1732256526, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 206964, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-14:22:08.378606 140025213425216 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206965.sst) /dev/shm/ToplingTemp/Topling-137374-EP929K 2024/11/22-14:22:08.837142 140025213425216 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206965.sst): first pass time = 0.46's, 292.741'MB/sec 2024/11/22-14:22:09.651427 140025213425216 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206965.sst): old prealloc_size = 147639500, real_size = 40561072 2024/11/22-14:22:09.651542 140025213425216 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206965.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1016.99 avg-zval = 311.44 2024/11/22-14:22:09.651599 140025213425216 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206965.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-14:22:09.803477 140025213425216 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206965.sst): second pass time = 0.81's, 161.895'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.15's, 275.778'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2326.914'MB/sec (index lex order gen) rebuild zvType time = 0.10's, 0.312'MB/sec write SST data time = 0.05's, 870.710'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 40374.293'MB/sec zip my value time = 0.81's, unzip length = 0.132'GB zip my value throughput = 161.895'MB/sec zip pipeline throughput = 161.895'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1016.99 avg-zval = 311.44 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1016.99 avg-zval = 311.44 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 9 bytes = 32 } seq expand size = 63 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0419 GB } UnZip/Zip{ index = 7.0981 value = 3.2655 dict = 1.00 all = 3.2011 } Zip/UnZip{ index = 0.1409 value = 0.3062 dict = 1.00 all = 0.3124 } ---------------------------- total value len = 1.579909 GB avg = 1.017 KB (by entry num) total key len = 0.031063 GB avg = 0.020 KB total ukey len = 0.018638 GB avg = 0.012 KB total ukey num = 0.001553146 Billion total entry num = 0.001553146 Billion write speed all = 0.081416880 MB/sec (with seq num) write speed all = 0.080788925 MB/sec (without seq num) 2024/11/22-14:22:09.839953 140025213425216 [compaction_job.cc:1948] [default] [JOB 358] Generated table #206965: 129431 keys, 41928862 bytes, temperature: kWarm 2024/11/22-14:22:09.840016 140025213425216 EVENT_LOG_v1 {"time_micros": 1732256529839984, "cf_name": "default", "job": 358, "event": "table_file_creation", "file_number": 206965, "file_size": 41928862, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3279645227, "table_properties": {"data_size": 40309728, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131629408, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732256528, "oldest_key_time": 0, "file_creation_time": 1732256528, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 206965, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-14:22:09.878844 140025213425216 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206966.sst) /dev/shm/ToplingTemp/Topling-137374-1PM2vM 2024/11/22-14:22:10.390474 140025213425216 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206966.sst): first pass time = 0.51's, 262.358'MB/sec 2024/11/22-14:22:11.333571 140025213425216 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206966.sst): old prealloc_size = 147639500, real_size = 40354288 2024/11/22-14:22:11.333688 140025213425216 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206966.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129429 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1017.00 avg-zval = 309.85 2024/11/22-14:22:11.333751 140025213425216 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206966.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-14:22:11.486723 140025213425216 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206966.sst): second pass time = 0.94's, 139.741'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.15's, 272.445'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2246.894'MB/sec (index lex order gen) rebuild zvType time = 0.10's, 0.309'MB/sec write SST data time = 0.05's, 866.320'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 36625.189'MB/sec zip my value time = 0.94's, unzip length = 0.132'GB zip my value throughput = 139.741'MB/sec zip pipeline throughput = 157.514'MB/sec entries = 129429 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1017.00 avg-zval = 309.85 usrkeys = 129429 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1017.00 avg-zval = 309.85 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 13 bytes = 48 } seq expand size = 91 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0980 value = 3.2823 dict = 1.00 all = 3.2170 } Zip/UnZip{ index = 0.1409 value = 0.3047 dict = 1.00 all = 0.3109 } ---------------------------- total value len = 1.711539 GB avg = 1.017 KB (by entry num) total key len = 0.033652 GB avg = 0.020 KB total ukey len = 0.020191 GB avg = 0.012 KB total ukey num = 0.001682575 Billion total entry num = 0.001682575 Billion write speed all = 0.088192637 MB/sec (with seq num) write speed all = 0.087512410 MB/sec (without seq num) 2024/11/22-14:22:11.522488 140025213425216 [compaction_job.cc:1948] [default] [JOB 358] Generated table #206966: 129429 keys, 41721866 bytes, temperature: kWarm 2024/11/22-14:22:11.522550 140025213425216 EVENT_LOG_v1 {"time_micros": 1732256531522518, "cf_name": "default", "job": 358, "event": "table_file_creation", "file_number": 206966, "file_size": 41721866, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3279734397, "table_properties": {"data_size": 40102944, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588580, "raw_average_key_size": 20, "raw_value_size": 131629702, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129429, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732256529, "oldest_key_time": 0, "file_creation_time": 1732256529, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 206966, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-14:22:11.567029 140025213425216 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206967.sst) /dev/shm/ToplingTemp/Topling-137374-0WRYfL 2024/11/22-14:22:12.012445 140025213425216 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206967.sst): first pass time = 0.45's, 301.360'MB/sec 2024/11/22-14:22:12.809986 140025213425216 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206967.sst): old prealloc_size = 147639500, real_size = 40355248 2024/11/22-14:22:12.810104 140025213425216 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206967.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129428 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1017.01 avg-zval = 309.85 2024/11/22-14:22:12.810158 140025213425216 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206967.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-14:22:12.962505 140025213425216 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206967.sst): second pass time = 0.80's, 165.180'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.15's, 273.586'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2324.245'MB/sec (index lex order gen) rebuild zvType time = 0.10's, 0.311'MB/sec write SST data time = 0.05's, 863.078'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 44693.570'MB/sec zip my value time = 0.80's, unzip length = 0.132'GB zip my value throughput = 165.180'MB/sec zip pipeline throughput = 165.180'MB/sec entries = 129428 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1017.01 avg-zval = 309.85 usrkeys = 129428 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1017.01 avg-zval = 309.85 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 10 bytes = 48 } seq expand size = 70 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0979 value = 3.2822 dict = 1.00 all = 3.2169 } Zip/UnZip{ index = 0.1409 value = 0.3047 dict = 1.00 all = 0.3109 } ---------------------------- total value len = 1.843169 GB avg = 1.017 KB (by entry num) total key len = 0.036240 GB avg = 0.020 KB total ukey len = 0.021744 GB avg = 0.012 KB total ukey num = 0.001812003 Billion total entry num = 0.001812003 Billion write speed all = 0.094968241 MB/sec (with seq num) write speed all = 0.094235744 MB/sec (without seq num) 2024/11/22-14:22:12.999926 140025213425216 [compaction_job.cc:1948] [default] [JOB 358] Generated table #206967: 129428 keys, 41723328 bytes, temperature: kWarm 2024/11/22-14:22:12.999991 140025213425216 EVENT_LOG_v1 {"time_micros": 1732256532999957, "cf_name": "default", "job": 358, "event": "table_file_creation", "file_number": 206967, "file_size": 41723328, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3279661756, "table_properties": {"data_size": 40103904, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588560, "raw_average_key_size": 20, "raw_value_size": 131629824, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129428, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732256531, "oldest_key_time": 0, "file_creation_time": 1732256531, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 206967, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-14:22:13.035674 140025213425216 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206968.sst) /dev/shm/ToplingTemp/Topling-137374-rFqjbK 2024/11/22-14:22:13.520988 140025213425216 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206968.sst): first pass time = 0.49's, 276.584'MB/sec 2024/11/22-14:22:14.417655 140025213425216 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206968.sst): old prealloc_size = 147639500, real_size = 40354944 2024/11/22-14:22:14.417810 140025213425216 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206968.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129428 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1017.01 avg-zval = 309.85 2024/11/22-14:22:14.417899 140025213425216 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206968.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-14:22:14.636006 140025213425216 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206968.sst): second pass time = 0.90's, 146.916'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.22's, 191.088'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1677.188'MB/sec (index lex order gen) rebuild zvType time = 0.16's, 0.196'MB/sec write SST data time = 0.05's, 780.416'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 41946.175'MB/sec zip my value time = 0.90's, unzip length = 0.132'GB zip my value throughput = 146.916'MB/sec zip pipeline throughput = 171.570'MB/sec entries = 129428 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1017.01 avg-zval = 309.85 usrkeys = 129428 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1017.02 avg-zval = 309.85 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 11 bytes = 48 } seq expand size = 77 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0979 value = 3.2823 dict = 1.00 all = 3.2169 } Zip/UnZip{ index = 0.1409 value = 0.3047 dict = 1.00 all = 0.3109 } ---------------------------- total value len = 1.974799 GB avg = 1.017 KB (by entry num) total key len = 0.038829 GB avg = 0.020 KB total ukey len = 0.023297 GB avg = 0.012 KB total ukey num = 0.001941431 Billion total entry num = 0.001941431 Billion write speed all = 0.101741837 MB/sec (with seq num) write speed all = 0.100957085 MB/sec (without seq num) 2024/11/22-14:22:14.672897 140025213425216 [compaction_job.cc:1948] [default] [JOB 358] Generated table #206968: 129428 keys, 41722509 bytes, temperature: kWarm 2024/11/22-14:22:14.672960 140025213425216 EVENT_LOG_v1 {"time_micros": 1732256534672926, "cf_name": "default", "job": 358, "event": "table_file_creation", "file_number": 206968, "file_size": 41722509, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3279730736, "table_properties": {"data_size": 40103600, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588560, "raw_average_key_size": 20, "raw_value_size": 131630189, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129428, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732256533, "oldest_key_time": 0, "file_creation_time": 1732256533, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 206968, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-14:22:14.718968 140025213425216 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206969.sst) /dev/shm/ToplingTemp/Topling-137374-ipCaNK 2024/11/22-14:22:15.298841 140025213425216 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206969.sst): first pass time = 0.58's, 231.480'MB/sec 2024/11/22-14:22:16.093296 140025213425216 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206969.sst): old prealloc_size = 147639500, real_size = 40353072 2024/11/22-14:22:16.093412 140025213425216 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206969.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1016.99 avg-zval = 309.83 2024/11/22-14:22:16.093466 140025213425216 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206969.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-14:22:16.244872 140025213425216 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206969.sst): second pass time = 0.79's, 165.800'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.15's, 275.303'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2356.331'MB/sec (index lex order gen) rebuild zvType time = 0.10's, 0.311'MB/sec write SST data time = 0.05's, 879.681'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 42652.341'MB/sec zip my value time = 0.79's, unzip length = 0.132'GB zip my value throughput = 165.800'MB/sec zip pipeline throughput = 165.800'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1016.99 avg-zval = 309.83 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1016.99 avg-zval = 309.83 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 19 bytes = 64 } seq expand size = 133 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0981 value = 3.2824 dict = 1.00 all = 3.2170 } Zip/UnZip{ index = 0.1409 value = 0.3047 dict = 1.00 all = 0.3108 } ---------------------------- total value len = 2.106429 GB avg = 1.017 KB (by entry num) total key len = 0.041417 GB avg = 0.020 KB total ukey len = 0.024850 GB avg = 0.012 KB total ukey num = 0.002070862 Billion total entry num = 0.002070862 Billion write speed all = 0.108514641 MB/sec (with seq num) write speed all = 0.107677639 MB/sec (without seq num) 2024/11/22-14:22:16.281960 140025213425216 [compaction_job.cc:1948] [default] [JOB 358] Generated table #206969: 129431 keys, 41721328 bytes, temperature: kWarm 2024/11/22-14:22:16.282025 140025213425216 EVENT_LOG_v1 {"time_micros": 1732256536281993, "cf_name": "default", "job": 358, "event": "table_file_creation", "file_number": 206969, "file_size": 41721328, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3279439357, "table_properties": {"data_size": 40101728, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131630039, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732256534, "oldest_key_time": 0, "file_creation_time": 1732256534, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 206969, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-14:22:16.318205 140025213425216 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206970.sst) /dev/shm/ToplingTemp/Topling-137374-nj1tNL 2024/11/22-14:22:16.819512 140025213425216 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206970.sst): first pass time = 0.50's, 267.757'MB/sec 2024/11/22-14:22:17.617547 140025213425216 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206970.sst): old prealloc_size = 147639500, real_size = 40352320 2024/11/22-14:22:17.617664 140025213425216 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206970.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129434 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1016.96 avg-zval = 309.82 2024/11/22-14:22:17.617716 140025213425216 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206970.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-14:22:17.857967 140025213425216 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206970.sst): second pass time = 0.80's, 165.062'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.24's, 173.556'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2405.629'MB/sec (index lex order gen) rebuild zvType time = 0.15's, 0.214'MB/sec write SST data time = 0.09's, 469.256'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 45957.573'MB/sec zip my value time = 0.80's, unzip length = 0.132'GB zip my value throughput = 165.062'MB/sec zip pipeline throughput = 165.062'MB/sec entries = 129434 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1016.96 avg-zval = 309.82 usrkeys = 129434 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1016.96 avg-zval = 309.82 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 15 bytes = 48 } seq expand size = 105 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0982 value = 3.2825 dict = 1.00 all = 3.2171 } Zip/UnZip{ index = 0.1409 value = 0.3046 dict = 1.00 all = 0.3108 } ---------------------------- total value len = 2.238059 GB avg = 1.017 KB (by entry num) total key len = 0.044006 GB avg = 0.020 KB total ukey len = 0.026404 GB avg = 0.012 KB total ukey num = 0.002200296 Billion total entry num = 0.002200296 Billion write speed all = 0.115286304 MB/sec (with seq num) write speed all = 0.114397061 MB/sec (without seq num) 2024/11/22-14:22:17.898919 140025213425216 [compaction_job.cc:1948] [default] [JOB 358] Generated table #206970: 129434 keys, 41719933 bytes, temperature: kWarm 2024/11/22-14:22:17.899002 140025213425216 EVENT_LOG_v1 {"time_micros": 1732256537898957, "cf_name": "default", "job": 358, "event": "table_file_creation", "file_number": 206970, "file_size": 41719933, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3279674248, "table_properties": {"data_size": 40100976, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588680, "raw_average_key_size": 20, "raw_value_size": 131629730, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129434, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732256536, "oldest_key_time": 0, "file_creation_time": 1732256536, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 206970, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-14:22:17.950232 140025213425216 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206971.sst) /dev/shm/ToplingTemp/Topling-137374-oN1DgO 2024/11/22-14:22:18.561318 140025213425216 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206971.sst): first pass time = 0.61's, 219.659'MB/sec 2024/11/22-14:22:19.361844 140025213425216 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206971.sst): old prealloc_size = 147639500, real_size = 40354752 2024/11/22-14:22:19.361966 140025213425216 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206971.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129430 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1017.00 avg-zval = 309.85 2024/11/22-14:22:19.362031 140025213425216 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206971.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-14:22:19.514554 140025213425216 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206971.sst): second pass time = 0.80's, 164.549'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.15's, 273.213'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2233.751'MB/sec (index lex order gen) rebuild zvType time = 0.10's, 0.309'MB/sec write SST data time = 0.05's, 872.972'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 47249.529'MB/sec zip my value time = 0.80's, unzip length = 0.132'GB zip my value throughput = 164.549'MB/sec zip pipeline throughput = 164.549'MB/sec entries = 129430 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1017.00 avg-zval = 309.85 usrkeys = 129430 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1017.00 avg-zval = 309.85 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 14 bytes = 48 } seq expand size = 98 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0980 value = 3.2823 dict = 1.00 all = 3.2169 } Zip/UnZip{ index = 0.1409 value = 0.3047 dict = 1.00 all = 0.3109 } ---------------------------- total value len = 2.369689 GB avg = 1.017 KB (by entry num) total key len = 0.046595 GB avg = 0.020 KB total ukey len = 0.027957 GB avg = 0.012 KB total ukey num = 0.002329726 Billion total entry num = 0.002329726 Billion write speed all = 0.122056592 MB/sec (with seq num) write speed all = 0.121115118 MB/sec (without seq num) 2024/11/22-14:22:19.553340 140025213425216 [compaction_job.cc:1948] [default] [JOB 358] Generated table #206971: 129430 keys, 41722638 bytes, temperature: kWarm 2024/11/22-14:22:19.553418 140025213425216 EVENT_LOG_v1 {"time_micros": 1732256539553376, "cf_name": "default", "job": 358, "event": "table_file_creation", "file_number": 206971, "file_size": 41722638, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3279711011, "table_properties": {"data_size": 40103408, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588600, "raw_average_key_size": 20, "raw_value_size": 131629735, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129430, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732256537, "oldest_key_time": 0, "file_creation_time": 1732256537, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 206971, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-14:22:19.593891 140025213425216 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206972.sst) /dev/shm/ToplingTemp/Topling-137374-kQZLvL 2024/11/22-14:22:20.054320 140025213425216 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206972.sst): first pass time = 0.46's, 291.533'MB/sec 2024/11/22-14:22:20.837987 140025213425216 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206972.sst): old prealloc_size = 147639500, real_size = 40354048 2024/11/22-14:22:20.838107 140025213425216 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206972.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129430 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1016.99 avg-zval = 309.84 2024/11/22-14:22:20.838161 140025213425216 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206972.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-14:22:20.988800 140025213425216 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206972.sst): second pass time = 0.78's, 168.089'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.15's, 276.703'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2286.431'MB/sec (index lex order gen) rebuild zvType time = 0.10's, 0.314'MB/sec write SST data time = 0.05's, 874.240'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 36164.011'MB/sec zip my value time = 0.78's, unzip length = 0.132'GB zip my value throughput = 168.089'MB/sec zip pipeline throughput = 168.089'MB/sec entries = 129430 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1016.99 avg-zval = 309.84 usrkeys = 129430 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1016.99 avg-zval = 309.84 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 16 bytes = 64 } seq expand size = 112 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0980 value = 3.2823 dict = 1.00 all = 3.2170 } Zip/UnZip{ index = 0.1409 value = 0.3047 dict = 1.00 all = 0.3109 } ---------------------------- total value len = 2.501318 GB avg = 1.017 KB (by entry num) total key len = 0.049183 GB avg = 0.020 KB total ukey len = 0.029510 GB avg = 0.012 KB total ukey num = 0.002459156 Billion total entry num = 0.002459156 Billion write speed all = 0.128826921 MB/sec (with seq num) write speed all = 0.127833217 MB/sec (without seq num) 2024/11/22-14:22:21.023502 140025213425216 [compaction_job.cc:1948] [default] [JOB 358] Generated table #206972: 129430 keys, 41721692 bytes, temperature: kWarm 2024/11/22-14:22:21.023567 140025213425216 EVENT_LOG_v1 {"time_micros": 1732256541023533, "cf_name": "default", "job": 358, "event": "table_file_creation", "file_number": 206972, "file_size": 41721692, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3279741120, "table_properties": {"data_size": 40102704, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588600, "raw_average_key_size": 20, "raw_value_size": 131629477, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129430, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732256539, "oldest_key_time": 0, "file_creation_time": 1732256539, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 206972, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-14:22:21.058338 140025213425216 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206973.sst) /dev/shm/ToplingTemp/Topling-137374-FiwA8J 2024/11/22-14:22:21.533026 140025213425216 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206973.sst): first pass time = 0.47's, 282.777'MB/sec 2024/11/22-14:22:22.313996 140025213425216 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206973.sst): old prealloc_size = 147639500, real_size = 40356512 2024/11/22-14:22:22.314117 140025213425216 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206973.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129426 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1017.03 avg-zval = 309.87 2024/11/22-14:22:22.314177 140025213425216 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206973.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-14:22:22.466402 140025213425216 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206973.sst): second pass time = 0.78's, 168.673'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.15's, 273.798'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2274.216'MB/sec (index lex order gen) rebuild zvType time = 0.10's, 0.312'MB/sec write SST data time = 0.05's, 858.504'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 48036.769'MB/sec zip my value time = 0.78's, unzip length = 0.132'GB zip my value throughput = 168.673'MB/sec zip pipeline throughput = 168.673'MB/sec entries = 129426 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1017.03 avg-zval = 309.87 usrkeys = 129426 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1017.03 avg-zval = 309.87 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 9 bytes = 32 } seq expand size = 63 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0978 value = 3.2821 dict = 1.00 all = 3.2168 } Zip/UnZip{ index = 0.1409 value = 0.3047 dict = 1.00 all = 0.3109 } ---------------------------- total value len = 2.632948 GB avg = 1.017 KB (by entry num) total key len = 0.051772 GB avg = 0.020 KB total ukey len = 0.031063 GB avg = 0.012 KB total ukey num = 0.002588582 Billion total entry num = 0.002588582 Billion write speed all = 0.135596222 MB/sec (with seq num) write speed all = 0.134550297 MB/sec (without seq num) 2024/11/22-14:22:22.501025 140025213425216 [compaction_job.cc:1948] [default] [JOB 358] Generated table #206973: 129426 keys, 41724558 bytes, temperature: kWarm 2024/11/22-14:22:22.501092 140025213425216 EVENT_LOG_v1 {"time_micros": 1732256542501058, "cf_name": "default", "job": 358, "event": "table_file_creation", "file_number": 206973, "file_size": 41724558, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3279690932, "table_properties": {"data_size": 40105168, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588520, "raw_average_key_size": 20, "raw_value_size": 131629678, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129426, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732256541, "oldest_key_time": 0, "file_creation_time": 1732256541, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 206973, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-14:22:22.558672 140025213425216 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206974.sst) /dev/shm/ToplingTemp/Topling-137374-1AX1tO 2024/11/22-14:22:23.017680 140025213425216 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206974.sst): first pass time = 0.46's, 292.440'MB/sec 2024/11/22-14:22:23.795062 140025213425216 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206974.sst): old prealloc_size = 147639500, real_size = 40352832 2024/11/22-14:22:23.795174 140025213425216 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206974.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129432 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1016.98 avg-zval = 309.83 2024/11/22-14:22:23.795226 140025213425216 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206974.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-14:22:23.948939 140025213425216 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206974.sst): second pass time = 0.78's, 169.465'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.15's, 271.169'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2408.515'MB/sec (index lex order gen) rebuild zvType time = 0.11's, 0.301'MB/sec write SST data time = 0.05's, 898.609'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 43722.443'MB/sec zip my value time = 0.78's, unzip length = 0.132'GB zip my value throughput = 169.465'MB/sec zip pipeline throughput = 169.465'MB/sec entries = 129432 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1016.98 avg-zval = 309.83 usrkeys = 129432 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1016.98 avg-zval = 309.83 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 11 bytes = 48 } seq expand size = 77 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0981 value = 3.2824 dict = 1.00 all = 3.2171 } Zip/UnZip{ index = 0.1409 value = 0.3047 dict = 1.00 all = 0.3108 } ---------------------------- total value len = 2.764578 GB avg = 1.017 KB (by entry num) total key len = 0.054360 GB avg = 0.020 KB total ukey len = 0.032616 GB avg = 0.012 KB total ukey num = 0.002718014 Billion total entry num = 0.002718014 Billion write speed all = 0.142364502 MB/sec (with seq num) write speed all = 0.141266362 MB/sec (without seq num) 2024/11/22-14:22:23.985297 140025213425216 [compaction_job.cc:1948] [default] [JOB 358] Generated table #206974: 129432 keys, 41720941 bytes, temperature: kWarm 2024/11/22-14:22:23.985358 140025213425216 EVENT_LOG_v1 {"time_micros": 1732256543985327, "cf_name": "default", "job": 358, "event": "table_file_creation", "file_number": 206974, "file_size": 41720941, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3279689853, "table_properties": {"data_size": 40101488, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588640, "raw_average_key_size": 20, "raw_value_size": 131630022, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129432, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732256542, "oldest_key_time": 0, "file_creation_time": 1732256542, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 206974, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-14:22:24.023550 140025213425216 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206975.sst) /dev/shm/ToplingTemp/Topling-137374-zeyoNN 2024/11/22-14:22:24.527353 140025213425216 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206975.sst): first pass time = 0.50's, 266.431'MB/sec 2024/11/22-14:22:25.311362 140025213425216 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206975.sst): old prealloc_size = 147639500, real_size = 40350544 2024/11/22-14:22:25.311482 140025213425216 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206975.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129433 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1016.97 avg-zval = 309.81 2024/11/22-14:22:25.311534 140025213425216 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206975.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-14:22:25.462204 140025213425216 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206975.sst): second pass time = 0.78's, 168.013'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.15's, 276.589'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2296.437'MB/sec (index lex order gen) rebuild zvType time = 0.10's, 0.314'MB/sec write SST data time = 0.05's, 876.676'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 40477.427'MB/sec zip my value time = 0.78's, unzip length = 0.132'GB zip my value throughput = 168.013'MB/sec zip pipeline throughput = 168.013'MB/sec entries = 129433 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1016.97 avg-zval = 309.81 usrkeys = 129433 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1016.97 avg-zval = 309.81 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 15 bytes = 48 } seq expand size = 105 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0982 value = 3.2826 dict = 1.00 all = 3.2172 } Zip/UnZip{ index = 0.1409 value = 0.3046 dict = 1.00 all = 0.3108 } ---------------------------- total value len = 2.896208 GB avg = 1.017 KB (by entry num) total key len = 0.056949 GB avg = 0.020 KB total ukey len = 0.034169 GB avg = 0.012 KB total ukey num = 0.002847447 Billion total entry num = 0.002847447 Billion write speed all = 0.149131516 MB/sec (with seq num) write speed all = 0.147981169 MB/sec (without seq num) 2024/11/22-14:22:25.498457 140025213425216 [compaction_job.cc:1948] [default] [JOB 358] Generated table #206975: 129433 keys, 41718341 bytes, temperature: kWarm 2024/11/22-14:22:25.498518 140025213425216 EVENT_LOG_v1 {"time_micros": 1732256545498485, "cf_name": "default", "job": 358, "event": "table_file_creation", "file_number": 206975, "file_size": 41718341, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3279721775, "table_properties": {"data_size": 40099200, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588660, "raw_average_key_size": 20, "raw_value_size": 131629545, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129433, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732256544, "oldest_key_time": 0, "file_creation_time": 1732256544, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 206975, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-14:22:25.535890 140025213425216 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206976.sst) /dev/shm/ToplingTemp/Topling-137374-Ck1xsK 2024/11/22-14:22:25.981256 140025213425216 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206976.sst): first pass time = 0.45's, 301.395'MB/sec 2024/11/22-14:22:26.767196 140025213425216 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206976.sst): old prealloc_size = 147639500, real_size = 40357840 2024/11/22-14:22:26.767313 140025213425216 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206976.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129427 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1017.02 avg-zval = 309.88 2024/11/22-14:22:26.767367 140025213425216 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206976.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-14:22:26.919419 140025213425216 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206976.sst): second pass time = 0.79's, 167.612'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.15's, 274.135'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2361.290'MB/sec (index lex order gen) rebuild zvType time = 0.10's, 0.310'MB/sec write SST data time = 0.05's, 874.075'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 41500.271'MB/sec zip my value time = 0.79's, unzip length = 0.132'GB zip my value throughput = 167.612'MB/sec zip pipeline throughput = 167.612'MB/sec entries = 129427 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1017.02 avg-zval = 309.88 usrkeys = 129427 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1017.02 avg-zval = 309.88 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 11 bytes = 48 } seq expand size = 77 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0979 value = 3.2820 dict = 1.00 all = 3.2167 } Zip/UnZip{ index = 0.1409 value = 0.3047 dict = 1.00 all = 0.3109 } ---------------------------- total value len = 3.027838 GB avg = 1.017 KB (by entry num) total key len = 0.059537 GB avg = 0.020 KB total ukey len = 0.035722 GB avg = 0.012 KB total ukey num = 0.002976874 Billion total entry num = 0.002976874 Billion write speed all = 0.155897960 MB/sec (with seq num) write speed all = 0.154695415 MB/sec (without seq num) 2024/11/22-14:22:26.957497 140025213425216 [compaction_job.cc:1948] [default] [JOB 358] Generated table #206976: 129427 keys, 41725392 bytes, temperature: kWarm 2024/11/22-14:22:26.957561 140025213425216 EVENT_LOG_v1 {"time_micros": 1732256546957529, "cf_name": "default", "job": 358, "event": "table_file_creation", "file_number": 206976, "file_size": 41725392, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3279703648, "table_properties": {"data_size": 40106496, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588540, "raw_average_key_size": 20, "raw_value_size": 131630166, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129427, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732256545, "oldest_key_time": 0, "file_creation_time": 1732256545, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 206976, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-14:22:26.999968 140025213425216 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206977.sst) /dev/shm/ToplingTemp/Topling-137374-xSZ49L 2024/11/22-14:22:27.541963 140025213425216 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206977.sst): first pass time = 0.54's, 247.656'MB/sec 2024/11/22-14:22:28.327188 140025213425216 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206977.sst): old prealloc_size = 147639500, real_size = 40354816 2024/11/22-14:22:28.327313 140025213425216 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206977.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129429 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1017.00 avg-zval = 309.85 2024/11/22-14:22:28.327366 140025213425216 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206977.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-14:22:28.478986 140025213425216 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206977.sst): second pass time = 0.78's, 167.912'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.15's, 274.877'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2151.943'MB/sec (index lex order gen) rebuild zvType time = 0.10's, 0.310'MB/sec write SST data time = 0.05's, 879.418'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 40059.111'MB/sec zip my value time = 0.78's, unzip length = 0.132'GB zip my value throughput = 167.912'MB/sec zip pipeline throughput = 167.912'MB/sec entries = 129429 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1017.00 avg-zval = 309.85 usrkeys = 129429 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1017.00 avg-zval = 309.85 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 13 bytes = 48 } seq expand size = 91 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0980 value = 3.2822 dict = 1.00 all = 3.2169 } Zip/UnZip{ index = 0.1409 value = 0.3047 dict = 1.00 all = 0.3109 } ---------------------------- total value len = 3.159468 GB avg = 1.017 KB (by entry num) total key len = 0.062126 GB avg = 0.020 KB total ukey len = 0.037276 GB avg = 0.012 KB total ukey num = 0.003106303 Billion total entry num = 0.003106303 Billion write speed all = 0.162662531 MB/sec (with seq num) write speed all = 0.161407800 MB/sec (without seq num) 2024/11/22-14:22:28.513369 140025213425216 [compaction_job.cc:1948] [default] [JOB 358] Generated table #206977: 129429 keys, 41723009 bytes, temperature: kWarm 2024/11/22-14:22:28.513430 140025213425216 EVENT_LOG_v1 {"time_micros": 1732256548513400, "cf_name": "default", "job": 358, "event": "table_file_creation", "file_number": 206977, "file_size": 41723009, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3279728609, "table_properties": {"data_size": 40103472, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588580, "raw_average_key_size": 20, "raw_value_size": 131629383, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129429, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732256546, "oldest_key_time": 0, "file_creation_time": 1732256546, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 206977, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-14:22:28.549281 140025213425216 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206978.sst) /dev/shm/ToplingTemp/Topling-137374-HOHIiL 2024/11/22-14:22:29.130769 140025213425216 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206978.sst): first pass time = 0.58's, 230.834'MB/sec 2024/11/22-14:22:29.878868 140025213425216 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206978.sst): old prealloc_size = 147639500, real_size = 40358448 2024/11/22-14:22:29.878981 140025213425216 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206978.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129425 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1017.03 avg-zval = 309.89 2024/11/22-14:22:29.879032 140025213425216 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206978.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-14:22:30.030219 140025213425216 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206978.sst): second pass time = 0.75's, 176.090'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.15's, 276.017'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2459.353'MB/sec (index lex order gen) rebuild zvType time = 0.10's, 0.313'MB/sec write SST data time = 0.05's, 876.725'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 42703.133'MB/sec zip my value time = 0.75's, unzip length = 0.132'GB zip my value throughput = 176.090'MB/sec zip pipeline throughput = 176.090'MB/sec entries = 129425 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1017.03 avg-zval = 309.89 usrkeys = 129425 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1017.03 avg-zval = 309.89 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 20 bytes = 64 } seq expand size = 140 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0977 value = 3.2819 dict = 1.00 all = 3.2166 } Zip/UnZip{ index = 0.1409 value = 0.3047 dict = 1.00 all = 0.3109 } ---------------------------- total value len = 3.291097 GB avg = 1.017 KB (by entry num) total key len = 0.064715 GB avg = 0.020 KB total ukey len = 0.038829 GB avg = 0.012 KB total ukey num = 0.003235728 Billion total entry num = 0.003235728 Billion write speed all = 0.169426103 MB/sec (with seq num) write speed all = 0.168119196 MB/sec (without seq num) 2024/11/22-14:22:30.066352 140025213425216 [compaction_job.cc:1948] [default] [JOB 358] Generated table #206978: 129425 keys, 41726125 bytes, temperature: kWarm 2024/11/22-14:22:30.066415 140025213425216 EVENT_LOG_v1 {"time_micros": 1732256550066384, "cf_name": "default", "job": 358, "event": "table_file_creation", "file_number": 206978, "file_size": 41726125, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3279515372, "table_properties": {"data_size": 40107104, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588500, "raw_average_key_size": 20, "raw_value_size": 131629284, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129425, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732256548, "oldest_key_time": 0, "file_creation_time": 1732256548, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 206978, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-14:22:30.101712 140025213425216 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206979.sst) /dev/shm/ToplingTemp/Topling-137374-LJ1EsN 2024/11/22-14:22:30.584713 140025213425216 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206979.sst): first pass time = 0.48's, 277.907'MB/sec 2024/11/22-14:22:31.364378 140025213425216 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206979.sst): old prealloc_size = 147639500, real_size = 40346720 2024/11/22-14:22:31.364492 140025213425216 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206979.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129436 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1016.95 avg-zval = 309.77 2024/11/22-14:22:31.364546 140025213425216 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206979.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-14:22:31.517076 140025213425216 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206979.sst): second pass time = 0.78's, 168.950'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.15's, 273.218'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2377.763'MB/sec (index lex order gen) rebuild zvType time = 0.10's, 0.310'MB/sec write SST data time = 0.05's, 864.240'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 41879.300'MB/sec zip my value time = 0.78's, unzip length = 0.132'GB zip my value throughput = 168.950'MB/sec zip pipeline throughput = 168.950'MB/sec entries = 129436 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1016.95 avg-zval = 309.77 usrkeys = 129436 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1016.95 avg-zval = 309.77 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 18 bytes = 64 } seq expand size = 126 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0983 value = 3.2829 dict = 1.00 all = 3.2175 } Zip/UnZip{ index = 0.1409 value = 0.3046 dict = 1.00 all = 0.3108 } ---------------------------- total value len = 3.422727 GB avg = 1.017 KB (by entry num) total key len = 0.067303 GB avg = 0.020 KB total ukey len = 0.040382 GB avg = 0.012 KB total ukey num = 0.003365164 Billion total entry num = 0.003365164 Billion write speed all = 0.176189199 MB/sec (with seq num) write speed all = 0.174830114 MB/sec (without seq num) 2024/11/22-14:22:31.553270 140025213425216 [compaction_job.cc:1948] [default] [JOB 358] Generated table #206979: 129436 keys, 41714611 bytes, temperature: kWarm 2024/11/22-14:22:31.553335 140025213425216 EVENT_LOG_v1 {"time_micros": 1732256551553303, "cf_name": "default", "job": 358, "event": "table_file_creation", "file_number": 206979, "file_size": 41714611, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3279623931, "table_properties": {"data_size": 40095376, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588720, "raw_average_key_size": 20, "raw_value_size": 131629342, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129436, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732256550, "oldest_key_time": 0, "file_creation_time": 1732256550, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 206979, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-14:22:31.590162 140025213425216 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206980.sst) /dev/shm/ToplingTemp/Topling-137374-DgrTQN 2024/11/22-14:22:32.054606 140025213425216 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206980.sst): first pass time = 0.46's, 289.013'MB/sec 2024/11/22-14:22:32.838331 140025213425216 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206980.sst): old prealloc_size = 147639500, real_size = 40351904 2024/11/22-14:22:32.838449 140025213425216 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206980.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1016.99 avg-zval = 309.82 2024/11/22-14:22:32.838518 140025213425216 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206980.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-14:22:32.989748 140025213425216 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206980.sst): second pass time = 0.78's, 168.085'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.15's, 275.546'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2345.873'MB/sec (index lex order gen) rebuild zvType time = 0.10's, 0.313'MB/sec write SST data time = 0.05's, 872.089'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 41234.770'MB/sec zip my value time = 0.78's, unzip length = 0.132'GB zip my value throughput = 168.085'MB/sec zip pipeline throughput = 168.085'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1016.99 avg-zval = 309.82 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1016.99 avg-zval = 309.82 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 14 bytes = 48 } seq expand size = 98 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0981 value = 3.2825 dict = 1.00 all = 3.2171 } Zip/UnZip{ index = 0.1409 value = 0.3046 dict = 1.00 all = 0.3108 } ---------------------------- total value len = 3.554356 GB avg = 1.017 KB (by entry num) total key len = 0.069892 GB avg = 0.020 KB total ukey len = 0.041935 GB avg = 0.012 KB total ukey num = 0.003494595 Billion total entry num = 0.003494595 Billion write speed all = 0.182951419 MB/sec (with seq num) write speed all = 0.181540166 MB/sec (without seq num) 2024/11/22-14:22:33.026428 140025213425216 [compaction_job.cc:1948] [default] [JOB 358] Generated table #206980: 129431 keys, 41719697 bytes, temperature: kWarm 2024/11/22-14:22:33.026492 140025213425216 EVENT_LOG_v1 {"time_micros": 1732256553026459, "cf_name": "default", "job": 358, "event": "table_file_creation", "file_number": 206980, "file_size": 41719697, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3279658822, "table_properties": {"data_size": 40100560, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131629616, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732256551, "oldest_key_time": 0, "file_creation_time": 1732256551, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 206980, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-14:22:33.071521 140025213425216 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206981.sst) /dev/shm/ToplingTemp/Topling-137374-4jZ9HN 2024/11/22-14:22:33.636716 140025213425216 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206981.sst): first pass time = 0.57's, 237.491'MB/sec 2024/11/22-14:22:34.416628 140025213425216 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206981.sst): old prealloc_size = 147639500, real_size = 40355120 2024/11/22-14:22:34.416745 140025213425216 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206981.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129427 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1017.02 avg-zval = 309.86 2024/11/22-14:22:34.416805 140025213425216 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206981.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-14:22:34.567955 140025213425216 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206981.sst): second pass time = 0.78's, 169.065'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.15's, 275.757'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2413.749'MB/sec (index lex order gen) rebuild zvType time = 0.10's, 0.314'MB/sec write SST data time = 0.05's, 865.238'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 40546.027'MB/sec zip my value time = 0.78's, unzip length = 0.132'GB zip my value throughput = 169.065'MB/sec zip pipeline throughput = 169.065'MB/sec entries = 129427 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1017.02 avg-zval = 309.86 usrkeys = 129427 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1017.02 avg-zval = 309.86 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 17 bytes = 64 } seq expand size = 119 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0979 value = 3.2822 dict = 1.00 all = 3.2169 } Zip/UnZip{ index = 0.1409 value = 0.3047 dict = 1.00 all = 0.3109 } ---------------------------- total value len = 3.685987 GB avg = 1.017 KB (by entry num) total key len = 0.072480 GB avg = 0.020 KB total ukey len = 0.043488 GB avg = 0.012 KB total ukey num = 0.003624022 Billion total entry num = 0.003624022 Billion write speed all = 0.189711648 MB/sec (with seq num) write speed all = 0.188248244 MB/sec (without seq num) 2024/11/22-14:22:34.605623 140025213425216 [compaction_job.cc:1948] [default] [JOB 358] Generated table #206981: 129427 keys, 41723095 bytes, temperature: kWarm 2024/11/22-14:22:34.605683 140025213425216 EVENT_LOG_v1 {"time_micros": 1732256554605652, "cf_name": "default", "job": 358, "event": "table_file_creation", "file_number": 206981, "file_size": 41723095, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3279741083, "table_properties": {"data_size": 40103776, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588540, "raw_average_key_size": 20, "raw_value_size": 131630159, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129427, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732256553, "oldest_key_time": 0, "file_creation_time": 1732256553, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 206981, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-14:22:34.643450 140025213425216 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206982.sst) /dev/shm/ToplingTemp/Topling-137374-tdq17N 2024/11/22-14:22:34.689701 140025213425216 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206982.sst): first pass time = 0.05's, 704.161'MB/sec 2024/11/22-14:22:34.964265 140025213425216 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206982.sst): old prealloc_size = 147639500, real_size = 9844424 2024/11/22-14:22:34.964310 140025213425216 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206982.sst): index type = UintIndex_AllOne , store type = DictZipBlobStore usrkeys = 31376 prefix = 4 raw-key = 0.0003 GB zip-key = 0.0000 GB avg-key = 8.00 avg-zkey = 0.01 raw-val = 0.0319 GB zip-val = 0.0098 GB avg-val =1017.08 avg-zval = 313.50 2024/11/22-14:22:35.002250 140025213425216 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00/206982.sst): second pass time = 0.27's, 116.465'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.04's, 267.441'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 8.339'MB/sec (index lex order gen) rebuild zvType time = 0.03's, 0.293'MB/sec write SST data time = 0.01's, 909.647'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.313'MB, throughput = 11177.033'MB/sec zip my value time = 0.27's, unzip length = 0.032'GB zip my value throughput = 116.465'MB/sec zip pipeline throughput = 116.465'MB/sec entries = 31376 avg-key = 20.00 avg-zkey = 0.01 avg-val = 1017.08 avg-zval = 313.50 usrkeys = 31376 avg-key = 12.00 avg-zkey = 0.01 avg-val = 1017.08 avg-zval = 313.50 TagRS{ kinds = RS_Key0_TagN bytes = 5000 } TagArray{ size = 5 bytes = 32 } seq expand size = 35 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0004 GB value = 0.0319 GB dict = 0.31 MB all = 0.0325 GB } __ZipSize{ index = 0.0000 GB value = 0.0098 GB dict = 0.31 MB all = 0.0102 GB } UnZip/Zip{ index =1961.0000 value = 3.2443 dict = 1.00 all = 3.2040 } Zip/UnZip{ index = 0.0005 value = 0.3082 dict = 1.00 all = 0.3121 } ---------------------------- total value len = 3.717899 GB avg = 1.017 KB (by entry num) total key len = 0.073108 GB avg = 0.020 KB total ukey len = 0.043865 GB avg = 0.012 KB total ukey num = 0.003655398 Billion total entry num = 0.003655398 Billion write speed all = 0.191349913 MB/sec (with seq num) write speed all = 0.189873872 MB/sec (without seq num) 2024/11/22-14:22:35.015849 140025213425216 [compaction_job.cc:1948] [default] [JOB 358] Generated table #206982: 31376 keys, 10155841 bytes, temperature: kWarm 2024/11/22-14:22:35.015910 140025213425216 EVENT_LOG_v1 {"time_micros": 1732256555015879, "cf_name": "default", "job": 358, "event": "table_file_creation", "file_number": 206982, "file_size": 10155841, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3279625910, "table_properties": {"data_size": 9836240, "index_size": 192, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 627520, "raw_average_key_size": 20, "raw_value_size": 31911990, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 31376, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-UintIndex_AllOne-DictZipBlobStore", "creation_time": 1732256554, "oldest_key_time": 0, "file_creation_time": 1732256554, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 206982, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-14:22:35.030102 140025213425216 [compaction_job.cc:703] job-00358: subcompact[0], size: 1.179206 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00358/att-00 [206954,206955,206956,206957,206958,206959,206960,206961,206962,206963,206964,206965,206966,206967,206968,206969,206970,206971,206972,206973,206974,206975,206976,206977,206978,206979,206980,206981,206982] 2024/11/22-14:22:35.211736 140025213425216 (Original Log Time 2024/11/22-14:21:47.682957) EVENT_LOG_v1 {"time_micros": 1732256507682921, "job": 358, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [206931], "files_L3": [206950, 206951, 206891, 206844, 206874, 206873, 206876, 206875, 206878, 206877, 206879, 206881, 206880, 206884, 206882, 206883, 206885, 206886, 206887, 206894, 206892, 206893, 206896, 206895, 206897, 206898, 206900, 206901, 206902, 206903], "score": 0.821154, "input_data_size": 1192022663, "oldest_snapshot_seqno": 3279914143} 2024/11/22-14:22:35.211741 140025213425216 (Original Log Time 2024/11/22-14:22:35.210697) [compaction_job.cc:2022] [default] [JOB 358] Compacted 1@2 + 30@3 files to L3 => 1179206414 bytes 2024/11/22-14:22:35.211742 140025213425216 (Original Log Time 2024/11/22-14:22:35.211660) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 29 0 0 0] max score 0.04, MB/sec: 25.2 rd, 24.9 wr, level 3, files in(1, 30) out(29 +0 blob) MB in(12.7, 1124.1 +0.0 blob) out(1124.6 +0.0 blob), read-write-amplify(178.0) write-amplify(88.5) OK, records in: 3668275, records dropped: 12877 output_compression: Snappy 2024/11/22-14:22:35.211746 140025213425216 (Original Log Time 2024/11/22-14:22:35.211711) EVENT_LOG_v1 {"time_micros": 1732256555211686, "cf": "default", "job": 358, "event": "compaction_finished", "compaction_time_micros": 47347153, "compaction_time_cpu_micros": 9869583, "output_level": 3, "num_output_files": 29, "total_output_size": 1179206414, "num_input_records": 3668275, "num_output_records": 3655398, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 785127319, "file_range_sync_nanos": 0, "file_fsync_nanos": 28549, "file_prepare_write_nanos": 61341, "lsm_state": [0, 0, 0, 29, 0, 0, 0]} 2024/11/22-14:22:35.347751 140025213425216 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732256054,"starts":1732256507,"executesMs":47657,"compactionJobId":358,"attempt":0,"compactionInputRawBytes":3804005507,"compactionInputZipBytes":1192022663,"compactionOutputRawBytes":0,"compactionOutputZipBytes":1179206414,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-9580f2915b5c891c776bb3d70787d7b2-9908fc880aef21bd-00"}}, response = 2024/11/22-14:22:35.347826 140025213425216 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-00358/att-00: olev 3, work 47.657 s, result 6.363 ms, install 1.069 ms, input{raw 3.543 GiB zip 1.110 GiB}