2024/11/23-19:35:22.356492 139957634799168 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00: fork to child time = 0.033609 sec 2024/11/23-19:35:22.357518 139957634799168 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00 2024/11/23-19:35:22.366385 139957634799168 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00 2024/11/23-19:35:22.367589 139957634799168 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/23-19:35:22.367927 139957634799168 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/23-19:35:22.419520 139957634799168 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-34341/att-00/MANIFEST-206347 2024/11/23-19:35:22.435335 139957634799168 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-34341/att-00/MANIFEST-206347 succeeded,manifest_file_number is 206347, next_file_number is 277468, last_sequence is 4219335080, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 277310 2024/11/23-19:35:22.435347 139957634799168 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/23-19:35:22.435583 139957634799168 [version_set.cc:5721] Creating manifest 277468 2024/11/23-19:35:22.470989 139957634799168 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/23-19:35:22.493796 139957634799168 [compaction_job.cc:2437] [default] [JOB 34341] Compacting 1@2 + 17@3 files to L3, score 0.99, subcompactions 1 : 1 2024/11/23-19:35:22.493823 139957634799168 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 25702 Base level 2, inputs: [277445(27MB)], [277350(36MB) 277351(36MB) 277398(37MB) 277399(39MB) 277400(37MB) 277401(36MB) 277402(38MB) 277403(35MB) 277404(34MB) 277405(37MB) 277406(34MB) 277407(37MB) 277408(35MB) 277409(35MB) 277410(36MB) 277411(36MB) 277464(37MB)] 2024/11/23-19:35:22.502583 139957634799168 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-19:35:22.502624 139957634799168 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-19:35:22.502653 139957634799168 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-19:35:22.502663 139957634799168 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-19:35:22.502678 139957634799168 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-19:35:23.123920 139957634799168 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277469.sst) /dev/shm/ToplingTemp/Topling-167716-tesSF7 2024/11/23-19:35:23.698719 139957634799168 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277469.sst): first pass time = 0.57's, 233.522'MB/sec 2024/11/23-19:35:26.839301 139957634799168 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277469.sst): old prealloc_size = 147639500, real_size = 34271440 2024/11/23-19:35:26.839843 139957634799168 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277469.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 929335 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0323 GB avg-val = 116.42 avg-zval = 34.73 2024/11/23-19:35:26.840661 139957634799168 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277469.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-19:35:27.702061 139957634799168 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277469.sst): second pass time = 3.14's, 34.461'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.86's, 44.348'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3391.206'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.318'MB/sec write SST data time = 0.13's, 291.375'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 33781.728'MB/sec zip my value time = 3.14's, unzip length = 0.108'GB zip my value throughput = 34.461'MB/sec zip pipeline throughput = 103.158'MB/sec entries = 929335 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.42 avg-zval = 34.73 usrkeys = 929335 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.42 avg-zval = 34.73 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 929335 bytes = 3136528 } seq expand size = 6505345 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0323 GB dict = 1.08 MB all = 0.0383 GB } UnZip/Zip{ index = 10.5144 value = 3.3527 dict = 1.00 all = 3.5080 } Zip/UnZip{ index = 0.0951 value = 0.2983 dict = 1.00 all = 0.2851 } ---------------------------- total value len = 8.963322 GB avg = 0.168 KB (by entry num) total key len = 1.466842 GB avg = 0.028 KB total ukey len = 1.016465 GB avg = 0.015 KB total ukey num = 0.066479770 Billion total entry num = 0.053287499 Billion write speed all = 0.271509352 MB/sec (with seq num) write speed all = 0.260412265 MB/sec (without seq num) 2024/11/23-19:35:27.786288 139957634799168 [compaction_job.cc:1948] [default] [JOB 34341] Generated table #277469: 929335 keys, 38260816 bytes, temperature: kWarm 2024/11/23-19:35:27.786388 139957634799168 EVENT_LOG_v1 {"time_micros": 1732361727786326, "cf_name": "default", "job": 34341, "event": "table_file_creation", "file_number": 277469, "file_size": 38260816, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4136224572, "largest_seqno": 4219226299, "table_properties": {"data_size": 32271168, "index_size": 1767744, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26021380, "raw_average_key_size": 28, "raw_value_size": 108196482, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 929335, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732361723, "oldest_key_time": 0, "file_creation_time": 1732361723, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 277469, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-19:35:27.824878 139957634799168 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277470.sst) /dev/shm/ToplingTemp/Topling-167716-D6sAt6 2024/11/23-19:35:28.859584 139957634799168 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277470.sst): first pass time = 1.03's, 129.720'MB/sec 2024/11/23-19:35:30.938128 139957634799168 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277470.sst): old prealloc_size = 147639500, real_size = 34644640 2024/11/23-19:35:30.938681 139957634799168 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277470.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927253 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0326 GB avg-val = 116.75 avg-zval = 35.21 2024/11/23-19:35:30.939421 139957634799168 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277470.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-19:35:31.846860 139957634799168 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277470.sst): second pass time = 2.08's, 52.101'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.91's, 42.383'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3315.870'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 0.320'MB/sec write SST data time = 0.18's, 210.094'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 16823.390'MB/sec zip my value time = 2.08's, unzip length = 0.108'GB zip my value throughput = 52.101'MB/sec zip pipeline throughput = 144.796'MB/sec entries = 927253 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.75 avg-zval = 35.21 usrkeys = 927253 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.75 avg-zval = 35.21 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927253 bytes = 3013584 } seq expand size = 6490771 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0326 GB dict = 1.08 MB all = 0.0385 GB } UnZip/Zip{ index = 10.5114 value = 3.3158 dict = 1.00 all = 3.4850 } Zip/UnZip{ index = 0.0951 value = 0.3016 dict = 1.00 all = 0.2869 } ---------------------------- total value len = 9.078067 GB avg = 0.167 KB (by entry num) total key len = 1.492806 GB avg = 0.028 KB total ukey len = 1.035010 GB avg = 0.015 KB total ukey num = 0.067407023 Billion total entry num = 0.054214752 Billion write speed all = 0.275142475 MB/sec (with seq num) write speed all = 0.263853506 MB/sec (without seq num) 2024/11/23-19:35:31.903626 139957634799168 [compaction_job.cc:1948] [default] [JOB 34341] Generated table #277470: 927253 keys, 38512808 bytes, temperature: kWarm 2024/11/23-19:35:31.903707 139957634799168 EVENT_LOG_v1 {"time_micros": 1732361731903660, "cf_name": "default", "job": 34341, "event": "table_file_creation", "file_number": 277470, "file_size": 38512808, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4155809461, "largest_seqno": 4219226550, "table_properties": {"data_size": 32648336, "index_size": 1764288, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25963084, "raw_average_key_size": 28, "raw_value_size": 108254746, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927253, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732361727, "oldest_key_time": 0, "file_creation_time": 1732361727, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 277470, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-19:35:31.976538 139957634799168 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277471.sst) /dev/shm/ToplingTemp/Topling-167716-BQErs6 2024/11/23-19:35:32.994956 139957634799168 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277471.sst): first pass time = 1.02's, 131.798'MB/sec 2024/11/23-19:35:35.095061 139957634799168 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277471.sst): old prealloc_size = 147639500, real_size = 34812672 2024/11/23-19:35:35.095596 139957634799168 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277471.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 929524 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0328 GB avg-val = 116.39 avg-zval = 35.30 2024/11/23-19:35:35.096362 139957634799168 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277471.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-19:35:36.171882 139957634799168 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277471.sst): second pass time = 2.10's, 51.536'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.08's, 35.928'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3482.586'MB/sec (index lex order gen) rebuild zvType time = 0.84's, 0.276'MB/sec write SST data time = 0.23's, 165.691'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 27557.042'MB/sec zip my value time = 2.10's, unzip length = 0.108'GB zip my value throughput = 51.536'MB/sec zip pipeline throughput = 160.198'MB/sec entries = 929524 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.39 avg-zval = 35.30 usrkeys = 929524 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.39 avg-zval = 35.30 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 929524 bytes = 3020960 } seq expand size = 6506668 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0328 GB dict = 1.08 MB all = 0.0387 GB } UnZip/Zip{ index = 10.5127 value = 3.2973 dict = 1.00 all = 3.4694 } Zip/UnZip{ index = 0.0951 value = 0.3033 dict = 1.00 all = 0.2882 } ---------------------------- total value len = 9.192765 GB avg = 0.167 KB (by entry num) total key len = 1.518832 GB avg = 0.028 KB total ukey len = 1.053600 GB avg = 0.015 KB total ukey num = 0.068336547 Billion total entry num = 0.055144276 Billion write speed all = 0.278773920 MB/sec (with seq num) write speed all = 0.267292692 MB/sec (without seq num) 2024/11/23-19:35:36.223320 139957634799168 [compaction_job.cc:1948] [default] [JOB 34341] Generated table #277471: 929524 keys, 38686548 bytes, temperature: kWarm 2024/11/23-19:35:36.223388 139957634799168 EVENT_LOG_v1 {"time_micros": 1732361736223352, "cf_name": "default", "job": 34341, "event": "table_file_creation", "file_number": 277471, "file_size": 38686548, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4184103631, "largest_seqno": 4219226372, "table_properties": {"data_size": 32811696, "index_size": 1768384, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26026672, "raw_average_key_size": 28, "raw_value_size": 108191160, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 929524, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732361731, "oldest_key_time": 0, "file_creation_time": 1732361731, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 277471, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-19:35:36.261437 139957634799168 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277472.sst) /dev/shm/ToplingTemp/Topling-167716-DJaXK5 2024/11/23-19:35:37.219294 139957634799168 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277472.sst): first pass time = 0.95's, 140.786'MB/sec 2024/11/23-19:35:39.226270 139957634799168 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277472.sst): old prealloc_size = 147639500, real_size = 36782384 2024/11/23-19:35:39.226934 139957634799168 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277472.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 935453 prefix = 4 raw-key = 0.0150 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.89 raw-val = 0.1080 GB zip-val = 0.0348 GB avg-val = 115.48 avg-zval = 37.18 2024/11/23-19:35:39.228401 139957634799168 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277472.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-19:35:40.200024 139957634799168 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277472.sst): second pass time = 2.01's, 53.851'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.97's, 42.254'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2759.227'MB/sec (index lex order gen) rebuild zvType time = 0.82's, 0.286'MB/sec write SST data time = 0.16's, 265.136'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 35136.693'MB/sec zip my value time = 2.01's, unzip length = 0.108'GB zip my value throughput = 53.851'MB/sec zip pipeline throughput = 107.347'MB/sec entries = 935453 avg-key = 28.00 avg-zkey = 1.89 avg-val = 115.48 avg-zval = 37.18 usrkeys = 935453 avg-key = 20.00 avg-zkey = 1.89 avg-val = 122.48 avg-zval = 37.18 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 935453 bytes = 3507968 } seq expand size = 6548171 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0187 GB value = 0.1080 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0348 GB dict = 1.08 MB all = 0.0411 GB } UnZip/Zip{ index = 10.5824 value = 3.1059 dict = 1.00 all = 3.2621 } Zip/UnZip{ index = 0.0945 value = 0.3220 dict = 1.00 all = 0.3065 } ---------------------------- total value len = 9.307338 GB avg = 0.166 KB (by entry num) total key len = 1.545025 GB avg = 0.028 KB total ukey len = 1.072309 GB avg = 0.015 KB total ukey num = 0.069272000 Billion total entry num = 0.056079729 Billion write speed all = 0.282407808 MB/sec (with seq num) write speed all = 0.270733039 MB/sec (without seq num) 2024/11/23-19:35:40.254780 139957634799168 [compaction_job.cc:1948] [default] [JOB 34341] Generated table #277472: 935453 keys, 41144192 bytes, temperature: kWarm 2024/11/23-19:35:40.254852 139957634799168 EVENT_LOG_v1 {"time_micros": 1732361740254815, "cf_name": "default", "job": 34341, "event": "table_file_creation", "file_number": 277472, "file_size": 41144192, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3591110068, "largest_seqno": 4219226409, "table_properties": {"data_size": 34780384, "index_size": 1767936, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26192684, "raw_average_key_size": 28, "raw_value_size": 108025074, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 935453, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732361736, "oldest_key_time": 0, "file_creation_time": 1732361736, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 277472, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-19:35:40.294508 139957634799168 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277473.sst) /dev/shm/ToplingTemp/Topling-167716-Weu5j6 2024/11/23-19:35:41.427936 139957634799168 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277473.sst): first pass time = 1.13's, 118.421'MB/sec 2024/11/23-19:35:43.268226 139957634799168 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277473.sst): old prealloc_size = 147639500, real_size = 36810352 2024/11/23-19:35:43.268893 139957634799168 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277473.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 930022 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.1082 GB zip-val = 0.0348 GB avg-val = 116.32 avg-zval = 37.40 2024/11/23-19:35:43.269587 139957634799168 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277473.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-19:35:44.176181 139957634799168 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277473.sst): second pass time = 1.84's, 58.850'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.91's, 44.220'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2775.991'MB/sec (index lex order gen) rebuild zvType time = 0.75's, 0.309'MB/sec write SST data time = 0.15's, 259.506'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 34885.288'MB/sec zip my value time = 1.84's, unzip length = 0.108'GB zip my value throughput = 58.850'MB/sec zip pipeline throughput = 87.578'MB/sec entries = 930022 avg-key = 28.00 avg-zkey = 1.93 avg-val = 116.32 avg-zval = 37.40 usrkeys = 930022 avg-key = 20.00 avg-zkey = 1.93 avg-val = 121.01 avg-zval = 37.40 TagRS{ kinds = RS_Key0_TagN bytes = 145400 } TagArray{ size = 623230 bytes = 2337120 } seq expand size = 4362610 multi value expand size = 0 cnt WriteAppend = 21 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0348 GB dict = 1.08 MB all = 0.0401 GB } UnZip/Zip{ index = 10.3745 value = 3.1099 dict = 1.00 all = 3.3430 } Zip/UnZip{ index = 0.0964 value = 0.3216 dict = 1.00 all = 0.2991 } ---------------------------- total value len = 9.419878 GB avg = 0.165 KB (by entry num) total key len = 1.571066 GB avg = 0.028 KB total ukey len = 1.090910 GB avg = 0.016 KB total ukey num = 0.070202022 Billion total entry num = 0.057009751 Billion write speed all = 0.285984454 MB/sec (with seq num) write speed all = 0.274117300 MB/sec (without seq num) 2024/11/23-19:35:44.231283 139957634799168 [compaction_job.cc:1948] [default] [JOB 34341] Generated table #277473: 930022 keys, 40148656 bytes, temperature: kWarm 2024/11/23-19:35:44.231355 139957634799168 EVENT_LOG_v1 {"time_micros": 1732361744231319, "cf_name": "default", "job": 34341, "event": "table_file_creation", "file_number": 277473, "file_size": 40148656, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4012775947, "table_properties": {"data_size": 34784736, "index_size": 1792896, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26040616, "raw_average_key_size": 28, "raw_value_size": 108177208, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 930022, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732361740, "oldest_key_time": 0, "file_creation_time": 1732361740, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 277473, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-19:35:44.266864 139957634799168 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277474.sst) /dev/shm/ToplingTemp/Topling-167716-5l3ss6 2024/11/23-19:35:45.448060 139957634799168 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277474.sst): first pass time = 1.18's, 113.633'MB/sec 2024/11/23-19:35:46.872246 139957634799168 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277474.sst): old prealloc_size = 147639500, real_size = 35352784 2024/11/23-19:35:46.872934 139957634799168 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277474.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925181 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1083 GB zip-val = 0.0333 GB avg-val = 117.07 avg-zval = 36.05 2024/11/23-19:35:46.873824 139957634799168 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277474.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-19:35:47.913279 139957634799168 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277474.sst): second pass time = 1.42's, 76.098'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.04's, 38.003'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2658.391'MB/sec (index lex order gen) rebuild zvType time = 0.89's, 0.261'MB/sec write SST data time = 0.15's, 259.414'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 34531.536'MB/sec zip my value time = 1.42's, unzip length = 0.108'GB zip my value throughput = 76.098'MB/sec zip pipeline throughput = 76.098'MB/sec entries = 925181 avg-key = 28.00 avg-zkey = 1.91 avg-val = 117.07 avg-zval = 36.05 usrkeys = 925181 avg-key = 20.00 avg-zkey = 1.91 avg-val = 124.07 avg-zval = 36.05 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 925181 bytes = 3353792 } seq expand size = 6476267 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0333 GB dict = 1.08 MB all = 0.0396 GB } UnZip/Zip{ index = 10.4454 value = 3.2478 dict = 1.00 all = 3.3926 } Zip/UnZip{ index = 0.0957 value = 0.3079 dict = 1.00 all = 0.2948 } ---------------------------- total value len = 9.534667 GB avg = 0.165 KB (by entry num) total key len = 1.596971 GB avg = 0.028 KB total ukey len = 1.109413 GB avg = 0.016 KB total ukey num = 0.071127203 Billion total entry num = 0.057934932 Billion write speed all = 0.289617152 MB/sec (with seq num) write speed all = 0.277558584 MB/sec (without seq num) 2024/11/23-19:35:47.970578 139957634799168 [compaction_job.cc:1948] [default] [JOB 34341] Generated table #277474: 925181 keys, 39561872 bytes, temperature: kWarm 2024/11/23-19:35:47.970642 139957634799168 EVENT_LOG_v1 {"time_micros": 1732361747970609, "cf_name": "default", "job": 34341, "event": "table_file_creation", "file_number": 277474, "file_size": 39561872, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3514720078, "largest_seqno": 4012776021, "table_properties": {"data_size": 33349824, "index_size": 1771456, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25905068, "raw_average_key_size": 28, "raw_value_size": 108312678, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 925181, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732361744, "oldest_key_time": 0, "file_creation_time": 1732361744, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 277474, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-19:35:48.007420 139957634799168 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277475.sst) /dev/shm/ToplingTemp/Topling-167716-nTAkm7 2024/11/23-19:35:49.200394 139957634799168 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277475.sst): first pass time = 1.19's, 112.511'MB/sec 2024/11/23-19:35:50.776290 139957634799168 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277475.sst): old prealloc_size = 147639500, real_size = 35792464 2024/11/23-19:35:50.777022 139957634799168 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277475.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 929714 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1082 GB zip-val = 0.0338 GB avg-val = 116.36 avg-zval = 36.33 2024/11/23-19:35:50.777820 139957634799168 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277475.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-19:35:51.601662 139957634799168 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277475.sst): second pass time = 1.57's, 68.737'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.83's, 47.972'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2503.150'MB/sec (index lex order gen) rebuild zvType time = 0.68's, 0.342'MB/sec write SST data time = 0.14's, 274.243'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 34792.969'MB/sec zip my value time = 1.57's, unzip length = 0.108'GB zip my value throughput = 68.737'MB/sec zip pipeline throughput = 68.737'MB/sec entries = 929714 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.36 avg-zval = 36.33 usrkeys = 929714 avg-key = 20.00 avg-zkey = 1.91 avg-val = 121.99 avg-zval = 36.33 TagRS{ kinds = RS_Key0_TagN bytes = 145360 } TagArray{ size = 746717 bytes = 2800208 } seq expand size = 5227019 multi value expand size = 0 cnt WriteAppend = 16 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0338 GB dict = 1.08 MB all = 0.0396 GB } UnZip/Zip{ index = 10.4472 value = 3.2027 dict = 1.00 all = 3.3898 } Zip/UnZip{ index = 0.0957 value = 0.3122 dict = 1.00 all = 0.2950 } ---------------------------- total value len = 9.648080 GB avg = 0.164 KB (by entry num) total key len = 1.623003 GB avg = 0.028 KB total ukey len = 1.128008 GB avg = 0.016 KB total ukey num = 0.072056917 Billion total entry num = 0.058864646 Billion write speed all = 0.293217015 MB/sec (with seq num) write speed all = 0.280966113 MB/sec (without seq num) 2024/11/23-19:35:51.650873 139957634799168 [compaction_job.cc:1948] [default] [JOB 34341] Generated table #277475: 929714 keys, 39594164 bytes, temperature: kWarm 2024/11/23-19:35:51.650943 139957634799168 EVENT_LOG_v1 {"time_micros": 1732361751650907, "cf_name": "default", "job": 34341, "event": "table_file_creation", "file_number": 277475, "file_size": 39594164, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4012774830, "table_properties": {"data_size": 33780032, "index_size": 1779840, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26031992, "raw_average_key_size": 28, "raw_value_size": 108185748, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 929714, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732361747, "oldest_key_time": 0, "file_creation_time": 1732361747, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 277475, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-19:35:51.689948 139957634799168 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277476.sst) /dev/shm/ToplingTemp/Topling-167716-9FXff7 2024/11/23-19:35:52.834257 139957634799168 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277476.sst): first pass time = 1.14's, 117.298'MB/sec 2024/11/23-19:35:54.377317 139957634799168 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277476.sst): old prealloc_size = 147639500, real_size = 33151056 2024/11/23-19:35:54.377849 139957634799168 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277476.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928905 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0312 GB avg-val = 116.49 avg-zval = 33.54 2024/11/23-19:35:54.378647 139957634799168 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277476.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-19:35:55.256632 139957634799168 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277476.sst): second pass time = 1.54's, 70.208'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.88's, 42.503'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3451.169'MB/sec (index lex order gen) rebuild zvType time = 0.75's, 0.310'MB/sec write SST data time = 0.13's, 287.933'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 35046.645'MB/sec zip my value time = 1.54's, unzip length = 0.108'GB zip my value throughput = 70.208'MB/sec zip pipeline throughput = 70.208'MB/sec entries = 928905 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.49 avg-zval = 33.54 usrkeys = 928905 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.49 avg-zval = 33.54 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 928905 bytes = 3367296 } seq expand size = 6502335 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0312 GB dict = 1.08 MB all = 0.0374 GB } UnZip/Zip{ index = 10.5137 value = 3.4736 dict = 1.00 all = 3.5914 } Zip/UnZip{ index = 0.0951 value = 0.2879 dict = 1.00 all = 0.2784 } ---------------------------- total value len = 9.762791 GB avg = 0.163 KB (by entry num) total key len = 1.649012 GB avg = 0.028 KB total ukey len = 1.146586 GB avg = 0.016 KB total ukey num = 0.072985822 Billion total entry num = 0.059793551 Billion write speed all = 0.296849622 MB/sec (with seq num) write speed all = 0.284406580 MB/sec (without seq num) 2024/11/23-19:35:55.304344 139957634799168 [compaction_job.cc:1948] [default] [JOB 34341] Generated table #277476: 928905 keys, 37371666 bytes, temperature: kWarm 2024/11/23-19:35:55.304414 139957634799168 EVENT_LOG_v1 {"time_micros": 1732361755304376, "cf_name": "default", "job": 34341, "event": "table_file_creation", "file_number": 277476, "file_size": 37371666, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3480997236, "largest_seqno": 4012776210, "table_properties": {"data_size": 31151616, "index_size": 1767040, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26009340, "raw_average_key_size": 28, "raw_value_size": 108208490, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928905, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732361751, "oldest_key_time": 0, "file_creation_time": 1732361751, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 277476, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-19:35:55.341963 139957634799168 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277477.sst) /dev/shm/ToplingTemp/Topling-167716-SGi4k4 2024/11/23-19:35:56.424298 139957634799168 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277477.sst): first pass time = 1.08's, 124.015'MB/sec 2024/11/23-19:35:57.898326 139957634799168 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277477.sst): old prealloc_size = 147639500, real_size = 32396992 2024/11/23-19:35:57.899053 139957634799168 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277477.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 935201 prefix = 4 raw-key = 0.0150 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1080 GB zip-val = 0.0304 GB avg-val = 115.52 avg-zval = 32.49 2024/11/23-19:35:57.901653 139957634799168 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277477.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-19:35:58.793740 139957634799168 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277477.sst): second pass time = 1.47's, 73.368'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.90's, 40.918'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2492.400'MB/sec (index lex order gen) rebuild zvType time = 0.74's, 0.316'MB/sec write SST data time = 0.16's, 235.363'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 33220.462'MB/sec zip my value time = 1.47's, unzip length = 0.108'GB zip my value throughput = 73.368'MB/sec zip pipeline throughput = 73.368'MB/sec entries = 935201 avg-key = 28.00 avg-zkey = 1.90 avg-val = 115.52 avg-zval = 32.49 usrkeys = 935201 avg-key = 20.00 avg-zkey = 1.90 avg-val = 122.52 avg-zval = 32.49 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 935201 bytes = 3390112 } seq expand size = 6546407 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0187 GB value = 0.1080 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0304 GB dict = 1.08 MB all = 0.0366 GB } UnZip/Zip{ index = 10.5126 value = 3.5556 dict = 1.00 all = 3.6634 } Zip/UnZip{ index = 0.0951 value = 0.2812 dict = 1.00 all = 0.2730 } ---------------------------- total value len = 9.877369 GB avg = 0.163 KB (by entry num) total key len = 1.675198 GB avg = 0.028 KB total ukey len = 1.165290 GB avg = 0.016 KB total ukey num = 0.073921023 Billion total entry num = 0.060728752 Billion write speed all = 0.300483604 MB/sec (with seq num) write speed all = 0.287847108 MB/sec (without seq num) 2024/11/23-19:35:58.842193 139957634799168 [compaction_job.cc:1948] [default] [JOB 34341] Generated table #277477: 935201 keys, 36637188 bytes, temperature: kWarm 2024/11/23-19:35:58.842264 139957634799168 EVENT_LOG_v1 {"time_micros": 1732361758842229, "cf_name": "default", "job": 34341, "event": "table_file_creation", "file_number": 277477, "file_size": 36637188, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3512539342, "largest_seqno": 4012776248, "table_properties": {"data_size": 30383792, "index_size": 1779200, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26185628, "raw_average_key_size": 28, "raw_value_size": 108032118, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 935201, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732361755, "oldest_key_time": 0, "file_creation_time": 1732361755, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 277477, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-19:35:58.879843 139957634799168 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277478.sst) /dev/shm/ToplingTemp/Topling-167716-NqPHW6 2024/11/23-19:36:00.087332 139957634799168 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277478.sst): first pass time = 1.21's, 111.158'MB/sec 2024/11/23-19:36:01.471639 139957634799168 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277478.sst): old prealloc_size = 147639500, real_size = 35000368 2024/11/23-19:36:01.472263 139957634799168 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277478.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 930631 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1082 GB zip-val = 0.0330 GB avg-val = 116.22 avg-zval = 35.44 2024/11/23-19:36:01.473088 139957634799168 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277478.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-19:36:02.311084 139957634799168 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277478.sst): second pass time = 1.38's, 78.173'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 46.868'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2963.831'MB/sec (index lex order gen) rebuild zvType time = 0.71's, 0.327'MB/sec write SST data time = 0.13's, 309.938'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 33757.547'MB/sec zip my value time = 1.38's, unzip length = 0.108'GB zip my value throughput = 78.173'MB/sec zip pipeline throughput = 78.173'MB/sec entries = 930631 avg-key = 28.00 avg-zkey = 1.92 avg-val = 116.22 avg-zval = 35.44 usrkeys = 930631 avg-key = 20.00 avg-zkey = 1.92 avg-val = 123.22 avg-zval = 35.44 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 930631 bytes = 3489888 } seq expand size = 6514417 multi value expand size = 0 cnt WriteAppend = 16 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0330 GB dict = 1.08 MB all = 0.0393 GB } UnZip/Zip{ index = 10.4436 value = 3.2790 dict = 1.00 all = 3.4116 } Zip/UnZip{ index = 0.0958 value = 0.3050 dict = 1.00 all = 0.2931 } ---------------------------- total value len = 9.992044 GB avg = 0.162 KB (by entry num) total key len = 1.701255 GB avg = 0.028 KB total ukey len = 1.183902 GB avg = 0.016 KB total ukey num = 0.074851654 Billion total entry num = 0.061659383 Billion write speed all = 0.304116244 MB/sec (with seq num) write speed all = 0.291287275 MB/sec (without seq num) 2024/11/23-19:36:02.363187 139957634799168 [compaction_job.cc:1948] [default] [JOB 34341] Generated table #277478: 930631 keys, 39341322 bytes, temperature: kWarm 2024/11/23-19:36:02.363261 139957634799168 EVENT_LOG_v1 {"time_micros": 1732361762363223, "cf_name": "default", "job": 34341, "event": "table_file_creation", "file_number": 277478, "file_size": 39341322, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3411274482, "largest_seqno": 4012776268, "table_properties": {"data_size": 32985312, "index_size": 1782208, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26057668, "raw_average_key_size": 28, "raw_value_size": 108160170, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 930631, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732361758, "oldest_key_time": 0, "file_creation_time": 1732361758, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 277478, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-19:36:02.403490 139957634799168 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277479.sst) /dev/shm/ToplingTemp/Topling-167716-lbKMz7 2024/11/23-19:36:03.270728 139957634799168 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277479.sst): first pass time = 0.87's, 154.775'MB/sec 2024/11/23-19:36:04.558745 139957634799168 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277479.sst): old prealloc_size = 147639500, real_size = 30335056 2024/11/23-19:36:04.559314 139957634799168 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277479.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 931242 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1081 GB zip-val = 0.0283 GB avg-val = 116.13 avg-zval = 30.42 2024/11/23-19:36:04.560109 139957634799168 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277479.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-19:36:05.383204 139957634799168 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277479.sst): second pass time = 1.29's, 84.037'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.82's, 41.922'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3326.646'MB/sec (index lex order gen) rebuild zvType time = 0.70's, 0.334'MB/sec write SST data time = 0.13's, 271.906'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 34514.403'MB/sec zip my value time = 1.29's, unzip length = 0.108'GB zip my value throughput = 84.037'MB/sec zip pipeline throughput = 84.037'MB/sec entries = 931242 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.13 avg-zval = 30.42 usrkeys = 931242 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.13 avg-zval = 30.42 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 931242 bytes = 3375760 } seq expand size = 6518694 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0283 GB dict = 1.08 MB all = 0.0346 GB } UnZip/Zip{ index = 10.5123 value = 3.8172 dict = 1.00 all = 3.8834 } Zip/UnZip{ index = 0.0951 value = 0.2620 dict = 1.00 all = 0.2575 } ---------------------------- total value len = 10.106705 GB avg = 0.161 KB (by entry num) total key len = 1.727330 GB avg = 0.028 KB total ukey len = 1.202527 GB avg = 0.016 KB total ukey num = 0.075782896 Billion total entry num = 0.062590625 Billion write speed all = 0.307751891 MB/sec (with seq num) write speed all = 0.294730207 MB/sec (without seq num) 2024/11/23-19:36:05.426168 139957634799168 [compaction_job.cc:1948] [default] [JOB 34341] Generated table #277479: 931242 keys, 34562224 bytes, temperature: kWarm 2024/11/23-19:36:05.426241 139957634799168 EVENT_LOG_v1 {"time_micros": 1732361765426203, "cf_name": "default", "job": 34341, "event": "table_file_creation", "file_number": 277479, "file_size": 34562224, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3525889795, "largest_seqno": 4012776300, "table_properties": {"data_size": 28330368, "index_size": 1771712, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26074776, "raw_average_key_size": 28, "raw_value_size": 108142972, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 931242, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732361762, "oldest_key_time": 0, "file_creation_time": 1732361762, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 277479, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-19:36:05.461936 139957634799168 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277480.sst) /dev/shm/ToplingTemp/Topling-167716-vESx17 2024/11/23-19:36:06.332422 139957634799168 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277480.sst): first pass time = 0.87's, 154.193'MB/sec 2024/11/23-19:36:07.676532 139957634799168 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277480.sst): old prealloc_size = 147639500, real_size = 35235568 2024/11/23-19:36:07.677111 139957634799168 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277480.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 922697 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1084 GB zip-val = 0.0332 GB avg-val = 117.46 avg-zval = 36.04 2024/11/23-19:36:07.678640 139957634799168 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277480.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-19:36:08.518373 139957634799168 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277480.sst): second pass time = 1.34's, 80.718'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 46.987'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3160.303'MB/sec (index lex order gen) rebuild zvType time = 0.71's, 0.323'MB/sec write SST data time = 0.13's, 309.344'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 34300.725'MB/sec zip my value time = 1.34's, unzip length = 0.108'GB zip my value throughput = 80.718'MB/sec zip pipeline throughput = 80.718'MB/sec entries = 922697 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.46 avg-zval = 36.04 usrkeys = 922697 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.46 avg-zval = 36.04 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 922697 bytes = 3460128 } seq expand size = 6458879 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0332 GB dict = 1.08 MB all = 0.0396 GB } UnZip/Zip{ index = 10.5135 value = 3.2597 dict = 1.00 all = 3.3933 } Zip/UnZip{ index = 0.0951 value = 0.3068 dict = 1.00 all = 0.2947 } ---------------------------- total value len = 10.221547 GB avg = 0.161 KB (by entry num) total key len = 1.753166 GB avg = 0.028 KB total ukey len = 1.220981 GB avg = 0.016 KB total ukey num = 0.076705593 Billion total entry num = 0.063513322 Billion write speed all = 0.311384893 MB/sec (with seq num) write speed all = 0.298172323 MB/sec (without seq num) 2024/11/23-19:36:08.566133 139957634799168 [compaction_job.cc:1948] [default] [JOB 34341] Generated table #277480: 922697 keys, 39553978 bytes, temperature: kWarm 2024/11/23-19:36:08.566205 139957634799168 EVENT_LOG_v1 {"time_micros": 1732361768566169, "cf_name": "default", "job": 34341, "event": "table_file_creation", "file_number": 277480, "file_size": 39553978, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3405268578, "largest_seqno": 4012776316, "table_properties": {"data_size": 33249440, "index_size": 1755264, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25835516, "raw_average_key_size": 28, "raw_value_size": 108382282, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 922697, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732361765, "oldest_key_time": 0, "file_creation_time": 1732361765, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 277480, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-19:36:08.602566 139957634799168 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277481.sst) /dev/shm/ToplingTemp/Topling-167716-2WJJR4 2024/11/23-19:36:09.616524 139957634799168 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277481.sst): first pass time = 1.01's, 132.375'MB/sec 2024/11/23-19:36:10.950191 139957634799168 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277481.sst): old prealloc_size = 147639500, real_size = 32234768 2024/11/23-19:36:10.950722 139957634799168 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277481.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 931083 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1081 GB zip-val = 0.0302 GB avg-val = 116.15 avg-zval = 32.46 2024/11/23-19:36:10.952287 139957634799168 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277481.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-19:36:11.796504 139957634799168 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277481.sst): second pass time = 1.33's, 81.165'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.85's, 43.222'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3516.400'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 0.324'MB/sec write SST data time = 0.13's, 288.039'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 30674.365'MB/sec zip my value time = 1.33's, unzip length = 0.108'GB zip my value throughput = 81.165'MB/sec zip pipeline throughput = 81.165'MB/sec entries = 931083 avg-key = 28.00 avg-zkey = 1.92 avg-val = 116.15 avg-zval = 32.46 usrkeys = 931083 avg-key = 20.00 avg-zkey = 1.92 avg-val = 123.15 avg-zval = 32.46 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 931083 bytes = 3491584 } seq expand size = 6517581 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0186 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0302 GB dict = 1.08 MB all = 0.0366 GB } UnZip/Zip{ index = 10.4438 value = 3.5788 dict = 1.00 all = 3.6694 } Zip/UnZip{ index = 0.0958 value = 0.2794 dict = 1.00 all = 0.2725 } ---------------------------- total value len = 10.336212 GB avg = 0.160 KB (by entry num) total key len = 1.779236 GB avg = 0.028 KB total ukey len = 1.239603 GB avg = 0.016 KB total ukey num = 0.077636676 Billion total entry num = 0.064444405 Billion write speed all = 0.315017659 MB/sec (with seq num) write speed all = 0.301612541 MB/sec (without seq num) 2024/11/23-19:36:11.840349 139957634799168 [compaction_job.cc:1948] [default] [JOB 34341] Generated table #277481: 931083 keys, 36578080 bytes, temperature: kWarm 2024/11/23-19:36:11.840416 139957634799168 EVENT_LOG_v1 {"time_micros": 1732361771840381, "cf_name": "default", "job": 34341, "event": "table_file_creation", "file_number": 277481, "file_size": 36578080, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3471845708, "largest_seqno": 4012776344, "table_properties": {"data_size": 30218752, "index_size": 1783040, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26070324, "raw_average_key_size": 28, "raw_value_size": 108147522, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 931083, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732361768, "oldest_key_time": 0, "file_creation_time": 1732361768, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 277481, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-19:36:11.886013 139957634799168 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277482.sst) /dev/shm/ToplingTemp/Topling-167716-po2yU7 2024/11/23-19:36:12.769148 139957634799168 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277482.sst): first pass time = 0.88's, 151.984'MB/sec 2024/11/23-19:36:14.081890 139957634799168 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277482.sst): old prealloc_size = 147639500, real_size = 32243728 2024/11/23-19:36:14.082459 139957634799168 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277482.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925987 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1083 GB zip-val = 0.0302 GB avg-val = 116.95 avg-zval = 32.66 2024/11/23-19:36:14.083176 139957634799168 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277482.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-19:36:14.898804 139957634799168 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277482.sst): second pass time = 1.31's, 82.593'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.82's, 44.225'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3227.894'MB/sec (index lex order gen) rebuild zvType time = 0.69's, 0.337'MB/sec write SST data time = 0.13's, 281.239'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 34230.796'MB/sec zip my value time = 1.31's, unzip length = 0.108'GB zip my value throughput = 82.593'MB/sec zip pipeline throughput = 82.593'MB/sec entries = 925987 avg-key = 28.00 avg-zkey = 1.92 avg-val = 116.95 avg-zval = 32.66 usrkeys = 925987 avg-key = 20.00 avg-zkey = 1.92 avg-val = 122.95 avg-zval = 32.66 TagRS{ kinds = RS_Key0_TagN bytes = 144800 } TagArray{ size = 794142 bytes = 2878784 } seq expand size = 5558994 multi value expand size = 0 cnt WriteAppend = 17 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0302 GB dict = 1.08 MB all = 0.0361 GB } UnZip/Zip{ index = 10.4432 value = 3.5812 dict = 1.00 all = 3.7152 } Zip/UnZip{ index = 0.0958 value = 0.2792 dict = 1.00 all = 0.2692 } ---------------------------- total value len = 10.450061 GB avg = 0.160 KB (by entry num) total key len = 1.805163 GB avg = 0.028 KB total ukey len = 1.258123 GB avg = 0.016 KB total ukey num = 0.078562663 Billion total entry num = 0.065370392 Billion write speed all = 0.318626339 MB/sec (with seq num) write speed all = 0.305029703 MB/sec (without seq num) 2024/11/23-19:36:14.943622 139957634799168 [compaction_job.cc:1948] [default] [JOB 34341] Generated table #277482: 925987 keys, 36126792 bytes, temperature: kWarm 2024/11/23-19:36:14.943691 139957634799168 EVENT_LOG_v1 {"time_micros": 1732361774943655, "cf_name": "default", "job": 34341, "event": "table_file_creation", "file_number": 277482, "file_size": 36126792, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4012776360, "table_properties": {"data_size": 30238656, "index_size": 1773376, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25927636, "raw_average_key_size": 28, "raw_value_size": 108290194, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 925987, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732361771, "oldest_key_time": 0, "file_creation_time": 1732361771, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 277482, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-19:36:14.983629 139957634799168 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277483.sst) /dev/shm/ToplingTemp/Topling-167716-o7ib75 2024/11/23-19:36:15.930828 139957634799168 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277483.sst): first pass time = 0.95's, 141.705'MB/sec 2024/11/23-19:36:17.444364 139957634799168 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277483.sst): old prealloc_size = 147639500, real_size = 36875360 2024/11/23-19:36:17.444898 139957634799168 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277483.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926279 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0349 GB avg-val = 116.90 avg-zval = 37.66 2024/11/23-19:36:17.445140 139957634799168 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277483.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-19:36:18.154597 139957634799168 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277483.sst): second pass time = 1.51's, 71.609'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.71's, 53.911'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3440.845'MB/sec (index lex order gen) rebuild zvType time = 0.59's, 0.395'MB/sec write SST data time = 0.12's, 310.736'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 35712.841'MB/sec zip my value time = 1.51's, unzip length = 0.108'GB zip my value throughput = 71.609'MB/sec zip pipeline throughput = 71.609'MB/sec entries = 926279 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.90 avg-zval = 37.66 usrkeys = 926279 avg-key = 20.00 avg-zkey = 1.90 avg-val = 117.89 avg-zval = 37.66 TagRS{ kinds = RS_Key0_TagN bytes = 144840 } TagArray{ size = 131136 bytes = 409808 } seq expand size = 917952 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0349 GB dict = 1.08 MB all = 0.0383 GB } UnZip/Zip{ index = 10.5133 value = 3.1043 dict = 1.00 all = 3.5055 } Zip/UnZip{ index = 0.0951 value = 0.3221 dict = 1.00 all = 0.2853 } ---------------------------- total value len = 10.559261 GB avg = 0.159 KB (by entry num) total key len = 1.831099 GB avg = 0.028 KB total ukey len = 1.276648 GB avg = 0.016 KB total ukey num = 0.079488942 Billion total entry num = 0.066296671 Billion write speed all = 0.322112497 MB/sec (with seq num) write speed all = 0.308324367 MB/sec (without seq num) 2024/11/23-19:36:18.201468 139957634799168 [compaction_job.cc:1948] [default] [JOB 34341] Generated table #277483: 926279 keys, 38288193 bytes, temperature: kWarm 2024/11/23-19:36:18.201535 139957634799168 EVENT_LOG_v1 {"time_micros": 1732361778201500, "cf_name": "default", "job": 34341, "event": "table_file_creation", "file_number": 277483, "file_size": 38288193, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3273700812, "table_properties": {"data_size": 34881488, "index_size": 1762112, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25935812, "raw_average_key_size": 28, "raw_value_size": 108281946, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926279, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732361774, "oldest_key_time": 0, "file_creation_time": 1732361774, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 277483, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-19:36:18.239448 139957634799168 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277484.sst) /dev/shm/ToplingTemp/Topling-167716-VSYNH4 2024/11/23-19:36:19.153265 139957634799168 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277484.sst): first pass time = 0.91's, 146.882'MB/sec 2024/11/23-19:36:20.524601 139957634799168 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277484.sst): old prealloc_size = 147639500, real_size = 35095856 2024/11/23-19:36:20.525176 139957634799168 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277484.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926763 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1083 GB zip-val = 0.0331 GB avg-val = 116.82 avg-zval = 35.70 2024/11/23-19:36:20.525739 139957634799168 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277484.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-19:36:21.318757 139957634799168 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277484.sst): second pass time = 1.37's, 78.995'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.79's, 48.065'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3217.021'MB/sec (index lex order gen) rebuild zvType time = 0.67's, 0.348'MB/sec write SST data time = 0.13's, 298.223'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 33592.077'MB/sec zip my value time = 1.37's, unzip length = 0.108'GB zip my value throughput = 78.995'MB/sec zip pipeline throughput = 78.995'MB/sec entries = 926763 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.82 avg-zval = 35.70 usrkeys = 926763 avg-key = 20.00 avg-zkey = 1.91 avg-val = 120.99 avg-zval = 35.70 TagRS{ kinds = RS_Key0_TagN bytes = 144920 } TagArray{ size = 552158 bytes = 2070608 } seq expand size = 3865106 multi value expand size = 0 cnt WriteAppend = 16 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0331 GB dict = 1.08 MB all = 0.0382 GB } UnZip/Zip{ index = 10.4456 value = 3.2720 dict = 1.00 all = 3.5164 } Zip/UnZip{ index = 0.0957 value = 0.3056 dict = 1.00 all = 0.2844 } ---------------------------- total value len = 10.671394 GB avg = 0.159 KB (by entry num) total key len = 1.857049 GB avg = 0.028 KB total ukey len = 1.295183 GB avg = 0.016 KB total ukey num = 0.080415705 Billion total entry num = 0.067223434 Billion write speed all = 0.325675451 MB/sec (with seq num) write speed all = 0.311695727 MB/sec (without seq num) 2024/11/23-19:36:21.366311 139957634799168 [compaction_job.cc:1948] [default] [JOB 34341] Generated table #277484: 926763 keys, 38169614 bytes, temperature: kWarm 2024/11/23-19:36:21.366382 139957634799168 EVENT_LOG_v1 {"time_micros": 1732361781366346, "cf_name": "default", "job": 34341, "event": "table_file_creation", "file_number": 277484, "file_size": 38169614, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4219224756, "table_properties": {"data_size": 33089504, "index_size": 1774464, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25949364, "raw_average_key_size": 28, "raw_value_size": 108268406, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926763, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732361778, "oldest_key_time": 0, "file_creation_time": 1732361778, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 277484, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-19:36:21.401159 139957634799168 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277485.sst) /dev/shm/ToplingTemp/Topling-167716-D3IX14 2024/11/23-19:36:22.346820 139957634799168 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277485.sst): first pass time = 0.95's, 141.935'MB/sec 2024/11/23-19:36:23.697519 139957634799168 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277485.sst): old prealloc_size = 147639500, real_size = 35033328 2024/11/23-19:36:23.698091 139957634799168 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277485.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 930706 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1082 GB zip-val = 0.0330 GB avg-val = 116.21 avg-zval = 35.48 2024/11/23-19:36:23.698847 139957634799168 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277485.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-19:36:24.531141 139957634799168 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277485.sst): second pass time = 1.35's, 80.120'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.83's, 46.817'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3242.285'MB/sec (index lex order gen) rebuild zvType time = 0.71's, 0.328'MB/sec write SST data time = 0.12's, 312.865'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 35379.715'MB/sec zip my value time = 1.35's, unzip length = 0.108'GB zip my value throughput = 80.120'MB/sec zip pipeline throughput = 80.120'MB/sec entries = 930706 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.21 avg-zval = 35.48 usrkeys = 930706 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.21 avg-zval = 35.48 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 930706 bytes = 3141152 } seq expand size = 6514942 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0330 GB dict = 1.08 MB all = 0.0390 GB } UnZip/Zip{ index = 10.4452 value = 3.2757 dict = 1.00 all = 3.4392 } Zip/UnZip{ index = 0.0957 value = 0.3053 dict = 1.00 all = 0.2908 } ---------------------------- total value len = 10.786067 GB avg = 0.158 KB (by entry num) total key len = 1.883108 GB avg = 0.028 KB total ukey len = 1.313798 GB avg = 0.016 KB total ukey num = 0.081346411 Billion total entry num = 0.068154140 Billion write speed all = 0.329306285 MB/sec (with seq num) write speed all = 0.315134195 MB/sec (without seq num) 2024/11/23-19:36:24.582301 139957634799168 [compaction_job.cc:1948] [default] [JOB 34341] Generated table #277485: 930706 keys, 39026250 bytes, temperature: kWarm 2024/11/23-19:36:24.582372 139957634799168 EVENT_LOG_v1 {"time_micros": 1732361784582334, "cf_name": "default", "job": 34341, "event": "table_file_creation", "file_number": 277485, "file_size": 39026250, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4100102034, "largest_seqno": 4219226584, "table_properties": {"data_size": 33018400, "index_size": 1782080, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26059768, "raw_average_key_size": 28, "raw_value_size": 108158048, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 930706, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732361781, "oldest_key_time": 0, "file_creation_time": 1732361781, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 277485, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-19:36:24.629696 139957634799168 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277486.sst) /dev/shm/ToplingTemp/Topling-167716-exp2o6 2024/11/23-19:36:24.713096 139957634799168 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277486.sst): first pass time = 0.08's, 240.454'MB/sec 2024/11/23-19:36:24.894695 139957634799168 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277486.sst): old prealloc_size = 147639500, real_size = 5983264 2024/11/23-19:36:24.894829 139957634799168 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277486.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 138301 prefix = 4 raw-key = 0.0022 GB zip-key = 0.0003 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.0162 GB zip-val = 0.0057 GB avg-val = 116.93 avg-zval = 41.10 2024/11/23-19:36:24.895005 139957634799168 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277486.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.020 GB 2024/11/23-19:36:25.014798 139957634799168 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00/277486.sst): second pass time = 0.18's, 89.370'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.12's, 54.708'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2341.996'MB/sec (index lex order gen) rebuild zvType time = 0.10's, 0.344'MB/sec write SST data time = 0.02's, 337.830'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.170'MB, throughput = 5979.477'MB/sec zip my value time = 0.18's, unzip length = 0.016'GB zip my value throughput = 89.370'MB/sec zip pipeline throughput = 89.370'MB/sec entries = 138301 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.93 avg-zval = 41.10 usrkeys = 138301 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.93 avg-zval = 41.10 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 138301 bytes = 449488 } seq expand size = 968107 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0028 GB value = 0.0162 GB dict = 0.17 MB all = 0.0200 GB } __ZipSize{ index = 0.0003 GB value = 0.0057 GB dict = 0.17 MB all = 0.0066 GB } UnZip/Zip{ index = 10.4571 value = 2.8452 dict = 1.00 all = 3.0511 } Zip/UnZip{ index = 0.0956 value = 0.3515 dict = 1.00 all = 0.3277 } ---------------------------- total value len = 10.803207 GB avg = 0.158 KB (by entry num) total key len = 1.886981 GB avg = 0.028 KB total ukey len = 1.316564 GB avg = 0.016 KB total ukey num = 0.081484712 Billion total entry num = 0.068292441 Billion write speed all = 0.329848314 MB/sec (with seq num) write speed all = 0.315647644 MB/sec (without seq num) 2024/11/23-19:36:25.029281 139957634799168 [compaction_job.cc:1948] [default] [JOB 34341] Generated table #277486: 138301 keys, 6569581 bytes, temperature: kWarm 2024/11/23-19:36:25.029338 139957634799168 EVENT_LOG_v1 {"time_micros": 1732361785029309, "cf_name": "default", "job": 34341, "event": "table_file_creation", "file_number": 277486, "file_size": 6569581, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4163386585, "largest_seqno": 4219226466, "table_properties": {"data_size": 5683984, "index_size": 264512, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 3872428, "raw_average_key_size": 28, "raw_value_size": 16172126, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 138301, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732361784, "oldest_key_time": 0, "file_creation_time": 1732361784, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 277486, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-19:36:25.041388 139957634799168 [compaction_job.cc:703] job-34341: subcompact[0], size: 0.658134 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34341/att-00 [277469,277470,277471,277472,277473,277474,277475,277476,277477,277478,277479,277480,277481,277482,277483,277484,277485,277486] 2024/11/23-19:36:25.176371 139957634799168 (Original Log Time 2024/11/23-19:35:22.493901) EVENT_LOG_v1 {"time_micros": 1732361722493842, "job": 34341, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [277445], "files_L3": [277350, 277351, 277398, 277399, 277400, 277401, 277402, 277403, 277404, 277405, 277406, 277407, 277408, 277409, 277410, 277411, 277464], "score": 0.990584, "input_data_size": 681376485, "oldest_snapshot_seqno": 4219335075} 2024/11/23-19:36:25.176375 139957634799168 (Original Log Time 2024/11/23-19:36:25.174928) [compaction_job.cc:2022] [default] [JOB 34341] Compacted 1@2 + 17@3 files to L3 => 658133944 bytes 2024/11/23-19:36:25.176376 139957634799168 (Original Log Time 2024/11/23-19:36:25.176307) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 18 0 0 0] max score 0.02, MB/sec: 10.9 rd, 10.5 wr, level 3, files in(1, 17) out(18 +0 blob) MB in(27.2, 622.6 +0.0 blob) out(627.6 +0.0 blob), read-write-amplify(47.0) write-amplify(23.1) OK, records in: 16029818, records dropped: 95541 output_compression: Snappy 2024/11/23-19:36:25.176381 139957634799168 (Original Log Time 2024/11/23-19:36:25.176351) EVENT_LOG_v1 {"time_micros": 1732361785176329, "cf": "default", "job": 34341, "event": "compaction_finished", "compaction_time_micros": 62547494, "compaction_time_cpu_micros": 25228397, "output_level": 3, "num_output_files": 18, "total_output_size": 658133944, "num_input_records": 16029818, "num_output_records": 15934277, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 492687001, "file_range_sync_nanos": 0, "file_fsync_nanos": 13133, "file_prepare_write_nanos": 53420, "lsm_state": [0, 0, 0, 18, 0, 0, 0]} 2024/11/23-19:36:25.288614 139957634799168 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732256054,"starts":1732361722,"executesMs":62810,"compactionJobId":34341,"attempt":0,"compactionInputRawBytes":2315313948,"compactionInputZipBytes":681376485,"compactionOutputRawBytes":0,"compactionOutputZipBytes":658133944,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-62eb493b7b259fef9a9065cf70e776f0-951af0ae1616c8da-00"}}, response = 2024/11/23-19:36:25.288686 139957634799168 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-34341/att-00: olev 3, work 62.810 s, result 7.712 ms, install 1.467 ms, input{raw 2.156 GiB zip 649.811 MiB}