2024/11/22-05:59:56.645865 139783581591104 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-09799/att-00: fork to child time = 0.018402 sec 2024/11/22-05:59:56.646753 139783581591104 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-09799/att-00 2024/11/22-05:59:56.656581 139783581591104 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-09799/att-00 2024/11/22-05:59:56.657768 139783581591104 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/22-05:59:56.658129 139783581591104 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/22-05:59:56.715253 139783581591104 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-21T23.11.14/.rocksdb/job-09799/att-00/MANIFEST-169053 2024/11/22-05:59:56.729878 139783581591104 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-21T23.11.14/.rocksdb/job-09799/att-00/MANIFEST-169053 succeeded,manifest_file_number is 169053, next_file_number is 187059, last_sequence is 2974634509, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 186922 2024/11/22-05:59:56.729886 139783581591104 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/22-05:59:56.730009 139783581591104 [version_set.cc:5721] Creating manifest 187059 2024/11/22-05:59:56.765630 139783581591104 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-09799/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/22-05:59:56.784412 139783581591104 [compaction_job.cc:2437] [default] [JOB 9799] Compacting 1@2 + 9@3 files to L3, score 0.77, subcompactions 1 : 1 2024/11/22-05:59:56.784427 139783581591104 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 7242 Base level 2, inputs: [187050(15MB)], [186978(34MB) 186979(34MB) 186980(35MB) 186981(35MB) 186982(35MB) 186983(35MB) 186984(35MB) 186985(35MB) 186986(36MB)] 2024/11/22-05:59:56.789246 139783581591104 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/22-05:59:56.789283 139783581591104 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/22-05:59:56.789309 139783581591104 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/22-05:59:56.789314 139783581591104 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/22-05:59:56.789324 139783581591104 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/22-05:59:57.222962 139783581591104 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-09799/att-00/187060.sst) /dev/shm/ToplingTemp/Topling-742954-ljQgaU 2024/11/22-05:59:58.144854 139783581591104 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-09799/att-00/187060.sst): first pass time = 0.92's, 145.596'MB/sec 2024/11/22-06:00:01.085707 139783581591104 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-09799/att-00/187060.sst): old prealloc_size = 147639500, real_size = 31556688 2024/11/22-06:00:01.086365 139783581591104 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-09799/att-00/187060.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 923921 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0296 GB avg-val = 117.27 avg-zval = 32.00 2024/11/22-06:00:01.087552 139783581591104 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-09799/att-00/187060.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.015 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-06:00:02.239570 139783581591104 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-09799/att-00/187060.sst): second pass time = 2.94's, 36.853'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.15's, 30.895'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2735.274'MB/sec (index lex order gen) rebuild zvType time = 0.92's, 0.250'MB/sec write SST data time = 0.23's, 156.110'MB/sec dict compress time = 0.00's, 1071649.505'MB/sec z-dict build time = 0.00's, sample length = 1.082'MB, throughput = 32388.713'MB/sec zip my value time = 2.94's, unzip length = 0.108'GB zip my value throughput = 36.853'MB/sec zip pipeline throughput = 109.498'MB/sec entries = 923921 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.27 avg-zval = 32.00 usrkeys = 923921 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.27 avg-zval = 32.00 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 923921 bytes = 3233744 } seq expand size = 6467447 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0296 GB dict = 1.08 MB all = 0.0356 GB } UnZip/Zip{ index = 10.5121 value = 3.6644 dict = 1.00 all = 3.7651 } Zip/UnZip{ index = 0.0951 value = 0.2729 dict = 1.00 all = 0.2656 } ---------------------------- total value len = 1709.783292 GB avg = 0.313 KB (by entry num) total key len = 143.095060 GB avg = 0.026 KB total ukey len = 110.330390 GB avg = 0.014 KB total ukey num = 7.641623242 Billion total entry num = 5.468271643 Billion write speed all = 24.390185029 MB/sec (with seq num) write speed all = 23.814336509 MB/sec (without seq num) 2024/11/22-06:00:02.273388 139783581591104 [compaction_job.cc:1948] [default] [JOB 9799] Generated table #187060: 923921 keys, 35647630 bytes, temperature: kWarm 2024/11/22-06:00:02.273497 139783581591104 EVENT_LOG_v1 {"time_micros": 1732226402273427, "cf_name": "default", "job": 9799, "event": "table_file_creation", "file_number": 187060, "file_size": 35647630, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 2834154953, "largest_seqno": 2974606063, "table_properties": {"data_size": 29567680, "index_size": 1757824, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25869788, "raw_average_key_size": 28, "raw_value_size": 108348074, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 923921, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732226397, "oldest_key_time": 0, "file_creation_time": 1732226397, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "W8MV0ZD9CRSC93X8GXGR", "orig_file_number": 187060, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-06:00:02.348555 139783581591104 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-09799/att-00/187061.sst) /dev/shm/ToplingTemp/Topling-742954-znMcFR 2024/11/22-06:00:03.931648 139783581591104 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-09799/att-00/187061.sst): first pass time = 1.58's, 84.784'MB/sec 2024/11/22-06:00:05.499424 139783581591104 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-09799/att-00/187061.sst): old prealloc_size = 147639500, real_size = 32031808 2024/11/22-06:00:05.499956 139783581591104 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-09799/att-00/187061.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 924075 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0300 GB avg-val = 117.25 avg-zval = 32.51 2024/11/22-06:00:05.500743 139783581591104 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-09799/att-00/187061.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.015 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-06:00:06.654456 139783581591104 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-09799/att-00/187061.sst): second pass time = 1.57's, 69.132'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.16's, 31.275'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3414.160'MB/sec (index lex order gen) rebuild zvType time = 1.02's, 0.226'MB/sec write SST data time = 0.13's, 272.153'MB/sec dict compress time = 0.00's, 1071487.129'MB/sec z-dict build time = 0.00's, sample length = 1.082'MB, throughput = 36757.082'MB/sec zip my value time = 1.57's, unzip length = 0.108'GB zip my value throughput = 69.132'MB/sec zip pipeline throughput = 69.132'MB/sec entries = 924075 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.25 avg-zval = 32.51 usrkeys = 924075 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.25 avg-zval = 32.51 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 924075 bytes = 3234272 } seq expand size = 6468525 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0300 GB dict = 1.08 MB all = 0.0361 GB } UnZip/Zip{ index = 10.5127 value = 3.6063 dict = 1.00 all = 3.7156 } Zip/UnZip{ index = 0.0951 value = 0.2773 dict = 1.00 all = 0.2691 } ---------------------------- total value len = 1709.898104 GB avg = 0.313 KB (by entry num) total key len = 143.120934 GB avg = 0.026 KB total ukey len = 110.348872 GB avg = 0.014 KB total ukey num = 7.642547317 Billion total entry num = 5.469195718 Billion write speed all = 24.390619468 MB/sec (with seq num) write speed all = 23.814707106 MB/sec (without seq num) 2024/11/22-06:00:06.687640 139783581591104 [compaction_job.cc:1948] [default] [JOB 9799] Generated table #187061: 924075 keys, 36123114 bytes, temperature: kWarm 2024/11/22-06:00:06.687699 139783581591104 EVENT_LOG_v1 {"time_micros": 1732226406687669, "cf_name": "default", "job": 9799, "event": "table_file_creation", "file_number": 187061, "file_size": 36123114, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 2834154984, "largest_seqno": 2974606081, "table_properties": {"data_size": 30042608, "index_size": 1758016, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25874100, "raw_average_key_size": 28, "raw_value_size": 108343634, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 924075, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732226402, "oldest_key_time": 0, "file_creation_time": 1732226402, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "W8MV0ZD9CRSC93X8GXGR", "orig_file_number": 187061, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-06:00:06.737647 139783581591104 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-09799/att-00/187062.sst) /dev/shm/ToplingTemp/Topling-742954-vKR9tT 2024/11/22-06:00:07.557733 139783581591104 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-09799/att-00/187062.sst): first pass time = 0.82's, 163.671'MB/sec 2024/11/22-06:00:09.046501 139783581591104 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-09799/att-00/187062.sst): old prealloc_size = 147639500, real_size = 32514992 2024/11/22-06:00:09.047061 139783581591104 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-09799/att-00/187062.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 923891 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1083 GB zip-val = 0.0305 GB avg-val = 117.27 avg-zval = 33.03 2024/11/22-06:00:09.047836 139783581591104 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-09799/att-00/187062.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.015 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-06:00:09.938816 139783581591104 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-09799/att-00/187062.sst): second pass time = 1.49's, 72.811'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.89's, 41.024'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3329.856'MB/sec (index lex order gen) rebuild zvType time = 0.76's, 0.304'MB/sec write SST data time = 0.13's, 278.205'MB/sec dict compress time = 0.00's, 1071637.624'MB/sec z-dict build time = 0.00's, sample length = 1.082'MB, throughput = 32813.521'MB/sec zip my value time = 1.49's, unzip length = 0.108'GB zip my value throughput = 72.811'MB/sec zip pipeline throughput = 72.811'MB/sec entries = 923891 avg-key = 28.00 avg-zkey = 1.92 avg-val = 117.27 avg-zval = 33.03 usrkeys = 923891 avg-key = 20.00 avg-zkey = 1.92 avg-val = 124.27 avg-zval = 33.03 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 923891 bytes = 3233632 } seq expand size = 6467237 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0305 GB dict = 1.08 MB all = 0.0366 GB } UnZip/Zip{ index = 10.4407 value = 3.5508 dict = 1.00 all = 3.6666 } Zip/UnZip{ index = 0.0958 value = 0.2816 dict = 1.00 all = 0.2727 } ---------------------------- total value len = 1710.012920 GB avg = 0.313 KB (by entry num) total key len = 143.146803 GB avg = 0.026 KB total ukey len = 110.367350 GB avg = 0.014 KB total ukey num = 7.643471208 Billion total entry num = 5.470119609 Billion write speed all = 24.391416793 MB/sec (with seq num) write speed all = 23.815432044 MB/sec (without seq num) 2024/11/22-06:00:09.970461 139783581591104 [compaction_job.cc:1948] [default] [JOB 9799] Generated table #187062: 923891 keys, 36605826 bytes, temperature: kWarm 2024/11/22-06:00:09.970527 139783581591104 EVENT_LOG_v1 {"time_micros": 1732226409970489, "cf_name": "default", "job": 9799, "event": "table_file_creation", "file_number": 187062, "file_size": 36605826, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 2834155001, "largest_seqno": 2974606091, "table_properties": {"data_size": 30514016, "index_size": 1769792, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25868948, "raw_average_key_size": 28, "raw_value_size": 108348846, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 923891, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732226406, "oldest_key_time": 0, "file_creation_time": 1732226406, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "W8MV0ZD9CRSC93X8GXGR", "orig_file_number": 187062, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-06:00:10.011454 139783581591104 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-09799/att-00/187063.sst) /dev/shm/ToplingTemp/Topling-742954-khbF6S 2024/11/22-06:00:10.841170 139783581591104 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-09799/att-00/187063.sst): first pass time = 0.83's, 161.770'MB/sec 2024/11/22-06:00:12.210749 139783581591104 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-09799/att-00/187063.sst): old prealloc_size = 147639500, real_size = 32954000 2024/11/22-06:00:12.211325 139783581591104 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-09799/att-00/187063.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 923701 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1084 GB zip-val = 0.0310 GB avg-val = 117.30 avg-zval = 33.51 2024/11/22-06:00:12.212112 139783581591104 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-09799/att-00/187063.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.015 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-06:00:13.121978 139783581591104 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-09799/att-00/187063.sst): second pass time = 1.37's, 79.216'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.91's, 40.654'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3191.593'MB/sec (index lex order gen) rebuild zvType time = 0.78's, 0.297'MB/sec write SST data time = 0.13's, 280.850'MB/sec dict compress time = 0.00's, 1071809.901'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 24860.555'MB/sec zip my value time = 1.37's, unzip length = 0.108'GB zip my value throughput = 79.216'MB/sec zip pipeline throughput = 79.216'MB/sec entries = 923701 avg-key = 28.00 avg-zkey = 1.91 avg-val = 117.30 avg-zval = 33.51 usrkeys = 923701 avg-key = 20.00 avg-zkey = 1.91 avg-val = 124.30 avg-zval = 33.51 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 923701 bytes = 3232976 } seq expand size = 6465907 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0310 GB dict = 1.08 MB all = 0.0370 GB } UnZip/Zip{ index = 10.4446 value = 3.5005 dict = 1.00 all = 3.6232 } Zip/UnZip{ index = 0.0957 value = 0.2857 dict = 1.00 all = 0.2760 } ---------------------------- total value len = 1710.127740 GB avg = 0.313 KB (by entry num) total key len = 143.172667 GB avg = 0.026 KB total ukey len = 110.385824 GB avg = 0.014 KB total ukey num = 7.644394909 Billion total entry num = 5.471043310 Billion write speed all = 24.392246521 MB/sec (with seq num) write speed all = 23.816188645 MB/sec (without seq num) 2024/11/22-06:00:13.156378 139783581591104 [compaction_job.cc:1948] [default] [JOB 9799] Generated table #187063: 923701 keys, 37044400 bytes, temperature: kWarm 2024/11/22-06:00:13.156436 139783581591104 EVENT_LOG_v1 {"time_micros": 1732226413156406, "cf_name": "default", "job": 9799, "event": "table_file_creation", "file_number": 187063, "file_size": 37044400, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 2834155015, "largest_seqno": 2974606101, "table_properties": {"data_size": 30954112, "index_size": 1768768, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25863628, "raw_average_key_size": 28, "raw_value_size": 108354154, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 923701, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732226409, "oldest_key_time": 0, "file_creation_time": 1732226409, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "W8MV0ZD9CRSC93X8GXGR", "orig_file_number": 187063, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-06:00:13.194699 139783581591104 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-09799/att-00/187064.sst) /dev/shm/ToplingTemp/Topling-742954-Pjm5qV 2024/11/22-06:00:13.998930 139783581591104 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-09799/att-00/187064.sst): first pass time = 0.80's, 166.896'MB/sec 2024/11/22-06:00:15.354950 139783581591104 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-09799/att-00/187064.sst): old prealloc_size = 147639500, real_size = 33096032 2024/11/22-06:00:15.355553 139783581591104 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-09799/att-00/187064.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 923985 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1083 GB zip-val = 0.0311 GB avg-val = 117.26 avg-zval = 33.65 2024/11/22-06:00:15.356330 139783581591104 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-09799/att-00/187064.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.015 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-06:00:16.273196 139783581591104 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-09799/att-00/187064.sst): second pass time = 1.36's, 79.941'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.92's, 40.499'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3112.580'MB/sec (index lex order gen) rebuild zvType time = 0.78's, 0.294'MB/sec write SST data time = 0.13's, 279.842'MB/sec dict compress time = 0.00's, 1071435.644'MB/sec z-dict build time = 0.00's, sample length = 1.082'MB, throughput = 31778.404'MB/sec zip my value time = 1.36's, unzip length = 0.108'GB zip my value throughput = 79.941'MB/sec zip pipeline throughput = 79.941'MB/sec entries = 923985 avg-key = 28.00 avg-zkey = 1.92 avg-val = 117.26 avg-zval = 33.65 usrkeys = 923985 avg-key = 20.00 avg-zkey = 1.92 avg-val = 124.26 avg-zval = 33.65 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 923985 bytes = 3233968 } seq expand size = 6467895 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0311 GB dict = 1.08 MB all = 0.0372 GB } UnZip/Zip{ index = 10.4432 value = 3.4843 dict = 1.00 all = 3.6093 } Zip/UnZip{ index = 0.0958 value = 0.2870 dict = 1.00 all = 0.2771 } ---------------------------- total value len = 1710.242554 GB avg = 0.313 KB (by entry num) total key len = 143.198538 GB avg = 0.026 KB total ukey len = 110.404303 GB avg = 0.014 KB total ukey num = 7.645318894 Billion total entry num = 5.471967295 Billion write speed all = 24.393086459 MB/sec (with seq num) write speed all = 23.816955189 MB/sec (without seq num) 2024/11/22-06:00:16.304447 139783581591104 [compaction_job.cc:1948] [default] [JOB 9799] Generated table #187064: 923985 keys, 37187062 bytes, temperature: kWarm 2024/11/22-06:00:16.304506 139783581591104 EVENT_LOG_v1 {"time_micros": 1732226416304475, "cf_name": "default", "job": 9799, "event": "table_file_creation", "file_number": 187064, "file_size": 37187062, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 2834155033, "largest_seqno": 2974606121, "table_properties": {"data_size": 31095312, "index_size": 1769536, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25871580, "raw_average_key_size": 28, "raw_value_size": 108346282, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 923985, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732226413, "oldest_key_time": 0, "file_creation_time": 1732226413, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "W8MV0ZD9CRSC93X8GXGR", "orig_file_number": 187064, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-06:00:16.341520 139783581591104 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-09799/att-00/187065.sst) /dev/shm/ToplingTemp/Topling-742954-7omqRR 2024/11/22-06:00:17.132228 139783581591104 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-09799/att-00/187065.sst): first pass time = 0.79's, 169.751'MB/sec 2024/11/22-06:00:18.477487 139783581591104 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-09799/att-00/187065.sst): old prealloc_size = 147639500, real_size = 33188576 2024/11/22-06:00:18.478041 139783581591104 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-09799/att-00/187065.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 923974 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0312 GB avg-val = 117.26 avg-zval = 33.77 2024/11/22-06:00:18.478984 139783581591104 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-09799/att-00/187065.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.015 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-06:00:19.400424 139783581591104 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-09799/att-00/187065.sst): second pass time = 1.34's, 80.599'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.92's, 40.393'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3362.995'MB/sec (index lex order gen) rebuild zvType time = 0.79's, 0.293'MB/sec write SST data time = 0.13's, 279.186'MB/sec dict compress time = 0.00's, 1071344.554'MB/sec z-dict build time = 0.00's, sample length = 1.082'MB, throughput = 33670.162'MB/sec zip my value time = 1.34's, unzip length = 0.108'GB zip my value throughput = 80.599'MB/sec zip pipeline throughput = 80.599'MB/sec entries = 923974 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.26 avg-zval = 33.77 usrkeys = 923974 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.26 avg-zval = 33.77 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 923974 bytes = 3233920 } seq expand size = 6467818 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0312 GB dict = 1.08 MB all = 0.0373 GB } UnZip/Zip{ index = 10.5127 value = 3.4727 dict = 1.00 all = 3.6003 } Zip/UnZip{ index = 0.0951 value = 0.2880 dict = 1.00 all = 0.2778 } ---------------------------- total value len = 1710.357369 GB avg = 0.313 KB (by entry num) total key len = 143.224410 GB avg = 0.026 KB total ukey len = 110.422783 GB avg = 0.014 KB total ukey num = 7.646242868 Billion total entry num = 5.472891269 Billion write speed all = 24.393934030 MB/sec (with seq num) write speed all = 23.817729192 MB/sec (without seq num) 2024/11/22-06:00:19.434387 139783581591104 [compaction_job.cc:1948] [default] [JOB 9799] Generated table #187065: 923974 keys, 37279386 bytes, temperature: kWarm 2024/11/22-06:00:19.434449 139783581591104 EVENT_LOG_v1 {"time_micros": 1732226419434419, "cf_name": "default", "job": 9799, "event": "table_file_creation", "file_number": 187065, "file_size": 37279386, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 2834155048, "largest_seqno": 2974606135, "table_properties": {"data_size": 31199568, "index_size": 1757824, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25871272, "raw_average_key_size": 28, "raw_value_size": 108346480, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 923974, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732226416, "oldest_key_time": 0, "file_creation_time": 1732226416, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "W8MV0ZD9CRSC93X8GXGR", "orig_file_number": 187065, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-06:00:19.472082 139783581591104 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-09799/att-00/187066.sst) /dev/shm/ToplingTemp/Topling-742954-12vhwV 2024/11/22-06:00:20.320904 139783581591104 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-09799/att-00/187066.sst): first pass time = 0.85's, 158.129'MB/sec 2024/11/22-06:00:21.665713 139783581591104 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-09799/att-00/187066.sst): old prealloc_size = 147639500, real_size = 33475600 2024/11/22-06:00:21.666271 139783581591104 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-09799/att-00/187066.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 924075 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1083 GB zip-val = 0.0315 GB avg-val = 117.25 avg-zval = 34.06 2024/11/22-06:00:21.667066 139783581591104 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-09799/att-00/187066.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.015 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-06:00:22.594184 139783581591104 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-09799/att-00/187066.sst): second pass time = 1.34's, 80.648'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.93's, 40.462'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3290.763'MB/sec (index lex order gen) rebuild zvType time = 0.80's, 0.290'MB/sec write SST data time = 0.13's, 286.466'MB/sec dict compress time = 0.00's, 1071483.168'MB/sec z-dict build time = 0.00's, sample length = 1.082'MB, throughput = 33450.729'MB/sec zip my value time = 1.34's, unzip length = 0.108'GB zip my value throughput = 80.648'MB/sec zip pipeline throughput = 80.648'MB/sec entries = 924075 avg-key = 28.00 avg-zkey = 1.92 avg-val = 117.25 avg-zval = 34.06 usrkeys = 924075 avg-key = 20.00 avg-zkey = 1.92 avg-val = 124.25 avg-zval = 34.06 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 924075 bytes = 3234272 } seq expand size = 6468525 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0315 GB dict = 1.08 MB all = 0.0376 GB } UnZip/Zip{ index = 10.4435 value = 3.4422 dict = 1.00 all = 3.5728 } Zip/UnZip{ index = 0.0958 value = 0.2905 dict = 1.00 all = 0.2799 } ---------------------------- total value len = 1710.472181 GB avg = 0.312 KB (by entry num) total key len = 143.250284 GB avg = 0.026 KB total ukey len = 110.441264 GB avg = 0.014 KB total ukey num = 7.647166943 Billion total entry num = 5.473815344 Billion write speed all = 24.394760179 MB/sec (with seq num) write speed all = 23.818482273 MB/sec (without seq num) 2024/11/22-06:00:22.627171 139783581591104 [compaction_job.cc:1948] [default] [JOB 9799] Generated table #187066: 924075 keys, 37567014 bytes, temperature: kWarm 2024/11/22-06:00:22.627233 139783581591104 EVENT_LOG_v1 {"time_micros": 1732226422627202, "cf_name": "default", "job": 9799, "event": "table_file_creation", "file_number": 187066, "file_size": 37567014, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 2834155059, "largest_seqno": 2974606153, "table_properties": {"data_size": 31474752, "index_size": 1769664, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25874100, "raw_average_key_size": 28, "raw_value_size": 108343718, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 924075, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732226419, "oldest_key_time": 0, "file_creation_time": 1732226419, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "W8MV0ZD9CRSC93X8GXGR", "orig_file_number": 187066, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-06:00:22.671128 139783581591104 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-09799/att-00/187067.sst) /dev/shm/ToplingTemp/Topling-742954-v38h0S 2024/11/22-06:00:23.581494 139783581591104 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-09799/att-00/187067.sst): first pass time = 0.91's, 147.438'MB/sec 2024/11/22-06:00:24.933294 139783581591104 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-09799/att-00/187067.sst): old prealloc_size = 147639500, real_size = 33570192 2024/11/22-06:00:24.933832 139783581591104 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-09799/att-00/187067.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 923944 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0316 GB avg-val = 117.27 avg-zval = 34.18 2024/11/22-06:00:24.934748 139783581591104 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-09799/att-00/187067.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.015 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-06:00:25.867829 139783581591104 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-09799/att-00/187067.sst): second pass time = 1.35's, 80.189'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.93's, 40.300'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3372.894'MB/sec (index lex order gen) rebuild zvType time = 0.80's, 0.288'MB/sec write SST data time = 0.13's, 287.528'MB/sec dict compress time = 0.00's, 1071605.941'MB/sec z-dict build time = 0.00's, sample length = 1.082'MB, throughput = 30955.325'MB/sec zip my value time = 1.35's, unzip length = 0.108'GB zip my value throughput = 80.189'MB/sec zip pipeline throughput = 80.189'MB/sec entries = 923944 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.27 avg-zval = 34.18 usrkeys = 923944 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.27 avg-zval = 34.18 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 923944 bytes = 3233824 } seq expand size = 6467608 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0316 GB dict = 1.08 MB all = 0.0377 GB } UnZip/Zip{ index = 10.5127 value = 3.4308 dict = 1.00 all = 3.5638 } Zip/UnZip{ index = 0.0951 value = 0.2915 dict = 1.00 all = 0.2806 } ---------------------------- total value len = 1710.586996 GB avg = 0.312 KB (by entry num) total key len = 143.276154 GB avg = 0.026 KB total ukey len = 110.459743 GB avg = 0.014 KB total ukey num = 7.648090887 Billion total entry num = 5.474739288 Billion write speed all = 24.395560601 MB/sec (with seq num) write speed all = 23.819210253 MB/sec (without seq num) 2024/11/22-06:00:25.900036 139783581591104 [compaction_job.cc:1948] [default] [JOB 9799] Generated table #187067: 923944 keys, 37661154 bytes, temperature: kWarm 2024/11/22-06:00:25.900093 139783581591104 EVENT_LOG_v1 {"time_micros": 1732226425900063, "cf_name": "default", "job": 9799, "event": "table_file_creation", "file_number": 187067, "file_size": 37661154, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 2834155074, "largest_seqno": 2974606173, "table_properties": {"data_size": 31581248, "index_size": 1757760, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25870432, "raw_average_key_size": 28, "raw_value_size": 108347408, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 923944, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732226422, "oldest_key_time": 0, "file_creation_time": 1732226422, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "W8MV0ZD9CRSC93X8GXGR", "orig_file_number": 187067, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-06:00:25.935799 139783581591104 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-09799/att-00/187068.sst) /dev/shm/ToplingTemp/Topling-742954-A39yNU 2024/11/22-06:00:26.737904 139783581591104 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-09799/att-00/187068.sst): first pass time = 0.80's, 167.339'MB/sec 2024/11/22-06:00:28.084016 139783581591104 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-09799/att-00/187068.sst): old prealloc_size = 147639500, real_size = 33754784 2024/11/22-06:00:28.084565 139783581591104 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-09799/att-00/187068.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 923837 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1084 GB zip-val = 0.0318 GB avg-val = 117.28 avg-zval = 34.37 2024/11/22-06:00:28.085332 139783581591104 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-09799/att-00/187068.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.015 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-06:00:29.021222 139783581591104 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-09799/att-00/187068.sst): second pass time = 1.35's, 80.529'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.94's, 40.382'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3335.241'MB/sec (index lex order gen) rebuild zvType time = 0.81's, 0.287'MB/sec write SST data time = 0.13's, 289.271'MB/sec dict compress time = 0.00's, 1071875.248'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 30672.730'MB/sec zip my value time = 1.35's, unzip length = 0.108'GB zip my value throughput = 80.529'MB/sec zip pipeline throughput = 80.529'MB/sec entries = 923837 avg-key = 28.00 avg-zkey = 1.92 avg-val = 117.28 avg-zval = 34.37 usrkeys = 923837 avg-key = 20.00 avg-zkey = 1.92 avg-val = 124.28 avg-zval = 34.37 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 923837 bytes = 3233440 } seq expand size = 6466859 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0185 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0318 GB dict = 1.08 MB all = 0.0378 GB } UnZip/Zip{ index = 10.4438 value = 3.4121 dict = 1.00 all = 3.5465 } Zip/UnZip{ index = 0.0958 value = 0.2931 dict = 1.00 all = 0.2820 } ---------------------------- total value len = 1710.701813 GB avg = 0.312 KB (by entry num) total key len = 143.302022 GB avg = 0.026 KB total ukey len = 110.478220 GB avg = 0.014 KB total ukey num = 7.649014724 Billion total entry num = 5.475663125 Billion write speed all = 24.396399551 MB/sec (with seq num) write speed all = 23.819975865 MB/sec (without seq num) 2024/11/22-06:00:29.052899 139783581591104 [compaction_job.cc:1948] [default] [JOB 9799] Generated table #187068: 923837 keys, 37845618 bytes, temperature: kWarm 2024/11/22-06:00:29.052964 139783581591104 EVENT_LOG_v1 {"time_micros": 1732226429052925, "cf_name": "default", "job": 9799, "event": "table_file_creation", "file_number": 187068, "file_size": 37845618, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 2834155085, "largest_seqno": 2973478181, "table_properties": {"data_size": 31754512, "index_size": 1769152, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25867436, "raw_average_key_size": 28, "raw_value_size": 108350410, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 923837, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732226425, "oldest_key_time": 0, "file_creation_time": 1732226425, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "W8MV0ZD9CRSC93X8GXGR", "orig_file_number": 187068, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-06:00:29.094857 139783581591104 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-09799/att-00/187069.sst) /dev/shm/ToplingTemp/Topling-742954-2QMJxS 2024/11/22-06:00:29.137714 139783581591104 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-09799/att-00/187069.sst): first pass time = 0.04's, 229.834'MB/sec 2024/11/22-06:00:29.224989 139783581591104 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-09799/att-00/187069.sst): old prealloc_size = 147639500, real_size = 3076784 2024/11/22-06:00:29.225072 139783581591104 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-09799/att-00/187069.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 67421 prefix = 4 raw-key = 0.0011 GB zip-key = 0.0001 GB avg-key = 16.00 avg-zkey = 1.94 raw-val = 0.0080 GB zip-val = 0.0029 GB avg-val = 118.00 avg-zval = 43.45 2024/11/22-06:00:29.225162 139783581591104 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-09799/att-00/187069.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.015 GB, reorder workingMem = 0.0001 GB, waited 0.000 sec, Key+Value = 0.010 GB 2024/11/22-06:00:29.281712 139783581591104 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-09799/att-00/187069.sst): second pass time = 0.09's, 91.597'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.06's, 58.987'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2007.785'MB/sec (index lex order gen) rebuild zvType time = 0.05's, 0.358'MB/sec write SST data time = 0.01's, 348.845'MB/sec dict compress time = 0.00's, 80847.525'MB/sec z-dict build time = 0.00's, sample length = 0.082'MB, throughput = 3523.300'MB/sec zip my value time = 0.09's, unzip length = 0.008'GB zip my value throughput = 91.597'MB/sec zip pipeline throughput = 91.597'MB/sec entries = 67421 avg-key = 28.00 avg-zkey = 1.94 avg-val = 118.00 avg-zval = 43.45 usrkeys = 67421 avg-key = 20.00 avg-zkey = 1.94 avg-val = 125.00 avg-zval = 43.45 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 67421 bytes = 202272 } seq expand size = 471947 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0013 GB value = 0.0080 GB dict = 0.08 MB all = 0.0098 GB } __ZipSize{ index = 0.0001 GB value = 0.0029 GB dict = 0.08 MB all = 0.0033 GB } UnZip/Zip{ index = 10.3330 value = 2.7159 dict = 1.00 all = 2.9425 } Zip/UnZip{ index = 0.0968 value = 0.3682 dict = 1.00 all = 0.3398 } ---------------------------- total value len = 1710.710241 GB avg = 0.312 KB (by entry num) total key len = 143.303910 GB avg = 0.026 KB total ukey len = 110.479568 GB avg = 0.014 KB total ukey num = 7.649082145 Billion total entry num = 5.475730546 Billion write speed all = 24.396451662 MB/sec (with seq num) write speed all = 23.820022855 MB/sec (without seq num) 2024/11/22-06:00:29.291954 139783581591104 [compaction_job.cc:1948] [default] [JOB 9799] Generated table #187069: 67421 keys, 3345238 bytes, temperature: kWarm 2024/11/22-06:00:29.292002 139783581591104 EVENT_LOG_v1 {"time_micros": 1732226429291976, "cf_name": "default", "job": 9799, "event": "table_file_creation", "file_number": 187069, "file_size": 3345238, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 2914272206, "largest_seqno": 2927628874, "table_properties": {"data_size": 2929248, "index_size": 130496, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 1887788, "raw_average_key_size": 28, "raw_value_size": 7955678, "raw_average_value_size": 118, "num_data_blocks": 1, "num_entries": 67421, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 118, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732226429, "oldest_key_time": 0, "file_creation_time": 1732226429, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "W8MV0ZD9CRSC93X8GXGR", "orig_file_number": 187069, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-06:00:29.301909 139783581591104 [compaction_job.cc:703] job-09799: subcompact[0], size: 0.336306 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-09799/att-00 [187060,187061,187062,187063,187064,187065,187066,187067,187068,187069] 2024/11/22-06:00:29.366680 139783581591104 (Original Log Time 2024/11/22-05:59:56.784487) EVENT_LOG_v1 {"time_micros": 1732226396784440, "job": 9799, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [187050], "files_L3": [186978, 186979, 186980, 186981, 186982, 186983, 186984, 186985, 186986], "score": 0.76973, "input_data_size": 349974934, "oldest_snapshot_seqno": 2974634315} 2024/11/22-06:00:29.366683 139783581591104 (Original Log Time 2024/11/22-06:00:29.366090) [compaction_job.cc:2022] [default] [JOB 9799] Compacted 1@2 + 9@3 files to L3 => 336306442 bytes 2024/11/22-06:00:29.366685 139783581591104 (Original Log Time 2024/11/22-06:00:29.366618) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 10 0 0 0] max score 0.01, MB/sec: 10.8 rd, 10.3 wr, level 3, files in(1, 9) out(10 +0 blob) MB in(15.3, 318.4 +0.0 blob) out(320.7 +0.0 blob), read-write-amplify(42.7) write-amplify(20.9) OK, records in: 8446926, records dropped: 64102 output_compression: Snappy 2024/11/22-06:00:29.366691 139783581591104 (Original Log Time 2024/11/22-06:00:29.366661) EVENT_LOG_v1 {"time_micros": 1732226429366642, "cf": "default", "job": 9799, "event": "compaction_finished", "compaction_time_micros": 32517427, "compaction_time_cpu_micros": 14569217, "output_level": 3, "num_output_files": 10, "total_output_size": 336306442, "num_input_records": 8446926, "num_output_records": 8382824, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 212437315, "file_range_sync_nanos": 0, "file_fsync_nanos": 7976, "file_prepare_write_nanos": 21535, "lsm_state": [0, 0, 0, 10, 0, 0, 0]} 2024/11/22-06:00:29.483780 139783581591104 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732201874,"starts":1732226396,"executesMs":32713,"compactionJobId":9799,"attempt":0,"compactionInputRawBytes":1226906240,"compactionInputZipBytes":349974934,"compactionOutputRawBytes":0,"compactionOutputZipBytes":336306442,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-14ae509123a4cef4fb101f69b5b5d068-1a803876b9cdfa06-00"}}, response = 2024/11/22-06:00:29.483865 139783581591104 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-21T23.11.14/.rocksdb/job-09799/att-00: olev 3, work 32.714 s, result 6.351 ms, install 0.619 ms, input{raw 1.143 GiB zip 333.762 MiB}