Metrics q through z
note
Metrics for materialized views and shared-data clusters are detailed in the corresponding sections:
- Metrics for asynchronous materialized view metrics
- Metrics for Shared-data Dashboard metrics, and Starlet Dashboard metrics
For more information on how to build a monitoring service for your StarRocks cluster, see Monitor and Alert.
query_cache_capacityβ
- Description: Capacity of query cache.
query_cache_hit_countβ
- Unit: Count
- Description: Number of query cache hits.
query_cache_hit_ratioβ
- Unit: -
- Description: Hit ratio of query cache.
query_cache_lookup_countβ
- Unit: Count
- Description: Total number of query cache lookups.
query_cache_usageβ
- Unit: Bytes
- Description: Current query cache usages.
query_cache_usage_ratioβ
- Unit: -
- Description: Current query cache usage ratio.
query_mem_bytesβ
- Unit: Bytes
- Description: Memory used by queries.
query_scan_bytesβ
- Unit: Bytes
- Description: Total number of scanned bytes.
query_scan_bytes_per_secondβ
- Unit: Bytes/s
- Description: Estimated rate of scanned bytes per second.
query_scan_rowsβ
- Unit: Count
- Description: Total number of scanned rows.
readable_blocks_total (Deprecated)β
resource_group_bigquery_countβ
- Unit: Count
- Description: Number of queries in each resource group that have triggered the limit for big queries. This is an instantaneous value.
resource_group_concurrency_overflow_countβ
- Unit: Count
- Description: Number of queries in each resource group that have triggered the concurrency limit. This is an instantaneous value.
resource_group_connector_scan_use_ratio (Deprecated)β
- Unit: -
- Description: Ratio of external table scan thread time slices used by each resource group to the total used by all resource groups. This is an average value over the time interval between two metric retrievals.
resource_group_cpu_limit_ratioβ
- Unit: -
- Description: Ratio of the CPU core limit for each resource group to the total CPU core limit for all resource groups. This is an instantaneous value.
resource_group_cpu_use_ratio (Deprecated)β
- Unit: -
- Description: Ratio of pipeline thread time slices used by each resource group to the total used by all resource groups. This is an average value over the time interval between two metric retrievals.
resource_group_inuse_cpu_coresβ
- Unit: Count
- Description: Estimated number of CPU cores currently in use by each resource group. This is an average value over the time interval between two metric retrievals.
resource_group_mem_inuse_bytesβ
- Unit: Bytes
- Description: Currently used memory by each resource group, measured in bytes. This is an instantaneous value.
resource_group_mem_limit_bytesβ
- Unit: Bytes
- Description: Memory limit for each resource group, measured in bytes. This is an instantaneous value.
resource_group_running_queriesβ
- Unit: Count
- Description: Number of queries currently running in each resource group. This is an instantaneous value.
resource_group_scan_use_ratio (Deprecated)β
- Unit: -
- Description: Ratio of internal table scan thread time slices used by each resource group to the total used by all resource groups. This is an average value over the time interval between two metric retrievals.
resource_group_total_queriesβ
- Unit: Count
- Description: Total number of queries executed in each resource group, including those currently running. This is an instantaneous value.
result_block_queue_countβ
- Unit: Count
- Description: Number of results in the result block queue.
result_buffer_block_countβ
- Unit: Count
- Description: Number of blocks in the result buffer.
routine_load_task_countβ
- Unit: Count
- Description: Number of currently running Routine Load tasks.
rowset_count_generated_and_in_useβ
- Unit: Count
- Description: Number of rowset IDs currently in use.
rowset_metadata_mem_bytesβ
- Unit: Bytes
- Description: Total number of bytes for rowset metadata.
running_base_compaction_task_numβ
- Unit: Count
- Description: Total number of running base compaction tasks.
running_cumulative_compaction_task_numβ
- Unit: Count
- Description: Total number of running cumulative compactions.
running_update_compaction_task_numβ
- Unit: Count
- Description: Total number of currently running Primary Key table compaction tasks.
schema_change_mem_bytesβ
- Unit: Bytes
- Description: Memory used for Schema Change.
segment_flush_queue_countβ
- Unit: Count
- Description: Number of queued tasks in the segment flush thread pool.
segment_metadata_mem_bytesβ
- Unit: Bytes
- Description: Memory used by segment metadata.
segment_readβ
- Unit: Count
- Description: Total number of segment reads.
segment_replicate_queue_countβ
- Unit: Count
- Description: Queued task count in the Segment Replicate thread pool.
segment_zonemap_mem_bytesβ
- Unit: Bytes
- Description: Memory used by segment zonemap.
short_key_index_mem_bytesβ
- Unit: Bytes
- Description: Memory used by the short key index.
small_file_cache_countβ
- Unit: Count
- Description: Number of small file caches.
snmpβ
- Unit: -
- Description: Metrics returned by
/proc/net/snmp.
starrocks_be_clone_task_copy_bytesβ
- Unit: Bytes
- Type: Cumulative
- Description: The total file size copied by Clone tasks in the BE node, including both INTER_NODE and INTRA_NODE types.
starrocks_be_clone_task_copy_duration_msβ
- Unit: ms
- Type: Cumulative
- Description: The total time for copy consumed by Clone tasks in the BE node, including both INTER_NODE and INTRA_NODE types.
starrocks_be_exec_state_report_active_threadsβ
- Unit: Count
- Type: Instantaneous
- Description: The number of tasks being executed in the thread pool that reports the execution status of the Fragment instance.
starrocks_be_exec_state_report_queue_countβ
- Unit: Count
- Type: Instantaneous
- Description: The number of tasks queued in the thread pool that reports the execution status of the Fragment instance, up to a maximum of 1000.
starrocks_be_exec_state_report_running_threadsβ
- Unit: Count
- Type: Instantaneous
- Description: The number of threads in the thread pool that reports the execution status of the Fragment instance, with a minimum of 1 and a maximum of 2.
starrocks_be_exec_state_report_threadpool_sizeβ
- Unit: Count
- Type: Instantaneous
- Description: The maximum number of threads in the thread pool that reports the execution status of the Fragment instance, defaults to 2.
starrocks_be_files_scan_num_bytes_readβ
- Unit: Bytes
- Description: Total bytes read from external storage. Labels:
file_format,scan_type.
starrocks_be_files_scan_num_files_readβ
- Unit: Count
- Description: Number of files read from external storage (CSV, Parquet, ORC, JSON, Avro). Labels:
file_format,scan_type.
starrocks_be_files_scan_num_raw_rows_readβ
- Unit: Count
- Description: Total raw rows read from external storage before format validation and predicate filtering. Labels:
file_format,scan_type.
starrocks_be_files_scan_num_rows_returnβ
- Unit: Count
- Description: Number of rows returned after predicate filtering. Labels:
file_format,scan_type.
starrocks_be_files_scan_num_valid_rows_readβ
- Unit: Count
- Description: Number of valid rows read (excluding rows with invalid format). Labels:
file_format,scan_type.
starrocks_be_mem_pool_mem_limit_bytesβ
- Unit: Bytes
- Type: Instantaneous
- Description: Memory limit for each memory pool, measured in bytes.
starrocks_be_mem_pool_mem_usage_bytesβ
- Unit: Bytes
- Type: Instantaneous
- Description: Currently used total memory by each memory pool, measured in bytes.
starrocks_be_mem_pool_mem_usage_ratioβ
- Unit: -
- Type: Instantaneous
- Description: Ratio of the memory usage of the memory pool to the memory limit of the memory pool.
starrocks_be_mem_pool_workgroup_countβ
- Unit: Count
- Type: Instantaneous
- Description: Number of resource groups assigned to each memory pool.
starrocks_be_pipe_prepare_pool_queue_lenβ
- Unit: Count
- Type: Instantaneous
- Description: Instantaneous value of pipeline prepare thread pool task queue length.
starrocks_be_priority_exec_state_report_active_threadsβ
- Unit: Count
- Type: Instantaneous
- Description: The number of tasks being executed in the thread pool that reports the final execution state of the Fragment instance.
starrocks_be_priority_exec_state_report_queue_countβ
- Unit: Count
- Type: Instantaneous
- Description: The number of tasks queued in the thread pool that reports the final execution status of the Fragment instance, up to a maximum of 2147483647.
starrocks_be_priority_exec_state_report_running_threadsβ
- Unit: Count
- Type: Instantaneous
- Description: The number of threads in the thread pool that reports the final execution status of the Fragment instance, with a minimum of 1 and a maximum of 2.
starrocks_be_priority_exec_state_report_threadpool_sizeβ
- Unit: Count
- Type: Instantaneous
- Description: The maximum number of threads in the thread pool that reports the final execution status of the Fragment instance, defaults to 2.
starrocks_be_resource_group_cpu_limit_ratioβ
- Unit: -
- Type: Instantaneous
- Description: Instantaneous value of resource group cpu quota ratio.
starrocks_be_resource_group_cpu_use_ratioβ
- Unit: -
- Type: Average
- Description: The ratio of CPU time used by the resource group to the CPU time of all resource groups.
starrocks_be_resource_group_mem_inuse_bytesβ
- Unit: Bytes
- Type: Instantaneous
- Description: Instantaneous value of resource group memory usage.
starrocks_be_resource_group_mem_limit_bytesβ
- Unit: Bytes
- Type: Instantaneous
- Description: Instantaneous value of resource group memory quota.
starrocks_be_segment_file_not_found_totalβ
- Unit: Count
- Description: Total number of times a segment file was not found (file missing) during segment open. A continuously increasing value may indicate data loss or storage inconsistency.
starrocks_fe_clone_task_copy_bytesβ
- Unit: Bytes
- Type: Cumulative
- Description: The total file size copied by Clone tasks in the cluster, including both INTER_NODE and INTRA_NODE types.
starrocks_fe_clone_task_copy_duration_msβ
- Unit: ms
- Type: Cumulative
- Description: The total time for copy consumed by Clone tasks in the cluster, including both INTER_NODE and INTRA_NODE types.
starrocks_fe_clone_task_successβ
- Unit: Count
- Type: Cumulative
- Description: The number of successfully executed Clone tasks in the cluster.
starrocks_fe_clone_task_totalβ
- Unit: Count
- Type: Cumulative
- Description: The total number of Clone tasks in the cluster.
starrocks_fe_last_finished_job_timestampβ
- Unit: ms
- Type: Instantaneous
- Description: Indicates the end time of the last query or loading under the specific warehouse. For a shared-nothing cluster, this item only monitors the default warehouse.
starrocks_fe_memory_usageβ
- Unit: Bytes or Count
- Type: Instantaneous
- Description: Indicates the memory statistics for various modules under the specific warehouse. For a shared-nothing cluster, this item only monitors the default warehouse.
starrocks_fe_meta_log_countβ
- Unit: Count
- Type: Instantaneous
- Description: The number of Edit Logs without a checkpoint. A value within
100000is considered reasonable..
starrocks_fe_publish_version_daemon_loop_totalβ
- Unit: Count
- Type: Cumulative
- Description: Total number of
publish-version-daemonloop runs on this FE node.
The following metrics are summary-type metrics that provide latency distributions for different phases of a transaction. These metrics are reported exclusively by the Leader FE node.
Each metric includes the following outputs:
- Quantiles: Latency values at different percentile boundaries. These are exposed via the
quantilelabel, which can have values of0.75,0.95,0.98,0.99, and0.999. <metric_name>_sum: The total cumulative time spent in this phase, for example,starrocks_fe_txn_total_latency_ms_sum.<metric_name>_count: The total number of transactions recorded for this phase, for example,starrocks_fe_txn_total_latency_ms_count.
All transaction metrics share the following labels:
type: Categorizes transactions by their load job source type (for example,all,stream_load,routine_load). This allows for monitoring both overall transaction performance and the performance of specific load types. The reported groups can be configured via the FE parametertxn_latency_metric_report_groups.is_leader: Indicates whether the reporting FE node is the Leader. Only the Leader FE (is_leader="true") reports actual metric values. Followers will haveis_leader="false"and report no data.
starrocks_fe_query_resource_groupβ
- Unit: Count
- Type: Cumulative
- Description: Indicates the total number of queries executed under the specific resource group.
starrocks_fe_query_resource_groupβ
- Unit: Count
- Type: Cumulative
- Description: The number of queries for each resource group.
starrocks_fe_query_resource_group_errβ
- Unit: Count
- Type: Cumulative
- Description: Indicates the number of failed queries under the specific resource group.
starrocks_fe_query_resource_group_errβ
- Unit: Count
- Type: Cumulative
- Description: The number of incorrect queries for each resource group.
starrocks_fe_query_resource_group_latencyβ
- Unit: ms
- Type: Cumulative
- Description: Indicates the latency statistics for queries under the specific resource group.
starrocks_fe_query_resource_group_latencyβ
- Unit: Seconds
- Type: Average
- Description: the query latency percentile for each resource group.
starrocks_fe_routine_load_error_rowsβ
- Unit: Count
- Description: The total number of error rows encountered during data loading by all Routine Load jobs.
starrocks_fe_routine_load_jobsβ
-
Unit: Count
-
Description: The total number of Routine Load jobs in different states. For example:
starrocks_fe_routine_load_jobs{state="NEED_SCHEDULE"} 0
starrocks_fe_routine_load_jobs{state="RUNNING"} 1
starrocks_fe_routine_load_jobs{state="PAUSED"} 0
starrocks_fe_routine_load_jobs{state="STOPPED"} 0
starrocks_fe_routine_load_jobs{state="CANCELLED"} 1
starrocks_fe_routine_load_jobs{state="UNSTABLE"} 0
starrocks_fe_routine_load_max_lag_of_partitionβ
- Unit: -
- Description: The maximum Kafka partition offset lag for each Routine Load job. It is collected only when the FE configuration
enable_routine_load_lag_metricsis set totrueand the offset lag is greater than or equal to the FE configurationmin_routine_load_lag_for_metrics. By default,enable_routine_load_lag_metricsisfalse, andmin_routine_load_lag_for_metricsis10000.
starrocks_fe_routine_load_max_lag_time_of_partitionβ
- Unit: Seconds
- Description: The maximum Kafka partition offset timestamp lag for each Routine Load job. It is collected only when the FE configuration
enable_routine_load_lag_time_metricsis set totrue. By default,enable_routine_load_lag_time_metricsisfalse.
starrocks_fe_routine_load_pausedβ
- Unit: Count
- Description: The total number of times Routine Load jobs are paused.
starrocks_fe_routine_load_receive_bytesβ
- Unit: Byte
- Description: The total amount of data loaded by all Routine Load jobs.
starrocks_fe_routine_load_rowsβ
- Unit: Count
- Description: The total number of rows loaded by all Routine Load jobs.
starrocks_fe_safe_modeβ
- Unit: -
- Type: Instantaneous
- Description: Indicates whether Safe Mode is enabled. Valid values:
0(disabled) and1(enabled). When Safe Mode is enabled, the cluster no longer accepts any loading requests.
starrocks_fe_scheduled_pending_tablet_numβ
- Unit: Count
- Type: Instantaneous
- Description: The number of Clone tasks in Pending state FE scheduled, including both BALANCE and REPAIR types.
starrocks_fe_scheduled_running_tablet_numβ
- Unit: Count
- Type: Instantaneous
- Description: The number of Clone tasks in Running state FE scheduled, including both BALANCE and REPAIR types.
starrocks_fe_slow_lock_held_time_msβ
- Unit: ms
- Type: Summary
- Description: Histogram tracking the lock held time (in milliseconds) when slow locks are detected. This metric is updated when lock wait time exceeds the
slow_lock_threshold_msconfiguration parameter. It tracks the maximum lock held time among all lock owners when a slow lock event is detected. Each metric includes quantile values (0.75, 0.95, 0.98, 0.99, 0.999),_sum, and_countoutputs. Note: This metric may not accurately reflect the exact lock held time under high contention, because the metric is updated once the wait time exceeds the threshold, but the held time may continue to increase until the owner completes its operation and releases the lock. However, this metric can still be updated even when deadlock occurs.
starrocks_fe_slow_lock_wait_time_msβ
- Unit: ms
- Type: Summary
- Description: Histogram tracking the lock wait time (in milliseconds) when slow locks are detected. This metric is updated when lock wait time exceeds the
slow_lock_threshold_msconfiguration parameter. It accurately tracks how long threads wait to acquire locks during lock contention scenarios. Each metric includes quantile values (0.75, 0.95, 0.98, 0.99, 0.999),_sum, and_countoutputs. This metric provides precise wait time measurements. Note: This metric cannot be updated when deadlock occurs, hence it cannot be used to detect deadlock situations.
starrocks_fe_sql_block_hit_countβ
- Unit: Count
- Description: The number of times blacklisted SQL has been intercepted.
starrocks_fe_tablet_max_compaction_scoreβ
- Unit: Count
- Type: Instantaneous
- Description: Indicates the highest Compaction Score on each BE node.
starrocks_fe_tablet_numβ
- Unit: Count
- Type: Instantaneous
- Description: Indicates the number of tablets on each BE node.
starrocks_fe_txn_publish_ack_latency_msβ
- Unit: ms
- Type: Summary
- Description: The final acknowledgment latency, from
ready-to-finishtime to the finalfinishtime when the transaction is marked asVISIBLE. This metric includes final acknowledgment steps after the transaction is ready to finish.
starrocks_fe_txn_publish_can_finish_latency_msβ
- Unit: ms
- Type: Summary
- Description: The latency from
publishtask completion to the momentcanTxnFinish()first returns true, measured frompublish version finishtime toready-to-finishtime.
starrocks_fe_txn_publish_execute_latency_msβ
- Unit: ms
- Type: Summary
- Description: The active execution time of the
publishtask, from when the task is picked up to when it finishes. This metric represents the actual time being spent to make the transaction's changes visible.
starrocks_fe_txn_publish_latency_msβ
- Unit: ms
- Type: Summary
- Description: The latency of the
publishphase, fromcommittime tofinishtime. This is the duration it takes for a committed transaction to become visible to queries. It is the sum of theschedule,execute,can_finish, andacksub-phases.
starrocks_fe_txn_publish_schedule_latency_msβ
- Unit: ms
- Type: Summary
- Description: The time a transaction spends waiting to be published after it has been committed, measured from
committime to when the publish task is picked up. This metric reflects scheduling delays or queueing time in thepublishpipeline.
starrocks_fe_txn_total_latency_msβ
- Unit: ms
- Type: Summary
- Description: The total latency for a transaction to complete, measured from the
preparetime to thefinishtime. This metric represents the full end-to-end duration of a transaction.
starrocks_fe_txn_write_latency_msβ
- Unit: ms
- Type: Summary
- Description: The latency of the
writephase of a transaction, frompreparetime tocommittime. This metric isolates the performance of the data writing and preparation stage before the transaction is ready to be published.
starrocks_fe_unfinished_backup_jobβ
- Unit: Count
- Type: Instantaneous
- Description: Indicates the number of running BACKUP tasks under the specific warehouse. For a shared-nothing cluster, this item only monitors the default warehouse. For a shared-data cluster, this value is always
0.
starrocks_fe_unfinished_queryβ
- Unit: Count
- Type: Instantaneous
- Description: Indicates the number of queries currently running under the specific warehouse. For a shared-nothing cluster, this item only monitors the default warehouse.
starrocks_fe_unfinished_restore_jobβ
- Unit: Count
- Type: Instantaneous
- Description: Indicates the number of running RESTORE tasks under the specific warehouse. For a shared-nothing cluster, this item only monitors the default warehouse. For a shared-data cluster, this value is always
0.
storage_page_cache_mem_bytesβ
- Unit: Bytes
- Description: Memory used by storage page cache.
stream_loadβ
- Unit: -
- Description: Total loaded rows and received bytes.
stream_load_pipe_countβ
- Unit: Count
- Description: Number of currently running Stream Load tasks.
streaming_load_bytesβ
- Unit: Bytes
- Description: Total bytes loaded by Stream Load.
streaming_load_current_processingβ
- Unit: Count
- Description: Number of currently running Stream Load tasks.
streaming_load_duration_msβ
- Unit: ms
- Description: Total time spent on Stream Load.
streaming_load_requests_totalβ
- Unit: Count
- Description: Total number of Stream Load requests.
SPLITβ
tablet_base_max_compaction_scoreβ
- Unit: -
- Description: Highest base compaction score of tablets in this BE.
tablet_cumulative_max_compaction_scoreβ
- Unit: -
- Description: Highest cumulative compaction score of tablets in this BE.
tablet_metadata_mem_bytesβ
- Unit: Bytes
- Description: Memory used by tablet metadata.
tablet_schema_mem_bytesβ
- Unit: Bytes
- Description: Memory used by tablet schema.
tablet_update_max_compaction_scoreβ
- Unit: -
- Description: Highest compaction score of tablets in Primary Key tables in the current BE.
thrift_connections_totalβ
- Unit: Count
- Description: Total number of thrift connections (including finished connections).
thrift_current_connections (Deprecated)β
thrift_opened_clientsβ
- Unit: Count
- Description: Number of currently opened thrift clients.
thrift_used_clientsβ
- Unit: Count
- Description: Number of thrift clients in use currently.
total_column_pool_bytes (Deprecated)β
transaction_streaming_load_bytesβ
- Unit: Bytes
- Description: Total loading bytes of transaction load.
transaction_streaming_load_current_processingβ
- Unit: Count
- Description: Number of currently running transactional Stream Load tasks.
transaction_streaming_load_duration_msβ
- Unit: ms
- Description: Total time spent on Stream Load transaction Interface.
transaction_streaming_load_requests_totalβ
- Unit: Count
- Description: Total number of transaction load requests.
txn_requestβ
- Unit: -
- Description: Transaction requests of BEGIN, COMMIT, ROLLBACK, and EXEC.
uint8_column_pool_bytesβ
- Unit: Bytes
- Description: Bytes used by the UINT8 column pool.
unused_rowsets_countβ
- Unit: Count
- Description: Total number of unused rowsets. Please note that these rowsets will be reclaimed later.
update_apply_queue_countβ
- Unit: Count
- Description: Queued task count in the Primary Key table transaction APPLY thread pool.
update_compaction_duration_usβ
- Unit: us
- Description: Total time spent on Primary Key table compactions.
update_compaction_outputs_bytes_totalβ
- Unit: Bytes
- Description: Total bytes written by Primary Key table compactions.
update_compaction_outputs_totalβ
- Unit: Count
- Description: Total number of Primary Key table compactions.
update_compaction_task_byte_per_secondβ
- Unit: Bytes/s
- Description: Estimated rate of Primary Key table compactions.
update_compaction_task_cost_time_nsβ
- Unit: ns
- Description: Total time spent on the Primary Key table compactions.
update_del_vector_bytes_totalβ
- Unit: Bytes
- Description: Total memory used for caching DELETE vectors in Primary Key tables.
update_del_vector_deletes_newβ
- Unit: Count
- Description: Total number of newly generated DELETE vectors used in Primary Key tables.
update_del_vector_deletes_total (Deprecated)β
update_del_vector_dels_num (Deprecated)β
update_del_vector_numβ
- Unit: Count
- Description: Number of the DELETE vector cache items in Primary Key tables.
update_mem_bytesβ
- Unit: Bytes
- Description: Memory used by Primary Key table APPLY tasks and Primary Key index.
update_primary_index_bytes_totalβ
- Unit: Bytes
- Description: Total memory cost of the Primary Key index.
update_primary_index_numβ
- Unit: Count
- Description: Number of Primary Key indexes cached in memory.
update_rowset_commit_apply_duration_usβ
- Unit: us
- Description: Total time spent on Primary Key table APPLY tasks.
update_rowset_commit_apply_totalβ
- Unit: Count
- Description: Total number of COMMIT and APPLY for Primary Key tables.
update_rowset_commit_request_failedβ
- Unit: Count
- Description: Total number of failed rowset COMMIT requests in Primary Key tables.
update_rowset_commit_request_totalβ
- Unit: Count
- Description: Total number of rowset COMMIT requests in Primary Key tables.
wait_base_compaction_task_numβ
- Unit: Count
- Description: Number of base compaction tasks waiting for execution.
wait_cumulative_compaction_task_numβ
- Unit: Count
- Description: Number of cumulative compaction tasks waiting for execution.