Streaming with Apache Kafka Metrics
Using metrics, you can monitor Kafka clusters and endpoints in OCI Streaming with Apache Kafka.
You can view default metric charts from the Service Metrics page that use predefined service queries for brokers in a Kafka cluster.
You can also use the OCI Monitoring service to create custom queries and alarms to notify you when these metrics meet alarm-specified triggers.
You must also monitor client metrics.
Available Metrics
A namespace is a container for metrics. The namespace for OCI Streaming with Apache Kafka is oci_kafka.
Streaming with Apache Kafka metrics include the following dimensions:
brokerId: The ID of the Kafka cluster broker.resourceId: The OCID of the Kafka cluster.resourceName: The name of the Kafka cluster.
| Metric | Metric Display Name | Unit | Description | Dimensions |
|---|---|---|---|---|
BrokerCPUUsage |
CPU Usage for Kafka Brokers | Percentage | Total CPU usage for each broker. |
|
BrokerAvailableDiskSpace |
Available Disk Space for Kafka Brokers | Percentage | Percentage of available disk space in each broker. |
|
BrokerMemoryUsed |
Memory Used by Kafka Broker | Percentage | Total heap + non-heap memory usage for each broker. |
|
BrokerActiveControllerCount |
Active Controller Count | Count | Number of active controllers for each broker. Should always be 1. |
|
BrokerUnderReplicatedPartitions |
Under Replicated Partitions | Count | Shows number of partitions that are under replicated in a broker. |
|
BrokerOfflinePartitionsCount |
Offline Partitions Count | Count | Number of partitions assigned to a broker that are currently offline. |
|
Recommendations
View the recommendations for the available metrics to ensure healthy operation of the Kafka clusters.
You must create alarms to monitor the values of these metrics.
| Metric | Alert Threshold Recommendation |
|---|---|
BrokerCPUUsage |
|
BrokerAvailableDiskSpace |
|
BrokerMemoryUsed |
|
BrokerActiveControllerCount |
|
BrokerUnderReplicatedPartitions |
|
BrokerOfflinePartitionsCount |
|