5 KPIs

This section provides information about the KPIs for Oracle Communications Unified Data Repository (OCUDR).

Note:

A sample OCUDR dashboard is provided for Grafana. To achieve KPIs, OCUDR requires metrics and functions, which are available at Metrics. You can download and import the file to your repository. http://docs.oracle.com/en/industries/communications/cloud-native-core/release21.html
The following table provides KPI names for UDR, SLF and EIR.

Table 5-1 KPI Applicability for UDR, EIR, and SLF

KPI Names UDR EIR SLF
Prov Success(2xx) Rate

Sub KPI: NA

Yes Yes Yes
Provisioning Request Rate(ingressgateway-prov)

Sub KPI: NA

Yes Yes Yes
Provisioning Response Breakdown

Sub KPI: Success Rate

Yes Yes Yes
Provisioning Response Breakdown

Sub KPI: Failure Rate

Yes Yes Yes
Provisioning Response Breakdown

Sub KPI: 408 response rate

Yes Yes Yes
Provisioning Response Breakdown

Sub KPI: 500 response rate

Yes Yes Yes
Provisioning Response Breakdown

Sub KPI: 503 response rate

Yes Yes Yes
Provisioning Response Breakdown

Sub KPI: 404 response rate

Yes Yes Yes
Provisioning Response Breakdown

Sub KPI: 429 response rate

Yes Yes Yes
Provisioning Response Breakdown

Sub KPI: 400 response rate

Yes Yes Yes
Signalling Success (2xx) Rate

Sub KPI: NA

Yes Yes Yes
Signaling Request Rate(ingressgateway-sig)

Sub KPI: NA

Yes Yes Yes
Signaling Response Breakdown

Sub KPI: Success Rate

Yes Yes Yes
Signaling Response Breakdown

Sub KPI: Failure Rate

Yes Yes Yes
Signaling Response Breakdown

Sub KPI: 408 response rate

Yes Yes Yes
Signaling Response Breakdown

Sub KPI: 500 response rate

Yes Yes Yes
Signaling Response Breakdown

Sub KPI: 503 response rate

Yes Yes Yes
Signaling Response Breakdown

Sub KPI: 404 response rate

Yes Yes Yes
Signaling Response Breakdown

Sub KPI: 429 response rate

Yes Yes Yes
Signaling Response Breakdown

Sub KPI: 400 response rate

Yes Yes Yes
UDR Incoming Traffic

Sub KPI: Sig Method Wise Request Rate

Yes Yes Yes
UDR Incoming Traffic

Sub KPI: Sig Method Wise Request Rate

Yes Yes Yes
UDR Incoming Traffic

Sub KPI: Prov Method Wise Request Rate

Yes Yes Yes
UDR Incoming Traffic

Sub KPI: Prov Method Wise Request Rate

Yes Yes Yes
IGW and DB Failure Rates

Sub KPI: Sig DB Failures

Yes Yes Yes
IGW and DB Failure Rates

Sub KPI: Sig IGW Failures

Yes Yes Yes
IGW and DB Failure Rates

Sub KPI: Prov DB Failures

Yes Yes Yes
IGW and DB Failure Rates

Sub KPI: Prov IGW Failures

Yes Yes Yes
DB Operations Rate

Sub KPI: Total Operations Rate

Yes Yes Yes
DB Operations Rate

Sub KPI: Success Rate

Yes Yes Yes
DB Operations Rate

Sub KPI: Failure Rate

Yes Yes Yes
IGW Latencies(Percentile)

Sub KPI: Backend latency Sig

Yes Yes Yes
IGW Latencies(Percentile)

Sub KPI: GW Request latency Sig

Yes Yes Yes
IGW Latencies(Percentile)

Sub KPI: GW Response latency Sig

Yes Yes Yes
IGW Latencies(Percentile)

Sub KPI: GW total latency Sig

Yes Yes Yes
IGW Latencies(Percentile)

Sub KPI: Backend latency Prov

Yes Yes Yes
IGW Latencies(Percentile)

Sub KPI: GW Request latency Prov

Yes Yes Yes
IGW Latencies(Percentile)

Sub KPI: GW Response latency Prov

Yes Yes Yes
IGW Latencies(Percentile)

Sub KPI: GW total latency Prov

Yes Yes Yes
DB and DR-Service Latency [Percentile]

Sub KPI: udr_sig_db_latency

Yes Yes Yes
DB and DR-Service Latency [Percentile]

Sub KPI: udr_sig_request_latency

Yes Yes Yes
DB and DR-Service Latency [Percentile]

Sub KPI: udr_prov_db_latency

Yes Yes Yes
DB and DR-Service Latency [Percentile]

Sub KPI: udr_prov_request_latency

Yes Yes Yes
IGW Latencies [Average]

Sub KPI: Backend latency Sig

Yes Yes Yes
IGW Latencies [Average]

Sub KPI: GW Request latency Sig

Yes Yes Yes
IGW Latencies [Average]

Sub KPI: GW Response latency Sig

Yes Yes Yes
IGW Latencies [Average]

Sub KPI: GW total latency Sig

Yes Yes Yes
IGW Latencies [Average]

Sub KPI: Backend latency Prov

Yes Yes Yes
IGW Latencies [Average]

Sub KPI: GW Request latency Prov

Yes Yes Yes
IGW Latencies [Average]

Sub KPI: GW Response latency Prov

Yes Yes Yes
IGW Latencies [Average]

Sub KPI: GW total latency Prov

Yes Yes Yes
Error Logs Indicator

Sub KPI: Microservice wise error logs indicator

Yes Yes Yes
CPU Usage Across Namespace (per pod)

Sub KPI: POD Wise CPU Utilization

Yes Yes Yes
Memory Usage Across Namespace (per pod)

Sub KPI: POD Wise Memory Utilization

Yes Yes Yes
Overload Level

Sub KPI: Overload Level

Yes Yes Yes
Overload level resource wise

Sub KPI: Overload level resource wise

Yes Yes Yes
Overload Stress Resource Wise

Sub KPI: Overload stress resource wise

Yes Yes Yes
IGW Pod Congested State

Sub KPI: IGW Pod Congested State

Yes Yes Yes
IGW Congestion State Resource Wise

Sub KPI: IGW Congestion state resource wise

Yes Yes Yes
POD Wise Congested Resource Stress

Sub KPI: POD wise congested resource stress

Yes Yes Yes
IGW Total Connections Rejected

Sub KPI: IGW Total Connections Rejected

Yes Yes Yes
NRF Client Operative State

Sub KPI: NRF Client NF Status

Yes Yes Yes
NRF Client NF Status

Sub KPI: NRF Client NF Status

Yes Yes Yes
kmps per group(cgroup)

Sub KPI: Ingressgateway-sig

Yes Yes Yes
kmps per group(cgroup)

Sub KPI: Egressgateway

Yes Yes Yes
kmps per group(cgroup)

Sub KPI: DR Service

Yes Yes Yes
kmps per group(cgroup)

Sub KPI: Ingressgateway-prov

Yes Yes Yes
kmps per group(cgroup)

Sub KPI: DR-Prov Service

Yes Yes Yes
Diameter Gateway

Sub KPI: Diameter GW Success Rate

Yes Yes No
Diameter Gateway

Sub KPI: Diameter GW Failure Rate

Yes Yes No
Diameter Gateway Traffic Rate

Sub KPI: Total Request Rate

Yes Yes No
Diameter Gateway Traffic Rate

Sub KPI: Success Rate

Yes Yes No
Diameter Gateway Traffic Rate

Sub KPI: Failure Rate

Yes Yes No
Diameter Gateway Traffic Rate

Sub KPI: Message Type Wise TPS

Yes Yes No
Diameter Gateway Traffic Rate

Sub KPI: Message Type Wise Success Rate

Yes Yes No
Diameter Gateway Traffic Rate

Sub KPI: Message Type Wise Failure Rate

Yes Yes No
Diameter Backend

Sub KPI: Diameter Backend Success Rate

Yes Yes No
Diameter Backend

Sub KPI: Diameter Backend Failure Rate

Yes Yes No
Diameter Backend Traffic Rate

Sub KPI: Total Request Rate

Yes Yes No
Diameter Backend Traffic Rate

Sub KPI: Success Rate

Yes Yes No
Diameter Backend Traffic Rate

Sub KPI: Failure Rate

Yes Yes No
Diameter Backend Traffic Rate

Sub KPI: Message Type Wise Total TPS

Yes Yes No
Diameter Backend Traffic Rate

Sub KPI: Message Type Wise Success Rate

Yes Yes No
Diameter Backend Traffic Rate

Sub KPI: Message Type Wise Failure Rate

Yes Yes No
DB and DR-Service Latency [Percentile]

Sub KPI: diameter_db_latency

Yes Yes No
DB and DR-Service Latency [Percentile]

Sub KPI: diameter_req_latency

Yes Yes No
DB and DR-Service Latency [Percentile]

Sub KPI: diameter_backend_latency

Yes Yes No
DGW Congestion State

Sub KPI: DGW Congestion State

Yes Yes No
DGW Congestion State Resource Wise

Sub KPI: DGW congestion state resource wise

Yes Yes No
DGW Congestion Resource Stress

Sub KPI: DGW congestion resource stress

Yes Yes No
DGW Total Messages Rejected

Sub KPI: DGW Total Messages Rejected

Yes Yes No
Notifications Rate (NOTIFY SERVICE)

Sub KPI: Notifications sent

Yes No No
Notifications Rate (NOTIFY SERVICE)

Sub KPI: Total ack received

Yes No No
Notifications Rate (NOTIFY SERVICE)

Sub KPI: 2xx ack received

Yes No No
Notifications Rate (NOTIFY SERVICE)

Sub KPI: 4xx ack received

Yes No No
Notifications Rate (NOTIFY SERVICE)

Sub KPI: 5xx ack received

Yes No No
Notification Rate (DR SERVICE/DIAM PROXY)

Sub KPI: Notifications Sent DR

Yes No No
Notification Rate (DR SERVICE/DIAM PROXY)

Sub KPI: UPDATE Notifications Failure Rate DR

Yes No No
Notification Rate (DR SERVICE/DIAM PROXY)

Sub KPI: UPDATE Notifications Success Rate

Yes No No
Notification Rate (DR SERVICE/DIAM PROXY)

Sub KPI: DELETE Notifications Success Rate DR

Yes No No
Notification Rate (DR SERVICE/DIAM PROXY)

Sub KPI: DELETE Notifications Failure Rate DR

Yes No No
Retry and New Notifications

Sub KPI: Retry Notification

Yes No No
Retry and New Notifications

Sub KPI: New Notifications

Yes No No
Congestion Level

Sub KPI: Congestion Level

No No Yes
Allowed/Rejected Requests

Sub KPI: Allowed requests

No No Yes
Allowed/Rejected Requests

Sub KPI: Rejected requests

No No Yes
Allow/Reject Requests per Pod

Sub KPI: Allow/Reject requests per pod

No No Yes
Overall CPU Usage

Sub KPI: Overall CPU Usage

No No Yes

5.1 UDR, SLF, and EIR KPIs

Following table provides the KPI details of UDR, SLF, and EIR.

Table 5-2 Prov Success(2xx) Rate

Field Details
Description Measures the success rate percentage for the provisioning traffic.
Expression sum(irate(oc_ingressgateway_http_responses_total{namespace="$namespace",Status=~"2.*",container="ingressgateway-prov",app_kubernetes_io_instance="$Deployment"}[5m]))/sum(irate(oc_ingressgateway_http_requests_total{namespace="$namespace",container="ingressgateway-prov",app_kubernetes_io_instance="$Deployment"}[5m])) *100

Table 5-3 Provisioning Request Rate(ingressgateway-prov)

Field Details
Description Measures the TPS of the provisioning traffic for each method wise and pod wise.
Expression sum(irate(oc_ingressgateway_http_requests_total{namespace="$namespace",container="ingressgateway-prov",app_kubernetes_io_instance="$Deployment"}[5m])) sum(irate(oc_ingressgateway_http_requests_total{namespace="$namespace",container="ingressgateway-prov",app_kubernetes_io_instance="$Deployment"}[5m])) by (Method) sum(irate(oc_ingressgateway_http_requests_total{namespace="$namespace",container="ingressgateway-prov",app_kubernetes_io_instance="$Deployment"}[5m])) by (pod)

Table 5-4 Provisioning Response Breakdown

Field Details
Sub KPI Success Rate
Description Measures the success percentage of provisioning requests that are on the ingressgateway-prov.
Expression

sum(irate(oc_ingressgateway_http_responses_total{namespace="$namespace",Status=~"2.*",container="ingressgateway-prov",app_kubernetes_io_instance="$Deployment"}[5m]))/sum(irate(oc_ingressgateway_http_requests_total{namespace="$namespace",container="ingressgateway-prov",app_kubernetes_io_instance="$Deployment"}[5m])) *100

Table 5-5 Provisioning Response Breakdown

Field Details
Sub KPI Failure Rate
Description Measures the failure rate of total requests that are on the ingressgateway-prov.
Expression

(sum(irate(oc_ingressgateway_http_requests_total{namespace="$namespace",container="ingressgateway-prov",app_kubernetes_io_instance="$Deployment"}[5m]))-sum(irate(oc_ingressgateway_http_responses_total{namespace="$namespace",Status=~"2.*",container="ingressgateway-prov",app_kubernetes_io_instance="$Deployment"}[5m])))/sum(irate(oc_ingressgateway_http_requests_total{namespace="$namespace",container="ingressgateway-prov",app_kubernetes_io_instance="$Deployment"}[5m])) *100

Table 5-6 Provisioning Response Breakdown

Field Details
Sub KPI 408 response rate
Description Measures the 408 response rate of the total requests that are on the ingressgateway-prov.
Expression

sum(irate(oc_ingressgateway_http_responses_total{namespace="$namespace",Status="408 REQUEST_TIMEOUT",container="ingressgateway-prov",app_kubernetes_io_instance="$Deployment"}[5m]))/sum(irate(oc_ingressgateway_http_requests_total{namespace="$namespace",container="ingressgateway-prov",app_kubernetes_io_instance="$Deployment"}[5m])) *100=

Table 5-7 Provisioning Response Breakdown

Field Details
Sub KPI 500 response rate
Description Measures the 500 response rate of total requests that are on the ingressgateway-prov.
Expression

sum(irate(oc_ingressgateway_http_responses_total{namespace="$namespace",Status="500 INTERNAL_SERVER_ERROR",container="ingressgateway-prov",app_kubernetes_io_instance="$Deployment"}[5m]))/sum(irate(oc_ingressgateway_http_requests_total{namespace="$namespace",container="ingressgateway-prov",app_kubernetes_io_instance="$Deployment"}[5m])) *100

Table 5-8 Provisioning Response Breakdown

Field Details
Sub KPI 503 response rate
Description Measures the 503 response rate of the total requests that are on the ingressgateway-prov.
Expression

sum(irate(oc_ingressgateway_http_responses_total{namespace="$namespace",Status="503 SERVICE_UNAVAILABLE",container="ingressgateway-prov",app_kubernetes_io_instance="$Deployment"}[5m]))/sum(irate(oc_ingressgateway_http_requests_total{namespace="$namespace",container="ingressgateway-prov",app_kubernetes_io_instance="$Deployment"}[5m])) *100

Table 5-9 Provisioning Response Breakdown

Field Details
Sub KPI 404 response rate
Description Measures the 404 response rate of the total requests that are on the ingressgateway-prov.
Expression

sum(irate(oc_ingressgateway_http_responses_total{namespace="$namespace",Status="404 NOT_FOUND",container="ingressgateway-prov",app_kubernetes_io_instance="$Deployment"}[5m]))/sum(irate(oc_ingressgateway_http_requests_total{namespace="$namespace",container="ingressgateway-prov",app_kubernetes_io_instance="$Deployment"}[5m])) *100

Table 5-10 Provisioning Response Breakdown

Field Details
Sub KPI 429 response rate
Description Measures the 429 response rate of the total requests that are on the ingressgateway-prov.
Expression

sum(irate(oc_ingressgateway_http_responses_total{namespace="$namespace",Status="429 TOO_MANY_REQUESTS",container="ingressgateway-prov",app_kubernetes_io_instance="$Deployment"}[5m]))/sum(irate(oc_ingressgateway_http_requests_total{namespace="$namespace",container="ingressgateway-prov",app_kubernetes_io_instance="$Deployment"}[5m])) *100

Table 5-11 Provisioning Response Breakdown

Field Details
Sub KPI 400 response rate
Description Measures the 400 response rate of the total requests that are on the ingressgateway-prov.
Expression

sum(irate(oc_ingressgateway_http_responses_total{namespace="$namespace",Status="400 BAD_REQUEST",container="ingressgateway-prov",app_kubernetes_io_instance="$Deployment"}[5m]))/sum(irate(oc_ingressgateway_http_requests_total{namespace="$namespace",container="ingressgateway-prov",app_kubernetes_io_instance="$Deployment"}[5m])) *100

Table 5-12 Signalling Success (2xx) Rate

Field Details
Description Measures the success rate percentage for signaling traffic.
Expression sum(irate(oc_ingressgateway_http_responses_total{namespace="$namespace",Status=~"2.*",container="ingressgateway-sig",app_kubernetes_io_instance="$Deployment"}[5m]))/sum(irate(oc_ingressgateway_http_requests_total{namespace="$namespace",container="ingressgateway-sig",app_kubernetes_io_instance="$Deployment"}[5m])) *100

Table 5-13 Signaling Request Rate(ingressgateway-sig)

Field Details
Description Measures the TPS of signaling traffic for each method wise and pod wise.
Expression sum(irate(oc_ingressgateway_http_requests_total{namespace="$namespace",container="ingressgateway-sig",app_kubernetes_io_instance="$Deployment"}[5m])) sum(irate(oc_ingressgateway_http_requests_total{namespace="$namespace",container="ingressgateway-sig",app_kubernetes_io_instance="$Deployment"}[5m])) by (Method) sum(irate(oc_ingressgateway_http_requests_total{namespace="$namespace",container="ingressgateway-sig",app_kubernetes_io_instance="$Deployment"}[5m])) by (pod)

Table 5-14 Signaling Response Breakdown

Field Details
Sub KPI Success Rate
Description Measures the success percentage of signaling requests that are on the ingressgateway-sig.
Expression sum(irate(oc_ingressgateway_http_responses_total{namespace="$namespace",Status=~"2.*",container="ingressgateway-sig",app_kubernetes_io_instance="$Deployment"}[5m]))/sum(irate(oc_ingressgateway_http_requests_total{namespace="$namespace",container="ingressgateway-sig",app_kubernetes_io_instance="$Deployment"}[5m])) *100

Table 5-15 Signaling Response Breakdown

Field Details
Sub KPI Failure Rate
Description Measures the failure percentage of the total requests that are on the ingressgateway-sig.
Expression (sum(irate(oc_ingressgateway_http_requests_total{namespace="$namespace",container="ingressgateway-sig",app_kubernetes_io_instance="$Deployment"}[5m]))-sum(irate(oc_ingressgateway_http_responses_total{namespace="$namespace",Status=~"2.*",container="ingressgateway-sig",app_kubernetes_io_instance="$Deployment"}[5m])))/sum(irate(oc_ingressgateway_http_requests_total{namespace="$namespace",container="ingressgateway-sig",app_kubernetes_io_instance="$Deployment"}[5m])) *100

Table 5-16 Signaling Response Breakdown

Field Details
Sub KPI 408 response rate
Description Measures the failure percentage of the total requests that are on the ingressgateway-sig.
Expression sum(irate(oc_ingressgateway_http_responses_total{namespace="$namespace",Status="408 REQUEST_TIMEOUT",container="ingressgateway-sig",app_kubernetes_io_instance="$Deployment"}[5m]))/sum(irate(oc_ingressgateway_http_requests_total{namespace="$namespace",container="ingressgateway-sig",app_kubernetes_io_instance="$Deployment"}[5m])) *100

Table 5-17 Signaling Response Breakdown

Field Details
Sub KPI 500 response rate
Description Measures the 500 response rate of the total requests that are on the ingressgateway-sig.
Expression sum(irate(oc_ingressgateway_http_responses_total{namespace="$namespace",Status="500 INTERNAL_SERVER_ERROR",container="ingressgateway-sig",app_kubernetes_io_instance="$Deployment"}[5m]))/sum(irate(oc_ingressgateway_http_requests_total{namespace="$namespace",container="ingressgateway-sig",app_kubernetes_io_instance="$Deployment"}[5m])) *100

Table 5-18 Signaling Response Breakdown

Field Details
Sub KPI 503 response rate
Description Measures the 503 response rate of the total requests that are on the ingressgateway-sig.
Expression sum(irate(oc_ingressgateway_http_responses_total{namespace="$namespace",Status="503 SERVICE_UNAVAILABLE",container="ingressgateway-sig",app_kubernetes_io_instance="$Deployment"}[5m]))/sum(irate(oc_ingressgateway_http_requests_total{namespace="$namespace",container="ingressgateway-sig",app_kubernetes_io_instance="$Deployment"}[5m])) *100

Table 5-19 Signaling Response Breakdown

Field Details
Sub KPI 404 response rate
Description Measures the 404 response rate of the total requests that are on the ingressgateway-sig.
Expression sum(irate(oc_ingressgateway_http_responses_total{namespace="$namespace",Status="404 NOT_FOUND",container="ingressgateway-sig",app_kubernetes_io_instance="$Deployment"}[5m]))/sum(irate(oc_ingressgateway_http_requests_total{namespace="$namespace",container="ingressgateway-sig",app_kubernetes_io_instance="$Deployment"}[5m])) *100

Table 5-20 Signaling Response Breakdown

Field Details
Sub KPI 429 response rate
Description Measures the 429 response rate of the total requests that are on the ingressgateway-sig.
Expression

sum(irate(oc_ingressgateway_http_responses_total{namespace="$namespace",Status="429 TOO_MANY_REQUESTS",container="ingressgateway-sig",app_kubernetes_io_instance="$Deployment"}[5m]))/sum(irate(oc_ingressgateway_http_requests_total{namespace="$namespace",container="ingressgateway-sig",app_kubernetes_io_instance="$Deployment"}[5m])) *100

Table 5-21 Signaling Response Breakdown

Field Details
Sub KPI 400 response rate
Description Measures the 400 response rate of the total requests that are on the ingressgateway-sig.
Expression

sum(irate(oc_ingressgateway_http_responses_total{namespace="$namespace",Status="400 BAD_REQUEST",container="ingressgateway-sig",app_kubernetes_io_instance="$Deployment"}[5m]))/sum(irate(oc_ingressgateway_http_requests_total{namespace="$namespace",container="ingressgateway-sig",app_kubernetes_io_instance="$Deployment"}[5m])) *100

Table 5-22 UDR Incoming Traffic

Field Details
Sub KPI Sig Method Wise Request Rate
Description Measures the request TPS that the backend pod (nudr-drservice) is currently handling method wise.
Expression sum(irate(udr_nftype_specific_requests_total{namespace="$namespace",app_kubernetes_io_instance="$Deployment",container="nudr-drservice"}[5m])) by (Method)

Table 5-23 UDR Incoming Traffic

Field Details
Sub KPI Sig Method Wise Request Rate
Description Measures the response TPS that the backend pod (nudr-drservice) is currently returning method wise.
Expression sum(irate(udr_nftype_specific_requests_status_total{namespace="$namespace",StatusCode=~"2.*",app_kubernetes_io_instance="$Deployment",container="nudr-drservice"}[5m])) by (Method)

Table 5-24 UDR Incoming Traffic

Field Details
Sub KPI Prov Method Wise Request Rate
Description Measures the response TPS that the backend pod (nudr-drservice) is currently returning method wise.
Expression sum(irate(udr_nftype_specific_requests_total{namespace="$namespace",app_kubernetes_io_instance="$Deployment",container="nudr-dr-provservice"}[5m])) by (Method)

Table 5-25 UDR Incoming Traffic

Field Details
Sub KPI Prov Method Wise Request Rate
Description Measures the request TPS that the backend pod (nudr-drservice) is currently handling method wise.
Expression sum(irate(udr_nftype_specific_requests_status_total{namespace="$namespace",StatusCode=~"2.*",app_kubernetes_io_instance="$Deployment",container="nudr-dr-provservice"}[5m])) by (Method)

Table 5-26 IGW and DB Failure Rates

Field Details
Sub KPI Sig DB Failures
Description Measures the database failures on the nudr-drservice for the signaling traffic.
Expression (sum(irate(udr_db_operations_total{namespace="$namespace",app_kubernetes_io_instance="$Deployment",container="nudr-drservice"}[5m]))-sum(irate(udr_db_operations_success_total{namespace="$namespace",app_kubernetes_io_instance="$Deployment",container="nudr-drservice"}[5m]))) / sum(irate(udr_db_operations_total{namespace="$namespace",app_kubernetes_io_instance="$Deployment",container="nudr-drservice"}[5m])) *100

Table 5-27 IGW and DB Failure Rates

Field Details
Sub KPI Sig IGW Failures
Description Measures the ingress gateway failure rates for the signaling traffic.
Expression (sum(irate(oc_ingressgateway_http_requests_total{namespace="$namespace",app_kubernetes_io_instance="$Deployment",container="ingressgateway-sig"}[5m])) - sum(irate(oc_ingressgateway_http_responses_total{namespace="$namespace",Status=~"2.*",app_kubernetes_io_instance="$Deployment",container="ingressgateway-sig"}[5m]))) / sum(irate(oc_ingressgateway_http_requests_total{namespace="$namespace",app_kubernetes_io_instance="$Deployment",container="ingressgateway-sig"}[5m])) *100

Table 5-28 IGW and DB Failure Rates

Field Details
Sub KPI Prov DB Failures
Description Measures the database failures on the nudr-drservice for the provisioning traffic.
Expression (sum(irate(udr_db_operations_total{namespace="$namespace",app_kubernetes_io_instance="$Deployment",container="nudr-dr-provservice"}[5m]))-sum(irate(udr_db_operations_success_total{namespace="$namespace",app_kubernetes_io_instance="$Deployment",container="nudr-dr-provservice"}[5m]))) / sum(irate(udr_db_operations_total{namespace="$namespace",app_kubernetes_io_instance="$Deployment",container="nudr-dr-provservice"}[5m])) *100

Table 5-29 IGW and DB Failure Rates

Field Details
Sub KPI Prov IGW Failures
Description Measures the ingress gateway failure rates for the provisioning traffic.
Expression (sum(irate(oc_ingressgateway_http_requests_total{namespace="$namespace",app_kubernetes_io_instance="$Deployment",container="ingressgateway-prov"}[5m])) - sum(irate(oc_ingressgateway_http_responses_total{namespace="$namespace",Status=~"2.*",app_kubernetes_io_instance="$Deployment",container="ingressgateway-prov"}[5m]))) / sum(irate(oc_ingressgateway_http_requests_total{namespace="$namespace",app_kubernetes_io_instance="$Deployment",container="ingressgateway-prov"}[5m])) *100

Table 5-30 DB Operations Rate

Field Details
Sub KPI Total Operations Rate
Description Measures the total number of database operations occurred from the backend microservices.
Expression sum(irate(udr_db_operations_total{namespace="$namespace"}[5m]))

Table 5-31 DB Operations Rate

Field Details
Sub KPI Success Rate
Description Measures the total number of successful database operations occurred from the backend microservices.
Expression sum(irate(udr_db_operations_success_total{namespace="$namespace"}[5m]))

Table 5-32 DB Operations Rate

Field Details
Sub KPI Failure Rate
Description Measures the total number of failed database operations occurred from backend microservices.
Expression

sum(irate(udr_db_operations_total{namespace="$namespace"}[5m]))-sum(irate(udr_db_operations_success_total{namespace="$namespace"}[5m]))

Table 5-33 IGW Latencies(Percentile)

Field Details
Sub KPI Backend latency Sig
Description Measures the signaling traffic backend pod latencies.
Expression

histogram_quantile(${percentile} / 100, sum by(le) (rate(oc_ingressgateway_backend_invocation_latency_seconds_bucket{namespace="$namespace",app_kubernetes_io_instance="$Deployment",container="ingressgateway-sig"}[2m])))

Table 5-34 IGW Latencies(Percentile)

Field Details
Sub KPI GW Request latency Sig
Description Measures the gateway latency which are on the ingressgateway-sig.
Expression

histogram_quantile(${percentile} / 100, sum by(le) (rate(oc_ingressgateway_request_processing_latency_seconds_bucket{namespace="$namespace",app_kubernetes_io_instance="$Deployment",container="ingressgateway-sig"}[2m])))

Table 5-35 IGW Latencies(Percentile)

Field Details
Sub KPI GW Response latency Sig
Description Measures the gateway response latency for signaling traffic.
Expression

histogram_quantile(${percentile} / 100, sum by(le) (rate(oc_ingressgateway_response_processing_latency_seconds_bucket{namespace="$namespace",app_kubernetes_io_instance="$Deployment",container="ingressgateway-sig"}[2m])))

Table 5-36 IGW Latencies(Percentile)

Field Details
Sub KPI GW total latency Sig
Description Measures the total latency (including request, response, and processing) for each of the request that are on the ingressgateway-sig.
Expression

(histogram_quantile(${percentile} / 100, sum by(le) (rate(oc_ingressgateway_backend_invocation_latency_seconds_bucket{namespace="$namespace",app_kubernetes_io_instance="$Deployment",container="ingressgateway-sig"}[2m]))) + histogram_quantile(${percentile} / 100, sum by(le) (rate(oc_ingressgateway_request_processing_latency_seconds_bucket{namespace="$namespace",app_kubernetes_io_instance="$Deployment",container="ingressgateway-sig"}[2m]))) + histogram_quantile(${percentile} / 100, sum by(le) (rate(oc_ingressgateway_response_processing_latency_seconds_bucket{namespace="$namespace",app_kubernetes_io_instance="$Deployment",container="ingressgateway-sig"}[2m]))))

Table 5-37 IGW Latencies(Percentile)

Field Details
Sub KPI Backend latency Prov
Description Measures the provisioning traffic backend pod latencies.
Expression

histogram_quantile(${percentile} / 100, sum by(le) (rate(oc_ingressgateway_backend_invocation_latency_seconds_bucket{namespace="$namespace",app_kubernetes_io_instance="$Deployment",container="ingressgateway-prov"}[2m])))

Table 5-38 IGW Latencies(Percentile)

Field Details
Sub KPI GW Request latency Prov
Description Measures the gateway latency that are on the ingressgateway-prov.
Expression

histogram_quantile(${percentile} / 100, sum by(le) (rate(oc_ingressgateway_request_processing_latency_seconds_bucket{namespace="$namespace",app_kubernetes_io_instance="$Deployment",container="ingressgateway-prov"}[2m])))

Table 5-39 IGW Latencies(Percentile)

Field Details
Sub KPI GW Response latency Prov
Description Measures the gateway response latency for the provisioning traffic.
Expression

histogram_quantile(${percentile} / 100, sum by(le) (rate(oc_ingressgateway_response_processing_latency_seconds_bucket{namespace="$namespace",app_kubernetes_io_instance="$Deployment",container="ingressgateway-prov"}[2m])))

Table 5-40 IGW Latencies(Percentile)

Field Details
Sub KPI GW total latency Prov
Description Measures the total latency (including request, response, and processing) for each of the request that are on the ingressgateway-prov.
Expression

(histogram_quantile(${percentile} / 100, sum by(le) (rate(oc_ingressgateway_backend_invocation_latency_seconds_bucket{namespace="$namespace",app_kubernetes_io_instance="$Deployment",container="ingressgateway-prov"}[2m]))) + histogram_quantile(${percentile} / 100, sum by(le) (rate(oc_ingressgateway_request_processing_latency_seconds_bucket{namespace="$namespace",app_kubernetes_io_instance="$Deployment",container="ingressgateway-prov"}[2m]))) + histogram_quantile(${percentile} / 100, sum by(le) (rate(oc_ingressgateway_response_processing_latency_seconds_bucket{namespace="$namespace",app_kubernetes_io_instance="$Deployment",container="ingressgateway-prov"}[2m]))))

Table 5-41 DB and DR-Service Latency [Percentile]

Field Details
Sub KPI udr_sig_db_latency
Description Measures the signaling traffic database latency.
Expression

histogram_quantile(${percentile} / 100, sum by(le) (rate(udr_db_processing_time_seconds_bucket{namespace="$namespace",app_kubernetes_io_instance="$Deployment",container="nudr-drservice"}[5m])))

Table 5-42 DB and DR-Service Latency [Percentile]

Field Details
Sub KPI udr_sig_request_latency
Description Measures the signaling traffic request latency.
Expression

histogram_quantile(${percentile} / 100, sum by(le) (rate(udr_request_processing_time_seconds_bucket{namespace="$namespace",app_kubernetes_io_instance="$Deployment",container="nudr-drservice"}[5m])))

Table 5-43 DB and DR-Service Latency [Percentile]

Field Details
Sub KPI udr_prov_db_latency
Description Measures the provisioning traffic database latency.
Expression

histogram_quantile(${percentile} / 100, sum by(le) (rate(udr_db_processing_time_seconds_bucket{namespace="$namespace",app_kubernetes_io_instance="$Deployment",container="nudr-dr-provservice"}[5m])))

Table 5-44 DB and DR-Service Latency [Percentile]

Field Details
Sub KPI udr_prov_request_latency
Description Measures the provisioning traffic request latency.
Expression

histogram_quantile(${percentile} / 100, sum by(le) (rate(udr_request_processing_time_seconds_bucket{namespace="$namespace",app_kubernetes_io_instance="$Deployment",container="nudr-dr-provservice"}[5m])))

Table 5-45 IGW Latencies [Average]

Field Details
Sub KPI Backend latency Sig
Description Measures the average latency for the backend services for signaling traffic.
Expression

sum(irate(oc_ingressgateway_backend_invocation_latency_seconds_sum{namespace="$namespace",app_kubernetes_io_instance="$Deployment",container="ingressgateway-sig"}[2m])) /sum(irate(oc_ingressgateway_backend_invocation_latency_seconds_count{namespace="$namespace",app_kubernetes_io_instance="$Deployment",container="ingressgateway-sig"}[2m])))

Table 5-46 IGW Latencies [Average]

Field Details
Sub KPI GW Request latency Sig
Description Measures the average request latency for signaling traffic.
Expression

(sum(irate(oc_ingressgateway_request_processing_latency_seconds_sum{namespace="$namespace",app_kubernetes_io_instance="$Deployment",container="ingressgateway-sig"}[2m])) /sum(irate(oc_ingressgateway_request_processing_latency_seconds_count{namespace="$namespace",app_kubernetes_io_instance="$Deployment",container="ingressgateway-sig"}[2m])) )

Table 5-47 IGW Latencies [Average]

Field Details
Sub KPI GW Response latency Sig
Description Measures the average response latency for signaling traffic.
Expression

(sum(irate(oc_ingressgateway_response_processing_latency_seconds_sum{namespace="$namespace",app_kubernetes_io_instance="$Deployment",container="ingressgateway-sig"}[2m])) /sum(irate(oc_ingressgateway_response_processing_latency_seconds_count{namespace="$namespace",app_kubernetes_io_instance="$Deployment",container="ingressgateway-sig"}[2m])) )

Table 5-48 IGW Latencies [Average]

Field Details
Sub KPI GW total latency Sig
Description Measures the average total latency that includes request, response, and processing for signaling traffic.
Expression

(sum(irate(oc_ingressgateway_backend_invocation_latency_seconds_sum{namespace="$namespace",app_kubernetes_io_instance="$Deployment",container="ingressgateway-sig"}[2m])) /sum(irate(oc_ingressgateway_backend_invocation_latency_seconds_count{namespace="$namespace",app_kubernetes_io_instance="$Deployment",container="ingressgateway-sig"}[2m])) )+(sum(irate(oc_ingressgateway_request_processing_latency_seconds_sum{namespace="$namespace",app_kubernetes_io_instance="$Deployment",container="ingressgateway-sig"}[2m])) /sum(irate(oc_ingressgateway_request_processing_latency_seconds_count{namespace="$namespace",app_kubernetes_io_instance="$Deployment",container="ingressgateway-sig"}[2m])) )+(sum(irate(oc_ingressgateway_response_processing_latency_seconds_sum{namespace="$namespace",app_kubernetes_io_instance="$Deployment",container="ingressgateway-sig"}[2m])) /sum(irate(oc_ingressgateway_response_processing_latency_seconds_count{namespace="$namespace",app_kubernetes_io_instance="$Deployment",container="ingressgateway-sig"}[2m])) )

Table 5-49 IGW Latencies [Average]

Field Details
Sub KPI Backend latency Prov
Description Measures the average latency for backend services for provisioning traffic.
Expression

(sum(irate(oc_ingressgateway_backend_invocation_latency_seconds_sum{namespace="$namespace",app_kubernetes_io_instance="$Deployment",container="ingressgateway-prov"}[2m])) /sum(irate(oc_ingressgateway_backend_invocation_latency_seconds_count{namespace="$namespace",app_kubernetes_io_instance="$Deployment",container="ingressgateway-prov"}[2m])))

Table 5-50 IGW Latencies [Average]

Field Details
Sub KPI GW Request latency Prov
Description Measures the average request latency for provisioning traffic.
Expression

(sum(irate(oc_ingressgateway_request_processing_latency_seconds_sum{namespace="$namespace",app_kubernetes_io_instance="$Deployment",container="ingressgateway-prov"}[2m])) /sum(irate(oc_ingressgateway_request_processing_latency_seconds_count{namespace="$namespace",app_kubernetes_io_instance="$Deployment",container="ingressgateway-prov"}[2m])))

Table 5-51 IGW Latencies [Average]

Field Details
Sub KPI GW Response latency Prov
Description Measures the average response latency for provisioning traffic.
Expression

(sum(irate(oc_ingressgateway_response_processing_latency_seconds_sum{namespace="$namespace",app_kubernetes_io_instance="$Deployment",container="ingressgateway-prov"}[2m])) /sum(irate(oc_ingressgateway_response_processing_latency_seconds_count{namespace="$namespace",app_kubernetes_io_instance="$Deployment",container="ingressgateway-prov"}[2m])) )

Table 5-52 IGW Latencies [Average]

Field Details
Sub KPI GW total latency Prov
Description Measures the average total latency that includes request, response, and processing for provisioning traffic.
Expression

(sum(irate(oc_ingressgateway_backend_invocation_latency_seconds_sum{namespace="$namespace",app_kubernetes_io_instance="$Deployment",container="ingressgateway-prov"}[2m])) /sum(irate(oc_ingressgateway_backend_invocation_latency_seconds_count{namespace="$namespace",app_kubernetes_io_instance="$Deployment",container="ingressgateway-prov"}[2m])) )+(sum(irate(oc_ingressgateway_request_processing_latency_seconds_sum{namespace="$namespace",app_kubernetes_io_instance="$Deployment",container="ingressgateway-prov"}[2m])) /sum(irate(oc_ingressgateway_request_processing_latency_seconds_count{namespace="$namespace",app_kubernetes_io_instance="$Deployment",container="ingressgateway-prov"}[2m])) )+(sum(irate(oc_ingressgateway_response_processing_latency_seconds_sum{namespace="$namespace",app_kubernetes_io_instance="$Deployment",container="ingressgateway-prov"}[2m])) /sum(irate(oc_ingressgateway_response_processing_latency_seconds_count{namespace="$namespace",app_kubernetes_io_instance="$Deployment",container="ingressgateway-prov"}[2m])) )

Table 5-53 Error Logs Indicator

Field Details
Sub KPI Microservice wise error logs indicator
Description Measures the error logs that are printing for the respective microservices. This helps in debugging purpose and understand the error on the microservice pod level.
Expression

sum by (microservice) (increase(log4j2_events_total{namespace="$namespace",level="error",app_kubernetes_io_instance="$Deployment"}[3m]))

Table 5-54 CPU Usage Across Namespace (per pod)

Field Details
Sub KPI POD Wise CPU Utilization
Description Measures the CPU resource usage for all the pods that are deployed within the namespace.
Expression

irate(cgroup_cpu_nanoseconds{namespace="$namespace"}[5m])

Table 5-55 Memory Usage Across Namespace (per pod)

Field Details
Sub KPI POD Wise Memory Utilization
Description Measures the memory resource usage for all the pods that are deployed with in the namespace.
Expression

sum(cgroup_memory_bytes{namespace="$namespace"}) by (pod)

Table 5-56 Overload Level

Field Details
Sub KPI Overload Level
Description Measures the overall load level for the backend pod that is handling the signaling or provisioning traffic.
Expression

load_level{namespace="$namespace",app_kubernetes_io_instance="$Deployment"} > 0

Table 5-57 Overload level resource wise

Field Details
Sub KPI Overload level resource wise
Description Measures the overload level by resource. Example as follows:
  • CPU is at L1
  • failure count is L2
Expression

max by (type, service) (service_resource_overload_level{namespace="$namespace",app_kubernetes_io_instance="$Deployment"}) > 0

Table 5-58 Overload Stress Resource Wise

Field Details
Sub KPI Overload stress resource wise
Description Measures the overload stress by resource. Example as follows:
  • CPU is at 40
  • failure count is at 8000
Expression

max by (type, service) (service_resource_stress{namespace="$namespace",app_kubernetes_io_instance="$Deployment"}) > 0

Table 5-59 IGW Pod Congested State

Field Details
Sub KPI IGW Pod Congested State
Description Measures the of ingress gateway pod congested state level. It may be at NORMAL, DOC or CONGESTED state.
Expression

sum by (pod) (oc_ingressgateway_pod_congestion_state{namespace="$namespace",app_kubernetes_io_instance="$Deployment"})

Table 5-60 IGW Congestion State Resource Wise

Field Details
Sub KPI IGW Congestion state resource wise
Description Measures the congested level by resource. Example as follows:
  • CPU is at DOC
  • pending count is CONGESTED
Expression

max by (type, pod) (oc_ingressgateway_pod_resource_state{namespace="$namespace",app_kubernetes_io_instance="$Deployment"})

Table 5-61 POD Wise Congested Resource Stress

Field Details
Sub KPI POD wise congested resource stress
Description Measures the overload stress by resource. Example as follows:
  • CPU is at 40
  • pending count is at 8000
Expression

max by (type, pod) (oc_ingressgateway_pod_resource_stress{namespace="$namespace",app_kubernetes_io_instance="$Deployment"}) > 0

Table 5-62 IGW Total Connections Rejected

Field Details
Sub KPI IGW Total Connections Rejected
Description Measures the total number of connections that got rejected at ingress gateway level because of the CONGESTED level.
Expression

sum(irate(oc_ingressgateway_incoming_pod_connections_rejected_total{namespace="$namespace",app_kubernetes_io_instance="$Deployment"}[5m])) by (pod)

Table 5-63 NRF Client Operative State

Field Details
Sub KPI NRF Client NF Status
Description Measures the NRF Client operative state.

0 - NRF is unavailable or unhealthy

Expression

nrfclient_nrf_operative_status{namespace="$namespace",app_kubernetes_io_instance="$Deployment"}

Table 5-64 NRF Client NF Status

Field Details
Sub KPI NRF Client NF Status
Description Measures the NRF Client NF Status.

1 - DEREGISTERED

2 - SUSPENDED

3 - UNDISCOVERABLE

4 - UNKNOWN

Expression

nrfclient_nf_status_with_nrf{namespace="$namespace",app_kubernetes_io_instance="$Deployment"}

Table 5-65 kmps per group(cgroup)

Field Details
Sub KPI Ingressgateway-sig
Description Measures the kmps of ingressgateway-sig service.
Expression

(sum(rate(http_server_requests_seconds_count{namespace="$namespace", pod=~".*ingressgateway-sig.*"}[2m]))*2)/sum(rate(cgroup_cpu_nanoseconds{namespace="$namespace", pod=~".*ingressgateway-sig.*"}[2m])/1E9)

Table 5-66 kmps per group(cgroup)

Field Details
Sub KPI Egressgateway
Description Measures the kmps of egressgateway service.
Expression

(sum(rate(http_server_requests_seconds_count{namespace="$namespace", pod=~".*egressgateway.*"}[2m]))*2)/sum(rate(cgroup_cpu_nanoseconds{namespace="$namespace", pod=~".*egressgateway.*"}[2m])/1E9)

Table 5-67 kmps per group(cgroup)

Field Details
Sub KPI DR Service
Description Measures the kmps of nudr-dr service.
Expression

(sum(rate(http_server_requests_seconds_count{namespace="$namespace", pod=~".*nudr-drservice.*"}[2m])))/sum(rate(cgroup_cpu_nanoseconds{namespace="$namespace", pod=~".*nudr-drservice.*"}[2m])/1E9)

Table 5-68 kmps per group(cgroup)

Field Details
Sub KPI Ingressgateway-prov
Description Measures the kmps of ingressgateway-prov service.
Expression

(sum(rate(http_server_requests_seconds_count{namespace="$namespace", pod=~".*ingressgateway-prov.*"}[2m]))*2)/sum(rate(cgroup_cpu_nanoseconds{namespace="$namespace", pod=~".*ingressgateway-prov.*"}[2m])/1E9)

Table 5-69 kmps per group(cgroup)

Field Details
Sub KPI DR-Prov Service
Description Measures the kmps of nudr-dr-prov service.
Expression

(sum(rate(http_server_requests_seconds_count{namespace="$namespace", pod=~".*nudr-dr-provservice.*"}[2m])))/sum(rate(cgroup_cpu_nanoseconds{namespace="$namespace", pod=~".*nudr-dr-provservice.*"}[2m])/1E9)

Table 5-70 Diameter Gateway

Field Details
Sub KPI Diameter GW Success Rate
Description Measures the total success TPS rate of the diameter gateway service.
Expression

sum(irate(ocudr_diam_response_network_total{namespace="$namespace",responseCode="2001",app_kubernetes_io_instance="$Deployment"}[5m]))/ sum(irate(ocudr_diam_response_network_total{namespace="$namespace",app_kubernetes_io_instance="$Deployment"}[5m])) *100

Table 5-71 Diameter Gateway

Field Details
Sub KPI Diameter GW Failure Rate
Description Measures the total failure TPS rate of the diameter gateway service.
Expression

sum(irate(ocudr_diam_response_network_total{namespace="$namespace",responseCode!="2001",app_kubernetes_io_instance="$Deployment"}[5m]))/ sum(irate(ocudr_diam_response_network_total{namespace="$namespace",app_kubernetes_io_instance="$Deployment"}[5m])) *100

Table 5-72 Diameter Gateway Traffic Rate

Field Details
Sub KPI Total Request Rate
Description Measures the total TPS of the diameter traffic that is on the diameter gateway.
Expression

sum(irate(ocudr_diam_request_network_total{namespace="$namespace",app_kubernetes_io_instance="$Deployment"}[5m]))

Table 5-73 Diameter Gateway Traffic Rate

Field Details
Sub KPI Success Rate
Description Measures the total successful TPS of the diameter traffic that is on the diameter gateway.
Expression

sum(irate(ocudr_diam_response_network_total{namespace="$namespace",responseCode="2001",app_kubernetes_io_instance="$Deployment"}[5m]))

Table 5-74 Diameter Gateway Traffic Rate

Field Details
Sub KPI Failure Rate
Description Measures the total failed TPS of the diameter traffic that is on the diameter gateway.
Expression

sum(irate(ocudr_diam_response_network_total{namespace="$namespace",responseCode!="2001",app_kubernetes_io_instance="$Deployment"}[5m]))

Table 5-75 Diameter Gateway Traffic Rate

Field Details
Sub KPI Message Type Wise TPS
Description Measures the total TPS of the diameter traffic that is on the diameter gateway by message type.
Expression

sum(irate(ocudr_diam_request_network_total{namespace="$namespace",app_kubernetes_io_instance="$Deployment"}[5m])) by (msgType)

Table 5-76 Diameter Gateway Traffic Rate

Field Details
Sub KPI Message Type Wise Success Rate
Description Measures the total successful TPS of the diameter traffic that is on the diameter gateway by message type.
Expression

sum(irate(ocudr_diam_response_network_total{namespace="$namespace",responseCode="2001",app_kubernetes_io_instance="$Deployment"}[5m])) by (msgType)

Table 5-77 Diameter Gateway Traffic Rate

Field Details
Sub KPI Message Type Wise Failure Rate
Description Measures the total failure TPS of the diameter traffic that is on the diameter gateway by message type.
Expression

sum(irate(ocudr_diam_response_network_total{namespace="$namespace",responseCode="2001",app_kubernetes_io_instance="$Deployment"}[5m])) by (msgType)

Table 5-78 Diameter Backend

Field Details
Sub KPI Diameter Backend Success Rate
Description Measures the total successful TPS rate of the diameter proxy service.
Expression

sum(irate(nudr_diameterproxy_responses_total{namespace="$namespace",ResultCode="2001",app_kubernetes_io_instance="$Deployment"}[5m]))/ sum(irate(nudr_diameterproxy_responses_total{namespace="$namespace",app_kubernetes_io_instance="$Deployment"}[5m])) *100

Table 5-79 Diameter Backend

Field Details
Sub KPI Diameter Backend Failure Rate
Description Measures the total failure TPS rate of the diameter proxy service.
Expression

sum(irate(nudr_diameterproxy_responses_total{namespace="$namespace",ResultCode!="2001",app_kubernetes_io_instance="$Deployment"}[5m]))/ sum(irate(nudr_diameterproxy_responses_total{namespace="$namespace",app_kubernetes_io_instance="$Deployment"}[5m])) *100

Table 5-80 Diameter Backend Traffic Rate

Field Details
Sub KPI Total Request Rate
Description Measures the total TPS of the diameter traffic that is on diameter proxy.
Expression

sum(irate(nudr_diameterproxy_requests_total{namespace="$namespace",app_kubernetes_io_instance="$Deployment"}[5m]))

Table 5-81 Diameter Backend Traffic Rate

Field Details
Sub KPI Success Rate
Description Measures the total success TPS of the diameter traffic that is on diameter proxy.
Expression

sum(irate(nudr_diameterproxy_responses_total{namespace="$namespace",ResultCode="2001",app_kubernetes_io_instance="$Deployment"}[5m]))

Table 5-82 Diameter Backend Traffic Rate

Field Details
Sub KPI Failure Rate
Description Measures the total failure TPS of the diameter traffic that is on diameter proxy.
Expression

sum(irate(nudr_diameterproxy_responses_total{namespace="$namespace",ResultCode!="2001",app_kubernetes_io_instance="$Deployment"}[5m]))

Table 5-83 Diameter Backend Traffic Rate

Field Details
Sub KPI Message Type Wise Total TPS
Description Measures the total TPS of the diameter traffic that is on diameter proxy by message type.
Expression

sum(irate(nudr_diameterproxy_requests_total{namespace="$namespace",app_kubernetes_io_instance="$Deployment"}[5m])) by (MessageType)

Table 5-84 Diameter Backend Traffic Rate

Field Details
Sub KPI Message Type Wise Success Rate
Description Measures the total success TPS of the diameter traffic that is on diameter proxy by message type.
Expression

sum(irate(nudr_diameterproxy_responses_total{namespace="$namespace",ResultCode="2001",app_kubernetes_io_instance="$Deployment"}[5m])) by (MessageType)

Table 5-85 Diameter Backend Traffic Rate

Field Details
Sub KPI Message Type Wise Failure Rate
Description Measures the total failure TPS of the diameter traffic that is on diameter proxy by message type.
Expression

sum(irate(nudr_diameterproxy_responses_total{namespace="$namespace",ResultCode!="2001",app_kubernetes_io_instance="$Deployment"}[5m])) by (MessageType)

Table 5-86 DB and DR-Service Latency [Percentile]

Field Details
Sub KPI diameter_db_latency
Description Measures the diameter traffic database latency.
Expression

histogram_quantile(${percentile} / 100, sum by(le) (rate(diameter_db_processing_time_seconds_bucket{namespace="$namespace",app_kubernetes_io_instance="$Deployment"}[5m])))

Table 5-87 DB and DR-Service Latency [Percentile]

Field Details
Sub KPI diameter_req_latency
Description Measures the diameter traffic request latency.
Expression

histogram_quantile(${percentile} / 100, sum by(le) (rate(diameter_request_processing_time_seconds_bucket{namespace="$namespace",app_kubernetes_io_instance="$Deployment"}[5m])))

Table 5-88 DB and DR-Service Latency [Percentile]

Field Details
Sub KPI diameter_backend_latency
Description Measures the diameter traffic backend request latency.
Expression

histogram_quantile(${percentile} / 100, sum by(le) (rate(diamgateway_backend_processing_time_seconds_bucket{namespace="$namespace",app_kubernetes_io_instance="$Deployment"}[5m])))

Table 5-89 DGW Congestion State

Field Details
Sub KPI DGW Congestion State
Description Measures the congested state of Diameter Gateway pod.
Expression

sum by (pod) (ocudr_pod_congestion_state{namespace="$namespace",app_kubernetes_io_instance="$Deployment"})

Table 5-90 DGW Congestion State Resource Wise

Field Details
Sub KPI DGW congestion state resource wise
Description Measures the diameter gateway congested level by resource. Example as follows:
  • CPU is at DOC
  • pending count is CONGESTED
Expression

max by (type, pod) (ocudr_pod_resource_congestion_state{namespace="$namespace",app_kubernetes_io_instance="$Deployment"})

Table 5-91 DGW Congestion Resource Stress

Field Details
Sub KPI DGW congestion resource stress
Description Measures the diameter gateway overload stress by resource. Example as follows:
  • CPU is at 40
  • pending count is at 8000
Expression

max by (type, pod) (ocudr_pod_resource_congestion_state{namespace="$namespace",app_kubernetes_io_instance="$Deployment"}) > 0

Table 5-92 DGW Total Messages Rejected

Field Details
Sub KPI DGW Total Messages Rejected
Description Measures the total number of connections that is rejected at diameter gateway because of CONGESTED level.
Expression

ocudr_diam_congestion_message_reject_total{namespace="$namespace",app_kubernetes_io_instance="$Deployment"}

Table 5-93 Notifications Rate (NOTIFY SERVICE)

Field Details
Sub KPI Notifications sent
Description Measures the total notifications rate that are sent from the notify-sercvice.
Expression

sum(irate(nudr_notif_notifications_sent_total{namespace="$namespace",app_kubernetes_io_instance="$Deployment"}[5m]))

Table 5-94 Notifications Rate (NOTIFY SERVICE)

Field Details
Sub KPI Total ack received
Description Measures the TPS of the received notifications to notify-service.
Expression

sum(irate(nudr_notif_notifications_ack_total{namespace="$namespace",app_kubernetes_io_instance="$Deployment"}[5m]))

Table 5-95 Notifications Rate (NOTIFY SERVICE)

Field Details
Sub KPI 2xx ack received
Description Measures the TPS of 2xx received notifications to notify-service.
Expression

sum(irate(nudr_notif_notifications_ack_2xx_total{namespace="$namespace",app_kubernetes_io_instance="$Deployment"}[5m]))

Table 5-96 Notifications Rate (NOTIFY SERVICE)

Field Details
Sub KPI 4xx ack received
Description Measures the TPS of 4xx received notifications to notify-service.
Expression

sum(irate(nudr_notif_notifications_ack_4xx_total{namespace="$namespace",app_kubernetes_io_instance="$Deployment"}[5m]))

Table 5-97 Notifications Rate (NOTIFY SERVICE)

Field Details
Sub KPI 5xx ack received
Description Measures the TPS of 5xx received notifications to notify-service.
Expression

sum(irate(nudr_notif_notifications_ack_5xx_total{namespace="$namespace",app_kubernetes_io_instance="$Deployment"}[5m]))

Table 5-98 Notification Rate (DR SERVICE/DIAM PROXY)

Field Details
Sub KPI Notifications Sent DR
Description Measures the total notifications that are sent to notify-service from the dr-service.
Expression

sum(irate(nudr_dr_notif_signal_sent_total{namespace="$namespace",app_kubernetes_io_instance="$Deployment"}[5m]))

Table 5-99 Notification Rate (DR SERVICE/DIAM PROXY)

Field Details
Sub KPI UPDATE Notifications Failure Rate DR
Description Measures the total failed update notifications that are sent to notify-service from the dr-service.
Expression

sum(irate(nudr_dr_notif_signal_notification_update_failed_total{namespace="$namespace",app_kubernetes_io_instance="$Deployment"}[5m]))

Table 5-100 Notification Rate (DR SERVICE/DIAM PROXY)

Field Details
Sub KPI UPDATE Notifications Success Rate
Description Measures the total successfully update notifications that are sent to notify-service from the dr-service.
Expression

sum(irate(nudr_dr_notif_signal_notification_update_success_total{namespace="$namespace",app_kubernetes_io_instance="$Deployment"}[5m]))

Table 5-101 Notification Rate (DR SERVICE/DIAM PROXY)

Field Details
Sub KPI DELETE Notifications Success Rate DR
Description Measures the total delete notifications that are successfully sent to notify-service from the dr-service.
Expression

sum(irate(nudr_dr_notif_signal_notification_delete_success_total{namespace="$namespace",app_kubernetes_io_instance="$Deployment"}[5m])

Table 5-102 Notification Rate (DR SERVICE/DIAM PROXY)

Field Details
Sub KPI DELETE Notifications Failure Rate DR
Description Measures the total failed delete notifications to notify-service from the dr-service.
Expression

sum(irate(nudr_dr_notif_signal_notification_delete_failed_total{namespace="$namespace",app_kubernetes_io_instance="$Deployment"}[5m]))

Table 5-103 Retry and New Notifications

Field Details
Sub KPI Retry Notification
Description Measures the retry notifications that are retried.
Expression

sum(irate(nudr_notif_notifications_marked_for_retry_total{namespace="$namespace",app_kubernetes_io_instance="$Deployment"}[5m]))

Table 5-104 Retry and New Notifications

Field Details
Sub KPI New Notifications
Description Measures the new notifications that are sent from notify service.
Expression

sum(irate(nudr_notif_notifications_sent_total{namespace="$namespace",app_kubernetes_io_instance="$Deployment"}[5m]))-sum(irate(nudr_notif_notifications_marked_for_retry_total{namespace="$namespace",app_kubernetes_io_instance="$Deployment"}[5m]))

Table 5-105 Congestion Level

Field Details
Sub KPI Congestion Level
Description Measures the congestion level per pod at particular instance.
Expression

sum(oc_ingressgateway_congestion_system_state{namespace="$namespace",container="ingressgateway-sig"}) by (pod)

Table 5-106 Allowed/Rejected Requests

Field Details
Sub KPI Allowed requests
Description Measures the total allowed requests across all the pods.
Expression

sum(rate(oc_ingressgateway_http_request_ratelimit_values_total{Allowed="true",namespace="$namespace",container="ingressgateway-sig"}[2m])) by (Id)

Table 5-107 Allowed/Rejected Requests

Field Details
Sub KPI Rejected requests
Description Measures the total rejected requests across all the pods.
Expression

sum(rate(oc_ingressgateway_http_request_ratelimit_values_total{Allowed="false",namespace="$namespace",container="ingressgateway-sig"}[2m])) by (Id)

Table 5-108 Allow/Reject Requests per Pod

Field Details
Sub KPI Allow/Reject requests per pod
Description Measures the CONTINUE or REJECT requests per pod along with the congestion level.
Expression

sum(rate(oc_ingressgateway_http_request_ratelimit_denied_count_total{namespace="$namespace",container="ingressgateway-sig"}[2m])) by (Action,pod)

Table 5-109 Overall CPU Usage

Field Details
Sub KPI Overall CPU Usage
Description Measures the overall CPU usage for the ingressgateway-sig microservice.
Expression

sum(rate(oc_ingressgateway_congestion_cpu_percentage_bucket{namespace="$namespace",container="ingressgateway-sig"}[2m]))by (le)