4.1 Performance Benchmarking with Synthetic Feed with Replication

The performance benchmarking test is performed on OCNADD with 100K MPS traffic (feed replication enabled) which includes 55K MPS SCP traffic (27.5K TPS with 2 traffic copy trigger points on SCP), 15K MPS NRF traffic (7.5K TPS with 2 traffic copy trigger points on NRF) and 30K MPS SEPP traffic (15K TPS with 2 traffic copy trigger points on SEPP). The benchmarking results are provided below:

Note:

One Ingress message from a NF is "1" MPS for OCNADD.

Benchmark Test Environment

The test environment specifications are listed below:
  • Ingress Traffic Rate: 100K MPS
  • The latency, resource utilization, and MPS is observed for the period of 3 hrs or more.
  • OCNADD single site deployment with ASM disabled
  • OCNADD Release 23.4.0 deployed over CNE (Bare metal) 22.3.0 version
  • Kafka Replication Factor (RF): 1
  • OCNADD TCP Feed: HTTP2/TLS
  • OCNADD Kafka PVC: 400GB

    For more information about PVC requirements, see Kafka PVC Storage Requirements.

  • 3rd Party Application: With 2 End-points
  • cnDBTier Release 23.4.0
  • NRF Release 23.4.0
  • SCP Release 23.3.0
  • SEPP Release 23.4.0
  • SASL/SSL, enabled between NRF/SCP/SEPP and OCNADD
  • CNCC Release 23.4.0
  • Message Size: 3580 Bytes
  • Environment: CNE (Bare metal)
  • Execution time: 12 Hours
  • NRF: IGW and EGW messageCopy feature is enabled
  • SCP: Default configuration
  • cSEPP: PLMN IGW messageCopy feature is enabled
  • pSEPP: The messageCopy feature is disabled

Benchmark Testcase Specifications

The testcase parameters are as follows:
  • OCNADD
    • A feed is configured using the OCNADD Console with aggregation rules set for SCP, NRF and SEPP.
    • Message Ingestion Rate: 100K MPS
    Resource Specifications:

    Table 4-1 OCNADD Resource Specifications

    Services CPU Request Per Pod CPU Limit Per Pod Memory Request Per Pod (Gi) Memory Limit Per Pod (Gi) min Replicas max Replicas Kafka Topic Partitions and Retention
    ocnaddconfiguration 1 1 1 1 1 1 -
    ocnaddalarm 1 1 1 1 1 1 -
    ocnaddadmin 1 1 1 1 1 1 -
    ocnaddhealthmonitoring 1 1 1 1 1 1 -
    ocnadduirouter 2 2 1 1 1 1 -
    ocnaddscpaggregation 2 2 2 2 2 2

    18 (SCP)/

    retention.ms = 300000
    ocnaddnrfaggregation 2 2 2 2 1 1

    6 (NRF)/

    retention.ms = 300000
    ocnaddseppaggregation 2 2 2 2 2 2

    12 (SEPP)/

    retention.ms = 300000
    ocnaddadapter 3 3 4 4 9 9

    54 (MAIN)/

    retention.ms = 300000
    ocnaddkafka 10 6 96 48 4 4 -
    zookeeper 1 1 2 2 3 3 -
    ocnaddgui 2 2 1 1 1 1 -
  • SCP

    SCP Traffic: 55K TPS using two trigger points.

  • NRF

    NRF Traffic: 15K TPS using two trigger points.

  • SEPP

    SEPP Traffic: 30K TPS using two trigger points.

Benchmark Test Results

Traffic Feed Details

Table 4-2 Traffic Feed Details

NF NF Traffic Copy Trigger Points Traffic Rate Duration in hours E2E Traffic Feed Average Latency E2E Traffic Feed Success Rate
OCNADD NA 100K MPS 12

Feed-1: 4.17 msec

Feed-2: 4.07 sec

Feed-1: 99.95%

Feed-2: 99.95%
NRF 2 - IGW/EGW (Request and Response) 15K MPS 12 NA 99.93%
SCP 2 (Request Ingress/Request Egress) 55K MPS 12 NA 99.99%
SEPP 2 (PLMN IGW) (Request and Response) 30K MPS 12 NA 99.93%

CPU and Memory Utilization

The following table describes the OCNADD CPU and memory utilization:

Table 4-3 OCNADD CPU and Memory Utilization

Microservice/ Container Pod Count CPU Utilization (%) Memory Utilization (%)
ocnaddadminservice 1 0.16% 28.60%
ocnaddalarm 1 0.26% 18.60%
ocnaddconfiguration 1 0.15% 35.00%
ocnaddgui 1 0.00% 3.47%
ocnaddhealthmonitoring 1 0.40% 35.30%
ocnadduirouter 1 0.01% 27.80%
feed-dd1-adapter 9 61.00% 29.70%
feed-dd2-adapter 9 62.00% 28.92%
kafka-broker 4 87.70% 72.50%
zookeeper 4 0.16% 17.00%
ocnaddfilter 4 49.30% 13.90%
ocnaddnrfaggregation 1 62.40% 64.70%
ocnaddscpaggregation 3 71.60% 66.20%
ocnaddseppaggregation 2 54.20% 52.50%