4.2 Performance Benchmarking with Synthetic Feed

The performance benchmarking test is performed on OCNADD with 30K MPS synthetic feed which includes 16K MPS SCP traffic (8K TPS with 2 trigger points), 5K MPS NRF traffic (2.5K TPS with 2 trigger points) and 9K MPS SEPP traffic (4.5K TPS with 2 trigger points). The benchmarking results are provided below:

Note:

One Ingress message from a NF is "1" MPS for OCNADD.

Benchmark Test Environment

The test environment specifications are listed below:
  • Ingress Traffic Rate: 30K MPS
  • The latency, resource utilization, and MPS is observed for the period of 4 hrs or more.
  • OCNADD single site deployment with ASM disabled
  • OCNADD Release 23.2.0 deployed over CNE (Bare metal) 22.3.0 version
  • Kafka Replication Factor (RF): 1
  • OCNADD Data Feed: Secure TCP feed (TCP with TLS enabled)
  • OCNADD Kafka PVC: 300GB

    For more information about PVC requirements, see Kafka PVC Storage Requirements.

  • 3rd Party Application: 1 Perfgo Server with 2 End-points
  • cnDBTier Release 23.2.0
  • NRF Release 23.1.0
  • SCP Release 23.2.0
  • SEPP Release 23.1.0
  • SASL/SSL, enabled between NRF/SCP/SEPP and OCNADD
  • CNCC Release 23.2.0
  • Message Size: 3000 Bytes
  • Environment: CNE (Bare metal)

Benchmark Testcase Specifications

The testcase parameters are as follows:
  • OCNADD
    • A feed is configured using the OCNADD Console with aggregation rules set for SCP, NRF and SEPP.
    • Message Ingestion Rate: 30K MPS
    Resource Specifications:

    Table 4-4 OCNADD Resource Specifications

    Services CPU Request Per Pod CPU Limit Per Pod Memory Request Per Pod (Gi) Memory Limit Per Pod (Gi) min Replicas max Replicas Kafka Topic Partitions and Retention
    ocnaddconfiguration 1 1 1 1 1 1  
    ocnaddalarm 1 1 1 1 1 1  
    ocnaddadmin 1 1 1 1 1 1  
    ocnaddhealthmonitoring 1 1 1 1 1 1  
    ocnaduirouter 1 1 1 1 1 1  
    ocnaddscpaggregation (16K) 2 2 2 2 2 2

    12 (SCP)/

    retention.ms=300000
    ocnaddnrfaggregation (5K) 2 2 2 2 1 1

    6 (NRF)/

    retention.ms=300000
    ocnaddseppaggregation (9K) 2 2 2 2 1 1

    6 (SEPP)/

    retention.ms=300000
    ocnaddadapter 3 3 4 4 2 2

    12 (MAIN)/

    retention.ms=300000
    ocnaddkafka 5 5 48 48 3 3  
    zookeeper 1 1 2 2 3 3  
    ocnaddgui 2 2 1 1 1 1  
    ocnaddcache 1 1 10 10 2 2  
  • SCP

    SCP Traffic: 8K TPS using two trigger points.

  • NRF

    NRF Traffic: 2.5K TPS using two trigger points.

  • SEPP

    SEPP Traffic: 4.5K TPS using two trigger points.

Benchmark Test Results

Traffic Feed Details

Table 4-5 Traffic Feed Details

NF NF Traffic Copy Trigger Points Traffic Rate Duration in hours E2E Traffic Feed Average Latency E2E Traffic Feed Success Rate
OCNADD NA 30K MPS 4 3.15 ms 99.99%
NRF 2 (IGW/ EGW) 5K MPS 4   99.96%
SCP 2 (Request Ingress/ Request Egress) 16K MPS 4   99.8%
SEPP 2 (PLMN IGW) 9K MPS 4   99.99%

CPU and Memory Utilization

The following table describes the OCNADD CPU and memory utilization:

Table 4-6 OCNADD CPU and Memory Utilization

Microservice/ Container Pod Count CPU Utilization (%) Memory Utilization (%)
ocnaddadapter 2 80.6 27.5
ocnaddkafka 3 53.7 10.9
ocnaddadmin 1 0.247 27.2
ocnaddalarm 1 0.306 18.9
ocnadduirouter 1 0.0190 24.6
ocnaddconfiguration 1 0.154 28.0
ocnaddhealthmonitoring 1 0.242 27.1
ocnaddgui 1 0.0301 5.15
ocnaddnrfaggregation (5K) 1 49.3 22.4
ocnaddscpaggregation (16K) 2 35.8 30.9
ocnaddseppaggregation (9K) 1 64.7 28.0
zookeeper 3 0.248 15.0
ocnaddcache 2 0.0656 8.09