3 SEPP Benchmark Testing

This section provides information about the SEPP testcases run in different scenarios.

3.1 Test Scenario 1: SEPP 40K MPS, 72 Hrs Run with Features Enabled with 50ms Delay at Server End

This test scenario describes the performance and capacity of SEPP and provides the benchmarking results for 40K MPS, 72 hours run with the following SEPP features enabled with 50ms delay at the server end:
  • Topology Hiding
  • Security Counter Measure features:
    • Cat-0 SBI Message Schema Validation Feature
    • Cat-1 NRF Service API Query Parameters Validation
    • Cat-1 Service API Validation Feature
    • Cat -2 Network ID Validation Feature
    • Cat-3 Previous Location Check Feature
    • Cat-3 Time Check for Roaming Subscribers
  • Overload Control
  • 5G SBI Message Mediation Support
  • Steering of Roaming (SOR) Feature
  • Global Rate Limiting on Ingress Gateway of SEPP
  • Alternate Routing and Load Sharing based on the DNS SRV Record for Home Network Functions

Note:

ASM is enabled in this test case scenario.

3.1.1 Testcase and Setup Details

Following are the testcase and setup details:

Traffic Model Details

Table 3-1 Transactions Per Second (TPS)

Total TPS Site 1 Site 2
40K MPS 20K MPS 20K MPS
Setup Details

Table 3-2 Setup Details

Setup Details Values
Active User NA for SEPP
Execution Time 72 Hrs
Environment vCNE
Cluster Hardhead1
cnDBTier 25.2.100
cSEPP 25.2.100
pSEPP 25.2.100
CNC Console 25.2.100
Setup Configuration
  • Both SEPPs are deployed on Model-B.
  • cnDBTier is deployed on both sites.
List of SEPP Features enabled
  • Topology Hiding
  • Security Counter Measure features:
    • Cat-0 SBI Message Schema Validation Feature
    • Cat-1 NRF Service API Query Parameters Validation
    • Cat-1 Service API Validation Feature
    • Cat -2 Network ID Validation Feature
    • Cat-3 Previous Location Check Feature
    • Cat-3 Time Check for Roaming Subscribers
  • Overload Control
  • 5G SBI Message Mediation Support
  • Steering of Roaming (SOR) Feature
  • Global Rate Limiting on Ingress Gateway of SEPP
  • Alternate Routing and Load Sharing based on the DNS SRV Record for Home Network Functions

Resource Footprint

Table 3-3 Resource Footprint

Microservices / container Container Count CPU Resource per container (Limit) CPU Resource per container (Request) Memory Resource per container (Limit) Memory Resource per container (Request)
Site2-ocsepp-alternate-route/alternate-route 2 2 2 4Gi 4Gi
Site2-ocsepp-appinfo/appinfo 2 1 1 2Gi 1Gi
Site2-ocsepp-cn32c-svc/cn32c-svc 2 2 2 2Gi 2Gi
Site2-ocsepp-cn32f-svc/cn32f-svc 7 5 5 8Gi 8Gi
Site2-ocsepp-coherence-svc/coherence-svc 1 4 4 4Gi 4Gi
Site2-ocsepp-config-mgr-svc/config-mgr-svc 1 2 2 2Gi 2Gi
Site2-ocsepp-n32-egress-gateway/n32-egress-gateway 7 5 5 5Gi 5Gi
Site2-ocsepp-n32-ingress-gateway/n32-ingress-gateway 7 6 6 5Gi 5Gi
Site2-ocsepp-nf-mediation/nf-mediation 2 8 8 8Gi 8Gi
Site2-ocsepp-ocpm-config/config-server 2 1 1 1Gi 1Gi
Site2-ocsepp-performance/perf-info 2 2 2 4Gi 200Mi
Site2-ocsepp-plmn-egress-gateway/plmn-egress-gateway 7 5 5 5Gi 5Gi
Site2-ocsepp-plmn-ingress-gateway/plmn-ingress-gateway 7 5 5 5Gi 5Gi
Site2-ocsepp-pn32c-svc/pn32c-svc 2 2 2 2Gi 2Gi
Site2-ocsepp-pn32f-svc/pn32f-svc 7 5 5 8Gi 8Gi
Site2-ocsepp-sepp-nrf-client-nfdiscovery/nrf-client-nfdiscovery 2 2 2 2Gi 2Gi
Site2-ocsepp-sepp-nrf-client-nfmanagement/nrf-client-nfmanagement 2 2 2 2Gi 2Gi
Site1-ocsepp-alternate-route/alternate-route 2 2 2 4Gi 4Gi
Site1-ocsepp-appinfo/appinfo 2 1 1 2Gi 1Gi
Site1-ocsepp-cn32c-svc/cn32c-svc 2 2 2 2Gi 2Gi
Site1-ocsepp-cn32f-svc/cn32f-svc 7 5 5 8Gi 8Gi
Site1-ocsepp-coherence-svc/coherence-svc 1 4 4 4Gi 4Gi
Site1-ocsepp-config-mgr-svc/config-mgr-svc 1 2 2 2Gi 2Gi
Site1-ocsepp-n32-egress-gateway/n32-egress-gateway 7 5 5 5Gi 5Gi
Site1-ocsepp-n32-ingress-gateway/n32-ingress-gateway 7 6 6 5Gi 5Gi
Site1-ocsepp-nf-mediation/nf-mediation 2 8 8 8Gi 8Gi
Site1-ocsepp-ocpm-config/config-server 2 1 1 1Gi 1Gi
Site1-ocsepp-performance/perf-info 2 2 2 4Gi 200Mi
Site1-ocsepp-plmn-egress-gateway/plmn-egress-gateway 7 5 5 5Gi 5Gi
Site1-ocsepp-plmn-ingress-gateway/plmn-ingress-gateway 7 5 5 5Gi 5Gi
Site1-ocsepp-pn32c-svc/pn32c-svc 2 2 2 2Gi 2Gi
Site1-ocsepp-pn32f-svc/pn32f-svc 7 5 5 8Gi 8Gi
Site1-ocsepp-sepp-nrf-client-nfdiscovery/nrf-client-nfdiscovery 2 2 2 2Gi 2Gi
Site1-ocsepp-sepp-nrf-client-nfmanagement/nrf-client-nfmanagement 2 2 2 2Gi 2Gi

Note:

  • Mi- Megabytes
  • Gi- Gigabytes
  • m- millicores
  • CPU Resource per container without unit is represented in cores

3.1.2 Traffic and Latency

The following tables describe the traffic and latency details:

Traffic Details

Table 3-4 Traffic Details

TPS Site-1 Site-2
PLMN-IGW-requests-rate 10280.68 10270.93
CN32F-requests-rate 9925.73 9711.63
N32-IGW-requests-rate 9711.61 9925.77
N32-EGW-requests-rate 9925.53 9711.57
PN32F-requests-rate 8441.16 8585.76
PLMN-EGW-requests-rate 11260.91 11554.10
Total TPS 9924.167 9959.833

Latency Details

Table 3-5 Latency Details

NF Service Latency( In MilliSecond) Site-1 Site-2
IGW(s) 0.07 0.07
EGW(s) 0.07 0.07
cn32f(s) 0.04 0.04
pn32f(s) 0.03 0.03

3.1.3 Results

  • csepp call success rate: 96.545%

    Note:

    A 3.45% drop was intentionally introduced by enabling global rate limiting on the PLMN Ingress gateway. Actual success rate is 99.995%.
  • psepp call success rate: 94.553%

    Note:

    A 5.442% drop was intentionally introduced by enabling global rate limiting on the PLMN Ingress gateway. Actual success rate is 99.995%.
  • csepp_Avg_Latency_rate: 94.502ms
  • psepp_Avg_Latency_rate: 100.517ms
  • No pod restarts are observed
  • Perfgo deployed on hardhead 1 cluster with 7 server and 8 client each side
  • Run with 50ms server delay
  • Features enabled:
    • Topology Hiding
    • Security Counter Measure features:
      • Cat-0 SBI Message Schema Validation Feature
      • Cat-1 NRF Service API Query Parameters Validation
      • Cat-1 Service API Validation Feature
      • Cat -2 Network ID Validation Feature
      • Cat-3 Previous Location Check Feature
      • Cat-3 Time Check for Roaming Subscribers
    • Overload Control
    • 5G SBI Message Mediation Support
    • Steering of Roaming (SOR) Feature
    • Global Rate Limiting on Ingress Gateway of SEPP
    • Alternate Routing and Load Sharing based on the DNS SRV Record for Home Network Functions