3 SEPP Benchmark Testing

This section provides information about the SEPP testcases run in different scenarios.

3.1 Test Scenario 1: SEPP 40K MPS, 72 Hrs Run with Features Enabled with 50ms Delay at Server End

This test scenario describes the performance and capacity of SEPP and provides the benchmarking results for 40K MPS, 72 hours run with the following SEPP features enabled with 50ms delay at the server end:
  • Topology Hiding
  • Security Counter Measure features:
    • Cat-0 SBI Message Schema Validation Feature
    • Cat-1 NRF Service API Query Parameters Validation
    • Cat-1 Service API Validation Feature
    • Cat -2 Network ID Validation Feature
    • Cat-3 Previous Location Check Feature
    • Cat-3 Time Check for Roaming Subscribers
  • Overload Control
  • 5G SBI Message Mediation Support
  • Steering of Roaming (SOR) Feature
  • Global Rate Limiting on Ingress Gateway of SEPP
  • Alternate Routing and Load Sharing based on the DNS SRV Record for Home Network Functions
  • LCI and OCI Header feature
  • NRF Autoroute Feature

Note:

ASM is not enabled in this test case scenario.

3.1.1 Testcase and Setup Details

Following are the testcase and setup details:

Traffic Model Details

Table 3-1 Transactions Per Second (TPS)

Total TPS Site 1 Site 2
40K MPS 20K MPS 20K MPS
Setup Details

Table 3-2 Setup Details

Setup Details Values
Active User NA for SEPP
Execution Time 72 Hrs
Environment vCNE
Cluster Hardhead1
cnDBTier 25.2.200
cSEPP 25.2.200
pSEPP 25.2.200
CNC Console 25.2.200
Setup Configuration
  • Both SEPPs are deployed on Model-B.
  • cnDBTier is deployed on both sites.
List of SEPP Features enabled
  • Topology Hiding
  • Security Counter Measure features:
    • Cat-0 SBI Message Schema Validation Feature
    • Cat-1 NRF Service API Query Parameters Validation
    • Cat-1 Service API Validation Feature
    • Cat -2 Network ID Validation Feature
    • Cat-3 Previous Location Check Feature
    • Cat-3 Time Check for Roaming Subscribers
  • Overload Control
  • 5G SBI Message Mediation Support
  • Steering of Roaming (SOR) Feature
  • Global Rate Limiting on Ingress Gateway of SEPP
  • Alternate Routing and Load Sharing based on the DNS SRV Record for Home Network Functions
  • LCI and OCI Header feature
  • NRF Autoroute Feature

Resource Footprint

Table 3-3 Resource Footprint

App/ Container Site-1 Site-2 Site-3
CPU Memory CPU Memory CPU Memory
ocsepp-alternate-route/alternate-route 0.006 (0.15%) 1.387 (17.33%) 0.005 (0.12%) 0.741 (9.27%) 0.006 (0.15%) 1.062 (13.27%)
ocsepp-appinfo/appinfo 0.053 (2.65%) 0.546 (13.65%) 0.043 (2.15%) 0.558 (13.94%) 0.050 (2.50%) 0.542 (13.55%)
ocsepp-cn32c-svc/cn32c-svc 0.008 (0.20%) 0.845 (21.12%) 0.010 (0.25%) 0.837 (20.92%) 0.011 (0.27%) 0.801 (20.02%)
ocsepp-cn32f-svc/cn32f-svc 9.211 (26.32%) 9.625 (17.19%) 1.882 (12.55%) 2.763 (11.51%) 1.905 (12.70%) 2.813 (11.72%)
ocsepp-coherence-svc/coherence-svc 0.099 (2.48%) 0.807 (20.17%) 0.128 (3.20%) 0.806 (20.14%) 0.072 (1.80%) 0.844 (21.09%)
ocsepp-config-mgr-svc/config-mgr-svc 0.012 (0.60%) 0.675 (33.74%) 0.009 (0.45%) 0.595 (29.74%) 0.008 (0.40%) 0.620 (31.01%)
ocsepp-n32-egress-gateway/n32-egress-gateway 9.224 (26.35%) 19.276 (55.08%) 1.782 (11.88%) 7.080 (47.20%) 2.005 (13.37%) 6.917 (46.11%)
ocsepp-n32-ingress-gateway/n32-ingress-gateway 5.800 (13.81%) 17.209 (49.17%) 4.523 (25.13%) 8.792 (58.61%) 4.621 (25.67%) 9.493 (63.29%)
ocsepp-nf-mediation/nf-mediation 0.306 (1.91%) 0.575 (3.59%) 0.130 (0.81%) 0.601 (3.75%) 0.134 (0.84%) 0.591 (3.69%)
ocsepp-ocpm-config/config-server 0.004 (0.20%) 0.665 (33.25%) 0.004 (0.20%) 0.644 (32.18%) 0.004 (0.20%) 0.638 (31.88%)
ocsepp-performance/perf-info 0.068 (1.70%) 0.263 (3.28%) 0.042 (1.05%) 0.262 (3.27%) 0.028 (0.70%) 0.261 (3.26%)
ocsepp-plmn-egress-gateway/plmn-egress-gateway 5.225 (14.93%) 19.030 (54.37%) 4.374 (29.16%) 9.991 (66.61%) 4.298 (28.65%) 10.038 (66.92%)
ocsepp-plmn-ingress-gateway/plmn-ingress-gateway 9.687 (27.68%) 19.276 (55.08%) 2.287 (15.25%) 7.357 (49.05%) 1.810 (12.07%) 7.370 (49.13%)
ocsepp-pn32c-svc/pn32c-svc 0.009 (0.22%) 0.875 (21.88%) 0.008 (0.20%) 0.811 (20.26%) 0.008 (0.20%) 0.959 (23.97%)
ocsepp-pn32f-svc/pn32f-svc 5.151 (14.72%) 8.717 (15.57%) 4.873 (32.49%) 4.770 (19.87%) 4.582 (30.55%) 4.993 (20.80%)
ocsepp-sepp-nrf-client-nfdiscovery/nrf-client-nfdiscovery 0.007 (0.18%) 1.026 (25.66%) 0.007 (0.18%) 1.001 (25.02%) 0.018 (0.45%) 1.009 (25.22%)
ocsepp-sepp-nrf-client-nfmanagement/nrf-client-nfmanagement 0.008 (0.20%) 1.082 (27.05%) 0.026 (0.65%) 1.075 (26.88%) 0.010 (0.25%) 1.076 (26.90%)
TOTAL CPU/MEM USAGE 44.878 101.879 20.133 48.684 19.570 50.027

Note:

  • Mi- Megabytes
  • Gi- Gigabytes
  • m- millicores
  • CPU Resource per container without unit is represented in cores

3.1.2 Traffic and Latency

The following tables describe the traffic and latency details:

Traffic Details

Table 3-4 Traffic Details

TPS Site 1 Site 2 Site 3
PLMN-IGW-requests-rate 8468.683 1499.967 1472.633
CN32F-requests-rate 7755.933 1292.583 1292.600
N32-IGW-requests-rate 3476.700 3473.800 3475.417
N32-EGW-requests-rate 7756.100 1293.533 1292.317
PN32F-requests-rate 3174.883 3173.333 3173.850
PLMN-EGW-requests-rate 3880.850 3878.467 3878.550
Total TPS 5752.167 2435.167 2430.833

Latency Details

Table 3-5 Latency Details

NF Service Latency( In MilliSecond) Site 1 Site 2 Site 3
Ingress Gateway(s) 0.056 0.056 0.056
Egress Gateway(s) 0.059 0.058 0.059
cn32f(s) 0.031 0.031 0.031
pn32f(s) 0.026 0.026 0.026

3.1.3 Results

The results are:

  • csepp_call success rate: 99.801% (Failures are attributed as follows: 0.164% due to Global PLMN ingress rate limiting with a 428 error code, 0.032% due to a 406 error code related to Cat-3, 0.001% due to a 408 error code (timeout), and 0.001% due to a 404 error code.)
  • psepp_call success rate: 99.951% (Failures are attributed as follows: 0.048% due to a 406 error code related to Cat-3.)
  • psepp2_call success rate: 99.944% (Failures are attributed as follows: 0.055% due to a 406 error code related to Cat-3, and 0.001% due to a 404 error code.)
  • psepp3_call success rate: 99.944% (Failures are attributed as follows: 0.055% due to a 406 error code related to Cat-3, and 0.001% due to a 404 error code.)
  • csepp_Avg_Latency_rate: 64.778 ms
  • psepp1_Avg_Latency_rate: 64.089 ms
  • psepp2_Avg_Latency_rate: 63.986 ms
  • psepp3_Avg_Latency_rate: 63.953 ms
  • No pod restarts are observed
  • Run with 50ms server delay
  • Features enabled:
    • Topology Hiding
    • Security Counter Measure features:
      • Cat-0 SBI Message Schema Validation Feature
      • Cat-1 NRF Service API Query Parameters Validation
      • Cat-1 Service API Validation Feature
      • Cat -2 Network ID Validation Feature
      • Cat-3 Previous Location Check Feature
      • Cat-3 Time Check for Roaming Subscribers
    • Overload Control
    • 5G SBI Message Mediation Support
    • Steering of Roaming (SOR) Feature
    • Global Rate Limiting on Ingress Gateway of SEPP
    • Alternate Routing and Load Sharing based on the DNS SRV Record for Home Network Functions
    • LCI and OCI Header Feature
    • NRF Auto route feature