3 SEPP Benchmark Testing
This section provides information about the SEPP testcases run in different scenarios.
3.1 Test Scenario 1 - SEPP Performance for 44.8K MPS, 24Hrs Without any Feature Enabled.
This test scenario describes performance and capacity of SEPP and provides the benchmarking results for 44.8K MPS, 24Hrs without feature enabled and without any delay at server end.
3.1.1 Testcase and Setup Details
Traffic Model Details:
Call Mix:
Table 3-1 Call Mix
| NF-Consumer | NF-Producer | Reference Point ID | Traffic % |
|---|---|---|---|
| vAMF | hUDM | N8 | 34.29 |
| vAMF | hAUSF | N12 | 8.39 |
| vNRF | hNRF | N27 | 13.99 |
| vNSSF | hNSSF | N31 | 2.5 |
| vPCF | hPCF | N24 | 11.9 |
| vSMF | hUDM | N10 | 8.57 |
| vSMF | hSMF | N16 | 17.86 |
| vSMSF | hUDM | N21 | 2.5 |
Call Rate: Total 62K MPS: 31K MPS (Home PLMN) + 31K MPS (Visited PLMN)
Table 3-2 Setup Details
| Set up Details | |
|---|---|
| Active User | NA for SEPP |
| Execution Timeline | 24Hrs |
| Environment | Bare Metal |
| Cluster | Groove2 |
| Bastion-1 IP | 10.121.20.66 |
| OCCNE Version | 23.3.1 |
| cnDBTier | 23.3.0 |
| cSEPP | 23.3.1 |
| pSEPP | 23.3.1 |
| CNC Console | 23.3.0 |
| Set up Configuration |
|
Resource Footprint for cSEPP
Table 3-3 Resource Footprint for cSEPP
| Services | CPU Request Per Pod | CPU Limit Per Pod | Memory Request Per Pod (Gi) | Memory Limit Per Pod (Gi) | Replicas |
|---|---|---|---|---|---|
| ocsepp-appinfo | 2 | 1 | 1 | 2Gi | 1Gi |
| ocsepp-cn32c-svc | 2 | 2 | 2 | 2Gi | 2Gi |
| ocsepp-cn32f-svc | 7 | 5 | 5 | 8Gi | 8Gi |
| ocsepp-coherence-svc | 1 | 1 | 1 | 2Gi | 2Gi |
| ocsepp-config-mgr-svc | 1 | 2 | 2 | 2Gi | 2Gi |
| ocsepp-n32-egress-gateway | 7 | 5 | 5 | 5Gi | 5Gi |
| ocsepp-n32-ingress-gateway | 7 | 6 | 6 | 5Gi | 5Gi |
| ocsepp-nf-mediation | 2 | 8 | 8 | 8Gi | 8Gi |
| ocsepp-ocpm-config | 2 | 1 | 1 | 1Gi | 1Gi |
| ocsepp-performance | 2 | 2 | 2 | 4Gi | 200Mi |
| ocsepp-plmn-egress-gateway | 7 | 5 | 5 | 5Gi | 5Gi |
| ocsepp-plmn-ingress-gateway | 7 | 5 | 5 | 5Gi | 5Gi |
| ocsepp-pn32c-svc | 2 | 2 | 2 | 2Gi | 2Gi |
| ocsepp-pn32f-svc | 7 | 5 | 5 | 8Gi | 8Gi |
| ocsepp-sepp-nrf-client-nfdiscovery | 2 | 1 | 1 | 2Gi | 2Gi |
| ocsepp-sepp-nrf-client-nfmanagement | 1 | 1 | 1 | 1Gi | 1Gi |
Resource Footprint for pSEPP
Table 3-4 Resource Footprint for pSEPP
| Services | CPU Request Per Pod | CPU Limit Per Pod | Memory Request Per Pod (Gi) | Memory Limit Per Pod (Gi) | Replicas |
|---|---|---|---|---|---|
| ocsepp-cn32c-svc | 2 | 2 | 2 | 2Gi | 2Gi |
| ocsepp-cn32f-svc | 7 | 5 | 5 | 8Gi | 8Gi |
| ocsepp-coherence-svc | 1 | 1 | 1 | 2Gi | 2Gi |
| ocsepp-config-mgr-svc | 1 | 2 | 2 | 2Gi | 2Gi |
| ocsepp-n32-egress-gateway | 7 | 5 | 5 | 5Gi | 5Gi |
| ocsepp-n32-ingress-gateway | 7 | 6 | 6 | 5Gi | 5Gi |
| ocsepp-nf-mediation | 2 | 8 | 8 | 8Gi | 8Gi |
| ocsepp-ocpm-config | 2 | 1 | 1 | 1Gi | 1Gi |
| ocsepp-performance | 2 | 2 | 2 | 4Gi | 200Mi |
| ocsepp-plmn-egress-gateway | 7 | 5 | 5 | 5Gi | 5Gi |
| ocsepp-plmn-ingress-gateway | 7 | 5 | 5 | 5Gi | 5Gi |
| ocsepp-pn32c-svc | 2 | 2 | 2 | 2Gi | 2Gi |
| ocsepp-pn32f-svc | 7 | 5 | 5 | 8Gi | 8Gi |
| ocsepp-sepp-nrf-client-nfdiscovery | 2 | 1 | 1 | 2Gi | 2Gi |
| ocsepp-sepp-nrf-client-nfmanagement | 1 | 1 | 1 | 1Gi | 1Gi |
Resource Footprint for cnDBTier
Table 3-5 Resource Footprint for cnDBTier
| Services | CPU Request Per Pod | CPU Limit Per Pod | Memory Request Per Pod (Gi) | Memory Limit Per Pod (Gi) | Replicas |
|---|---|---|---|---|---|
| mysql-cluster-db-backup-manager-svc/db-backup-manager-svc | 1 | 100m | 100m | 128Mi | 128Mi |
| mysql-cluster-db-monitor-svc/db-monitor-svc | 1 | 1 | 1 | 1Gi | 1Gi |
| ndbappmysqld/init-sidecar | 2 | 100m | 100m | 256Mi | 256Mi |
| ndbappmysqld/mysqlndbcluster | 2 | 8 | 8 | 10Gi | 10Gi |
| ndbmgmd/db-infra-monitor-svc | 2 | 100m | 100m | 256Mi | 256Mi |
| ndbmgmd/mysqlndbcluster | 2 | 4 | 4 | 10Gi | 8Gi |
| ndbmtd/db-backup-executor-svc | 4 | 100m | 100m | 256Mi | 256Mi |
| ndbmtd/db-infra-monitor-svc | 4 | 100m | 100m | 256Mi | 256Mi |
| ndbmtd/mysqlndbcluster | 4 | 10 | 10 | 18Gi | 16Gi |
3.1.2 CPU and Memory Utilization
This section lists the CPU and memory utilization at both site1 and site2 for
Consumer SEPP (csepp) and Producer SEPP (psepp).
csepp-Site1
Table 3-6 csepp-Site1
| Microservice/Container | Pod Count | Overall CPU | Overall Memory |
|---|---|---|---|
| ocsepp-appinfo/appinfo | 2 | 0.02 (1%) | 0.49 (24.5%) |
| ocsepp-cn32c-svc/cn32c-svc | 2 | 0 (0%) | 1.06 (26.5%) |
| ocsepp-cn32f-svc/cn32f-svc | 7 | 11.12 (31.77%) | 9.58 (17.11%) |
| ocsepp-config-mgr-svc/config-mgr-svc | 1 | 0.01 (1%) | 0.57 (28.5%) |
| ocsepp-n32-egress-gateway/n32-egress-gateway | 7 | 14.13 (40.37%) | 7.31 (20.89%) |
| ocsepp-n32-ingress-gateway/n32-ingress-gateway | 7 | 13.22 (31.48%) | 13.11 (31.21%) |
| ocsepp-ocpm-config/config-server | 2 | 0.01 (0.25%) | 0.67 (16.75%) |
| ocsepp-performance/perf-info | 2 | 0.05 (1.25%) | 0.22 (55%) |
| ocsepp-plmn-egress-gateway/plmn-egress-gateway | 7 | 10.68 (30.51%) | 8.83 (25.23%) |
| ocsepp-plmn-ingress-gateway/plmn-ingress-gateway | 7 | 12.02 (34.34%) | 15.25 (43.57%) |
| ocsepp-pn32c-svc/pn32c-svc | 2 | 0 (0%) | 0.94 (23.5%) |
| ocsepp-pn32f-svc/pn32f-svc | 7 | 11.19 (31.97%) | 9.94 (17.75%) |
| ocsepp-sepp-nrf-client-nfdiscovery/nrf-client-nfdiscovery | 2 | 0.01 (0.5%) | 0.91 (22.75%) |
| ocsepp-sepp-nrf-client-nfmanagement/nrf-client-nfmanagement | 1 | 0 (0%) | 0.49 (49%) |
| ocsepp-nf-mediation/nf-mediation | 2 | 0 (0%) | 1.03 (6.44%) |
| ocsepp-coherence-svc/coherence-svc | 1 | 0 (0%) | 0.22 (11%) |
psepp-Site2
| Microservice/Container | Pod Count | Overall CPU | Overall Memory |
|---|---|---|---|
| ocsepp-appinfo/appinfo | 1 | 0.01 (1%) | 0.22 (22%) |
| ocsepp-cn32c-svc/cn32c-svc | 4 | 0.01 (0.13%) | 1.59 (19.88%) |
| ocsepp-cn32f-svc/cn32f-svc | 14 | 23.6 (47.2%) | 23.21 (29.01%) |
| ocsepp-config-mgr-svc/config-mgr-svc | 1 | 0.02 (1%) | 0.58 (29%) |
| ocsepp-n32-egress-gateway/n32-egress-gateway | 10 | 21.42 (42.84%) | 19.45 (38.9%) |
| ocsepp-n32-egress-gateway/update-service | 10 | 2.65 (26.5%) | 1.76 (17.6%) |
| ocsepp-n32-ingress-gateway/n32-ingress-gateway | 10 | 23.23 (46.46%) | 16.03 (32.06%) |
| ocsepp-n32-ingress-gateway/update-service | 10 | 2.58 (25.8%) | 1.71 (17.1%) |
| ocsepp-ocpm-config/config-server | 1 | 0 (0%) | 0.31 (31%) |
| ocsepp-performance/perf-info | 1 | 0.03 (0.38%) | 0.19 (1.19%) |
| ocsepp-plmn-egress-gateway/plmn-egress-gateway | 10 | 20.28 (40.56%) | 18.62 (37.24%) |
| ocsepp-plmn-egress-gateway/update-service | 10 | 2.72 (27.2%) | 1.75 (17.5%) |
| ocsepp-plmn-ingress-gateway/plmn-ingress-gateway | 10 | 22.68 (45.36%) | 25.9 (51.8%) |
| ocsepp-plmn-ingress-gateway/update-service | 10 | 2.69 (26.9%) | 1.72 (17.2%) |
| ocsepp-pn32c-svc/pn32c-svc | 2 | 0.01 (0.25%) | 0.99 (24.75%) |
| ocsepp-pn32f-svc/pn32f-svc | 10 | 19.87 (39.74%) | 13.93 (17.41%) |
| ocsepp-sepp-nrf-client-nfdiscovery/nrf-client-nfdiscovery | 1 | 0 (0%) | 0.29 (9.67%) |
| ocsepp-sepp-nrf-client-nfmanagement/nrf-client-nfmanagement | 1 | 0 (0%) | 0.31 (31%) |
cnDBTier_csepp
Table 3-7 csepp-cndb-spad-perf
| Microservice/Container | Pod Count | Overall CPU | Overall Memory |
|---|---|---|---|
| mysql-cluster/db-backup-manager-svc | 1 | 0 (0%) | 0.04 (32%) |
| mysql-cluster/db-monitor-svc | 1 | 0.01 (5%) | 0.23 (47.13%) |
| mysql-cluster/delhi-mumbai-replication-svc | 1 | 0 (0%) | 0.4 (20%) |
| ndbappmysqld/init-sidecar | 2 | 0.01 (5%) | 0 (0%) |
| ndbappmysqld/mysqlndbcluster | 2 | 0.05 (0.31%) | 1.69 (8.45%) |
| ndbmgmd/mysqlndbcluster | 3 | 0.03 (0.25%) | 0.05 (0.21%) |
| ndbmtd/db-backup-executor-svc | 4 | 0 (0%) | 0.05 (10%) |
| ndbmtd/mysqlndbcluster | 4 | 0.15 (0.47%) | 59.52 (82.67%) |
| ndbmysqld/init-sidecar | 2 | 0.01 (5%) | 0 (0%) |
| ndbmysqld/mysqlndbcluster | 2 | 0.03 (0.38%) | 3.3 (16.5%) |
cnDBTier_csepp
Table 3-8 csepp-cndb-spad-perf2
| Microservice/Container | Pod Count | Overall CPU | Overall Memory |
|---|---|---|---|
| ocsepp-appinfo/appinfo | 2 | 0.02 (1%) | 0.49 (24.5%) |
| ocsepp-cn32c-svc/cn32c-svc | 2 | 0.01 (0.25%) | 0.79 (19.75%) |
| ocsepp-cn32f-svc/cn32f-svc | 7 | 11.01 (31.46%) | 9.23 (16.48%) |
| ocsepp-config-mgr-svc/config-mgr-svc | 1 | 0.01 (1%) | 0.54 (27%) |
| ocsepp-n32-egress-gateway/n32-egress-gateway | 7 | 14.2 (40.57%) | 7.44 (21.26%) |
| ocsepp-n32-ingress-gateway/n32-ingress-gateway | 7 | 13.44 (32%) | 12.45 (29.64%) |
| ocsepp-ocpm-config/config-server | 2 | 0.01 (0.25%) | 0.68 (17%) |
| ocsepp-performance/perf-info | 2 | 0.05 (1.25%) | 0.23 (57.5%) |
| ocsepp-plmn-egress-gateway/plmn-egress-gateway | 7 | 10.36 (29.6%) | 9.28 (26.51%) |
| ocsepp-plmn-ingress-gateway/plmn-ingress-gateway | 7 | 12.76 (36.46%) | 16.17 (46.2%) |
| ocsepp-pn32c-svc/pn32c-svc | 2 | 0.01 (0.25%) | 1.06 (26.5%) |
| ocsepp-pn32f-svc/pn32f-svc | 7 | 10.6 (30.29%) | 9.92 (17.71%) |
| ocsepp-sepp-nrf-client-nfdiscovery/nrf-client-nfdiscovery | 2 | 0 (0%) | 0.95 (23.75%) |
| ocsepp-sepp-nrf-client-nfmanagement/nrf-client-nfmanagement | 1 | 0 (0%) | 0.49 (49%) |
| ocsepp-nf-mediation/nf-mediation | 2 | 0 (0%) | 1.12 (7%) |
| ocsepp-coherence-svc/coherence-svc | 1 | 0.01 (0.5%) | 0.22 (11%) |
cnDBTier_psepp
Table 3-9 psepp-cndb-spad-perf
| Microservice/Container | Pod Count | Overall CPU | Overall Memory |
|---|---|---|---|
| mysql-cluster/db-backup-manager-svc | 1 | 0 (0%) | 0.05 (39.06%) |
| mysql-cluster/db-monitor-svc | 1 | 0 (0%) | 0.39 (39%) |
| ndbappmysqld/mysqlndbcluster | 2 | 0.04 (0.25%) | 7.54 (37.7%) |
| ndbappmysqld/init-sidecar | 2 | 0 (0%) | 0.01 (1.95%) |
| ndbmgmd/mysqlndbcluster | 2 | 0.02 (0.25%) | 0.05 (0.31%) |
| ndbmgmd/db-infra-monitor-svc | 2 | 0 (0%) | 0.03 (5.86%) |
| ndbmtd/mysqlndbcluster | 4 | 0.09 (0.23%) | 29.86 (46.66%) |
| ndbmtd/db-backup-executor-svc | 4 | 0 (0%) | 0.14 (13.67%) |
| ndbmtd/db-infra-monitor-svc | 4 | 0.01 (2.5%) | 0.08 (15.63%) |
cnDBTier_psepp
Table 3-10 psepp-cndb-spad-perf2
| Microservice/Container | Pod Count | Overall CPU | Overall Memory |
|---|---|---|---|
| mysql-cluster/db-backup-manager-svc | 1 | 0 (0%) | 0.05 (39.06%) |
| mysql-cluster/db-monitor-svc | 1 | 0 (0%) | 0.37 (37%) |
| ndbappmysqld/mysqlndbcluster | 2 | 0.04 (0.25%) | 6.29 (31.45%) |
| ndbappmysqld/init-sidecar | 2 | 0 (0%) | 0.01 (1.95%) |
| ndbmgmd/mysqlndbcluster | 2 | 0.02 (0.25%) | 0.05 (0.31%) |
| ndbmgmd/db-infra-monitor-svc | 2 | 0 (0%) | 0.03 (5.86%) |
| ndbmtd/mysqlndbcluster | 4 | 0.08 (0.2%) | 29.84 (46.63%) |
| ndbmtd/db-backup-executor-svc | 4 | 0 (0%) | 0.14 (13.67%) |
| ndbmtd/db-infra-monitor-svc | 4 | 0.01 (2.5%) | 0.08 (15.63%) |
3.1.3 TPS and DB Statistics
This section lists the TPS (Transactions Per Second) and DB (Database) Statistics
for Consumer SEPP (csepp) and Producer SEPP (psepp).
TPS (Transactions Per Second)
Table 3-11 TPS (Transactions Per Second)
| TPS | cSEPP | pSEPP |
|---|---|---|
| PLMN IGW | 11.2K TPS | 11.2K TPS |
| CN32F | 11.2K TPS | 11.2K TPS |
| N32 EGW | 11.2K TPS | 11.2K TPS |
| N32 IGW | 11.2K TPS | 11.2K TPS |
| PN32F | 11.2K TPS | 11.2K TPS |
| PLMN EGW | 11.2K TPS | 11.2K TPS |
DB (Database) Statistics
Table 3-12 DB (Database) Statistics
| DB Stats | csepp-cndb-spad-perf | psepp-cndb-spad-perf |
|---|---|---|
| Write Rate | 0.251 | 0.251 |
| Commit Rate | 1.63 | 1.62 |
| PVC Utilization(GB) | 1.42 | 1.56 |
| Read Rate | 13.1 | 13.4 |
csepp: NF Service Latency
Table 3-13 csepp: NF Service Latency
| NF Service Latency | Min. | Max. | Avg. |
|---|---|---|---|
| IGW(T2) (s) | 0.014 | 0.21 | 0.003 |
| pn32f(T3) (s) | 0.022 | 1.32 | 0.51 |
| cn32f (T4) (s) | 0.431 | 0.432 | 0.312 |
| EGW(T5) (s) | 0.01 | 0.06 | 0.02 |
|
Procedural Latency(Perfgo)(T1) (ms) |
NA | NA | 10.1 |
psepp: NF Service Latency
Table 3-14 psepp: NF Service Latency
| NF Service Latency | Min. | Max. | Avg. |
|---|---|---|---|
| IGW(T2) (s) | 0.014 | 0.21 | 0.003 |
| pn32f(T3) (s) | 0.024 | 1.21 | 0.21 |
| cn32f (T4) (s) | 0.323 | 0.451 | 0.512 |
| EGW(T5) (s) | 0.01 | 0.05 | 0.02 |
|
Procedural Latency(Perfgo)(T1(ms) |
NA | NA | 9.8 |