3 Benchmark Testing
This section describes the environment used for benchmarking Oracle Communications Cloud Native Core, Network Slice Selection Function (NSSF).
The default values or recommendations for any required software or resource are available from the third-party vendors. Benchmarking should be performed with the settings described in this section. Operators may choose different values.
The benchmark testing is performance testing with the fine-tuning done to improve the performance of NSSF. It is performed in the CNE environment.
3.1 Test Scenario-1: NSSF Performance with 10.5K TPS
3.1.1 Overview
To qualify the test run, you can consider the following elements:
- CPU and Memory utilization
- Ingress and Egress traffic rate
- Success rate
- Message request and response processing time
- Infrastructure resource requirements and utilization
Note:
The performance and capacity of the NSSF system may vary based on the call model, Feature or Interface configuration, and underlying CNE and hardware environment.3.1.2 NSSF Features
Table 3-1 NSSF Features
| NSSF Features | Status for benchmarking |
|---|---|
| Auto-Population of Configuration Based on NsAvailability Update | ENABLED |
| Handover from EPS to 5G | ENABLED |
| Subscription Modification Feature | ENABLED |
| Optimized NSSAI Availability Data Encoding and TAI Range | ENABLED |
| Support Indirect Communication | ENABLED |
| Multiple PLMN Support | ENABLED |
| Integration with ASM | ENABLED |
| Supports Compression Using Accept-Encoding or Content-Encoding gzip | ENABLED |
| OAuth Access Token Based Authorization with K-id | ENABLED |
| Overload control | ENABLED |
Note:
Apart from these features being enabled, rest of the configurations have been made default.3.1.3 Software Test Constraints
Table 3-2 Software Test Constraints
| Test Constraint | Details |
|---|---|
| NSSF Version | 24.3.0 |
| Sidecar ENABLED/DISABLED | Enabled |
| TLS ENABLED/DISABLED | Disabled |
3.1.4 NSSF Call-Mix
NsSelection
Table 3-3 NsSelection
| Get Request Type | Traffic % | TPS |
|---|---|---|
| Initial Registration | 10% | 350 |
| UE Config update | 5% | 175 |
| PDU establishment | 80% | 2900 |
| EPS to 5G HO | 5% | 175 |
NsAvailability
NsAvailability traffic is purely transactional, and records only 2 TPS.
3.1.5 Test Observations
The NSSF performance test provides insights into the system's ability to handle various network activities. The test simulates a mix of traffic, focusing on establishing new user connections (10%), data transmission through PDU sessions (80%), and network management tasks such as UE configuration updates (5%) and handovers (5%).
This distribution reflects the typical workload on the NSSF in a real-world network. Additionally, the NsAvailability test assesses the system's responsiveness to updates originating from network functions. This traffic is capped at a lower rate (2 transactions per second).
3.1.5.1 General Observations
The following table provides observation data for the performance test that can be used for benchmark testing to increase the traffic rate.
Table 3-4 General Observations
| Parameter | Values |
|---|---|
| Test Duration | 3 days and 15 hours |
| TPS Achieved | 10.5K |
3.1.5.2 Resource Utilization
The following table describes NSSF microservices and their utilization.
CNE Common Applications
Table 3-5 CNE Common Applications
| Service | Average vCPU | Average Memory (Gi) |
|---|---|---|
| stack-kube-prometheus | 1.045 | 216.5 |
| occne-opensearch-cluster-master | 0.0045 | 8.265 |
| occne-opensearch-cluster-data | 0.012 | 102 |
| occne-opensearch-cluster-client | 0.0008 | 12.87 |
NSSF Services
Table 3-6 NSSF Services Resource Utilization
| Service | Total CPU Usage (m) | Total Memory Usage (Mi) |
|---|---|---|
| alternate-route | 3 | 392 |
| appinfo | 22 | 255 |
| egress-gateway | 6 | 1851 |
| ingress-gateway | 12901 | 16681 |
| nsauditor | 2 | 438 |
| nsavailability | 40 | 2114 |
| nsconfig | 8 | 516 |
| nsselection | 13577 | 12991 |
| nssubscription | 1 | 475 |
| nrf-client-nfdiscovery | 6 | 965 |
| nrf-client-nfmanagement | 8 | 1053 |
| config-server | 2 | 399 |
| perf-info | 44 | 137 |
ASM Sidecar
The following table provides observed values of ASM Sidecar.
Table 3-7 ASM Sidecar
| Service | Total vCPU (m) | Total Memory (Mi) |
|---|---|---|
| alternate-route | 4 | 133 |
| appinfo | 6 | 146 |
| egress-gateway | 7 | 281 |
| ingress-gateway | 3505 | 851 |
| nsauditor | 5 | 138 |
| nsavailability | 21 | 292 |
| nsconfig | 9 | 148 |
| nsselection | 6256 | 2087 |
| nssubscription | 4 | 137 |
| nrf-client-nfdiscovery | 9 | 286 |
| nrf-client-nfmanagement | 12 | 286 |
| config-server | 7 | 149 |
| perf-info | 7 | 139 |
cnDBTier Services
The following table provides observed values of cnDBTier services.
Table 3-8 cnDBTier Services
| Service Name | Total vCPU (m) | Total Memory (Mi) |
|---|---|---|
| mysql-cluster-db-backup-manager-svc | 1 | 58 |
| mysql-cluster-db-monitor-svc | 4 | 1094 |
| mysql-cluster-site1-site2-replication-svc | 4 | 250 |
| mysql-cluster-site1-site3-replication-svc | 4 | 206 |
| ndbappmysqld | 10040 | 15423 |
| ndbmgmd | 31 | 115 |
| ndbmtd | 8081 | 63154 |
| ndbmysqld | 115 | 3527 |
cnDBTier with ASM
Table 3-9 cnDBTier with ASM
| Service Name | Total vCPU (m) | Total Memory (Mi) |
|---|---|---|
| mysql-cluster-db-backup-manager-svc | 3 | 111 |
| mysql-cluster-db-monitor-svc | 4 | 122 |
| mysql-cluster-site1-site2-replication-svc | 3 | 112 |
| mysql-cluster-site1-site3-replication-svc | 3 | 125 |
| ndbappmysqld | 3829 | 560 |
| ndbmgmd | 19 | 267 |
| ndbmtd | 5711 | 551 |
| ndbmysqld | 39 | 556 |
3.1.5.3 Latency Observations
The following table provides observed values in latency:
Table 3-10 Latency Parameters
| Latency Parameter | Details (Avg) |
|---|---|
| NSSelection success percentage | 100 |
| Ingress Gateway latency of NSSelection | 12.2 ms |
| NSAvailability Success percentage | 99.99 |
| Ingress Gateway latency of NSAvailability latency | 29.6 ms |
| Ingress success rate | 100 |
Table 3-11 NsSelection Ingress Gateway Latency
| Percentile | Min (ms) | Max (ms) | Avg (ms) | Current (ms) |
|---|---|---|---|---|
| 50% | 5.11 | 5.11 | 5.11 | 5.11 |
| 90% | 8.78 | 9.31 | 8.81 | 9.04 |
| 95% | 9.31 | 10.1 | 9.88 | 9.94 |
| 99% | 10.5 | 215 | 12.0 | 11.2 |
Table 3-12 NsSelection Application Latency
| Percentile | Min (ms) | Max (ms) | Avg (ms) | Current (ms) |
|---|---|---|---|---|
| 50% | 5.46 | 5.71 | 5.57 | 5.50 |
| 90% | 5.98 | 6.44 | 6.20 | 6.22 |
| 95% | 6.16 | 6.85 | 6.55 | 6.64 |
| 99% | 7.10 | 233 | 9.13 | 8.02 |
Table 3-13 NsAvailability Ingress Gateway Latency
| Percentile | Min (ms) | Max (ms) | Avg (ms) | Current (ms) |
|---|---|---|---|---|
| 50% | 13.4 | 16.0 | 14.4 | 14.6 |
| 90% | 14.6 | 39.3 | 16.1 | 18.0 |
| 95% | 14.8 | 39.5 | 16.4 | 18.2 |
| 99% | 14.9 | 68.9 | 17.3 | 18.5 |
Table 3-14 NsAvailability Application Latency
| Percentile | Min (ms) | Max (ms) | Avg (ms) | Current (ms) |
|---|---|---|---|---|
| 50% | 11.9 | 16.7 | 14.3 | 12.9 |
| 90% | 0.3 | 31.3 | 15.8 | 14.2 |
| 95% | 16.1 | 49.7 | 16.8 | 14.3 |
| 99% | 15.4 | 50.8 | 17.7 | 15.2 |