3 Benchmark Testing

This section describes the environment used for benchmarking Oracle Communications Cloud Native Core, Network Slice Selection Function (NSSF).

The default values or recommendations for any required software or resource are available from the third-party vendors. Benchmarking should be performed with the settings described in this section. Operators may choose different values.

The benchmark testing is performance testing with the fine-tuning done to improve the performance of NSSF. It is performed in the CNE environment.

3.1 Test Scenario-1: NSSF Performance with 10.5K TPS

3.1.1 Overview

To qualify the test run, you can consider the following elements:

  • CPU and Memory utilization
  • Ingress and Egress traffic rate
  • Success rate
  • Message request and response processing time
  • Infrastructure resource requirements and utilization

Note:

The performance and capacity of the NSSF system may vary based on the call model, Feature or Interface configuration, and underlying CNE and hardware environment.

3.1.2 NSSF Features

Table 3-1 NSSF Features

NSSF Features Status for benchmarking
Enhanced Computation of AllowedNSSAI in NSSF ENABLED
Auto-Population of Configuration Based on NsAvailability Update ENABLED
Handover from EPS to 5G ENABLED
Subscription Modification Feature ENABLED
Optimized NSSAI Availability Data Encoding and TAI Range ENABLED
Support Indirect Communication ENABLED
Multiple PLMN Support ENABLED
Integration with ASM ENABLED
Supports Compression Using Accept-Encoding or Content-Encoding gzip ENABLED
OAuth Access Token Based Authorization with K-id ENABLED
Overload control ENABLED

Note:

Apart from these features being enabled, rest of the configurations have been made default.

3.1.3 Software Test Constraints

Table 3-2 Software Test Constraints

Test Constraint Details
NSSF Version 25.1.100
cnDBTier 25.1.1xx
Sidecar ENABLED/DISABLED Enabled
TLS ENABLED/DISABLED Disabled

3.1.4 NSSF Call-Mix

NsSelection

Table 3-3 NsSelection

Get Request Type Traffic % TPS
Initial Registration 10% 350
UE Config update 5% 175
PDU establishment 80% 2900
EPS to 5G HO 5% 175

NsAvailability

NsAvailability traffic is purely transactional, and records only 2 TPS.

3.1.5 Test Observations

The NSSF performance test provides insights into the system's ability to handle various network activities. The test simulates a mix of traffic, focusing on establishing new user connections (10%), data transmission through PDU sessions (80%), and network management tasks such as UE configuration updates (5%) and handovers (5%).

This distribution reflects the typical workload on the NSSF in a real-world network. Additionally, the NsAvailability test assesses the system's responsiveness to updates originating from network functions. This traffic is capped at a lower rate (2 transactions per second).

3.1.5.1 General Observations

The following table provides observation data for the performance test that can be used for benchmark testing to increase the traffic rate.

Table 3-4 General Observations

Parameter Values
Test Duration 12 hours
TPS Achieved 10.5K
3.1.5.2 Resource Utilization

CNE Common Applications

The following table provides observed values for average CPU and memeory usage by CNE common applications:

Table 3-5 CNE Common Applications

CNE Services Avg CPU Avg Memory
alertmanager-occne-kube-prom-stack-kube-alertmanager-0 0.00239 239 MB
alertmanager-occne-kube-prom-stack-kube-alertmanager-1 0.00208 264 MB
occne-alertmanager-snmp-notifier-5b6ffc5d7d-vp2vz 0.000981 59.4 MB
occne-bastion-controller-6f9bcf7787-j7qm6 0.0386 250 MB
occne-fluentd-opensearch-2k7kr 0.19 3.99 GB
occne-fluentd-opensearch-5dwgs 0.114 3.52 GB
occne-fluentd-opensearch-5qqk2 0.0437 3.52 GB
occne-fluentd-opensearch-5qxr8 0.146 3.62 GB
occne-fluentd-opensearch-675bc 0.165 3.46 GB
occne-fluentd-opensearch-9sh4p 0.228 3.98 GB
occne-fluentd-opensearch-bqdtq 0.118 3.68 GB
occne-fluentd-opensearch-c9t9w 0.174 4.01 GB
occne-fluentd-opensearch-gsb6t 0.154 3.57 GB
occne-fluentd-opensearch-jhrnr 0.151 3.56 GB
occne-fluentd-opensearch-khvs9 0.204 3.97 GB
occne-fluentd-opensearch-mzv4b 0.151 3.54 GB
occne-fluentd-opensearch-p752q 0.15 3.36 GB
occne-fluentd-opensearch-rh4wq 0.142 3.68 GB
occne-fluentd-opensearch-s6mzk 0.127 3.67 GB
occne-fluentd-opensearch-srzgw 0.267 3.94 GB
occne-fluentd-opensearch-sxbdn 0.232 3.91 GB
occne-fluentd-opensearch-vd2hg 0.0104 3.19 GB
occne-fluentd-opensearch-xghvs 0.234 3.92 GB
occne-fluentd-opensearch-xxb7m 0.184 3.44 GB
occne-fluentd-opensearch-z9mjn 0.237 3.97 GB
occne-fluentd-opensearch-zcsc9 0.198 3.83 GB
occne-kube-prom-stack-grafana-7f89d4767-kskmb 0.00194 773 MB
occne-kube-prom-stack-kube-operator-6596bc4786-6h5gf 0.00188 222 MB
occne-kube-prom-stack-kube-state-metrics-586f95f8b8-m8nfj 0.00468 346 MB
occne-kube-prom-stack-prometheus-node-exporter-4g6pd 0.00665 131 MB
occne-kube-prom-stack-prometheus-node-exporter-4qt8m 0.00489 134 MB
occne-kube-prom-stack-prometheus-node-exporter-4vwwb 0.00635 134 MB
occne-kube-prom-stack-prometheus-node-exporter-6lrpm 0.00626 131 MB
occne-kube-prom-stack-prometheus-node-exporter-7jrmk 0.00534 143 MB
occne-kube-prom-stack-prometheus-node-exporter-97mbp 0.00596 140 MB
occne-kube-prom-stack-prometheus-node-exporter-cvdvb 0.00637 131 MB
occne-kube-prom-stack-prometheus-node-exporter-d7z72 0.00653 150 MB
occne-kube-prom-stack-prometheus-node-exporter-dl6p9 0.00559 131 MB
occne-kube-prom-stack-prometheus-node-exporter-f899p 0.00481 141 MB
occne-kube-prom-stack-prometheus-node-exporter-f922x 0.00526 128 MB
occne-kube-prom-stack-prometheus-node-exporter-fthcz 0.00585 128 MB
occne-kube-prom-stack-prometheus-node-exporter-gf44r 0.00722 143 MB
occne-kube-prom-stack-prometheus-node-exporter-n7v98 0.00188 74.0 MB
occne-kube-prom-stack-prometheus-node-exporter-nx6q7 0.00603 130 MB
occne-kube-prom-stack-prometheus-node-exporter-qlvfq 0.0052 128 MB
occne-kube-prom-stack-prometheus-node-exporter-qmpz4 0.00667 139 MB
occne-kube-prom-stack-prometheus-node-exporter-qtvs8 0.00557 133 MB
occne-kube-prom-stack-prometheus-node-exporter-sz8w6 0.00494 121 MB
occne-kube-prom-stack-prometheus-node-exporter-tfcfb 0.00522 135 MB
occne-kube-prom-stack-prometheus-node-exporter-tgvl4 0.0054 137 MB
occne-kube-prom-stack-prometheus-node-exporter-thkb4 0.00207 72.8 MB
occne-kube-prom-stack-prometheus-node-exporter-tpn4s 0.00198 73.5 MB
occne-kube-prom-stack-prometheus-node-exporter-v5qv9 0.00632 129 MB
occne-kube-prom-stack-prometheus-node-exporter-wbn52 0.0064 139 MB
occne-metallb-controller-7c6974d747-q4888 0.0012 200 MB
occne-metallb-speaker-49rbb 0.0063 194 MB
occne-metallb-speaker-5cx2g 0.00543 198 MB
occne-metallb-speaker-6dz6m 0.00639 178 MB
occne-metallb-speaker-6m57x 0.00503 198 MB
occne-metallb-speaker-8kb9s 0.00594 198 MB
occne-metallb-speaker-dw8bx 0.00526 197 MB
occne-metallb-speaker-fnkft 0.00499 197 MB
occne-metallb-speaker-gv926 0.00531 171 MB
occne-metallb-speaker-gz9wm 0.00499 198 MB
occne-metallb-speaker-jx4wl 0.0052 201 MB
occne-metallb-speaker-kdkn5 0.00611 199 MB
occne-metallb-speaker-ksjk6 0.00546 198 MB
occne-metallb-speaker-kw8mk 0.0061 201 MB
occne-metallb-speaker-ltxqs 0.00604 199 MB
occne-metallb-speaker-mqlvw 0.0056 199 MB
occne-metallb-speaker-p4wtq 0.0062 202 MB
occne-metallb-speaker-s989h 0.00632 200 MB
occne-metallb-speaker-snffx 0.00487 198 MB
occne-metallb-speaker-t5tgm 0.00611 194 MB
occne-metallb-speaker-tx8bf 0.00643 200 MB
occne-metallb-speaker-vlhpr 0.00591 201 MB
occne-metallb-speaker-xtjxb 0.00663 199 MB
occne-metrics-server-84649bc477-vsnpf 0.0118 321 MB
occne-opensearch-cluster-client-0 0.113 4.29 GB
occne-opensearch-cluster-client-1 0.000385 4.15 GB
occne-opensearch-cluster-client-2 0.000397 4.18 GB
occne-opensearch-cluster-data-0 0.00386 19.5 GB
occne-opensearch-cluster-data-1 0.00382 19.5 GB
occne-opensearch-cluster-data-2 0.00374 19.5 GB
occne-opensearch-cluster-data-3 0.00396 19.6 GB
occne-opensearch-cluster-data-4 0.00384 19.5 GB
occne-opensearch-cluster-master-0 0.0036 2.84 GB
occne-opensearch-cluster-master-1 0.00191 2.70 GB
occne-opensearch-cluster-master-2 0.00198 2.70 GB
occne-opensearch-dashboards-56784fcd58-nmjtc 0.0487 401 MB
occne-promxy-apigw-nginx-69ff88b5fd-csqvk 0 13.7 MB
occne-promxy-apigw-nginx-69ff88b5fd-v227f 0 13.6 MB
occne-promxy-c75bf699d-ttbxr 0.000268 253 MB
occne-tracer-jaeger-agent-566ml 0.000096 22.7 MB
occne-tracer-jaeger-agent-79qjh 0.0001 61.8 MB
occne-tracer-jaeger-agent-82926 9.14E-05 61.6 MB
occne-tracer-jaeger-agent-8t728 0.000111 61.6 MB
occne-tracer-jaeger-agent-92j8j 0.000115 61.8 MB
occne-tracer-jaeger-agent-9rb8n 0.000103 61.2 MB
occne-tracer-jaeger-agent-b4p9s 0.000116 60.9 MB
occne-tracer-jaeger-agent-bl7g2 8.44E-05 61.5 MB
occne-tracer-jaeger-agent-cgsmv 9.18E-05 62.1 MB
occne-tracer-jaeger-agent-g2v5r 0.000104 61.5 MB
occne-tracer-jaeger-agent-h7tnw 0.000105 60.8 MB
occne-tracer-jaeger-agent-hhjv9 0.000105 61.3 MB
occne-tracer-jaeger-agent-k8db4 0.00011 61.7 MB
occne-tracer-jaeger-agent-llp6n 0.000105 61.6 MB
occne-tracer-jaeger-agent-lnkf9 0.000102 62.0 MB
occne-tracer-jaeger-agent-ltjz9 0.000104 60.8 MB
occne-tracer-jaeger-agent-m7dq8 0.00012 61.3 MB
occne-tracer-jaeger-agent-mc5mp 9.05E-05 60.1 MB
occne-tracer-jaeger-agent-p54qq 0.000091 60.7 MB
occne-tracer-jaeger-agent-tg2t8 9.95E-05 61.4 MB
occne-tracer-jaeger-agent-wcsvs 0.000113 60.1 MB
occne-tracer-jaeger-agent-zxwkx 0.000107 61.3 MB
occne-tracer-jaeger-collector-7fdd4c8587-vqm9q 0.016 120 MB
occne-tracer-jaeger-query-78f4bd8b76-zmsjz 0.00144 144 MB
prometheus-occne-kube-prom-stack-kube-prometheus-0 0.0972 115 GB
prometheus-occne-kube-prom-stack-kube-prometheus-1 0.0969 115 GB

NSSF Services

The following table provides observed values of NSSF Services:

Table 3-6 NSSF Services

NAME Container Name CPU(cores) MEMORY(bytes)
ocnssf-alternate-route-5d95b6764b-nq7z5 alternate-route 4m 376Mi
ocnssf-appinfo-689bf68bc5-j4vcc appinfo 26m 264Mi
ocnssf-egress-gateway-f5f5d6cc5-7ctc5 egress-gateway 4m 667Mi
ocnssf-egress-gateway-f5f5d6cc5-fl5wq egress-gateway 3m 753Mi
ocnssf-ingress-gateway-5c46b97b7b-nmnxn ingress-gateway 833m 2017Mi
ocnssf-ingress-gateway-5c46b97b7b-phfqd ingress-gateway 894m 1942Mi
ocnssf-ingress-gateway-5c46b97b7b-rwxtg ingress-gateway 871m 2049Mi
ocnssf-ingress-gateway-5c46b97b7b-tnzqr ingress-gateway 839m 2002Mi
ocnssf-ingress-gateway-5c46b97b7b-x2ltj ingress-gateway 1038m 2044Mi
ocnssf-nsauditor-7474d9c8c7-zdfsh nsauditor 6m 481Mi
ocnssf-nsavailability-64655fbdc5-dqvf4 nsavailability 10m 706Mi
ocnssf-nsavailability-64655fbdc5-xk692 nsavailability 8m 723Mi
ocnssf-nsconfig-75969f79c4-dkdvs nsconfig 7m 622Mi
ocnssf-nsselection-74675666df-5rccg nsselection 483m 739Mi
ocnssf-nsselection-74675666df-7klp4 nsselection 480m 761Mi
ocnssf-nsselection-74675666df-9nrb5 nsselection 466m 722Mi
ocnssf-nsselection-74675666df-9x9wh nsselection 440m 640Mi
ocnssf-nsselection-74675666df-l8qb5 nsselection 450m 663Mi
ocnssf-nsselection-74675666df-lkz6d nsselection 458m 772Mi
ocnssf-nsselection-74675666df-qfbs6 nsselection 471m 655Mi
ocnssf-nsselection-74675666df-rp92c nsselection 490m 713Mi
ocnssf-nsselection-74675666df-sd7vc nsselection 456m 678Mi
ocnssf-nssubscription-57f66f5f7c-dnjc8 nssubscription 1m 477Mi
ocnssf-ocnssf-nrf-client-nfdiscovery-74d68f549d-j6lbm nrf-client-nfdiscovery 3m 476Mi
ocnssf-ocnssf-nrf-client-nfdiscovery-74d68f549d-jhh6l nrf-client-nfdiscovery 2m 481Mi
ocnssf-ocnssf-nrf-client-nfmanagement-6c85b94d7b-c2zkd nrf-client-nfmanagement 5m 532Mi
ocnssf-ocnssf-nrf-client-nfmanagement-6c85b94d7b-hr6d7 nrf-client-nfmanagement 3m 488Mi
ocnssf-ocpm-config-86c75cf4d6-r2djc config-server 3m 384Mi
ocnssf-performance-6d5d859bf7-l4qht perf-info 48m 134Mi

NSSF Services Sidecar

The following table provides observed values of NSSF ASM sidecar:

Table 3-7 NSSF Services Sidecar

NAME Container Name CPU(cores) MEMORY(bytes)
ocnssf-alternate-route-5d95b6764b-nq7z5 istio-proxy 6m 154Mi
ocnssf-appinfo-689bf68bc5-j4vcc istio-proxy 7m 183Mi
ocnssf-egress-gateway-f5f5d6cc5-7ctc5 istio-proxy 5m 155Mi
ocnssf-egress-gateway-f5f5d6cc5-fl5wq istio-proxy 6m 182Mi
ocnssf-ingress-gateway-5c46b97b7b-nmnxn istio-proxy 465m 188Mi
ocnssf-ingress-gateway-5c46b97b7b-phfqd istio-proxy 447m 185Mi
ocnssf-ingress-gateway-5c46b97b7b-rwxtg istio-proxy 433m 198Mi
ocnssf-ingress-gateway-5c46b97b7b-tnzqr istio-proxy 436m 210Mi
ocnssf-ingress-gateway-5c46b97b7b-x2ltj istio-proxy 498m 188Mi
ocnssf-nsauditor-7474d9c8c7-zdfsh istio-proxy 6m 149Mi
ocnssf-nsavailability-64655fbdc5-dqvf4 istio-proxy 8m 162Mi
ocnssf-nsavailability-64655fbdc5-xk692 istio-proxy 7m 163Mi
ocnssf-nsconfig-75969f79c4-dkdvs istio-proxy 12m 181Mi
ocnssf-nsselection-74675666df-5rccg istio-proxy 189m 160Mi
ocnssf-nsselection-74675666df-7klp4 istio-proxy 215m 153Mi
ocnssf-nsselection-74675666df-9nrb5 istio-proxy 188m 173Mi
ocnssf-nsselection-74675666df-9x9wh istio-proxy 209m 157Mi
ocnssf-nsselection-74675666df-l8qb5 istio-proxy 194m 185Mi
ocnssf-nsselection-74675666df-lkz6d istio-proxy 212m 154Mi
ocnssf-nsselection-74675666df-qfbs6 istio-proxy 214m 157Mi
ocnssf-nsselection-74675666df-rp92c istio-proxy 200m 152Mi
ocnssf-nsselection-74675666df-sd7vc istio-proxy 207m 157Mi
ocnssf-nssubscription-57f66f5f7c-dnjc8 istio-proxy 5m 158Mi
ocnssf-ocnssf-nrf-client-nfdiscovery-74d68f549d-j6lbm istio-proxy 6m 156Mi
ocnssf-ocnssf-nrf-client-nfdiscovery-74d68f549d-jhh6l istio-proxy 6m 167Mi
ocnssf-ocnssf-nrf-client-nfmanagement-6c85b94d7b-c2zkd istio-proxy 8m 189Mi
ocnssf-ocnssf-nrf-client-nfmanagement-6c85b94d7b-hr6d7 istio-proxy 7m 157Mi
ocnssf-ocpm-config-86c75cf4d6-r2djc istio-proxy 7m 158Mi
ocnssf-performance-6d5d859bf7-l4qht istio-proxy 12m 157Mi

cnDBTier Services and Sidecar

The following table provides observed values of cnDBTier services and sidecar:

Table 3-8 cnDBTier Services and Sidecar

NAME Container Name CPU(cores) MEMORY(bytes)
mysql-cluster-db-backup-manager-svc-6d44f4bb7-27sf9 db-backup-manager-svc 4m 73Mi
mysql-cluster-db-backup-manager-svc-6d44f4bb7-27sf9 istio-proxy 3m 125Mi
mysql-cluster-db-monitor-svc-599c7c544f-vmh2x db-monitor-svc 98m 635Mi
mysql-cluster-db-monitor-svc-599c7c544f-vmh2x istio-proxy 4m 126Mi
mysql-cluster-site2-site1-replication-svc-5ccf6d5b86-kg9nv istio-proxy 4m 118Mi
mysql-cluster-site2-site1-replication-svc-5ccf6d5b86-kg9nv site2-site1-replication-svc 3m 244Mi
mysql-cluster-site2-site3-replication-svc-7d4b6c89d5-z7kmw istio-proxy 3m 121Mi
mysql-cluster-site2-site3-replication-svc-7d4b6c89d5-z7kmw site2-site3-replication-svc 3m 232Mi
ndbappmysqld-0 init-sidecar 2m 1Mi
ndbappmysqld-0 istio-proxy 390m 145Mi
ndbappmysqld-0 mysqlndbcluster 923m 1002Mi
ndbappmysqld-1 init-sidecar 2m 1Mi
ndbappmysqld-1 istio-proxy 487m 185Mi
ndbappmysqld-1 mysqlndbcluster 1161m 960Mi
ndbappmysqld-2 init-sidecar 2m 1Mi
ndbappmysqld-2 istio-proxy 325m 146Mi
ndbappmysqld-2 mysqlndbcluster 765m 986Mi
ndbappmysqld-3 init-sidecar 2m 1Mi
ndbappmysqld-3 istio-proxy 313m 145Mi
ndbappmysqld-3 mysqlndbcluster 738m 969Mi
ndbmgmd-0 db-infra-monitor-svc 1m 28Mi
ndbmgmd-0 istio-proxy 9m 132Mi
ndbmgmd-0 mysqlndbcluster 8m 30Mi
ndbmgmd-1 db-infra-monitor-svc 1m 26Mi
ndbmgmd-1 istio-proxy 10m 134Mi
ndbmgmd-1 mysqlndbcluster 7m 27Mi
ndbmtd-0 db-backup-executor-svc 1m 56Mi
ndbmtd-0 db-infra-monitor-svc 1m 28Mi
ndbmtd-0 istio-proxy 689m 135Mi
ndbmtd-0 mysqlndbcluster 830m 15576Mi
ndbmtd-1 db-backup-executor-svc 1m 56Mi
ndbmtd-1 db-infra-monitor-svc 1m 28Mi
ndbmtd-1 istio-proxy 681m 141Mi
ndbmtd-1 mysqlndbcluster 793m 15578Mi
ndbmtd-2 db-backup-executor-svc 1m 55Mi
ndbmtd-2 db-infra-monitor-svc 1m 27Mi
ndbmtd-2 istio-proxy 855m 133Mi
ndbmtd-2 mysqlndbcluster 868m 15576Mi
ndbmtd-3 db-backup-executor-svc 1m 56Mi
ndbmtd-3 db-infra-monitor-svc 1m 30Mi
ndbmtd-3 istio-proxy 655m 137Mi
ndbmtd-3 mysqlndbcluster 824m 15580Mi
ndbmysqld-0 db-infra-monitor-svc 1m 30Mi
ndbmysqld-0 init-sidecar 2m 1Mi
ndbmysqld-0 istio-proxy 12m 135Mi
ndbmysqld-0 mysqlndbcluster 29m 660Mi
ndbmysqld-1 db-infra-monitor-svc 1m 28Mi
ndbmysqld-1 init-sidecar 3m 1Mi
ndbmysqld-1 istio-proxy 10m 134Mi
ndbmysqld-1 mysqlndbcluster 25m 653Mi
ndbmysqld-2 db-infra-monitor-svc 1m 29Mi
ndbmysqld-2 init-sidecar 2m 1Mi
ndbmysqld-2 istio-proxy 10m 136Mi
ndbmysqld-2 mysqlndbcluster 27m 647Mi
ndbmysqld-3 db-infra-monitor-svc 1m 30Mi
ndbmysqld-3 init-sidecar 2m 1Mi
ndbmysqld-3 istio-proxy 12m 138Mi
ndbmysqld-3 mysqlndbcluster 31m 664Mi
3.1.5.3 Latency Observations

The following table provides observed values in latency:

Table 3-9 Latency Parameters

Latency Parameter Details (Avg)
NSSelection success percentage 100
Ingress Gateway latency of NSSelection 39.8ms
NSAvailability Success percentage 100
Ingress Gateway latency of NSAvailability latency 49.1ms
Ingress success rate 100
Result Pass

Table 3-10 NsSelection Ingress Gateway Latency

Percentile Min (ms) Max (ms) Avg (ms) Current (ms)
50% 5.11 5.43 5.27 5.27
90% 10.4 10.4 10.4 10.4
95% 10.7 10.9 10.9 10.9
99% 12.3 500 16.4 178

Table 3-11 NsAvailability Ingress Gateway Latency

Percentile Min (ms) Max (ms) Avg (ms) Current (ms)
50% 13.1 14.6 13.8 13.6
90% 14.3 80.7 18.0 15.2
95% 14.5 137 20.5 35.8
99% 14.8 196 26.7 63.7