3.3.9 Profile Resource Requirements for Correlated Kafka Feed in OCI Environment
The following table displays the profile resource requirements for Correlated Kafka feed in OCI environment.
Table 3-13 Resource Requirements
| OCNADD Service | 5K SCP Profile | 5K Profile(SCP:3K NRF:1K SEPP:1K) | ||||||
|---|---|---|---|---|---|---|---|---|
|
Replication Factor = 1 Message Size = 3500 ACL FEED Type = Correlated |
vCPU | Total Replica |
Memory Required (Gi) |
Topic Partitions | vCPU | Total Replica |
Memory Required (Gi) |
Topic Partitions |
| OCNADD microservices resource requirements: | ||||||||
| ocnaddconfiguration | 1 | 1 | 1 | - | 1 | 1 | 1 | - |
| ocnaddalarm | 1 | 1 | 1 | - | 1 | 1 | 1 | - |
| ocnaddadmin | 1 | 1 | 1 | - | 1 | 1 | 1 | - |
| ocnaddhealthmonitoring | 1 | 1 | 1 | - | 1 | 1 | 1 | - |
| ocnaddgui | 2 | 1 | 1 | - | 2 | 1 | 1 | - |
| ocnadduirouter | 2 | 1 | 1 | - | 2 | 1 | 1 | - |
| zookeeper | 1 | 3 | 1 | - | 1 | 3 | 2 | - |
| ocnaddkafka | 3 | 4 | 32 | - | 3 | 4 | 32 | - |
| FEED TYPE = CORRELATED | ||||||||
| ocnaddscpaggregation | 2 | 1 | 2 | SCP=6 (Each instance 6 partitions) | 2 | 2 | 2 | SCP=12 (Each instance 6 partitions) |
| ocnaddnrfaggregation | 2 | 1 | 2 | NRF=6 (Each instance 6 partitions) | - | - | - | - |
| ocnaddseppaggregation | 2 | 1 | 2 |
SEPP=12 (Each instance 6 partitions) |
- | - | - | - |
| ocnaddcorrelation | 3 | 3 | 24 | MAIN=18,<feed-name> - CORRELATED=18 or as per consumer. | 3 | 3 | 24 | MAIN=18,<feed-name> - CORRELATED=18 or as per consumer. |
| FEED TYPE = CORRELATED_FILTERED (Minimum 20% data filter is configured) | ||||||||
| ocnaddfilter | 2 | 3 | 3 | MAIN=18,<feed-name> -FILTERED=18 | 2 | 3 | 3 | MAIN=18,<feed-name> -FILTERED=18 |
| ocnaddcorrelation | 2 | 3 | 16 | <feed-name> - FILTERED -CORRELATED=18 or as per consumer. | 2 | 3 | 16 | <feed-name> - FILTERED -CORRELATED=18 or as per consumer. |
Note:
- The filter service's resource requirements may vary based on the percentage of data allowed post-filtering and the number of filter conditions with configured values.
- The correlation service's resource requirements may vary when all transaction messages are not received and the value of "maxTransactionWaitTime" is set to a higher value (Use a lower value for such scenarios).
- The Kafka broker's resource requirement increases if the Replication Factor is "2" and (or) the Replicated Feed is running, and the end-to-end latency increases when DISK I/O is slow.
- The resource requirement in the above table is for a single feed. Additional Kafka resources are required for replicated feeds.
- Depending on the number of CORRLATION_FILTERED feeds configured, you might have to increase the filter service memory and CPU requirements. The requirements mentioned in the above table are for a single configuration.