1.1.1.6 Release 19.1.0.0.6 - April 2021
This section lists the new features added in the GGSA 19.1.0.0.6 bundle patch release.
1.1.1.6.1 Kafka MTLS Support
GGSA supports a 2-way authentication between the user and the Kafka broker. Users can enable the MTLS authentication by providing the Bootstrap URL, SSL truststore and keystore information in System Settings. Users can connect to MTLS enabled Kafka set-up while creating Kafka connections.
1.1.1.6.2 GoldenGate Full Records
The GoldenGate Extract process captures either full data records or transactional data changes, depending on the configuration parameters. To minimize the overhead or performance impact on the transactional database, GGSA users configure the Extract to capture only the transactional changes. This also helps to reduce payload size needs to transfer over the network, thus increasing the performance and security. But a few customers also need the unchanged columns (full data records), making them available to the processes that require up-to-date data feed, or to replicate this data to various big data targets for analysis.
To enable streaming of full data record (value of all fields), GGSA provides the Generate Full Records option while creating a GoldenGate stream. Enable this option to stream all the records, irrespective of the database transactional changes made to a single row, a subset or all the columns of a row.
1.1.1.6.3 Big Data Connections and Targets
- ElasticSearch
- HBase
- MongoDB
1.1.1.6.4 Continuous Merge Pattern
Use the Continuous Merge pattern to merge two or more continuous events into a single event, based on the key attributes.
1.1.1.6.5 Oracle Machine Learning Service Pattern (Preview Feature)
Use the Oracle Machine Learning (OML) Service pattern to use OML models to apply scoring on the ingested events.
1.1.1.6.6 Internal Kafka Topics
The internal Kafka topics and Group ID's used by GGSA are standardized to the following naming conventions:
Kafka Topics
| Topic | Resource | Operations |
|---|---|---|
|
sx_backend_notification_<UUID> |
Topic | CREATE,DELETE,DESCRIBE,READ,WRITE |
|
sx_messages_<UUID> |
Topic | CREATE,DELETE,DESCRIBE,READ,WRITE |
|
sx_<application_name>_<stage_name>_public |
Topic | CREATE,DELETE,DESCRIBE,READ,WRITE |
|
sx_<application_name>_<stage_name>_draft |
Topic | CREATE,DELETE,DESCRIBE,READ,WRITE |
|
sx_<application_name>_public_<offset_number>_<stage_name>_offset |
Topic | CREATE,DELETE,DESCRIBE,READ,WRITE |
Group IDs
| Group ID | Resource | Operations |
|---|---|---|
|
sx_<UUID>_receiver |
Group | DESCRIBE, READ |
|
sx_<UUID> |
Group | DESCRIBE, READ |
|
sx_<application_name>_public_<offset_number>_<stage_name> |
Group | DESCRIBE, READ |