Replicate data from Autonomous Transaction Processing to Apache Kafka
Learn to configure OCI GoldenGate to replicate data from Autonomous Transaction Processing to Apache Kafka.
Overview
Using OCI GoldenGate, you can replicate data from an Autonomous Database to a Big Data target, like Apache Kafka. This quickstart demonstrates how to set up an OCI GoldenGate deployment, source and target connections, and replication processes.
Before you begin
To successfully complete this quickstart, you must have the following:
- A VCN with port 9092 (or another port used for the bootstrap server) open in the Ingress rules.
- A source Autonomous Transaction Processing instance
- A target Apache Kafka node
Environment set up: Autonomous Transaction Processing
To set up the source Autonomous Database:
- Download and unzip the sample database schema.
- In the Oracle Cloud console, select your Autonomous Transaction Processing (ATP) instance from the Autonomous Databases page to view its details and access Database Actions.
- Unlock the GGADMIN user:
- Click Database actions, then click Database Users.
- Locate GGADMIN and then click its ellipsis menu (three dots) and select Edit.
- In the Edit User panel, enter the GGADMIN password, confirm the password, and then deselect Account is Locked.
- Click Apply Changes.
- Load the source sample schema and data:
- Enable supplemental logging:
Task 1: Create the OCI GoldenGate resources
- Create an Oracle deployment for the source Autonomous Transaction Processing instance.
- Create a Big Data deployment for the target Apache Kafka node.
- Create a connection for the source Autonomous Transaction Processing instance.
- Create a connection for the target Kafka node.
- (Optional) If your Big Data deployment doesn't have a public endpoint, then create a connection to GoldenGate, and then assign this connection to the source Oracle deployment.
- Assign the ATP connection to the source Oracle deployment.
- Assign the Kafka connection to the target Big Data deployment.
Task 2: Add the Extract
- On the Deployments page, select the source Autonomous Transaction Processing deployment.
- On the deployment details page, click Launch Console.
- Log in with the source deployment's administrator username and password.
- Add transaction information.
- Add an Extract
Task 4: Add the Replicat
Replicate data from Autonomous Transaction Processing to Apache Kafka
For information about Oracle's commitment to accessibility, visit the Oracle Accessibility Program website at http://www.oracle.com/pls/topic/lookup?ctx=acc&id=docacc.
Access to Oracle Support
Oracle customers that have purchased support have access to electronic support through My Oracle Support. For information, visit http://www.oracle.com/pls/topic/lookup?ctx=acc&id=info or visit http://www.oracle.com/pls/topic/lookup?ctx=acc&id=trs if you are hearing impaired.