Replicate Data from Autonomous Transaction Processing to Confluent Kafka
This quickstart demonstrates how to replicate data from Autonomous Transaction Processing to Confluent Kafka using OCI GoldenGate.
Before you begin
To successfully complete this quickstart, you must have the following:
- A source Autonomous Transaction Processing instance.
- A Confluent Platform instance.
Environment set up: Autonomous Transaction Processing
To set up the source Autonomous Database:
- Download and unzip the sample database schema.
- In the Oracle Cloud console, select your Autonomous Transaction Processing (ATP) instance from the Autonomous Databases page to view its details and access Database Actions.
- On the Database details page, click Database actions.
- Unlock the GGADMIN user:
- On the Database actions page, under Administration, click Database Users.
- Locate GGADMIN and then click its ellipsis menu (three dots) and select Edit.
- In the Edit User panel, enter the GGADMIN password, confirm the password, and then deselect Account is Locked.
- Click Apply Changes.
- Load the source sample schema and data:
- Enable supplemental logging:
Environment set up: Confluent Cloud
- Create a cluster.
- Create an API Key for the Cluster. Note the API Key and Secret for the next steps.
- Enable Schema Registry, and then create an API Key for Confluent Cloud Schema Registry. Note the API Key and Secret for the next steps.
- Create a topic in the cluster. Note the name of the topic for the next steps.
Task 1: Create the OCI GoldenGate resources
- Create an Oracle deployment for the source Autonomous Transaction Processing instance.
- Create a Big Data deployment for the target Confluent Cloud.
- Create a connection to the source Autonomous Transaction Processing.
- Create a Confluent Kafka connection.
- Create a Confluent Schema Registry.
- (Optional) If your Big Data deployment doesn't have a public endpoint, then create a connection to GoldenGate, and then assign this connection to the source Oracle deployment.
- Assign the Autonomous Transaction Processing connection to the source Oracle deployment.
- Assign Confluent Kafka and Confluent Schema Registry connections to the target Big Data deployment.
Task 2: Add the Extract
- On the Deployments page, select the source Autonomous Transaction Processing deployment.
- On the deployment details page, click Launch Console.
- Log in with the source deployment's administrator username and password.
- Add transaction information.
- Add an Extract
Task 3: Add and run the Distribution Path
- Create a user for the Distribution Path in the target Big Data
deployment.
- In the source ATP GoldenGate deployment console, add a credential for the user
created in Step 1.
- Click Distribution Service, and then click Add Path (plus icon).
- Complete the Add Path form fields as follows, and then click Create and
Run:
- In the target Big Data deployment console, review the Receiver Path.
- In the target Big Data deployment console, click Receiver Service.
- Review the path details. This path was created as a result of the Distribution Path created in the previous step.
Task 4: Add and run the Replicat
Replicate Data from Autonomous Transaction Processing to Confluent Kafka
For information about Oracle's commitment to accessibility, visit the Oracle Accessibility Program website at http://www.oracle.com/pls/topic/lookup?ctx=acc&id=docacc.
Access to Oracle Support
Oracle customers that have purchased support have access to electronic support through My Oracle Support. For information, visit http://www.oracle.com/pls/topic/lookup?ctx=acc&id=info or visit http://www.oracle.com/pls/topic/lookup?ctx=acc&id=trs if you are hearing impaired.