5 Oracle GoldenGate Classic for Big Data
- Deploying Oracle GoldenGate Classic Architecture for Big Data and Cloud Platforms
- Finding Oracle GoldenGate for Big Data within the Oracle Cloud Marketplace
- Launching Oracle GoldenGate Classic for Big Data
- Getting Started with Oracle GoldenGate Classic for Big Data Compute Node
- Working with Oracle GoldenGate Classic for Big Data
- Connecting to Data Resources
Deploying Oracle GoldenGate Classic Architecture for Big Data and Cloud Platforms
Using Oracle GoldenGate Classic Architecture on Marketplace, you can deploy and manage your deployment from a single location.
Here are the prerequisites which are required before deployment:
- Oracle Cloud Account
- Access to compute node resources within Oracle Cloud Tenant
Parent topic: Oracle GoldenGate Classic for Big Data
Finding Oracle GoldenGate for Big Data within the Oracle Cloud Marketplace
- Log in to Oracle Cloud Marketplace.
- From the Oracle Cloud Marketplace home page, use the search box under Applications and search for the keyword GoldenGate.
- From the Search Results, select Oracle GoldenGate for Big Data.
Parent topic: Oracle GoldenGate Classic for Big Data
Launching Oracle GoldenGate Classic for Big Data
Parent topic: Oracle GoldenGate Classic for Big Data
Getting Started with Oracle GoldenGate Classic for Big Data Compute Node
After deploying Oracle GoldenGate Classic for Big Data, log in to the compute node and access Oracle GoldenGate Software Command Interface (GGSCI). For this, you need to identify the public IP address of the compute node where Oracle GoldenGate Classic for Big Data is running. The following steps help you to identify the public IP address:
- Log in to your Oracle Cloud Console.
- Navigate to Compute -> Instances.
- Select the hyperlink name of the compute node. The public IP address is listed under Primary VNIC Information.
- To access the compute node where Oracle GoldenGate is running, connect as the
opc
account using SSH. For more information on how to access a node using theopc
account refer to Connecting to an Instance.
ssh -i <private-key-filename> opc@<public-id-address>
Parent topic: Oracle GoldenGate Classic for Big Data
Installing Third Party Drivers or Libraries
For example, before creating a kafka connection, you need to download all the dependent libraries from Kafka Maven repository depending on the Kafka version. The list of dependent libraries for each version of Kafka is listed in the Kafka section of Using Oracle GoldenGate for Big data guide.
For more information on dependent libraries, refer to Using Oracle GoldenGate for Big Data guide.
Running GGSCI
GGCSI
from home -> bigdata
directory (/home/opc/bigdata
). From here, you can execute GGSCI.
To start GGSCI, excute the following commands:
$ cd bigdata
$ export LD_LIBRARY_PATH=/home/opc/java/jre/lib/amd64/server
$ ./ggsci
Working with Oracle GoldenGate Classic for Big Data
After deploying Oracle GoldenGate Classic for Big Data on Oracle Cloud Marketplace, you can access the latest release of Oracle GoldenGate Classic for Big Data.
Before you can start using Oracle GoldenGate Classic for Big Data, there are a few tasks that you must perform to ensure that your environment is complete and ready to replicate your data. Before you begin data replication, you must perform the following tasks:
Topics:
- Configuring Source and Target Data System for Replication
- Establishing Connectivity
- Configuring Capture Support
- Configuring Apply Support
Parent topic: Oracle GoldenGate Classic for Big Data
Configuring Source and Target Data System for Replication
Before you can begin replicating data, you should prepare the source or target database to support Oracle GoldenGate. To prepare your database, follow the steps listed in Installing Oracle GoldenGate for Big Data in Installing and Upgrading Oracle GoldenGate for Big Data guide. See Using the Generic Build of Oracle GoldenGate to capture and/or apply data to Big Data and Cloud systems.
Parent topic: Working with Oracle GoldenGate Classic for Big Data
Establishing Connectivity
The Oracle GoldenGate Classic for Big Data on Oracle Cloud Marketplace compute node acts as a hub where you can manage your connections to source and/or target Big Data systems. To do this, establish a network connection between OCI compute node and your source and/or target Big Data systems. For this, you have to install the required third party connection libraries on the OCI compute node.
For more details on this, refer to Installing Oracle GoldenGate for Big Data chapter of Installing and Upgrading Oracle GoldenGate for Big Data guide.
Parent topic: Working with Oracle GoldenGate Classic for Big Data
Configuring Capture Support
Before installing Remote Extract for Cassandra source, refer to Setting Up Cassandra Change Data Capture section in Using Oracle GoldenGate for Big Data Guide, to know about the steps that you need to perform on the Cassandra platform for the replication to happen. For setting up JMS remote capture, refer to Configuring Message Capture section in Administering Oracle GoldenGate for Big Data guide.
To build the remote extract, perform the following steps within Oracle GoldenGate for Non-Oracle:
Note:
Theextract_name
parameter can be replaced with any process name that can be a maximum of 8 characters in length. The trail identifier (id)
can be a maximum of two characters.
Parent topic: Working with Oracle GoldenGate Classic for Big Data
Configuring Apply Support
Note:
- You can replace
replicat_name
andtrail name
characters specified above with any valid name. - Process names can be a maximum of 8 characters and trail names can be two characters in length.
Parent topic: Working with Oracle GoldenGate Classic for Big Data
Connecting to Data Resources
Connecting to Big Data Systems
You can use Oracle GoldenGate Classic for Big Data on Oracle Cloud Marketplace to remotely capture and apply data to Big Data Database on-premises or across Oracle Cloud platforms. This allows you to enable replication between cloud services in a scalable fashion and centrally manage the replication processes between cloud services. To know more about the supported Big Data systems and their versions, refer to GoldenGate for Big Data 19.1 Certification Matrix.
Use Cases for Replication
Use Oracle GoldenGate Classic for Big Data to replicate data between data resources in the following use cases:
- Data Migrations
- Data Distribution
- Real-Time Data Warehousing
- Operational Reporting
- Building Data Lakes
- Streaming Analytics
Prerequisites
Ensure that the following are set up before you begin replication:
- Oracle GoldenGate Classic for Big Data
- Any Sources and Targets that are supported by GoldenGate for BigData
To move data from on-premises to the cloud or from on-premises to on-premises, perform the tasks listed in the following sections:
- Configuring Big Data Systems for Replication
- Configuring Oracle GoldenGate Classic for Big Data Compute Node
Parent topic: Connecting to Data Resources
Configuring Big Data Systems for Replication
To prepare your Big Data systems for replication, perform the tasks that are outlined in Installing Oracle GoldenGate for Big Data chapter of Installing and Upgrading Oracle GoldenGate for Big Data guide.
If your sources or targets are other data sources and to know about the various data sources supported by Oracle Golden Gate, refer to Using Oracle GoldenGate for Oracle Database and Using Oracle GoldenGate for Heterogeneous Databases guides.
Parent topic: Connecting to Big Data Systems
Configuring Oracle GoldenGate Classic for Big Data Compute Node
To establish connection from Oracle GoldenGate Classic for Big Data compute node to your on-premises data systems or third party cloud systems, you must establish connectivity between OCI and on-premises data systems. To do this, you can use the following options:
- IPSec VPN
- FastConnect
For establishing an IPSec VPN with OCI, refer to IPSec VPN documentation. For establishing a FastConnect connection, refer to the FastConnect documentation.
Parent topic: Connecting to Big Data Systems