Overview of Oracle Cloud Infrastructure GoldenGate
Oracle Cloud Infrastructure GoldenGate is a fully managed, native cloud service that moves data in real-time, at scale. OCI GoldenGate processes data as it moves from one or more data management systems to target databases. You can also design, run, orchestrate, and monitor data replication tasks without having to allocate or manage any compute environments.
Watch a short overview video, or take an interactive service tour to learn more.
Oracle Cloud Infrastructure GoldenGate Concepts
The following concepts are essential for working with the GoldenGate service.
- Compartment: Organizes and isolates your cloud resources, such as cloud networks, compute instances, block volumes, or OCI GoldenGate deployments, and database registrations. Only users with permission to a compartment can work with the resources within that compartment. Compartments also serve as a security boundary inside OCI GoldenGate. Only deployments and database registrations within the same compartment can access each other.
- Deployment: A container for your OCI GoldenGate resources, such as the OCI GoldenGate Deployment Console.
- Deployment Backup: A backup of a deployment's current state, retained for 60 days. It can be used to restore a deployment or create a new deployment with the state of the original deployment at the time the backup was taken.
- Database Registration: Captures source and target credential information and enables networking between the OCI GoldenGate service tenancy virtual cloud network (VCN) and your tenancy VCN using a private endpoint. A database registration contains the connectivity information to source or target end points.
- Extract: A process that runs against the source database and extracts, or captures data.
- Trail: A series of files on the source, intermediary, and/or target system where Oracle GoldenGate stores the captured changes to support the continuous extraction and replication of database changes.
- Replicat: A process that delivers data to a target database. It reads the trail file on the target database, reconstructs the DML or DDL operations, and applies them to the target database.
For more information about Oracle GoldenGate concepts, see Components of the Oracle GoldenGate Microservices Architecture.
Shared responsibility model
| Task | Who | Details |
|---|---|---|
| Provisioning OCI GoldenGate resources | Oracle | Oracle is responsible for provisioning resources. You, the customer, are resonsible for initiating provisioning requests that specify configuration characteristics of the resource being provisioned. |
| Backing up OCI GoldenGate deployments | Oracle | Oracle is resopnsible for backing up OCI GoldenGate deployments on a daily basis and retaining backups for 60 days. |
| Restoring an OCI GoldenGate deployment | Oracle | Oracle is responsible for restoring an OCI GoldenGate deployment. You, the customer, are responsible for initiating a restore request that specifies which existing backup to restore to. |
| Patching and upgrading | Oracle | Oracle periodically releases patches and upgrades for OCI GoldenGate. You, the customer, are reponsible for initiating upgrade requests. |
| Autoscaling | Oracle | Oracle is reponsible for scaling OCI GoldenGate per autoscaling configuration settings. You, the customer, are responsible for configuring autoscaling for each OCI GoldenGate deployment. |
| Scaling | Customer | You, the customer, are responsible for configuring scaling/base OCPU settings for each OCI GoldenGate deployment. |
| Monitoring service health | Oracle | Oracle is responsible for monitoring the health of OCI GoldenGate resources and for ensuring their availability as per published guidelines. |
| Monitoring OCI GoldenGate processes' health and performance | Customer | You, the customer, are responsible for monitoring the health and performance of your OCI GoldenGate processes at all levels. This responsibility includes monitoring the performance of the OCI GoldenGate Extract, Replicat, Distribution, and Receiver services and associated processes. |
| Application security | Customer | You, the customer, are responsible for the security of your
applications at all levels. This responsibility includes user access to
the OCI GoldenGate resources and network access to these
resources.
Oracle ensures that data stored in OCI GoldenGate is encrypted and ensures that connections to OCI GoldenGate require SSL encryption. |
| Alerts and notifications | Oracle / Customer | Oracle is responsible for providing an alert and notification feature for service events. You, the customer are responsible for monitoring any OCI GoldenGate alerts that may be of interest. |
Basic taskflow
This set of tasks is meant to give you a general idea of how to get set up with OCI GoldenGate quickly and easily. Depending on your use case, you may need diverge from the path outlined below, in which case you can choose to follow one of the various quickstarts available.
| Task | Description | More information |
|---|---|---|
| Create OCI resources | This task is typically performed by an administrator. Ensure that the required networking resources are created before you begin. | Creating Resources |
| Create a deployment | A deployment is a container for your OCI GoldenGate resources. | Creating a Deployment |
| Register databases | A database registration contains the network connectivity details for a source or target database. | Registering a Database |
| Launch the OCI GoldenGate deployment console | Create your data replication processes in the OCI GoldenGate deployment console. | Using the OCI GoldenGate Deployment Console |
| Manage deployment users | Add users that can create and manage data replication processes in the deployment console. | Manage deployment users |
| Create an Extract | An Extract is a process that captures the data from the source that you want to replicate to the target. | Creating an Extract |
| Create a Replicat | A Replicat is a process that delivers data to the target. | Creating a Replicat |
| Monitor performance | Monitor the overall health of your deployments to ensure your processes run smoothly. | Monitoring Performance |
| Maintain trail files | Trail files can add up exponentially over time and take up valuable space. Ensure that you create tasks to purge unused trail files periodically. | Manage Trail Files |
Accessing Oracle Cloud Infrastructure
You can access Oracle Cloud Infrastructure using the Console (a browser based interface) or the REST APIs.
To access the Console:
- Use a supported browser to access the Console.
- Enter your cloud tenant, user name, and password, when prompted.
- Click Sign in.
Resource Identifiers
Most types of Oracle Cloud Infrastructure resources have a unique, Oracle-assigned identifier called an Oracle Cloud ID (OCID).
For information about the OCID format and other ways to identify your resources, see Resource Identifiers.
Compartment Quotas
Creating a quota limit lets you limit the number of deployment resources in a compartment.
For example:
set goldengate quota deployment-count to 5 in compartment <compartment_name>Metering and Billing
Metering and billing for OCI GoldenGate is based on the number of OCPUs the service uses per minute.
When you create an OCI GoldenGate deployment, you select the number of OCPUs between 1 and 24 that your deployment will use. Each OCPU allocates an additional 16 GB memory.
You can enable auto scaling, which allows the service to scale up to three times the OCPU Count you specified upon creation. When you enable auto scaling, you are billed for the actual average number of OCPUs consumed per hour.
For example, if you specify 3 as the base OCPU and enable Auto Scale, then the total OCPUs that can be used is 9. When the OCPU Utilization is greater than 33.333% of 9 OCPUs, you are billed for the integer value over 33.333%, which is 4 OCPUs.
| OCPU Utilization Greater than | OCPU Utilization Less than or equal to | Billed for |
|---|---|---|
| 0 | 33.333% | 3 OCPUs |
| 33.333% | 44.444% | 4 OCPUs |
| 44.444% | 55.555% | 5 OCPUs |
| 55.555% | 66.666% | 6 OCPUs |
| 66.666% | 77.777% | 7 OCPUs |
| 77.777% | 88.888% | 8 OCPUs |
| 88.888% | 100% | 9 OCPUs |
OCI GoldenGate cannot scale over 24 OCPUs, which is the maximum number of OCPUs. For example, if you select 9 OCPUs as your base OCPU Count and enable Auto Scale, the service will scale up to 24 OCPUs. You can enable or disable auto scaling at any time. Learn more about Scaling a Deployment.
You can monitor the OCPU consumption and memory of a deployment in the Metrics section of a deployment's Detail page.
Integrated Services
The GoldenGate service is integrated with various Oracle Cloud Infrastructure services and features.
IAM
OCI GoldenGate integrates with the Identity and Access Management (IAM) service for authentication and authorization for the Console, SDK, CLI, and REST API, but not the OCI GoldenGate Deployment Console. To access the OCI GoldenGate Deployment Console, use the username and password that you specify when you create the deployment.
To learn more about the OCI GoldenGate Deployment Console, see Replicating Data.
To learn more about IAM, see IAM Overview.
Work Requests
OCI GoldenGate is not integrated with the common Work Requests API. The GoldenGate service uses its own API for Work Requests. See Work Request Reference.
Monitoring
Oracle Cloud Infrastructure Monitoring lets you actively and passively monitor your Oracle Cloud Infrastructure GoldenGate resources and alarms. Oracle Cloud Infrastructure GoldenGate Metrics captures CPU utilization, OCPU consumption, memory utilization, deployment health, and inbound and outbound lag. You can view these metrics using the Monitoring service, or on your Deployment Details page.