About Oracle Cloud Infrastructure GoldenGate

Learn about data replication concepts to help you get started with Oracle Cloud Infrastructure GoldenGate.

Oracle Cloud Infrastructure GoldenGate is a fully managed, native cloud service that moves data in real-time, at scale. OCI GoldenGate processes data as it moves from one or more data management systems to target databases. You can also design, run, orchestrate, and monitor data replication, transform data, analyze streaming data in real time without having to allocate or manage any compute environments.

OCI GoldenGate concepts

The following concepts are essential for working with the Oracle Cloud Infrastructure GoldenGate service.

• Compartment: Organizes and isolates your cloud resources, such as cloud networks, compute instances, block volumes, or OCI GoldenGate deployments, and database registrations. Only users with permission to a compartment can work with the resources within that compartment. Compartments also serve as a security boundary inside OCI GoldenGate. Only deployments and database registrations within the same compartment can access each other.

• Connection: Contains the network connectivity details for a data source or target for OCI GoldenGate. Connections support database and non-database technologies such as Oracle, MySQL, SQL Server, PostgreSQL, Db2 for z/OS, Big Data technologies, and Oracle GoldenGate Distribution and Receiver servers.

• Deployment: A container for your OCI GoldenGate resources, such as the OCI GoldenGate Deployment Console.

• Deployment type: Defines the type of processing the deployment performs.

• Deployment Backup: A backup of a deployment's current state, retained for 60 days. It can be used to restore a deployment or create a new deployment with the state of the original deployment at the time the backup was taken.

  Note: Only Data replication deployments support manual and automatic backups.

Data replication concepts

The following concepts are essential for data replication:

• Extract: A process that runs against the source database and extracts, or captures data.

• Trail: A series of files on the source, intermediary, or target system where Oracle GoldenGate stores the captured changes to support the continuous extraction and replication of database changes.

• Replicat: A process that delivers data to a target database. It reads the trail file on the target database, reconstructs the DML or DDL operations, and applies them to the target database.

For more information about Oracle GoldenGate concepts, see Components of a Data Replication in Oracle GoldenGate.

Stream analytics concepts

The following concepts are essential for working with OCI GoldenGate Stream Analytics:

• Connection: Stores the connectivity information for a source or target technology.

• Stream: A continuous flow of dynamic data.

• Pipeline: The workflow data from source to target.

• Business logic: Various filters and functions you can apply to a pipeline to obtain the precise data you want to analyze.

• Publishing: Makes the pipeline available to all Stream analytics users and sends data to targets.

Data Transforms concepts

Whether you’re new to Data Transforms or have past experience with Oracle Data Integrator, it’s helpful to familiarize yourself with these concepts before starting with OCI GoldenGate Data Transforms. See Terminology Information in the Using Data Transforms guide to learn more.

Pipeline concepts

The following concepts are essential for working with pipelines:

• Pipeline: a predefined component that enables real time, minimal latency data movement from a source operational database to a target data warehouse or analytics platform without the need for traditional ETL steps.

• Pipeline type: A common data replication use case.

• Capture: A process that runs against the source connection and extracts, or captures, data. Also known as an Extract process.

• Apply: A process that delivers data to a target database or technology, otherwise known as the Replicat process.

User roles

Service administrators, Application DBAs, and Data engineers are among the types of data professionals who use OCI GoldenGate. You may perform one or more of the following roles:

• Service administrators are responsible for the administration, management, monitoring, diagnostics, lifecycle management, and security for OCI GoldenGate.

• Application DBAs use OCI GoldenGate to develop, build, and test solutions focused on high availability, transaction replication, and data warehouse loading.

• Data engineers use OCI GoldenGate to develop, build, and test solutions focused on data lake pipelines and stream processing.