About Oracle GoldenGate

The Oracle GoldenGate (OGG) product family delivers real-time trusted information. Oracle GoldenGate has been a trusted provider of Data Fabric and Data Mesh capabilities built around data product thinking, decentralized architectures, event-driven pipelines, and polyglot data payloads and topologies.

Now, with Oracle GoldenGate 26ai, you will be able to leverage its transactional database replication for artificial intelligence use cases including Retrieval-Augmented Generation (RAG) and enabling real-time AI embedding. The Oracle GoldenGate platform excels at change data capture (CDC), transactional data replication, data ingestion, data pipelines for continuous transformation and loading (CTL), and a wide variety of analytics on streaming data. Oracle GoldenGate interacts with the database transaction logs to continuously capture changed data (both DML and DDL) with minimal impact to the source database. This is why Oracle GoldenGate log-based replication is preferred over batch or periodically scheduled data captures. Only through leveraging such trusted data in real-time can organizations make better, faster business decisions and actions.

Oracle GoldenGate supports a real-time hybrid, heterogeneous data fabric that connects and unifies sources and targets through a multitude of styles for data integration processing:

• Real-time changed data capture (CDC) with transactional integrity

• Improve scalability and availability of mission critical databases

• High-speed ingest into big data targets

• Real-time continuous integration (CTL)

• Bulk ETL/ELT with Data Transforms in OCI GoldenGate

• Real-time streaming analytics for data-in-motion

Why Do You Need Oracle GoldenGate?

Enterprise data is typically distributed across the enterprise in heterogeneous databases. To get data between different data sources, you can use Oracle GoldenGate to load, distribute, and filter transactions within your enterprise in real-time and enable migrations between different databases in near zero-downtime.

To do this, you need a means to effectively move data from one system to another in real-time and with zero-downtime. Oracle GoldenGate is Oracle’s solution to replicate and integrate data.

Oracle GoldenGate’s modular architecture provides flexibility in how data is extracted, transformed, and replicated across heterogeneous systems. This architecture allows for the configuration of various components, including Extract, Replicat, and Collector processes, as well as trail files, to tailor data movement to specific needs. This modularity enables efficient handling of data at the transaction level across different platforms and topologies.

In a data replication environment, Oracle GoldenGate performs the following functions:

• Data movement in real-time, reducing latency.

• Only committed transactions are moved, to leverage consistency and improved performance.

• REST-based microservices to handle different types of data replication environments.

• High performance with minimal overhead on the underlying databases and infrastructure.

• Integration with a wide range of databases providing complete support for replication across different data types, database objects and other requirements.

• Security configurations at different levels and different topologies for a customized secure configuration.

When Do You Use Oracle GoldenGate?

Oracle GoldenGate meets almost any data movement requirement. Some of the most common use cases include:

Business Continuity and High Availability

Business Continuity is the ability of an enterprise to provide its functions and services without any lapse in its operations. High Availability is the highest possible level of fault tolerance. To achieve business continuity, systems are designed with multiple servers, multiple storage, and multiple data centers to provide high availability that supports business continuity in true sense. To establish and maintain such an environment, data needs to be moved between these multiple servers and data centers, which is easily done using Oracle GoldenGate.

Consider a scenario where you are working in a multinational bank that has its headquarters in London, UK. You work in one of the banks’ branches in Bangalore, India. This bank uses a specific account for its financial application that is used globally at all the branches. You have been asked by your manager to daily synchronize the transactions that have happened for this account in the database in the Bangalore branch with the centralized database situated at the UK. The volume of transactions is massive, and even the slightest delay can greatly impact the business. This same process is required at multiple destinations for every database in all the branches of the bank worldwide. This process has to be monitored continuously, preferably through some sort of GUI-based tool for the ease of management. Additionally, the bank has several other, non-critical applications used at all the branches. These applications are based on heterogeneous databases, such as MySQL, but the transactions done over these databases also must be loaded into an Oracle Database located at the headquarters. The replication technology used must support both Oracle and heterogeneous databases so that they can talk to each other. Oracle GoldenGate is an apt solution in such a scenario.

Initial Load and Database Migration

Initial load is a process of extracting data records from a source database and loading those records onto a target database. Initial load is a data migration process that is performed only once. Oracle GoldenGate allows you to perform initial load data migrations without taking your systems offline.

Data Integration

Data integration involves combining data from several disparate sources, which are stored using various technologies, and provide a unified view of the data. Oracle GoldenGate provides real-time data integration.

Real-time Access to Real-time Information

Oracle GoldenGate software provides database high availability enabling business continuity for Oracle, MySQL, PostgreSQL, YugabyteDB, EDB Postgres Advanced Server, SQL Server, HPE NonStop, Db2 for i, LUW and z/OS. Oracle GoldenGate enables the highest service level, the Platinum Tier, of the Oracle Maximum Availability Architecture (MAA).

Many thousands of global banks, retailers, telecoms, healthcare companies depend on Oracle GoldenGate to reliably run their operational data platforms. Oracle GoldenGate’s real-time ACID-based replication capabilities also offer an advantage for data movement for every purpose; across multivendor relational and document databases, across message stores, and across applications. Minimal source database overhead paired with high-speed processing make Oracle GoldenGate replication unique. As a result, Oracle GoldenGate includes a large collection of certified heterogeneous sources and targets and is widely used for Big Data and NoSQL data transactions and analytical payloads as well as federating data into staging and search platforms.

Oracle GoldenGate is built as a microservices/REST-based application. The modular architecture provides the flexibility for cooperative and distributed deployments across enterprise systems, on-premises and in the cloud.

Topologies for Oracle GoldenGate

After installation, Oracle GoldenGate can be configured to meet your organization’s business requirements.

Oracle GoldenGate can be configured in different topologies, ranging from simple unidirectional topology to more complex peer-to-peer. Supported topologies depend on the underlying database requirements and its supported configurations.

For different type of topology based use cases, see About OGG Solutions in the Oracle GoldenGate Microservices Architecture Solutions.

Real-time Data Integration Across the Enterprise and Cloud

Oracle GoldenGate captures and delivers real-time changed data to on-premises or cloud-based data warehouses, lakes and object stores, reporting systems, and other online transaction processing (OLTP) databases with minimal source system impact. Real-time data access improves business insight and analytics.

• Oracle and non-Oracle data replication: Oracle GoldenGate connects to many non-Oracle and open-source databases across on-premises and cloud platforms. Oracle GoldenGate also connects across multicloud relational database sources and targets such as databases in OCI, AWS Aurora and RDS environments, Azure, SQL, and Google Cloud SQL and AlloyDB. Oracle GoldenGate supports many nonrelational data platforms such as, Kafka, NoSQL databases, object storage, Hadoop, and more. See the certification matrix for a complete list of supported data platforms for each solution.

• Real-time data warehouse: To achieve continuous, real-time capture and delivery of changed data between operational and analytical systems.

• Operational reporting and data integration: Offload reporting activity from production databases to lower-cost secondary systems with current data for realtime reporting. Integrate operational data between OLTP systems in real-time.

• Data Lakehouse ingest: Provide continuous, real-time capture and delivery of changed data between OLTP and object storage, data lake, or data lakehouse targets. Oracle GoldenGate delivers data to Oracle or non-Oracle platforms, such as Snowflake, Azure Data Lake, Google BigQuery, and other cloud object stores.

• Big Data integration: Keep your entire distributed heterogeneous and multicloud data fabric and supporting applications up to date with real-time data replication, propagation, and transaction consistency. Simplify building and operating an event-based and zero data loss data fabric with five integrated enterprise-class components:

  • Oracle GoldenGate connectors to capture and apply data from NoSQL and messaging systems.

  • Oracle GoldenGate Distributed Applications and Analytics connectors for object storage, data lake, data warehouse targets.

  • Oracle Stream Analytics for continuous ETL and data in-motion analytics.

  • GoldenGate Data Streams for developer control over all GoldenGate events

  • Transaction Manager for Microservices Enterprise Edition (MicroTx EE) for transactional integrity

• Real-time streaming analytics: Oracle Stream Analytics ingests real-time data from GoldenGate changed data, and from messaging environments like Kafka and JMS. A graphical pipeline designer can perform data transformations and apply time-series and geo-spatial analytics on these event streams. Oracle Stream Analytics is available standalone, a deployment option in OCI GoldenGate, and is included with Oracle Distributed Applications and Analytics.

• Using GoldenGate in the cloud: Oracle GoldenGate is available as a managed service in OCI, or as a self-managed OCI Marketplace image. Oracle GoldenGate on-premises can also be installed in any cloud on their compute instances.

• Data Streams: Most GoldenGate DDL and DML capabilities can also be accessed through developer APIs. Deployed using the AsyncAPI standard, developers can subscribe and publish to the GoldenGate data event model.

Oracle GoldenGate Product Family

There are a wide range of products in the Oracle GoldenGate product family.

• Oracle GoldenGate for Oracle Database: Oracle GoldenGate Microservices for Oracle database provides all the data replication features of Oracle GoldenGate with the features of Oracle Database.

• Oracle GoldenGate for Non-Oracle Databases: Oracle GoldenGate Microservices for non-Oracle databases provides all the data replication features of Oracle GoldenGate with all the supported databases including Db2 for i, Db2 z/OS, Db2 LUW, MySQL, PostgreSQL, SQL Server, Sybase, Oracle TimesTen, Teradata.

• OCI GoldenGate: Oracle Cloud Infrastructure GoldenGate is a fully managed, native cloud service that moves data in real-time, at scale. OCI GoldenGate processes data as it moves from one or more data management systems to target databases. You can also design, run, orchestrate, and monitor data replication tasks without having to allocate or manage any compute environments.

• Oracle GoldenGate Free: Oracle GoldenGate Free provides all the features of the licensed Oracle GoldenGate product, as well as a recipe-driven user interface to easily create and manage replication pipelines. GoldenGate Free deploys from a Docker container onto laptops, on-premises, or any cloud, for free.

• Oracle GoldenGate Microservices for Marketplace: Oracle GoldenGate Microservices on Marketplace allows you to deploy Oracle GoldenGate in an off-box architecture, which means you can run and manage your Oracle GoldenGate deployment from a single location.

• Oracle GoldenGate for HP NonStop (Guardian): Oracle GoldenGate for HP NonStop enables you to manage business data at a transactional level by extracting and replicating selected data records and transactional changes across a variety of heterogeneous applications and platforms.

• Oracle GoldenGate Veridata: Oracle GoldenGate Veridata compares one set of data to another and identifies data that is out-of-sync, and allows you to repair any out-of-sync data.

• Oracle GoldenGate for Distributed Applications and Analytics: Oracle GoldenGate for Distributed Applications and Analytics includes Oracle Transaction Manager for Microservices Enterprise Edition, GoldenGate handlers for Big Data, NoSQL, Messaging, Data Warehouse and Data Lakehouse.

• Oracle GoldenGate Plug-in for EMCC: The Enterprise Manager Plug-in for Oracle GoldenGate extends the Oracle Enterprise Manager Cloud Control and provides visual support for monitoring and managing Oracle GoldenGate processes.