1. Implement Oracle GoldenGate in Microsoft Azure with Oracle Database@Azure
  2. Implement Oracle GoldenGate in Microsoft Azure with Oracle Database@Azure

Implement Oracle GoldenGate in Microsoft Azure with Oracle Database@Azure

Oracle GoldenGate with Oracle Database@Azure enables on-premises customers to run mission-critical Oracle databases in Microsoft Azure data centers.

Enterprise data is typically distributed across the enterprise in heterogeneous databases. Investing in Oracle GoldenGate, Oracle Database@Azure, and Azure applications enables your enterprise to run mission critical real-time integration, data replication, transactional change data capture, data transformations, high-availability solutions, and verification between operational and analytical enterprise systems.

Oracle Database@Azure integrates Oracle Autonomous Database Serverless, Oracle Exadata Database Service on Dedicated Infrastructure, Oracle Real Application Clusters (Oracle RAC), and Oracle Data Guard technologies into the Azure platform to offer the same low latency as other Azure native services.

Oracle GoldenGate is one of the most popular real-time data fabric tools and already has numerous integrations with Azure (for example: Azure SQL, Azure Database for PostgreSQL, Azure Data Lake Storage, Azure Cosmos DB, Azure Synapse Analytics, Azure Event Hub, Databricks on Azure, Azure Site Recovery, and Snowflake on Azure). Customers using Oracle Database@Azure with Oracle GoldenGate are able to move data in and out of these data stores in real time. Oracle Database@Azure customers who need real-time transactions between Oracle databases in other infrastructures (such OCI, on-premise, or other clouds) can also use Oracle GoldenGate.

Before You Begin

Before you begin, ensure you are familiar with Oracle GoldenGate. Oracle GoldenGate has numerous configurations, integration scenarios, and supported database systems. Review Oracle GoldenGate documentation, tutorials, and videos for instructions on installation, configuration, and use cases.

Architecture

This reference architecture implements Oracle GoldenGate running on Azure linux virtual machines, or containers hosted on Azure Kubernetes Service. Oracle GoldenGate has deep integration with Oracle Database@Azure for change data capture to facilitate organization to stay up-to-date with the latest data in near real time and avoid relying on stale data.

Oracle GoldenGate empowers organizations to optimize their data management processes and facilitates the seamless integration of data stored in Oracle Database@Azure into data lakes and lakehouses for advanced analytics and machine learning workloads. You can build robust data streaming platforms on Azure, ensuring seamless data integration, scalability, and real-time analytics. Oracle GoldenGate provides data consistency and synchronization to make it an invaluable technology for organizations striving to leverage real-time data to make informed decisions based on accurate and timely data, driving the success of your business in the cloud-native era and enhancing business operations.

The following diagram illustrates this reference architecture for an Oracle GoldenGate implementation hosted in Microsoft Azure for integration between Oracle Database@Azure and Azure native services for streaming, data processing, machine learning, and analytics. You can leverage this reference architecture for reusing an existing Oracle GoldenGate implementation, or a fresh implementation for reasons like legal obligations, latency sensitive workloads, and centralized data management.

The following diagram illustrates this reference architecture.


Description of goldengate-dbatazure-integration.png follows
Description of the illustration goldengate-dbatazure-integration.png

goldengate-dbatazure-integration.zip

The architecture has the following components:

  • Region

    An Oracle Cloud Infrastructure region is a localized geographic area that contains one or more data centers, called availability domains. Regions are independent of other regions, and vast distances can separate them (across countries or even continents).

  • On-premises network

    This network is the local network used by your organization. It is one of the spokes of the topology.

  • Virtual cloud network (VCN) and subnets

    A VCN is a customizable, software-defined network that you set up in an Oracle Cloud Infrastructure region. Like traditional data center networks, VCNs give you control over your network environment. A VCN can have multiple non-overlapping CIDR blocks that you can change after you create the VCN. You can segment a VCN into subnets, which can be scoped to a region or to an availability domain. Each subnet consists of a contiguous range of addresses that don't overlap with the other subnets in the VCN. You can change the size of a subnet after creation. A subnet can be public or private.

  • VNIC

    A virtual network interface card (VNIC) enables an instance to connect to a VCN and determines how the instance connects with endpoints inside and outside the VCN. Each VNIC resides in a subnet in a VCN and includes these items:

    • A primary private IPv4 address from the subnet the VNIC is in, chosen by either you or Oracle.
    • Optional secondary private IPv4 addresses from the same subnet the VNIC is in, chosen by either you or Oracle.
    • An optional public IPv4 address for each private IP, chosen by Oracle but assigned by you at your discretion.
    • An optional hostname for DNS for each private IP address.
    • A MAC address.
    • A VLAN tag assigned by Oracle and available when attachment of the VNIC to the instance is complete (relevant only for bare metal instances).
    • A flag to enable or disable the source/destination check on the VNIC's network traffic.
    • Optional membership in one or more network security groups (NSGs) of your choice. NSGs have security rules that apply only to the VNICs in that NSG.
    • Optional IPv6 addresses. IPv6 addressing is supported for all commercial and government regions.
  • Object storage

    Oracle Cloud Infrastructure Object Storage provides quick access to large amounts of structured and unstructured data of any content type, including database backups, analytic data, and rich content such as images and videos. You can safely and securely store and then retrieve data directly from the internet or from within the cloud platform. You can scale storage without experiencing any degradation in performance or service reliability. Use standard storage for "hot" storage that you need to access quickly, immediately, and frequently. Use archive storage for "cold" storage that you retain for long periods of time and seldom or rarely access.

  • Oracle GoldenGate

    Oracle GoldenGate is an application that provides real-time data integration, data replication, transactional change data capture, data transformations, high availability solutions, and verification between operational and analytical enterprise systems. This architecture consists of running Oracle GoldenGate on Linux Virtual Machine or Azure Kubernetes Service.

  • Oracle Database@Azure

    Oracle Database@Azure integrates Oracle Exadata Database Service, Oracle Real Application Clusters (Oracle RAC), and Oracle Data Guard technologies into the Azure platform. Oracle Database@Azure service offers the same low latency as other Azure-native services and meets mission-critical workloads and cloud-native development needs. Users manage the service on the Azure console and with Azure automation tools. The service is deployed in Azure Virtual Network (VNet) and integrated with the Azure identity and access management system. The OCI and Oracle Database metrics and audit logs are natively available in Azure. The service requires users to have an Azure tenancy and an OCI tenancy. Oracle Autonomous Database Serverless is also available with Oracle Database@Azure as the world’s first autonomous data management, fully managed in the cloud, to deliver automated patching, upgrades, and tuning, without human intervention. Autonomous Database is built on Oracle Exadata infrastructure, is self-managing, self-securing, and self-repairing, helping eliminate manual database management and human errors. Autonomous Database enables development of scalable AI-powered apps with any data using built-in AI capabilities using your choice of large language model (LLM) and deployment location.

  • Oracle Autonomous Database Serverless

    Oracle Autonomous Database is the world’s first autonomous data management, fully managed in the cloud, to deliver automated patching, upgrades, and tuning, without human intervention. Autonomous Database is built on Oracle Exadata infrastructure, is self-managing, self-securing, and self-repairing, helping eliminate manual database management and human errors. Autonomous Database enables development of scalable AI-powered apps with any data using built-in AI capabilities using your choice of large language model (LLM) and deployment location.

  • Oracle Exadata Database Service on Dedicated Infrastructure

    Oracle Exadata Database Service on Dedicated Infrastructure provides Oracle Exadata Database Machine as a service in an Oracle Cloud Infrastructure (OCI) data center. The Oracle Exadata Database Service on Dedicated Infrastructure instance is a virtual machine (VM) cluster that resides on Exadata racks in an OCI region.

    Oracle Exadata Database Service delivers proven Oracle Database capabilities on purpose-built, optimized Oracle Exadata infrastructure in the public cloud. Built-in cloud automation, elastic resource scaling, security, and fast performance for OLTP, in-memory analytics, and converged Oracle Database workloads help simplify management and reduce costs.

The architecture has the following Azure components:

  • Azure Virtual Network (VNet)

    Azure Virtual Network (VNet) is the fundamental building block for your private network in Azure. VNet enables many types of Azure resources such as Azure virtual machines to securely communicate with each other, the internet, and on-premises networks.

  • Azure Delegated Subnet

    Subnet delegation is Microsoft's ability to inject a managed service, specifically a platform-as-a-service service, directly into your virtual network. This means that you can designate or delegate a subnet to be a home for an external managed service inside of your virtual network, or in other words, that external service will act as a virtual network resource, even though technically it is an external platform-as-a-service service.

  • Virtual network interface card (VNIC)

    The services in Azure data centers have physical network interface cards (NICs). Virtual machine instances communicate using virtual NICs (VNICs) associated with the physical NICs. Each instance has a primary VNIC that's automatically created and attached during launch and is available during the instance's lifetime.

Considerations

Consider the following points when deploying this reference architecture.

  • Performance

    This reference architecture is recommended for high performance low latency data replication for resources located in the same region such as Oracle Database@Azure, Oracle GoldenGate, Azure Data Lake, and Azure Synapse. While cross-region implementations might have slightly higher latencies.

  • Parallelism

    Configure Parallel replication in Oracle GoldenGate to speed up applying lag where possible.

  • Security

    We strongly recommend implementing a least privilege access model and conducting regular reviews of access logs and open ports.

  • Availability

    We recommend leveraging the scalability, reliability, and security of cloud infrastructure with automated backups, disaster recovery and failover mechanisms. This ensures your critical systems and data are protected and stay available, while minimizing downtime and enabling seamless recovery during unforeseen events.

  • Cost

    Oracle GoldenGate is licenced based on number of source and target processors, whereas OCI GoldenGate users pay for the OCPU's used by their deployments regardless of the source and target configuration. We suggest performing a cost analysis before implementing this architecture to determine where to deploy Oracle GoldenGate (Azure or OCI).

Explore More

Learn more about implementing Oracle GoldenGate in Azure with Oracle Database@Azure.

Review these other solutions to learn more about similar use cases:

Oracle Database@Azure resources:

Oracle GoldenGate resources:

Oracle Cloud Infrastructure resources:

Acknowledgments

  • Author: Neeraj Tyagi
  • Contributors: Julien Testut, Julien Silverston, Thomas Van Buggenhout, Suzanne Holliday