html
- Title and Copyright Information
- Preface
- Overview
- Prepare
- Install
- Get Started
- Upgrade
- Secure
- Configure
- Configuring Oracle GoldenGate for Distributed Applications and Analytics
- Running with Replicat
- About Schema Evolution and Metadata Change Events
- About Configuration Property CDATA[] Wrapping
- Using Regular Expression Search and Replace
- Scaling Oracle GoldenGate for Distributed Applications and Analytics Delivery
- Coordinated Apply Support
- Configuring Cluster High Availability
- Using Identities in Oracle GoldenGate Credential Store
- Logging
- Configuring Logging
- Configuring Oracle GoldenGate for Distributed Applications and Analytics
- Quickstarts
- QuickStarts: Prerequisites
- Realtime Data Ingestion into Snowflake with Oracle GoldenGate for Distributed Applications and Analytics
- Realtime Parquet Ingestion into Google Cloud Storage with GoldenGate for Distributed Applications and Analytics 23.8 and later
- Realtime Parquet Ingestion into Google Cloud Storage with Oracle GoldenGate for Distributed Applications and Analytics
- Realtime Parquet Ingestion into AWS S3 Buckets with Oracle GoldenGate for Distributed Applications and Analytics 23.8 and later
- Realtime Parquet Ingestion into AWS S3 Buckets with Oracle GoldenGate for Distributed Applications and Analytics
- Realtime Parquet Ingestion into Azure Data Lake Storage with Oracle GoldenGate for Distributed Applications and Analytics 23.8 and later
- Realtime Parquet Ingestion into Azure Data Lake Storage with Oracle GoldenGate for Distributed Applications and Analytics
- Realtime Parquet Ingestion into OCI Object Storage with Oracle GoldenGate for Distributed Applications and Analytics 23.8 and later
- Realtime Parquet Ingestion into OCI Object Storage with Oracle GoldenGate for Distributed Applications and Analytics
- Realtime Message Ingestion to OCI Streaming with Oracle GoldenGate for Distributed Applications and Analytics
- Realtime Message Ingestion to Azure Event Hubs with Oracle GoldenGate for Distributed Applications and Analytics
- Realtime Data Ingestion into GCP BigQuery with Oracle GoldenGate for Distributed Applications and Analytics
- Realtime Message Ingestion to Google Pub/Sub with Oracle GoldenGate for Distributed Applications and Analytics
- Realtime Message Ingestion to Apache Kafka with Oracle GoldenGate for Distributed Applications and Analytics
- Realtime Data Ingestion into Azure Databricks (unity catalog enabled) with GoldenGate for DAA
- Realtime Data Ingestion into Oracle AI Data Platform with Oracle GoldenGate for DAA
- Best Practices
- Apache Kafka
- Configuration Considerations and Best Practices
- Oracle GoldenGate Kafka Replicat Topic Mapping
- Oracle GoldenGate Kafka Replicat Schema Registry and Schema Propagation
- Oracle GoldenGate Kafka Replicat Partition Selection and Order Consistency
- Propagating Additional Metadata with Oracle GoldenGate Kafka Replicat
- Oracle GoldenGate Kafka Replicat Message Modes and Maintaining Transactional Boundaries
- Oracle GoldenGate Kafka Replicat Message Formatting
- Security Considerations and Best Practices
- Performance Considerations
- Cloud Object Storage Replication
- Snowflake
- Introduction
- Architecture Overview
- Configuration Considerations and Best Practices
- Snowflake Session and Connection Stability
- Snowflake Authentication
- Precise Instantiation for Snowflake
- Snowflake Compute and Cost Considerations
- Snowflake Schema Change Handling
- LOB Type Replication
- Snowflake Apache Iceberg Tables
- Handling PK Updates for Snowflake Stage and Merge Replicat
- Oracle GoldenGate Snowflake Performance Considerations
- Apache Kafka
- Connect
- About Oracle GoldenGate for DAA Connections
- Object Storage
- Cloud Data Warehouse
- Lakehouse and Open Table Formats
- Streaming and Messaging
- NoSQL and Document Stores
- Cache and Search
- JMS and File Systems
- Generic Connectivity
- Replicate Data
- Source
- Add Extract
- Amazon MSK
- Amazon DocumentDB
- Apache Cassandra
- Overview
- Setting Up Cassandra Extract Change Data Capture
- Deduplication
- Topology Changes
- Data Availability in the CDC Logs
- Using Initial Load Extract
- Using Change Data Capture Extract
- Replicating to RDMBS Targets
- Partition Update or Insert of Static Columns
- Partition Delete
- Security and Authentication
- Cleanup of CDC Commit Log Files
- Multiple Extract Support
- CDC Configuration Reference
- Troubleshooting
- Cassandra Capture Client Dependencies
- Apache Kafka
- Azure Event Hubs
- Confluent Kafka
- DataStax
- Java Message Service (JMS)
- MongoDB
- Overview
- Prerequisites to Setting up MongoDB
- MongoDB Database Operations
- Using Extract Initial Load
- Using Change Data Capture Extract
- Positioning the Extract
- Security and Authentication
- MongoDB Bidirectional Replication
- MongoDB Configuration Reference
- Columns in Trail File
- Update Operation Behavior
- Oplog Size Recommendations
- Troubleshooting
- MongoDB Capture Client Dependencies
- Microsoft Fabric Eventstreams
- OCI Streaming
- Snowflake Capture
- Target
- Amazon DocumentDB
- Add Replicat
- Amazon Kinesis
- Amazon MSK
- Amazon Redshift
- Detailed Functionality
- Operation Aggregation
- Unsupported Operations and Limitations
- Uncompressed UPDATE records
- Error During the Data Load Process
- Troubleshooting and Diagnostics
- Classpath
- Configuration
- INSERTALLRECORDS Support
- Redshift COPY SQL Authorization
- Coordinated Apply Support
- Support for Mixed Case Identifiers
- AWS Secrets Manager Authentication
- Restrictions on Database Object Names
- Amazon S3
- Apache Cassandra
- Overview
- Detailing the Functionality
- Setting Up and Running the Cassandra Handler
- About Automated DDL Handling
- Performance Considerations
- Additional Considerations
- Troubleshooting
- Cassandra Handler Client Dependencies
- Apache HBase
- Apache HDFS
- Overview
- Writing into HDFS in SequenceFile Format
- Setting Up and Running the HDFS Handler
- Writing in HDFS in Avro Object Container File Format
- Generating HDFS File Names Using Template Strings
- Metadata Change Events
- Partitioning
- HDFS Additional Considerations
- Best Practices
- Troubleshooting the HDFS Handler
- HDFS Handler Client Dependencies
- Apache Kafka
- Overview
- Apache Kafka Connect Handler
- Overview
- Detailed Functionality
- Setting Up and Running the Kafka Connect Handler
- Connecting to a Secure Schema Registry
- Kafka Connect Handler Performance Considerations
- Kafka Interceptor Support
- Kafka Partition Selection
- Troubleshooting the Kafka Connect Handler
- Kafka Connect Handler Client Dependencies
- Apache Kafka REST Proxy
- Overview
- Setting Up and Starting the Kafka REST Proxy Handler Services
- Using the Kafka REST Proxy Handler
- Downloading the Dependencies
- Classpath Configuration
- Kafka REST Proxy Handler Configuration
- Review a Sample Configuration
- Security
- Generating a Keystore or Truststore
- Using Templates to Resolve the Topic Name and Message Key
- Kafka REST Proxy Handler Formatter Properties
- Consuming the Records
- Performance Considerations
- Kafka REST Proxy Handler Metacolumns Template Property
- Apache Hive
- Apache Iceberg
- Detailed Functionality
- Replication without a SQL Engine
- Iceberg File Format
- Iceberg Catalog
- Iceberg Specification
- Delete Files and Merge-On-Read (MoR)
- Operation Support
- Compressed Update Handling
- INSERTALLRECORDS Support
- Operation Aggregation
- Automatic Table Creation
- Iceberg Metadata Provider
- Iceberg Identifier Fields
- Primary Key Updates and Truncates
- Configuration
- Automatic Configuration
- Configuration for Iceberg Nessie Catalog
- Configuration for Iceberg AWS Glue Catalog
- Configuration for Iceberg Polaris Catalog
- Polaris Common Configuration
- Polaris Catalog with Google Cloud Storage (GCS)
- Polaris Catalog with AWS S3 Storage
- Polaris Catalog with Azure Data Lake Storage (ADLS)
- Polaris Catalog and GCS Storage Classpath And Dependencies
- Polaris Catalog and AWS S3 storage Classpath and Dependencies
- Polaris Catalog and ADLS storage Classpath And Dependencies
- Sample Configuration for Polaris Catalog
- Polaris Namespace
- Configuration for Iceberg REST Catalog
- Configuration for Iceberg REST Catalog
- Sample Configuration for REST Catalog based on Polaris
- Sample Rest Catalog Properties file (For Polaris)
- Configuration and Table Names for REST Catalog based on AWS S3 Tables properties
- Sample configuration for REST Catalog based on IBM watsonx.data
- Sample Rest Catalog Properties file (For IBM watsonx.data)
- Standalone Utility to Test Connection to Apache Iceberg REST Catalog
- Configuration for Iceberg Hadoop Catalog
- Configuration for Oracle AI Data Catalog
- Configuration Templates
- Limitations
- Instantiating Oracle GoldenGate with an Initial Load
- Iceberg Version 3 Support
- Troubleshooting and Diagnostics
- Detailed Functionality
- Apache Pulsar
- Azure Blob Storage
- Azure Data Lake Storage
- Azure Event Hubs
- Azure Synapse Analytics Data Warehouse
- Detailed Functionality
- Operation Aggregation
- Compressed Update Handling
- Configuration
- Restrictions on Database Object Names
- Troubleshooting and Diagnostics
- Databricks
- Detailed Functionality
- Configuration
- Automatic Configuration
- Authentication to Databricks
- Unity Catalog
- Create an External Location
- Compute Clusters Without Unity Catalog
- Classpath Configuration
- Proxy Configuration
- INSERTALLRECORDS Support
- Operation Aggregation
- Compressed Update Handling
- End-to-End Configuration
- Table Mapping
- Replicat mode
- Troubleshooting and Diagnostics
- Restrictions on Database Object Names
- DataStax
- Confluent Kafka
- Elasticsearch
- Elasticsearch with Elasticsearch 7x and 6x
- Overview
- Detailing the Functionality
- Setting Up and Running the Elasticsearch Handler
- Troubleshooting
- Performance Consideration
- About the Shield Plug-In Support
- About DDL Handling
- Known Issues in the Elasticsearch Handler
- Elasticsearch Handler Transport Client Dependencies
- Elasticsearch High Level REST Client Dependencies
- Elasticsearch 8x
- Overview
- Detailing the Functionality
- About the Index
- About the Document
- About the Data Types
- About the Connection
- About Supported Operation
- About DDL Handling
- About the Primary Key Update
- About UPSERT
- About Bulk Write
- About Routing
- About Request Headers
- About Java API Client
- Setting Up the Elasticsearch Handler
- Elasticsearch Handler Configuration
- Enabling Security for Elasticsearch
- Security Configuration for Elasticsearch Cluster
- Security Configuration for Elasticsearch Handler
- Troubleshooting
- Elasticsearch Handler Client Dependencies
- Support for Vector Data
- Elasticsearch with Elasticsearch 7x and 6x
- Flat Files
- Google BigQuery
- BigQuery Streaming Handler
- Google BigQuery Stage and Merge
- Google Cloud Storage
- Google Cloud Managed Service for Apache Kafka
- Google Pub/Sub
- Java Message Service (JMS)
- Java Database Connectivity
- Microsoft Fabric Eventstreams
- Microsoft Fabric OneLake
- OneLake Event Handler Prerequisites
- OneLake Mappings to Azure Data Lake Gen2
- OneLake Event Handler Configuration
- OneLake Event Handler Automatic Configuration
- File Writer Handler Configuration
- Autoconfiguration of Parquet/ORC Event Handler
- OneLake Event Handler Configuration
- File Format for the Lakehouse target
- OneLake Event Handler Classpath Configuration
- OneLake Event Handler Authentication
- OneLake Event Handler Proxy Configuration
- Sample Configuration for Lakehouse Target
- Sample Configuration for Mirrored Database Target
- Performance Considerations
- Upload Reliability and Temporary Files
- OneLake Event Handler Primary Key Update
- Ingesting into Fabric Mirrored Tables using Partitioning
- Managing the partnerEvents.json File for Fabric Mirrored Databases
- OneLake Event Handler Troubleshooting and Diagnostics
- MongoDB
- Overview
- MongoDB Wire Protocol
- Supported Target Types
- Detailed Functionality
- Setting Up and Running the MongoDB Handler
- Security and Authentication
- Reviewing Sample Configurations
- MongoDB to AJD/ATP Migration
- Configuring an Initial Synchronization of Extract for a MongoDB Source Database using Precise Instantiation
- Delivery to Oracle AI Database JSON Collection Tables
- MongoDB Handler Client Dependencies
- Oracle AI Data Platform
- OCI Streaming
- Oracle NoSQL
- OCI Autonomous Data Warehouse
- OCI Search
- OCI Object Storage
- Redis
- Snowflake
- Snowflake Stage and Merge Handler
- Snowflake Streaming Handler
- Supported Snowflake Date Datatypes
- Snowflake Iceberg Tables
- Additional Details
- HDFS Event Handler
- Metacolumn Keywords
- Metadata Providers
- Pluggable Formatters
- Using Operation-Based versus Row-Based Formatting
- Using the Avro Formatter
- Cloud Event Formatter
- Existing Avro Formatter
- Using the Delimited Text Formatter
- Using the JSON Formatter
- Operation Metadata Formatting Details
- Operation Data Formatting Details
- Row Data Formatting Details
- Sample JSON Messages
- JSON Schemas
- JSON Formatter Configuration Properties
- Review a Sample Configuration
- Metadata Change Events
- JSON Primary Key Updates
- Integrating Oracle Stream Analytics
- Mongo Document Formatting Details
- Using the Length Delimited Value Formatter
- Using the XML Formatter
- Stage and Merge Data Warehouse Replication
- Template Keywords
- Velocity Dependencies
- Oracle GoldenGate Java Delivery
- Source
- Administer
- Automatic Heartbeat for Oracle GoldenGate for Distributed Applications and Analytics
- Parsing the Message
- Message Capture Properties
- Logging and Connection Properties
- Parser Properties
- Setting the Type of Parser
- Fixed Parser Properties
- fixed.schematype
- fixed.sourcedefs
- fixed.copybook
- fixed.header
- fixed.seqid
- fixed.timestamp
- fixed.timestamp.format
- fixed.txid
- fixed.txowner
- fixed.txname
- fixed.optype
- fixed.optype.insertval
- fixed.optype.updateval
- fixed.optype.deleteval
- fixed.table
- fixed.schema
- fixed.txind
- fixed.txind.beginval
- fixed.txind.middleval
- fixed.txind.endval
- fixed.txind.wholeval
- Delimited Parser Properties
- delim.sourcedefs
- delim.header
- delim.seqid
- delim.timestamp
- delim.timestamp.format
- delim.txid
- delim.txowner
- delim.txname
- delim.optype
- delim.optype.insertval
- delim.optype.updateval
- delim.optype.deleteval
- delim.schemaandtable
- delim.schema
- delim.table
- delim.txind
- delim.txind.beginval
- delim.txind.middleval
- delim.txind.endval
- delim.txind.wholeval
- delim.fielddelim
- delim.linedelim
- delim.quote
- delim.nullindicator
- delim.fielddelim.escaped
- delim.linedelim.escaped
- delim.quote.escaped
- delim.nullindicator.escaped
- delim.hasbefores
- delim.hasnames
- delim.afterfirst
- delim.isgrouped
- delim.dateformat \ delim.dateformat.table \ delim.dateform.table.column
- XML Parser Properties
- xml.sourcedefs
- xml.rules
- rulename.type
- rulename.match
- rulename.subrules
- txrule.timestamp
- txrule.timestamp.format
- txrule.seqid
- txrule.txid
- txrule.txowner
- txrule.txname
- oprule.timestamp
- oprule.timestamp.format
- oprule.seqid
- oprule.txid
- oprule.txowner
- oprule.txname
- oprule.schemandtable
- oprule.schema
- oprule.table
- oprule.optype
- oprule.optype.insertval
- oprule.optype.updateval
- oprule.optype.deleteval
- oprule.txind
- oprule.txind.beginval
- oprule.txind.middleval
- oprule.txind.endval
- oprule.txind.wholeval
- colrule.name
- colrule.index
- colrule.value
- colrule.isnull
- colrule.ismissing
- colrule.before.value
- colrule.before.isnull
- colrule.before.ismissing
- colrule.after.value
- colrule.after.isnull
- colrule.after.ismissing
- Oracle GoldenGate Java Delivery
- Configuring Java Delivery
- Running Java Delivery
- Configuring Event Handlers
- Java Delivery Properties
- Common Properties
- Delivery Properties
- Java Application Properties
- Properties for All Handlers
- Properties for Formatted Output
- Properties for CSV and Fixed Format Output
- gg.handler.name.format.delim
- gg.handler.name.format.quote
- gg.handler.name.format.metacols
- gg.handler.name.format.missingColumnChar
- gg.handler.name.format.presentColumnChar
- gg.handler.name.format.nullColumnChar
- gg.handler.name.format.beginTxChar
- gg.handler.name.format.middleTxChar
- gg.handler.name.format.endTxChar
- gg.handler.name.format.wholeTxChar
- gg.handler.name.format.insertChar
- gg.handler.name.format.updateChar
- gg.handler.name.format.deleteChar
- gg.handler.name.format.truncateChar
- gg.handler.name.format.endOfLine
- gg.handler.name.format.justify
- gg.handler.name.format.includeBefores
- File Writer Properties
- JMS Handler Properties
- JNDI Properties
- General Properties
- Java Delivery Transaction Grouping
- Developing Custom Filters, Formatters, and Handlers
- Configuring Data Transforms
- Troubleshoot