Table of Contents
- Title and Copyright Information
- Preface
- 1 Overview
-
2
Prepare
-
2.1
Preparing for Installation
- 2.1.1 Downloading Oracle GoldenGate for Distributed Applications and Analytics
-
2.1.2
Installation Overview
- 2.1.2.1 Contents of the Installation ZIP File
- 2.1.2.2 Using the Generic Build of Oracle GoldenGate
- 2.1.2.3 Considerations for Using a Custom Build for a GoldenGate for Distributed Applications and Analytics Instance of Oracle GoldenGate
- 2.1.2.4 Installing to a Non-Generic Instance of Oracle GoldenGate
- 2.1.3 Directories and Variables in Microservices Architecture
- 2.1.4 Setting up Environmental Variables
-
2.1
Preparing for Installation
-
3
Install
- 3.1 Setting up Oracle GoldenGate for Distributed Applications and Analytics in a High Availability Environment
- 3.2 Installing Oracle GoldenGate for Distributed Applications and Analytics
- 4 Get Started
- 5 Upgrade
- 6 Secure
-
7
Configure
-
7.1
Configuring Oracle GoldenGate for Distributed
Applications and Analytics
- 7.1.1 Running with Replicat
- 7.1.2 About Schema Evolution and Metadata Change Events
- 7.1.3 About Configuration Property CDATA[] Wrapping
- 7.1.4 Using Regular Expression Search and Replace
- 7.1.5 Scaling Oracle GoldenGate for Distributed Applications and Analytics Delivery
- 7.1.6 Coordinated Apply Support
- 7.1.7 Configuring Cluster High Availability
- 7.1.8 Using Identities in Oracle GoldenGate Credential Store
- 7.2 Logging
- 7.3 Configuring Logging
-
7.1
Configuring Oracle GoldenGate for Distributed
Applications and Analytics
-
8
Quickstarts
- 8.1 QuickStarts: Prerequisites
- 8.2 Realtime Data Ingestion into Snowflake with Oracle GoldenGate for Distributed Applications and Analytics
- 8.3 Realtime Parquet Ingestion into Google Cloud Storage with GoldenGate for Distributed Applications and Analytics 23.8 and later
- 8.4 Realtime Parquet Ingestion into Google Cloud Storage with Oracle GoldenGate for Distributed Applications and Analytics
- 8.5 Realtime Parquet Ingestion into AWS S3 Buckets with Oracle GoldenGate for Distributed Applications and Analytics 23.8 and later
- 8.6 Realtime Parquet Ingestion into AWS S3 Buckets with Oracle GoldenGate for Distributed Applications and Analytics
- 8.7 Realtime Parquet Ingestion into Azure Data Lake Storage with Oracle GoldenGate for Distributed Applications and Analytics 23.8 and later
- 8.8 Realtime Parquet Ingestion into Azure Data Lake Storage with Oracle GoldenGate for Distributed Applications and Analytics
- 8.9 Realtime Parquet Ingestion into OCI Object Storage with Oracle GoldenGate for Distributed Applications and Analytics 23.8 and later
- 8.10 Realtime Parquet Ingestion into OCI Object Storage with Oracle GoldenGate for Distributed Applications and Analytics
- 8.11 Realtime Message Ingestion to OCI Streaming with Oracle GoldenGate for Distributed Applications and Analytics
- 8.12 Realtime Message Ingestion to Azure Event Hubs with Oracle GoldenGate for Distributed Applications and Analytics
- 8.13 Realtime Data Ingestion into GCP BigQuery with Oracle GoldenGate for Distributed Applications and Analytics
- 8.14 Realtime Message Ingestion to Google Pub/Sub with Oracle GoldenGate for Distributed Applications and Analytics
- 8.15 Realtime Message Ingestion to Apache Kafka with Oracle GoldenGate for Distributed Applications and Analytics
- 8.16 Realtime Data Ingestion into Azure Databricks (unity catalog enabled) with GoldenGate for DAA
-
9
Replicate Data
-
9.1
Source
- 9.1.1 Add Extract
- 9.1.2 Amazon MSK
- 9.1.3 Amazon DocumentDB
-
9.1.4
Apache Cassandra
- 9.1.4.1 Overview
- 9.1.4.2 Setting Up Cassandra Extract Change Data Capture
- 9.1.4.3 Deduplication
- 9.1.4.4 Topology Changes
- 9.1.4.5 Data Availability in the CDC Logs
- 9.1.4.6 Using Initial Load Extract
- 9.1.4.7 Using Change Data Capture Extract
- 9.1.4.8 Replicating to RDMBS Targets
- 9.1.4.9 Partition Update or Insert of Static Columns
- 9.1.4.10 Partition Delete
- 9.1.4.11 Security and Authentication
- 9.1.4.12 Cleanup of CDC Commit Log Files
- 9.1.4.13 Multiple Extract Support
- 9.1.4.14 CDC Configuration Reference
- 9.1.4.15 Troubleshooting
- 9.1.4.16 Cassandra Capture Client Dependencies
-
9.1.5
Apache Kafka
- 9.1.5.1 Overview
- 9.1.5.2 Prerequisites
-
9.1.5.3
General Terms and Functionality of Kafka
Capture
- 9.1.5.3.1 Kafka Streams
- 9.1.5.3.2 Kafka Message Order
- 9.1.5.3.3 Kafka Message Timestamps
- 9.1.5.3.4 Kafka Message Coordinates
- 9.1.5.3.5 Start Extract Modes
- 9.1.5.3.6 General Configuration Overview
- 9.1.5.3.7 OGGSOURCE parameter
- 9.1.5.3.8 The Extract Parameter File
- 9.1.5.3.9 Kafka Consumer Properties File
- 9.1.5.4 Generic Mutation Builder
- 9.1.5.5 Kafka Connect Mutation Builder
- 9.1.5.6 Example Configuration Files
- 9.1.6 Azure Event Hubs
- 9.1.7 Confluent Kafka
- 9.1.8 DataStax
- 9.1.9 Java Message Service (JMS)
-
9.1.10
MongoDB
- 9.1.10.1 Overview
- 9.1.10.2 Prerequisites to Setting up MongoDB
- 9.1.10.3 MongoDB Database Operations
- 9.1.10.4 Using Extract Initial Load
- 9.1.10.5 Using Change Data Capture Extract
- 9.1.10.6 Positioning the Extract
- 9.1.10.7 Security and Authentication
- 9.1.10.8 MongoDB Bidirectional Replication
- 9.1.10.9 Mongo DB Configuration Reference
- 9.1.10.10 Columns in Trail File
- 9.1.10.11 Update Operation Behavior
- 9.1.10.12 Oplog Size Recommendations
- 9.1.10.13 Troubleshooting
- 9.1.10.14 MongoDB Capture Client Dependencies
- 9.1.11 OCI Streaming
-
9.2
Target
- 9.2.1 Add Replicat
- 9.2.2 Amazon DocumentDB
-
9.2.3
Amazon Kinesis
- 9.2.3.1 Overview
- 9.2.3.2 Detailed Functionality
-
9.2.3.3
Setting Up and Running the Kinesis Streams Handler
- 9.2.3.3.1 Set the Classpath in Kinesis Streams Handler
- 9.2.3.3.2 Kinesis Streams Handler Configuration
- 9.2.3.3.3 Using Templates to Resolve the Stream Name and Partition Name
- 9.2.3.3.4 Resolving AWS Credentials
- 9.2.3.3.5 Configuring the Proxy Server for Kinesis Streams Handler
- 9.2.3.3.6 Configuring Security in Kinesis Streams Handler
- 9.2.3.4 Kinesis Handler Performance Considerations
- 9.2.3.5 Troubleshooting
- 9.2.4 Amazon MSK
-
9.2.5
Amazon Redshift
- 9.2.5.1 Detailed Functionality
- 9.2.5.2 Operation Aggregation
- 9.2.5.3 Unsupported Operations and Limitations
- 9.2.5.4 Uncompressed UPDATE records
- 9.2.5.5 Error During the Data Load Proces
- 9.2.5.6 Troubleshooting and Diagnostics
- 9.2.5.7 Classpath
- 9.2.5.8 Configuration
- 9.2.5.9 INSERTALLRECORDS Support
- 9.2.5.10 Redshift COPY SQL Authorization
- 9.2.5.11 Co-ordinated Apply Support
- 9.2.5.12 Support for Mixed Case Identifiers
- 9.2.6 Amazon S3
-
9.2.7
Apache Cassandra
- 9.2.7.1 Overview
- 9.2.7.2 Detailing the Functionality
- 9.2.7.3 Setting Up and Running the Cassandra Handler
- 9.2.7.4 About Automated DDL Handling
- 9.2.7.5 Performance Considerations
- 9.2.7.6 Additional Considerations
- 9.2.7.7 Troubleshooting
- 9.2.7.8 Cassandra Handler Client Dependencies
- 9.2.8 Apache HBase
-
9.2.9
Apache HDFS
- 9.2.9.1 Overview
- 9.2.9.2 Writing into HDFS in SequenceFile Format
- 9.2.9.3 Setting Up and Running the HDFS Handler
- 9.2.9.4 Writing in HDFS in Avro Object Container File Format
- 9.2.9.5 Generating HDFS File Names Using Template Strings
- 9.2.9.6 Metadata Change Events
- 9.2.9.7 Partitioning
- 9.2.9.8 HDFS Additional Considerations
- 9.2.9.9 Best Practices
- 9.2.9.10 Troubleshooting the HDFS Handler
- 9.2.9.11 HDFS Handler Client Dependencies
-
9.2.10
Apache Kafka
-
9.2.10.1
Apache Kafka
- 9.2.10.1.1 Overview
- 9.2.10.1.2 Detailed Functionality
-
9.2.10.1.3
Setting Up and Running the Kafka Handler
- 9.2.10.1.3.1 Classpath Configuration
- 9.2.10.1.3.2 Kafka Handler Configuration
- 9.2.10.1.3.3 Java Adapter Properties File
- 9.2.10.1.3.4 Kafka Producer Configuration File
- 9.2.10.1.3.5 Using Templates to Resolve the Topic Name and Message Key
- 9.2.10.1.3.6 Kafka Configuring with Kerberos on a Hadoop Platform
- 9.2.10.1.3.7 Kafka SSL Support
- 9.2.10.1.4 Schema Propagation
- 9.2.10.1.5 Performance Considerations
- 9.2.10.1.6 About Security
- 9.2.10.1.7 Metadata Change Events
- 9.2.10.1.8 Snappy Considerations
- 9.2.10.1.9 Kafka Interceptor Support
- 9.2.10.1.10 Kafka Partition Selection
- 9.2.10.1.11 Troubleshooting
- 9.2.10.1.12 Kafka Handler Client Dependencies
-
9.2.10.2
Apache Kafka Connect Handler
- 9.2.10.2.1 Overview
- 9.2.10.2.2 Detailed Functionality
- 9.2.10.2.3 Setting Up and Running the Kafka Connect Handler
- 9.2.10.2.4 Connecting to a Secure Schema Registry
- 9.2.10.2.5 Kafka Connect Handler Performance Considerations
- 9.2.10.2.6 Kafka Interceptor Support
- 9.2.10.2.7 Kafka Partition Selection
- 9.2.10.2.8 Troubleshooting the Kafka Connect Handler
-
9.2.10.2.9
Kafka Connect Handler Client Dependencies
- 9.2.10.2.9.1 Kafka 2.8.0
- 9.2.10.2.9.2 Kafka 2.7.1
- 9.2.10.2.9.3 Kafka 2.6.0
- 9.2.10.2.9.4 Kafka 2.5.1
- 9.2.10.2.9.5 Kafka 2.4.1
- 9.2.10.2.9.6 Kafka 2.3.1
- 9.2.10.2.9.7 Kafka 2.2.1
- 9.2.10.2.9.8 Kafka 2.1.1
- 9.2.10.2.9.9 Kafka 2.0.1
- 9.2.10.2.9.10 Kafka 1.1.1
- 9.2.10.2.9.11 Kafka 1.0.2
- 9.2.10.2.9.12 Kafka 0.11.0.0
- 9.2.10.2.9.13 Kafka 0.10.2.0
- 9.2.10.2.9.14 Kafka 0.10.2.0
- 9.2.10.2.9.15 Kafka 0.10.0.0
- 9.2.10.2.9.16 Kafka 0.9.0.1
-
9.2.10.3
Apache Kafka REST Proxy
- 9.2.10.3.1 Overview
-
9.2.10.3.2
Setting Up and Starting the Kafka REST Proxy Handler Services
- 9.2.10.3.2.1 Using the Kafka REST Proxy Handler
- 9.2.10.3.2.2 Downloading the Dependencies
- 9.2.10.3.2.3 Classpath Configuration
- 9.2.10.3.2.4 Kafka REST Proxy Handler Configuration
- 9.2.10.3.2.5 Review a Sample Configuration
- 9.2.10.3.2.6 Security
- 9.2.10.3.2.7 Generating a Keystore or Truststore
- 9.2.10.3.2.8 Using Templates to Resolve the Topic Name and Message Key
- 9.2.10.3.2.9 Kafka REST Proxy Handler Formatter Properties
- 9.2.10.3.3 Consuming the Records
- 9.2.10.3.4 Performance Considerations
- 9.2.10.3.5 Kafka REST Proxy Handler Metacolumns Template Property
-
9.2.10.1
Apache Kafka
- 9.2.11 Apache Hive
-
9.2.12
Apache Iceberg
-
9.2.12.1
Detailed Functionality
- 9.2.12.1.1 Replication without a SQL Engine
- 9.2.12.1.2 Iceberg File Format
- 9.2.12.1.3 Iceberg Catalog
- 9.2.12.1.4 Iceberg Specification
- 9.2.12.1.5 Delete Files and Merge-On-Read (MoR)
- 9.2.12.1.6 Operation Support
- 9.2.12.1.7 Compressed Update Handling
- 9.2.12.1.8 INSERTALLRECORDS Support
- 9.2.12.1.9 Operation Aggregation
- 9.2.12.1.10 Automatic Table Creation
- 9.2.12.1.11 Iceberg Metadata Provider
- 9.2.12.1.12 Iceberg Identifier Fields
- 9.2.12.1.13 Primary Key Updates and Truncates
-
9.2.12.2
Configuration
- 9.2.12.2.1 Automatic Configuration
- 9.2.12.2.2 Configuration for Iceberg Nessie Catalog
- 9.2.12.2.3 Configuration for Iceberg AWS Glue Catalog
-
9.2.12.2.4
Configuration for Iceberg Polaris
Catalog
- 9.2.12.2.4.1 Polaris Common Configuration
- 9.2.12.2.4.2 Polaris Catalog with Google Cloud Storage (GCS)
- 9.2.12.2.4.3 Polaris Catalog with AWS S3 Storage
- 9.2.12.2.4.4 Polaris Catalog with Azure Data Lake Storage (ADLS)
- 9.2.12.2.4.5 Polaris Catalog and GCS Storage Classpath And Dependencies
- 9.2.12.2.4.6 Polaris Catalog and AWS S3 storage Classpath and Dependencies
- 9.2.12.2.4.7 Polaris Catalog and ADLS storage Classpath And Dependencies
- 9.2.12.2.4.8 Sample Configuration for Polaris Catalog
- 9.2.12.2.4.9 Polaris Namespace
- 9.2.12.2.5 Configuration for Iceberg REST Catalog
- 9.2.12.2.6 Configuration for Iceberg JDBC Catalog
- 9.2.12.2.7 Configuration for Iceberg Hadoop Catalog
- 9.2.12.3 Configuration Templates
- 9.2.12.4 Limitations
- 9.2.12.5 Instantiating Oracle GoldenGate with an Initial Load
- 9.2.12.6 Troubleshooting and Diagnostics
-
9.2.12.1
Detailed Functionality
- 9.2.13 Azure Blob Storage
- 9.2.14 Azure Data Lake Storage
- 9.2.15 Azure Event Hubs
-
9.2.16
Azure Synapse Analytics Data
Warehouse
- 9.2.16.1 Detailed Functionality
- 9.2.16.2 Operation Aggregation
- 9.2.16.3 Compressed Update Handling
- 9.2.16.4 Configuration
- 9.2.16.5 Troubleshooting and Diagnostics
- 9.2.17 Confluent Kafka
-
9.2.18
Databricks
- 9.2.18.1 Detailed Functionality
-
9.2.18.2
Configuration
- 9.2.18.2.1 Automatic Configuration
- 9.2.18.2.2 Authentication to Databricks
- 9.2.18.2.3 Unity Catalog
- 9.2.18.2.4 Create an External Location
- 9.2.18.2.5 Compute Clusters Without Unity Catalog
- 9.2.18.2.6 Classpath Configuration
- 9.2.18.2.7 Proxy Configuration
- 9.2.18.2.8 INSERTALLRECORDS Support
- 9.2.18.2.9 Operation Aggregation
- 9.2.18.2.10 Compressed Update Handling
- 9.2.18.2.11 End-to-End Configuration
- 9.2.18.2.12 Table Mapping
- 9.2.18.3 Troubleshooting and Diagnostics
- 9.2.19 DataStax
-
9.2.20
Elasticsearch
-
9.2.20.1
Elasticsearch with Elasticsearch 7x and
6x
- 9.2.20.1.1 Overview
-
9.2.20.1.2
Detailing the Functionality
- 9.2.20.1.2.1 About the Elasticsearch Version Property
- 9.2.20.1.2.2 About the Index and Type
- 9.2.20.1.2.3 About the Document
- 9.2.20.1.2.4 About the Primary Key Update
- 9.2.20.1.2.5 About the Data Types
- 9.2.20.1.2.6 Operation Mode
- 9.2.20.1.2.7 Operation Processing Support
- 9.2.20.1.2.8 About the Connection
- 9.2.20.1.3 Setting Up and Running the Elasticsearch Handler
- 9.2.20.1.4 Troubleshooting
- 9.2.20.1.5 Performance Consideration
- 9.2.20.1.6 About the Shield Plug-In Support
- 9.2.20.1.7 About DDL Handling
- 9.2.20.1.8 Known Issues in the Elasticsearch Handler
- 9.2.20.1.9 Elasticsearch Handler Transport Client Dependencies
- 9.2.20.1.10 Elasticsearch High Level REST Client Dependencies
-
9.2.20.2
Elasticsearch 8x
- 9.2.20.2.1 Overview
- 9.2.20.2.2 Detailing the Functionality
- 9.2.20.2.3 About the Index
- 9.2.20.2.4 About the Document
- 9.2.20.2.5 About the Data Types
- 9.2.20.2.6 About the Connection
- 9.2.20.2.7 About Supported Operation
- 9.2.20.2.8 About DDL Handling
- 9.2.20.2.9 About the Primary Key Update
- 9.2.20.2.10 About UPSERT
- 9.2.20.2.11 About Bulk Write
- 9.2.20.2.12 About Routing
- 9.2.20.2.13 About Request Headers
- 9.2.20.2.14 About Java API Client
- 9.2.20.2.15 Setting Up the Elasticsearch Handler
- 9.2.20.2.16 Elasticsearch Handler Configuration
- 9.2.20.2.17 Enabling Security for Elasticsearch
- 9.2.20.2.18 Security Configuration for Elasticsearch Cluster
- 9.2.20.2.19 Security Configuration for Elasticsearch Handler
- 9.2.20.2.20 Troubleshooting
- 9.2.20.2.21 Elasticsearch Handler Client Dependencies
- 9.2.20.3 Support for Vector Data
-
9.2.20.1
Elasticsearch with Elasticsearch 7x and
6x
-
9.2.21
Flat Files
- 9.2.21.1 File Writer Handler
- 9.2.21.2 Optimized Row Columnar (ORC)
- 9.2.21.3 Parquet
-
9.2.22
Google BigQuery
- 9.2.22.1 BigQuery Streaming Handler
-
9.2.22.2
Google BigQuery Stage and Merge
- 9.2.22.2.1 Overview
- 9.2.22.2.2 Detailed Functionality
- 9.2.22.2.3 Prerequisites
- 9.2.22.2.4 Differences between BigQuery Handler and Stage and Merge BigQuery Event Handler
- 9.2.22.2.5 Authentication or Authorization
- 9.2.22.2.6 Operation Aggregation
- 9.2.22.2.7 Compressed Update Handling
- 9.2.22.2.8 Configuration
- 9.2.22.2.9 Troubleshooting and Diagnostics
- 9.2.23 Google Cloud Storage
- 9.2.24 Google Pub/Sub
- 9.2.25 Java Message Service (JMS)
- 9.2.26 Java Database Connectivity
-
9.2.27
Microsoft Fabric OneLake
- 9.2.27.1 OneLake Event Handler Prerequisites
- 9.2.27.2 OneLake Mappings to Azure Data Lake Gen2
-
9.2.27.3
OneLake Event Handler Configuration
- 9.2.27.3.1 OneLake Event Handler Automatic Configuration
- 9.2.27.3.2 File Writer Handler Configuration
- 9.2.27.3.3 Autoconfiguration of Parquet/ORC Event Handler
- 9.2.27.3.4 OneLake Event Handler Configuration
- 9.2.27.3.5 File Format for the Lakehouse target
- 9.2.27.3.6 OneLake Event Handler Classpath Configuration
- 9.2.27.3.7 OneLake Event Handler Authentication
- 9.2.27.3.8 OneLake Event Handler Proxy Configuration
- 9.2.27.3.9 Sample Configuration for Lakehouse Target
- 9.2.27.3.10 Sample Configuration for Mirrored Database Target
- 9.2.27.4 OneLake Event Handler Primary Key Update
- 9.2.27.5 OneLake Event Handler Troubleshooting and Diagnostics
-
9.2.28
MongoDB
- 9.2.28.1 Overview
- 9.2.28.2 MongoDB Wire Protocol
- 9.2.28.3 Supported Target Types
- 9.2.28.4 Detailed Functionality
- 9.2.28.5 Setting Up and Running the MongoDB Handler
- 9.2.28.6 Security and Authentication
- 9.2.28.7 Reviewing Sample Configurations
- 9.2.28.8 MongoDB to AJD/ATP Migration
- 9.2.28.9 Configuring an Initial Synchronization of Extract for a MongoDB Source Database using Precise Instantiation
-
9.2.28.10
Delivery to Oracle JSON Collection Table
(JCT)
- 9.2.28.10.1 Install Oracle Database 23c Free
- 9.2.28.10.2 Connect to Oracle Database
- 9.2.28.10.3 Create a New Pluggable Database (PDB)
- 9.2.28.10.4 Create a User for ORDS
- 9.2.28.10.5 Generate SSL Certificates
- 9.2.28.10.6 Oracle REST Data Services (ORDS) Installation and Setup
- 9.2.28.10.7 MongoDB Handler Configuration and Setup
- 9.2.28.10.8 Error Handling
- 9.2.28.11 MongoDB Handler Client Dependencies
- 9.2.29 OCI Streaming
-
9.2.30
Oracle NoSQL
- 9.2.30.1 Overview
- 9.2.30.2 On-Premise Connectivity
- 9.2.30.3 OCI Cloud Connectivity
- 9.2.30.4 Oracle NoSQL Types
- 9.2.30.5 Oracle NoSQL Handler Configuration
- 9.2.30.6 Performance Considerations
- 9.2.30.7 Operation Processing Support
- 9.2.30.8 Column Processing
- 9.2.30.9 Table Check and Reconciliation Process
- 9.2.30.10 Oracle NoSQL SDK Dependencies
-
9.2.31
OCI Autonomous Data Warehouse
- 9.2.31.1 Detailed Functionality
- 9.2.31.2 ADW Database Credential to Access OCI ObjectStore File
- 9.2.31.3 ADW Database User Privileges
- 9.2.31.4 Unsupported Operations/ Limitations
- 9.2.31.5 Troubleshooting and Diagnostics
- 9.2.31.6 Classpath
-
9.2.31.7
Configuration
- 9.2.31.7.1 Automatic Configuration
- 9.2.31.7.2 File Writer Handler Configuration
- 9.2.31.7.3 OCI Event Handler Configuration
- 9.2.31.7.4 ADW Event Handler Configuration
- 9.2.31.7.5 INSERTALLRECORDS Support
- 9.2.31.7.6 In-Memory Operation Aggregation
- 9.2.31.7.7 End-to-End Configuration
- 9.2.31.7.8 Compressed Update Handling
- 9.2.32 Oracle Cloud Infrastructure Object Storage
- 9.2.33 Redis
-
9.2.34
Snowflake
-
9.2.34.1
Snowflake Stage and Merge Handler
- 9.2.34.1.1 Overview
- 9.2.34.1.2 Detailed Functionality
-
9.2.34.1.3
Configuration
- 9.2.34.1.3.1 Automatic Configuration
- 9.2.34.1.3.2 Snowflake Storage Integration
- 9.2.34.1.3.3 Classpath Configuration
- 9.2.34.1.3.4 Proxy Configuration
- 9.2.34.1.3.5 INSERTALLRECORDS Support
- 9.2.34.1.3.6 Snowflake Key Pair Authentication
- 9.2.34.1.3.7 Mapping Source JSON/XML to Snowflake VARIANT
- 9.2.34.1.3.8 Operation Aggregation
- 9.2.34.1.3.9 Compressed Update Handling
- 9.2.34.1.3.10 End-to-End Configuration
- 9.2.34.1.3.11 Table Mapping
- 9.2.34.1.4 Snowflake Iceberg Tables
- 9.2.34.1.5 Troubleshooting and Diagnostics
- 9.2.34.2 Snowflake Streaming Handler
- 9.2.34.3 Supported Snowflake Date Datatypes
-
9.2.34.1
Snowflake Stage and Merge Handler
-
9.2.35
Additional Details
- 9.2.35.1 HDFS Event Handler
- 9.2.35.2 Metacolumn Keywords
-
9.2.35.3
Metadata Providers
- 9.2.35.3.1 About the Metadata Providers
- 9.2.35.3.2 Avro Metadata Provider
- 9.2.35.3.3 Cassandra Metadata Provider
- 9.2.35.3.4 Java Database Connectivity Metadata Provider
-
9.2.35.3.5
Hive Metadata Provider
- 9.2.35.3.5.1 Detailed Functionality
- 9.2.35.3.5.2 Configuring Hive with a Remote Metastore Database
- 9.2.35.3.5.3 Classpath Configuration
- 9.2.35.3.5.4 Hive Metadata Provider Configuration Properties
- 9.2.35.3.5.5 Review a Sample Configuration
- 9.2.35.3.5.6 Security
- 9.2.35.3.5.7 Metadata Change Event
- 9.2.35.3.5.8 Limitations
- 9.2.35.3.5.9 Additional Considerations
- 9.2.35.3.5.10 Troubleshooting
-
9.2.35.3.6
Google BigQuery Metadata Provider
- 9.2.35.3.6.1 Authentication
- 9.2.35.3.6.2 Supported BigQuery Datatypes
- 9.2.35.3.6.3 Parameterized BigQuery Datatypes
- 9.2.35.3.6.4 Unsupported BigQuery Datatypes
- 9.2.35.3.6.5 Configuring BigQuery Metadata Provider
- 9.2.35.3.6.6 Sample Configuration
- 9.2.35.3.6.7 Proxy Settings
- 9.2.35.3.6.8 Classpath Settings
- 9.2.35.3.6.9 Limitations
-
9.2.35.4
Pluggable Formatters
- 9.2.35.4.1 Using Operation-Based versus Row-Based Formatting
- 9.2.35.4.2 Using the Avro Formatter
- 9.2.35.4.3 Cloud Event Formatter
- 9.2.35.4.4 Existing Avro Formatter
- 9.2.35.4.5 Using the Delimited Text Formatter
-
9.2.35.4.6
Using the JSON Formatter
- 9.2.35.4.6.1 Operation Metadata Formatting Details
- 9.2.35.4.6.2 Operation Data Formatting Details
- 9.2.35.4.6.3 Row Data Formatting Details
- 9.2.35.4.6.4 Sample JSON Messages
- 9.2.35.4.6.5 JSON Schemas
- 9.2.35.4.6.6 JSON Formatter Configuration Properties
- 9.2.35.4.6.7 Review a Sample Configuration
- 9.2.35.4.6.8 Metadata Change Events
- 9.2.35.4.6.9 JSON Primary Key Updates
- 9.2.35.4.6.10 Integrating Oracle Stream Analytics
- 9.2.35.4.6.11 Mongo Document Formatting Details
- 9.2.35.4.7 Using the Length Delimited Value Formatter
- 9.2.35.4.8 Using the XML Formatter
-
9.2.35.5
Stage and Merge Data Warehouse
Replication
-
9.2.35.5.1
Steps for Stage and Merge
- 9.2.35.5.1.1 Stage
- 9.2.35.5.1.2 Merge
- 9.2.35.5.1.3 Configuration of Handlers
- 9.2.35.5.1.4 File Writer Handler
- 9.2.35.5.1.5 Operation Aggregation
- 9.2.35.5.1.6 Object Store Event handler
- 9.2.35.5.1.7 JDBC Metadata Provider
- 9.2.35.5.1.8 Stage and Merge Sample Configuration
- 9.2.35.5.1.9 Variables in the Merge Script
- 9.2.35.5.1.10 SQL Statements in the Merge Script
- 9.2.35.5.1.11 Merge Script Functions
- 9.2.35.5.1.12 Prerequisites
- 9.2.35.5.1.13 Limitations
- 9.2.35.5.2 Hive Stage and Merge
-
9.2.35.5.1
Steps for Stage and Merge
- 9.2.35.6 Template Keywords
- 9.2.35.7 Velocity Dependencies
-
9.1
Source
-
10
Administer
- 10.1 Automatic Heartbeat for Oracle GoldenGate for Distributed Applications and Analytics
-
10.2
Parsing the Message
- 10.2.1 Parsing Overview
- 10.2.2 Fixed Width Parsing
- 10.2.3 Delimited Parsing
- 10.2.4 XML Parsing
- 10.2.5 Source Definitions Generation Utility
-
10.3
Message Capture Properties
- 10.3.1 Logging and Connection Properties
-
10.3.2
Parser Properties
- 10.3.2.1 Setting the Type of Parser
-
10.3.2.2
Fixed Parser Properties
- 10.3.2.2.1 fixed.schematype
- 10.3.2.2.2 fixed.sourcedefs
- 10.3.2.2.3 fixed.copybook
- 10.3.2.2.4 fixed.header
- 10.3.2.2.5 fixed.seqid
- 10.3.2.2.6 fixed.timestamp
- 10.3.2.2.7 fixed.timestamp.format
- 10.3.2.2.8 fixed.txid
- 10.3.2.2.9 fixed.txowner
- 10.3.2.2.10 fixed.txname
- 10.3.2.2.11 fixed.optype
- 10.3.2.2.12 fixed.optype.insertval
- 10.3.2.2.13 fixed.optype.updateval
- 10.3.2.2.14 fixed.optype.deleteval
- 10.3.2.2.15 fixed.table
- 10.3.2.2.16 fixed.schema
- 10.3.2.2.17 fixed.txind
- 10.3.2.2.18 fixed.txind.beginval
- 10.3.2.2.19 fixed.txind.middleval
- 10.3.2.2.20 fixed.txind.endval
- 10.3.2.2.21 fixed.txind.wholeval
-
10.3.2.3
Delimited Parser Properties
- 10.3.2.3.1 delim.sourcedefs
- 10.3.2.3.2 delim.header
- 10.3.2.3.3 delim.seqid
- 10.3.2.3.4 delim.timestamp
- 10.3.2.3.5 delim.timestamp.format
- 10.3.2.3.6 delim.txid
- 10.3.2.3.7 delim.txowner
- 10.3.2.3.8 delim.txname
- 10.3.2.3.9 delim.optype
- 10.3.2.3.10 delim.optype.insertval
- 10.3.2.3.11 delim.optype.updateval
- 10.3.2.3.12 delim.optype.deleteval
- 10.3.2.3.13 delim.schemaandtable
- 10.3.2.3.14 delim.schema
- 10.3.2.3.15 delim.table
- 10.3.2.3.16 delim.txind
- 10.3.2.3.17 delim.txind.beginval
- 10.3.2.3.18 delim.txind.middleval
- 10.3.2.3.19 delim.txind.endval
- 10.3.2.3.20 delim.txind.wholeval
- 10.3.2.3.21 delim.fielddelim
- 10.3.2.3.22 delim.linedelim
- 10.3.2.3.23 delim.quote
- 10.3.2.3.24 delim.nullindicator
- 10.3.2.3.25 delim.fielddelim.escaped
- 10.3.2.3.26 delim.linedelim.escaped
- 10.3.2.3.27 delim.quote.escaped
- 10.3.2.3.28 delim.nullindicator.escaped
- 10.3.2.3.29 delim.hasbefores
- 10.3.2.3.30 delim.hasnames
- 10.3.2.3.31 delim.afterfirst
- 10.3.2.3.32 delim.isgrouped
- 10.3.2.3.33 delim.dateformat | delim.dateformat.table | delim.dateform.table.column
-
10.3.2.4
XML Parser Properties
- 10.3.2.4.1 xml.sourcedefs
- 10.3.2.4.2 xml.rules
- 10.3.2.4.3 rulename.type
- 10.3.2.4.4 rulename.match
- 10.3.2.4.5 rulename.subrules
- 10.3.2.4.6 txrule.timestamp
- 10.3.2.4.7 txrule.timestamp.format
- 10.3.2.4.8 txrule.seqid
- 10.3.2.4.9 txrule.txid
- 10.3.2.4.10 txrule.txowner
- 10.3.2.4.11 txrule.txname
- 10.3.2.4.12 oprule.timestamp
- 10.3.2.4.13 oprule.timestamp.format
- 10.3.2.4.14 oprule.seqid
- 10.3.2.4.15 oprule.txid
- 10.3.2.4.16 oprule.txowner
- 10.3.2.4.17 oprule.txname
- 10.3.2.4.18 oprule.schemandtable
- 10.3.2.4.19 oprule.schema
- 10.3.2.4.20 oprule.table
- 10.3.2.4.21 oprule.optype
- 10.3.2.4.22 oprule.optype.insertval
- 10.3.2.4.23 oprule.optype.updateval
- 10.3.2.4.24 oprule.optype.deleteval
- 10.3.2.4.25 oprule.txind
- 10.3.2.4.26 oprule.txind.beginval
- 10.3.2.4.27 oprule.txind.middleval
- 10.3.2.4.28 oprule.txind.endval
- 10.3.2.4.29 oprule.txind.wholeval
- 10.3.2.4.30 colrule.name
- 10.3.2.4.31 colrule.index
- 10.3.2.4.32 colrule.value
- 10.3.2.4.33 colrule.isnull
- 10.3.2.4.34 colrule.ismissing
- 10.3.2.4.35 colrule.before.value
- 10.3.2.4.36 colrule.before.isnull
- 10.3.2.4.37 colrule.before.ismissing
- 10.3.2.4.38 colrule.after.value
- 10.3.2.4.39 colrule.after.isnull
- 10.3.2.4.40 colrule.after.ismissing
-
10.4
Oracle GoldenGate Java Delivery
- 10.4.1 Configuring Java Delivery
- 10.4.2 Running Java Delivery
- 10.4.3 Configuring Event Handlers
-
10.4.4
Java Delivery Properties
- 10.4.4.1 Common Properties
- 10.4.4.2 Delivery Properties
-
10.4.4.3
Java Application Properties
- 10.4.4.3.1 Properties for All Handlers
- 10.4.4.3.2 Properties for Formatted Output
-
10.4.4.3.3
Properties for CSV and Fixed Format Output
- 10.4.4.3.3.1 gg.handler.name.format.delim
- 10.4.4.3.3.2 gg.handler.name.format.quote
- 10.4.4.3.3.3 gg.handler.name.format.metacols
- 10.4.4.3.3.4 gg.handler.name.format.missingColumnChar
- 10.4.4.3.3.5 gg.handler.name.format.presentColumnChar
- 10.4.4.3.3.6 gg.handler.name.format.nullColumnChar
- 10.4.4.3.3.7 gg.handler.name.format.beginTxChar
- 10.4.4.3.3.8 gg.handler.name.format.middleTxChar
- 10.4.4.3.3.9 gg.handler.name.format.endTxChar
- 10.4.4.3.3.10 gg.handler.name.format.wholeTxChar
- 10.4.4.3.3.11 gg.handler.name.format.insertChar
- 10.4.4.3.3.12 gg.handler.name.format.updateChar
- 10.4.4.3.3.13 gg.handler.name.format.deleteChar
- 10.4.4.3.3.14 gg.handler.name.format.truncateChar
- 10.4.4.3.3.15 gg.handler.name.format.endOfLine
- 10.4.4.3.3.16 gg.handler.name.format.justify
- 10.4.4.3.3.17 gg.handler.name.format.includeBefores
- 10.4.4.3.4 File Writer Properties
- 10.4.4.3.5 JMS Handler Properties
- 10.4.4.3.6 JNDI Properties
- 10.4.4.3.7 General Properties
- 10.4.4.3.8 Java Delivery Transaction Grouping
- 10.4.5 Developing Custom Filters, Formatters, and Handlers
- 10.4.6 Configuring Data Transforms
- 11 Troubleshoot