1. Oracle GoldenGate for Distributed Applications and Analytics
  2. Replicate Data
  3. Source

8.1 Source

The Extract process is configured to run against the source technology, capturing data generated in the true source tecnology located somewhere else. This process is the extraction or the data capture mechanism of GG for DAA.

You can configure an Extract for the following use cases:
  • Initial Load Extract: When you set up GG for DAA for initial loads, the Extract process captures the current, static set of data directly from the source objects. This configuration of Extract process uses source source to capture data.

  • Change Data Capture Extract: When you set up GG for DAA to keep the source data synchronized with another set of data, the Extract process captures the DML and (if supported) DDL operations performed on the configured objects after the initial synchronization has taken place. It stores these operations until it receives commit records or rollbacks for the transactions that contain them. If it receives a rollback, it discards the operations for that transaction. If it receives a commit, it persists the transaction to disk in a series of files called a trail, where it is queued for propagation to the target system. All the operations in each transaction are written to the trail and are in the order in which they were committed to the source technology. This design ensures both speed and data integrity. The format of the data written to trail files depends on the source technology.

Parent topic: Replicate Data

8.1.1 Add Extract

Extract process can be configured in GoldenGate for Distributed Applications and Analytics (GG for DAA) 23ai web-based user interface.

To create an extract:

  1. Complete prerequisites based on source technology type. See the following sections for technology-specific details.
  2. Download dependencies using dependency downloader for your source technology and note the path to dependency files.
  3. If required, create the credential store entry. See the following sections for technology-specific details.
  4. In GG for DAA UI, go to Administration Service and click Add Extract.
  5. In Extract Information, provide a Process Name for the extract, select source technology and extract type.
  6. In Extract Options, provide a name for Extract Trail, select Source Credentials and Alias.
  7. Managed Options are optional, enable if needed.
    Option Description
    Profile Name Provides the name of the autostart and autorestart profile. You can select the default or custom options.

    If you have already created a profile, then you can select that profile also. If you select the Custom option, then you can set up a new profile from this section itself.
    Critical to deployment health

    (Oracle only) Enable this option if the profile is critical for the deployment health.

    Note:

    This option only appears while creating the Extract or Replicat and not when you set up the managed processes in the Profiles page.

    Auto Start Enables autostart for the process
    Startup Delay Time to wait in seconds before starting the process
    Auto Restart Configures how to restart the process if it terminates
    Max Retries Specify the maximum number of retries to try to start the process
    Retry Delay Delay time in trying to start the process
    Retries Window The duration interval to try to start the process
    Restart on Failure only If true, the task is only restarted if it fails.
    Disable Task After Retries Exhausted If true, then the task is disabled after exhausting all attempts to restart the process.

    Parameter File will be populated based on your source technology selection. In Parameter File, update the fields marked as TODO.

  8. Create and Run will register the extract and start it.

Parent topic: Source