Add a Replicat for Google BigQuery

Learn to create a Replicat process for a Google Cloud Storage target.

Before you begin

Before you create a Replicat for Google BigQuery, ensure that you:

• Create and assign both a Google Cloud Storage and a Google BigQuery connection to the Big Data deployment. The deployment uses Google Cloud Storage as a staging location for Google BigQuery.

  Note: Ensure that the Google Cloud Storage bucket and BigQuery dataset exist in the same location or region.

• Have your Google Cloud Service Account Key.

• Assign the appropriate Google BigQuery permissions

Add a Replicat (26ai)

Ensure that you review prerequisites specific to this target type.

1. In the OCI GoldenGate deployment console navigation menu, select Replicat.

2. On the Replicat page, select Add Replicat.

3. In the Add Replicat panel, on the Replicat Information page, complete the fields as needed, and then select Next:

   • Select a Replicat Type:

     • Classic Replicat

     • Coordinated Replicat

   • Enter a Process Name, no more than 5 characters long.

   • Enter a Description, to help distinguish this process from others.

4. On the Replicat Options page, complete the fields as needed, and then select Next:

   • Replicat Trail:

     • Enter a Name.

     • Enter a Subdirectory, if you expect the Trail file to be in a location other than the default.

     • Select an Encryption profile. If an encryption profile wasn't created, the Local Wallet is selected by default.

     • For Begin, select the starting point for data processing:

       • Position in Log (default)

       • Now

       • Custom Time

   • Trail Position:

     • Enter the Sequence Number.

     • Enter the RBA Offset.

     • Select your Target from the dropdown.

       Note: Depending on your target selection, you may have additional options to such as Streaming, Stage and Merge, and Staging locations.

   • Target Credentials:

     • Select a Domain.

     • Select an Alias within the specified Domain.

     • Select a Checkpoint Table. Leave the default selection or select the Checkpoint table you created for the target deployment.

     • Select the Max Threads Number (Coordinated Replicats only).

5. On the Managed Options page, complete the optional fields as needed, and then select Next:

   • Select a Profile Name, if one is available.

   • Enable Critical to deployment health.

   • Enable and configure Auto Start settings.

6. On the Parameter File page, you can add parameters to further configure your Replicat. For example:

   table source.table1;

   Note:

   GoldenGate uses Greenwich Mean Time (GMT) by default. Use SETENV to override the default setting for the Replicat. This change doesn’t apply to deployments. For example:

   setenv (TZ="US/Eastern")
   setenv (TZ="GMT+5")

7. On the Properties File page, locate gg.eventhandler.gcs.bucketMappingTemplate=<gcs bucket>, and then replace <gcs bucket> with the Google Cloud Storage bucket name.

   For information on this target's properties, see Google BigQuery Stage and Merge in the Oracle GoldenGate for Distributed Applications and Analytics guide.

8. Select Create and Run. If you select Create, then you can manually start the Replicat later from the Replicats page.

Add a Replicat (21c)

To add a Replicat for an Google BigQuery target in Oracle GoldenGate 21c:

1. In the OCI GoldenGate deployment console, on the Administration Service Overview page, select Add Replicat (plus icon).

2. On the Add Replicat page, select a Replicat type, and then select Next.

   The types of Replicats are:

   • Classic Replicat

   • Coordinated Replicat

3. On the Replicat Options page, complete the following fields, and then select Next:

   1. For Process Name, enter a name for the Replicat process.

   2. (Optional) For Description, enter a brief description to distinguish this Replicat from others.

   3. For Trail Name, enter two-character trail name.

   4. For Target, select Google BigQuery from the dropdown.

   5. For Available Aliases, select your alias from the dropdown.

   6. For Available staging locations, Google Cloud Storage should already be selected.

   7. For via staging alias, select a Google Cloud Storage connection.

4. On the Parameter File page, add and configure Replicat parameters as needed, and then select Next.

   table source.table1;

   Note:

   GoldenGate uses Greenwich Mean Time (GMT) by default. Use SETENV to override the default setting for the Extract. This change applies only to the Extract process and not the deployment.

   setenv (TZ="US/Eastern")
   setenv (TZ="GMT+5")

5. On the Properties File page, locate gg.eventhandler.gcs.bucketMappingTemplate=<gcs bucket>, and then replace <gcs bucket> with the Google Cloud Storage bucket name.

6. Select Create and Run. If you select Create, then you can manually start the Replicat later from the Administration Service Overview page.

You return to the Administration Service Overview page where you can view the creation of the Replicat process and access Replicat Actions.

Related content

• Google BigQuery Stage and Merge