10.3.4 Google BigQuery

• About Google BigQuery Connections
  
• Before You Begin
  
• Create and Validate an Google BigQuery Connection
  
• Use an Google Query Connection in Replicat
  

10.3.4.1 About Google BigQuery Connections

A Google BigQuery connection stores the information that Oracle GoldenGate DAA uses to connect to Google BigQuery. After the connection is created and validated, you can reuse it when configuring Replicat processes that load transactional data into Google BigQuery.

The connection stores the authentication information and optional runtime settings independently of the Replicat configuration. This allows multiple Replicat processes to use the same validated connection.

10.3.4.2 Before You Begin

Before creating a Google BigQuery connection, ensure that you have the following:

• An Oracle GoldenGate deployment.
• Network connectivity between the Oracle GoldenGate deployment and Google Cloud.
• A Google Cloud service account key file with the permissions required to access the target BigQuery resources.
• A Google Cloud Storage (GCS) connection: Google BigQuery Stage and Merge Replicat requires a Google Cloud Storage connection for staging data before loading it into BigQuery. For more information, see Create and Validate an Google BigQuery Connection .
• The required Google BigQuery client libraries and any additional runtime dependencies, if they are not already available in the deployment.

  To download the required dependencies, use the GG DAA Dependency Downloader:

  {GGforDAA install}/DependencyDownloader/bigquery.sh 2.x

  • Download the supported Google BigQuery client libraries from:

    https://search.maven.org/artifact/com.google.cloud/google-cloud-bigquery

  • After downloading the dependencies, configure the

    gg.classpath

    property in the Java Adapter properties file to include the downloaded libraries before starting the Replicat process.
• Configure common runtime settings, such as the runtime classpath, if additional libraries are required.
• Proxy information if the Oracle GoldenGate deployment accesses Google Cloud through an HTTP proxy.

10.3.4.3 Create and Validate an Google BigQuery Connection

Use the Add Connection page to create a Google BigQuery connection.

Procedure

1. In the navigation menu, select DB Connections.
2. Click Add Connection.
3. In Connection Alias, enter a unique name for the connection.
4. From Technology Type, select Google BigQuery.
5. In the Technology Settings section, provide the Google BigQuery connection information.

   Configure the following technology settings:Service Account Key – Specifies the Google Cloud service account key file used by Oracle GoldenGate for Distributed Applications and Analytics to authenticate with Google BigQuery. This field is required and is treated as sensitive information.

   Note:

   Ensure that the service account has the required permissions to access the target Google BigQuery datasets and tables.
6. Configure Common Settings, if additional runtime configuration is required.

   Configure the following common settings:

   Classpath: (Required) Specify the full path to client libraries are required by the replicat type. You can use Dependency Downloader to download client libraries.

   Note:

   Download the supported Google BigQuery client libraries by using the Dependency Downloader for Google BigQuery and configure the runtime classpath to reference the downloaded libraries before starting the Replicat process.
7. (Optional) Configure Proxy Settings if the Oracle GoldenGate for Distributed Applications and Analytics deployment accesses Google Cloud through an HTTP proxy.

   Configure the following proxy settings:

   • Proxy URL – Specifies the URL or host name of the proxy server used to access Google BigQuery.
   • Proxy Port – Specifies the port number of the proxy server.
   • Proxy Username – Specifies the user name for proxy authentication, if required.
   • Proxy Password – Specifies the password for proxy authentication. This field is treated as sensitive information.
   • Truststore – Specifies the Java truststore file that contains the certificate authority (CA) certificates used to validate the proxy server certificate, when required.
   • Truststore Password – Specifies the password associated with the truststore.
   • Keystore – Specifies the Java keystore file containing the client certificate and private key used for client authentication, when required.
   • Keystore Password – Specifies the password associated with the keystore.
   • SSL Key Password – Specifies the password protecting the private key stored in the keystore when it differs from the keystore password.
8. Click Submit.
9. On the DB Connections page, click DB Login to validate the connection.

   Note:

   A successful DB Login validates only the saved connection information. It does not validate the Replicat configuration or Google BigQuery Handler configuration. After successful validation, the connection is available for selection during Replicat creation.

10.3.4.4 Use an Google Query Connection in Replicat

After the Google BigQuery connection has been successfully validated:

1. Create or edit a Replicat.
2. Select Google BigQuery as the target technology.
3. Select the validated Google BigQuery connection.
4. Complete the remaining Replicat configuration.
5. Create the Replicat.
6. Configure any remaining Google BigQuery-specific handler properties before starting the Replicat.