10.2.3 Azure Data Lake Storage

• About Azure Data Lake Storage Connections
  
• Before You Begin
  
• Create and Validate an Azure Data Lake Storage Connection
  
• Use an Azure Data Lake Storage Connection in Replicat
  

10.2.3.1 About Azure Data Lake Storage Connections

An Azure Data Lake Storage connection stores the information that Oracle GoldenGate for Distributed Applications and Analytics uses to connect to an Azure Data Lake Storage account. You can use the connection with Replicat to deliver transactional data to Azure Data Lake Storage. After you create and validate the connection, you can reuse it across multiple Oracle GoldenGate for Distributed Applications and Analytics processes.

The connection stores the Azure endpoint information, authentication settings, security configuration, and optional runtime settings independently of the Replicat configuration. This enables multiple Replicat processes to reuse the same validated connection.

10.2.3.2 Before You Begin

Before creating an Azure Data Lake Storage connection, ensure that you have the following:

• An Oracle GoldenGate for DAA deployment.
• Network connectivity between the Oracle GoldenGate deployment and the Azure Data Lake Storage account.
• The Azure Storage account name.
• Authentication credentials supported by your deployment, such as an account key, shared access signature (SAS), or Azure Active Directory (Microsoft Entra ID) credentials, as defined in the connection configuration.
• The Azure Data Lake Storage endpoint, if required.
• Common runtime settings, such as the runtime classpath, if additional client libraries are required.
• Proxy information if the Oracle GoldenGate for DAA deployment accesses Azure Data Lake Storage through an HTTP proxy.

10.2.3.3 Create and Validate an Azure Data Lake Storage Connection

Use the Add Connection page to create an Azure Data Lake Storage connection.

Procedure

In the navigation menu, select DB Connections.

1. Click Add Connection.
2. In Connection Alias, enter a unique name for the connection.
3. From Technology Type, select Azure Data Lake Storage.
4. In the Technology Settings section, provide the Azure Data Lake Storage connection information.
   • Storage Account Name: Specifies the Azure Storage account that Oracle GoldenGate uses to connect to Azure Data Lake Storage.
   • Endpoint: Specifies the Azure Data Lake Storage service endpoint. Configure this field when a custom endpoint is required.
   • Authentication Credential: Specifies the credential used to authenticate to the Azure Data Lake Storage account, as defined by the connection configuration.
5. Configure the Authentication settings.
   • Account Key: Specifies the Azure Storage account key used to authenticate the connection, when applicable.
   • Shared Access Signature (SAS): Specifies the shared access signature token used to authenticate the connection, when applicable.

   Note:

   Configure only the authentication properties required by your deployment.
6. Configure Common Settings, if additional runtime configuration is required.

   Classpath: (Required) Specify the full path to client libraries are required by the replicat type. You can use Dependency Downloader to download client libraries.

7. (Optional) Configure Proxy Settings if the Oracle GoldenGate deployment accesses Azure Data Lake Storage through an HTTP proxy.
   Proxy Settings

   • Proxy URL – Specifies the URL or host name of the proxy server used to access Azure Data Lake Storage.
   • Proxy Port – Specifies the port number of the proxy server.
   • Proxy Username – Specifies the user name for proxy authentication, if required.
   • Proxy Password – Specifies the password for proxy authentication. This field is treated as sensitive information.
   • Truststore – Specifies the Java truststore file that contains the certificate authority (CA) certificates used to validate the proxy server certificate, when required.
   • Truststore Password – Specifies the password associated with the truststore.
   • Keystore – Specifies the Java keystore file containing the client certificate and private key used for client authentication, when required.
   • Keystore Password – Specifies the password associated with the keystore.
   • SSL Key Password – Specifies the password protecting the private key stored in the keystore when it differs from the keystore password.

   Note:

   If the Oracle GoldenGate deployment has direct network connectivity to Azure Data Lake Storage, leave the Proxy Settings blank.
8. Click Submit.
9. On the DB Connections page, click DB Login to validate the connection.

   Note:

   A successful DB Login validates only the saved connection information. It does not validate the Replicat configuration or Azure Data Lake Storage handler configuration. After successful validation, the connection is available for selection during Replicat creation.

10.2.3.4 Use an Azure Data Lake Storage Connection in Replicat

After the Azure Data Lake Storage connection has been successfully validated:

1. Create or edit a Replicat.
2. Select Azure Data Lake Storage as the target technology.
3. Select the validated Azure Data Lake Storage connection.
4. Complete the remaining Replicat configuration.
5. Create and start the Replicat.

The selected connection supplies the generated connection reference that Replicat uses during runtime.