Connect to Databricks Engine

Learn to create and configure a Databricks Engine connection.

Before you begin

Ensure that you:

• Review how OCI GoldenGate connects to your source and targets.

• Configure the required policies to enable secure Vault and Secrets access, such as use secrets, use vaults, and read secret-bundles. For more information, see Minimum recommended policies.

Create the connection

To create a Databricks Engine connection:

1. From the OCI GoldenGate Overview page, select Connections.

   You can also select Create Connection under the Get started section and skip to step 3.

2. On the Connections page, select Create Connection.

3. On the Create Connection page, complete the fields as follows:

   1. For Name, enter a name for the connection.

   2. (Optional) For Description, enter a description that helps you distinguish this connection from others.

   3. (For GoldenGate on Multicloud only) Select your Subscription, and then complete the following fields.

      1. From the Compartment dropdown, select the compartment in which the Resource Anchor resides.

      2. Select the Multicloud partner region.

      3. Select your Partner availability zone. The available options populate based on the selected Multicloud partner region.

   4. For Compartment, select the compartment in which to create the connection.

   5. From the Type dropdown, select Databricks Engine.

   6. Enter the Workspace URL.

   7. Select an Authentication type from the dropdown:

      • Personal access token, then select or create an Authentication token secret.

      • OAuth M2M, then enter the Client ID and select or create a Client secret secret.

      Note:

      • Secrets are credentials such as passwords, certificates, SSH keys, or authentication tokens that you use with OCI services. To create a secret, see Creating a secret. Ensure that you:

        • Select Manual secret generation.

        • Paste the credentials into Secret contents.

      • If you prefer not to use password secrets, ensure that you deselect Use secrets in vault in the Security section under Advanced Options, located at the bottom of this form.

      • When you need to update the Secret content, ensure that you:

        • Create a new Secret version using the Plain-Text template and provide the updated content. For more information, see Updating a Secret’s Content.

        • Refresh the connection to clear cached Secret content.

   8. For Artifacts:

      1. Select an Artifact location from the dropdown:

         • Unity Catalog volume path, then enter the Path.

         • OCI Object Storage, then complete the fields as follows:

           1. Select an Authentication type from the dropdown:

              • Secret key

              • Resource principal

              • User principal

              • Pre-authenticated request (PAR)

           2. Select a Region from the dropdown.

           3. Select an Object Storage bucket.

           4. Enter the Object prefix.

           5. Depending on your choice of Authentication type:

              • If you selected Secret key, then enter the Access key ID and select the Secret access key secret ID.

              • If you selected User principal, select how to authenticate access to Oracle Object Storage.

                1. For User, select one of the following options:

                   • Use current tenancy and user

                   • Specify another tenancy and user, and then enter the following information:

                     1. Enter the Tenancy OCID.

                     2. Enter the User OCID.

                2. Select the Private key secret. If located in a different compartment, use the dropdown to change compartments.

                3. Select the Private key passphrase secret. If located in a different compartment, use the dropdown to change compartments.

                4. For Public key fingerprint, enter the API key created for the user.

              • If you selected Pre-authenticated request, select or create the PAR URL secret.

         • Azure Data Lake Storage, then complete the fields as follows:

           1. Enter the Storage account.

           2. Enter the File system.

           3. Enter the Object prefix.

           4. Enter the Endpoint suffix.

           5. Select or create the Storage account key secret.

      2. Select whether to Overwrite existing artifacts with the same name.

   9. Expand Advanced options. You can configure the following options:

      • Security

        • Deselect Use vault secrets you prefer not to use password secrets for this connection. If not selected:

          • Select Use Oracle-managed encryption key to leave all encryption key management to Oracle.

          • Select Use customer-managed encryption key to select a specific encryption key stored in your OCI Vault to encrypt your connection credentials.

      • Network connectivity

        • Shared endpoint, to share an endpoint with the assigned deployment. You must allow connectivity from the deployment's ingress IP.

        • Dedicated endpoint, for network traffic through a dedicated endpoint in the assigned subnet in your VCN. You must allow connectivity from this connection's ingress IPs.

          Note:

          • If a dedicated connection remains unassigned for seven days, then the service converts it to a shared connection.
          • Learn more about Oracle GoldenGate connectivity.

      • Security attributes: Add security attributes to control access to this connection using Zero Trust Packet Routing (ZPR).

      • Tags: Add tags to organize your resources.

Next steps

• Assign a connection to a deployment
• Manage connections