Connect to Azure Event Hubs

Learn to connect to Azure Event Hubs to use as a soure or target for OCI GoldenGate

Related Topics

Before you begin

Before you create the connection, ensure that you:

Review how OCI GoldenGate connects to your source and targets.
Configure the required policies to enable secure Vault and Secrets access, such as use secrets, use vaults, and read secret-bundles. For more information, see Minimum recommended policies.

Create a source connection

To create a source Azure Event Hubs connection

From the OCI GoldenGate Overview page, click Connections.
You can also click Create Connection under the Get started section and skip to step 3.
On the Connections page, click Create Connection.
On the Create Connection page, complete the fields as follows:
1. For Name, enter a name for the connection.
2. (Optional) For Description, enter a description that helps you distinguish this connection from others.
3. If creating this deployment for GoldenGate on Oracle Database@Azure, select your Subscription.
  1. From the Compartment dropdown, select the compartment in which the Resource Anchor resides.
  2. Select the Multicloud partner region.
  3. Select your Partner availability zone. The available options populate based on the selected Multicloud partner region.
4. For Compartment, select the compartment in which to create the connection.
5. From the Type dropdown, select Azure Event Hubs.
6. Under Bootstrap servers:
  1. For Host, enter the hostname in the following format: NAMESPACE.servicebus.windows.net. Enter the Private IP only if the hostname is not resolvable from your subnet or if it uses SSL/TLS.
    
    Note:
    If you enter a private IP, then OCI GoldenGate rewrites the private IP in the format, ip-10-0-0-0.ociggsvc.oracle.vcn.com.
  2. For Port, enter 9093.
    
    Tip:
    All nodes in the cluster must have FQDNs to allow for traversal over private endpoints.
  3. (Optional) Click + Bootstrap server to add another bootstrap server.
7. Select the Password secret. If located in a different compartment, use the dropdown to change compartments.
  Note:
  - Secrets are credentials such as passwords, certificates, SSH keys, or authentication tokens that you use with OCI services. To create a secret, see Creating a secret. Ensure that you:
    
    Select Manual secret generation.
    
    Paste the credentials into Secret contents.
  - If you prefer not to use password secrets, ensure that you deselect Use secrets in vault in the Security section under Advanced Options, located at the bottom of this form.
8. Expand Show advanced options. You can configure the following options:
  - Security
    - Deselect Use vault secrets you prefer not to use password secrets for this connection. If not selected:
      
      Select Use Oracle-managed encryption key to leave all encryption key management to Oracle.
      
      Select Use customer-managed encryption key to select a specific encryption key stored in your OCI Vault to encrypt your connection credentials.
  - Network connectivity
    - Shared endpoint, to share an endpoint with the assigned deployment. You must allow connectivity from the deployment's ingress IP.
    - Dedicated endpoint, for network traffic through a dedicated endpoint in the assigned subnet in your VCN. You must allow connectivity from this connection's ingress IPs.
      
      Note:
      
      If a dedicated connection remains unassigned for seven days, then the service converts it to a shared connection.
      
      Learn more about Oracle GoldenGate connectivity.
  - Settings
    To capture from Azure Event Hubs, create a consumer.properties file with one of the following deserializers or converters, and then drag and drop the file into Consumer properties:
    - Kafka Consumer properties for JSON deserializer:
      key.deserializer=org.apache.kafka.common.serialization.ByteArrayDeserializer value.deserializer=org.apache.kafka.common.serialization.ByteArrayDeserializer
    - Kafka Consumer properties for JSON converter:
      key.converter=org.apache.kafka.connect.json.JsonConverter value.converter=org.apache.kafka.connect.json.JsonConverter
  - Security attributes: Add security attributes to control access to this connection using Zero Trust Packet Routing (ZPR).
  - Tags: Add tags to organize your resources.
Click Create.

After the connection is created, it appears in the Connections list. Ensure that you assign the connection to a deployment to use it as a source or target in a replication.

Create a target connection

To create a target Azure Event Hubs connection

From the OCI GoldenGate Overview page, click Connections.
You can also click Create Connection under the Get started section and skip to step 3.
On the Connections page, click Create Connection.
On the Create Connection page, complete the fields as follows:
1. For Name, enter a name for the connection.
2. (Optional) For Description, enter a description that helps you distinguish this connection from others.
3. If creating this deployment for GoldenGate on Oracle Database@Azure, select your Subscription.
  1. From the Compartment dropdown, select the compartment in which the Resource Anchor resides.
  2. Select the Multicloud partner region.
  3. Select your Partner availability zone. The available options populate based on the selected Multicloud partner region.
4. For Compartment, select the compartment in which to create the connection.
5. From the Type dropdown, select Azure Event Hubs.
6. Under Bootstrap servers:
  1. For Host, enter the hostname in the following format: NAMESPACE.servicebus.windows.net. Enter the Private IP only if the hostname is not resolvable from your subnet or if it uses SSL/TLS.
    
    Note:
    If you enter a private IP, then OCI GoldenGate rewrites the private IP in the format, ip-10-0-0-0.ociggsvc.oracle.vcn.com.
  2. For Port, enter 9093.
    
    Tip:
    All nodes in the cluster must have FQDNs to allow for traversal over private endpoints.
  3. (Optional) Click + Bootstrap server to add another bootstrap server.
7. Select the Password secret. If located in a different compartment, use the dropdown to change compartments.
  Note:
  - Secrets are credentials such as passwords, certificates, SSH keys, or authentication tokens that you use with OCI services. To create a secret, see Creating a secret. Ensure that you:
    
    Select Manual secret generation.
    
    Paste the credentials into Secret contents.
  - If you prefer not to use password secrets, ensure that you deselect Use secrets in vault in the Security section under Advanced Options, located at the bottom of this form.
8. Expand Show advanced options. You can configure the following options:
  - Security
    - Deselect Use vault secrets you prefer not to use password secrets for this connection. If not selected:
      
      Select Use Oracle-managed encryption key to leave all encryption key management to Oracle.
      
      Select Use customer-managed encryption key to select a specific encryption key stored in your OCI Vault to encrypt your connection credentials.
  - Network connectivity
    - Shared endpoint, to share an endpoint with the assigned deployment. You must allow connectivity from the deployment's ingress IP.
    - Dedicated endpoint, for network traffic through a dedicated endpoint in the assigned subnet in your VCN. You must allow connectivity from this connection's ingress IPs.
      
      Note:
      
      If a dedicated connection remains unassigned for seven days, then the service converts it to a shared connection.
      
      Learn more about Oracle GoldenGate connectivity.
  - Settings
    To use Snappy compression in Kafka replication, drag and drop or select Producer properties, and change replication settings as discussed in Using Compression OCI GoldenGate (Confluent) Kafka Replication.
  - Security attributes: Add security attributes to control access to this connection using Zero Trust Packet Routing (ZPR).
  - Tags: Add tags to organize your resources.
Click Create.

The connection appears in the Connections list, where you can select it to view its details. You can then assign the connection to a Big Data deployment to use as a source or target.

Title and Copyright Information

Oracle and/or its affiliates.