Connect to Microsoft Fabric Eventstream

Learn to create a connection to Microsoft Fabric Eventstream to use as an OCI GoldenGate source or target.

Before you begin

Before you create the connection, ensure that you:
  • Review how OCI GoldenGate connects to your source and targets.

  • Configure the required policies to enable secure Vault and Secrets access, such as use secrets, use vaults, and read secret-bundles. For more information, see Minimum recommended policies.

  • If using TLS/ mTLS, convert the JKS truststore or truststore and keystore to PKCS12 format to use in the connection.
    1. Use the keytool utility in the JDK to convert to the PKCS12 format.

      For the keystore, the keytool utility prompts you for a password, as shown in the following example:
      keytool -importkeystore -srckeystore [MY_KEYSTORE.jks] -destkeystore [MY_KEYSTORE.p12] -srcstoretype JKS -deststoretype PKCS12 -deststorepass [PASSWORD_PKCS12]
      For the truststore, the keytool utility prompts for a password, as shown in the following example:
      keytool -importkeystore -srckeystore [MY_TRUSTSTORE.jks] -destkeystore [MY_TRUSTSTORE.p12] -srcstoretype JKS -deststoretype PKCS12 -deststorepass [PASSWORD_PKCS12]
    2. After converting the keystore and truststore, add the following lines to the Kafka producer properties file and then save your changes:
      ssl.truststore.type=PKCS12
      ssl.keystore.type=PKCS12
    3. Upload the file to the connection's Producer properties in the Settings section of Advanced options.

Create a source connection

To create a source Microsoft Fabric Eventstream connection:
  1. From the OCI GoldenGate Overview page, click Connections.
    You can also click Create Connection under the Get started section and skip to step 3.
  2. On the Connections page, click Create Connection.
  3. On the Create Connection page, complete the fields as follows:
    1. For Name, enter a name for the connection.
    2. (Optional) For Description, enter a description that helps you distinguish this connection from others.
    3. (For GoldenGate on Multicloud only) Select your Subscription, and then complete the following fields.
      1. From the Compartment dropdown, select the compartment in which the Resource Anchor resides.
      2. Select the Multicloud partner region.
      3. Select your Partner availability zone. The available options populate based on the selected Multicloud partner region.
    4. For Compartment, select the compartment in which to create the connection.
    5. From the Type dropdown, select Microsoft Fabric Eventstream.
    6. Under Bootstrap servers:
      1. Enter the Host and Port number for the Bootstrap server. Enter the Private IP only if the hostname is not resolvable from your subnet or if it uses SSL/TLS.

        Note:

        If you enter a private IP, then OCI GoldenGate rewrites the private IP in the format, ip-10-0-0-0.ociggsvc.oracle.vcn.com.

        Tip:

        All nodes in the cluster must have FQDNs to allow for traversal over private endpoints.
      2. (Optional) Click + Bootstrap server to add another bootstrap server.
    7. For Security protocol, select one of the following and then complete the corresponding fields:
      • Plaintext
      • SASL over plaintext
      • SASL over SSL
      • SSL
    8. Expand Show advanced options. You can configure the following options:
      • Security
        • Deselect Use vault secrets if you prefer not to use password secrets for this connection. If not selected:
          • Select Use Oracle-managed encryption key to leave all encryption key management to Oracle.
          • Select Use customer-managed encryption key to select a specific encryption key stored in your OCI Vault to encrypt your connection credentials.
      • Network connectivity
        • Shared endpoint, to share an endpoint with the assigned deployment. You must allow connectivity from the deployment's ingress IP.
        • Dedicated endpoint, for network traffic through a dedicated endpoint in the assigned subnet in your VCN. You must allow connectivity from this connection's ingress IPs.

          Note:

          • If a dedicated connection remains unassigned for seven days, then the service converts it to a shared connection.
          • Learn more about Oracle GoldenGate connectivity.
      • Settings
        • If using this connection for Extract, then drag and drop or select the Consumer or Producer properties file (.properties).
        • To capture from Kafka, create a Kafka Consumer properties file (.properties) with one of the following deserializers or converters:
          • Kafka Consumer properties for JSON deserializer:
            key.deserializer=org.apache.kafka.common.serialization.ByteArrayDeserializer
            value.deserializer=org.apache.kafka.common.serialization.ByteArrayDeserializer
          • Kafka Consumer properties for JSON converter:
            key.converter=org.apache.kafka.connect.json.JsonConverter
            value.converter=org.apache.kafka.connect.json.JsonConverter
          • Kafka Consumer properties for Avro converter:
            key.converter=io.confluent.connect.avro.AvroConverter
            value.converter=io.confluent.connect.avro.AvroConverter
      • Security attributes: Add security attributes to control access to this connection using Zero Trust Packet Routing (ZPR).
      • Tags: Add tags to organize your resources.
  4. Click Create.
After the connection is created, it appears in the Connections list. Ensure that you assign the connection to a deployment to use it as a source or target in a replication.

Create a target connection

To create a target Microsoft Fabric Eventstream connection:
  1. From the OCI GoldenGate Overview page, click Connections.
    You can also click Create Connection under the Get started section and skip to step 3.
  2. On the Connections page, click Create Connection.
  3. On the Create Connection page, complete the fields as follows:
    1. For Name, enter a name for the connection.
    2. (Optional) For Description, enter a description that helps you distinguish this connection from others.
    3. (For GoldenGate on Multicloud only) Select your Subscription, and then complete the following fields.
      1. From the Compartment dropdown, select the compartment in which the Resource Anchor resides.
      2. Select the Multicloud partner region.
      3. Select your Partner availability zone. The available options populate based on the selected Multicloud partner region.
    4. For Compartment, select the compartment in which to create the connection.
    5. From the Type dropdown, select Microsoft Fabric Eventstream.
    6. Under Bootstrap servers:
      1. Enter the Host and Port number for the Bootstrap server. Enter the Private IP only if the hostname is not resolvable from your subnet or if it uses SSL/TLS.

        Note:

        If you enter a private IP, then OCI GoldenGate rewrites the private IP in the format, ip-10-0-0-0.ociggsvc.oracle.vcn.com.

        Tip:

        All nodes in the cluster must have FQDNs to allow for traversal over private endpoints.
      2. (Optional) Click + Bootstrap server to add another bootstrap server.
    7. For Security protocol, select one of the following and then complete the corresponding fields:
      • Plaintext
      • SASL over plaintext
      • SASL over SSL
      • SSL
    8. Expand Show advanced options. You can configure the following options:
      • Security
        • Deselect Use vault secrets if you prefer not to use password secrets for this connection. If not selected:
          • Select Use Oracle-managed encryption key to leave all encryption key management to Oracle.
          • Select Use customer-managed encryption key to select a specific encryption key stored in your OCI Vault to encrypt your connection credentials.
      • Network connectivity
        • Shared endpoint, to share an endpoint with the assigned deployment. You must allow connectivity from the deployment's ingress IP.
        • Dedicated endpoint, for network traffic through a dedicated endpoint in the assigned subnet in your VCN. You must allow connectivity from this connection's ingress IPs.

          Note:

          • If a dedicated connection remains unassigned for seven days, then the service converts it to a shared connection.
          • Learn more about Oracle GoldenGate connectivity.
      • SettingsTo use Snappy compression in Kafka replication, drag and drop or select Producer properties, and change replication settings as discussed in Using Compression OCI GoldenGate (Confluent) Kafka Replication.
      • Security attributes: Add security attributes to control access to this connection using Zero Trust Packet Routing (ZPR).
      • Tags: Add tags to organize your resources.
  4. Click Create.
After the connection is created, it appears in the Connections list. Ensure that you assign the connection to a deployment to use it as a source or target in a replication.