Connect to Microsoft Fabric Eventstream
Learn to create a connection to Microsoft Fabric Eventstream to use as an OCI GoldenGate source or target.
Before you begin
Ensure that you:
-
Review how OCI GoldenGate connects to your source and targets.
-
Configure the required policies to enable secure Vault and Secrets access, such as use secrets, use vaults, and read secret-bundles. For more information, see Minimum recommended policies.
-
If using TLS/ mTLS, convert the JKS truststore or truststore and keystore to
PKCS12format to use in the connection.-
Use the keytool utility in the JDK to convert to the PKCS12 format.
For the keystore, the keytool utility prompts you for a password, as shown in the following example:
keytool -importkeystore -srckeystore [MY_KEYSTORE.jks] -destkeystore [MY_KEYSTORE.p12] -srcstoretype JKS -deststoretype PKCS12 -deststorepass [PASSWORD_PKCS12]For the truststore, the keytool utility prompts for a password, as shown in the following example:
keytool -importkeystore -srckeystore [MY_TRUSTSTORE.jks] -destkeystore [MY_TRUSTSTORE.p12] -srcstoretype JKS -deststoretype PKCS12 -deststorepass [PASSWORD_PKCS12] -
After converting the keystore and truststore, add the following lines to the Kafka producer properties file and then save your changes:
ssl.truststore.type=PKCS12 ssl.keystore.type=PKCS12 -
Upload the file to the connection's Producer properties in the Settings section of Advanced options.
-
Create a source connection
To create a source Microsoft Fabric Eventstream connection:
-
From the OCI GoldenGate Overview page, select Connections.
You can also select Create Connection under the Get started section and skip to step 3.
-
On the Connections page, select Create Connection.
-
On the Create Connection page, complete the fields as follows:
-
For Name, enter a name for the connection.
-
(Optional) For Description, enter a description that helps you distinguish this connection from others.
-
(For GoldenGate on Multicloud only) Select your Subscription, and then complete the following fields.
-
From the Compartment dropdown, select the compartment in which the Resource Anchor resides.
-
Select the Multicloud partner region.
-
Select your Partner availability zone. The available options populate based on the selected Multicloud partner region.
-
-
For Compartment, select the compartment in which to create the connection.
-
From the Type dropdown, select Microsoft Fabric Eventstream.
-
Under Bootstrap servers:
-
Enter the Host and Port number for the Bootstrap server. Enter the Private IP only if the hostname is not resolvable from your subnet or if it uses SSL/TLS.
Note: If you enter a private IP, then OCI GoldenGate rewrites the private IP in the format,
ip-10-0-0-0.ociggsvc.oracle.vcn.com.Tip: All nodes in the cluster must have FQDNs to allow for traversal over private endpoints.
-
-
-
(Optional) Select + Bootstrap server to add another bootstrap server.
-
For Security protocol, select one of the following and then complete the corresponding fields:
-
Plaintext
-
SASL over plaintext
-
SASL over SSL
-
SSL
-
-
Expand Show advanced options. You can configure the following options:
-
Security
-
Deselect Use vault secrets you prefer not to use password secrets for this connection. If not selected:
-
Select Use Oracle-managed encryption key to leave all encryption key management to Oracle.
-
Select Use customer-managed encryption key to select a specific encryption key stored in your OCI Vault to encrypt your connection credentials.
-
-
-
Network connectivity
-
Shared endpoint, to share an endpoint with the assigned deployment. You must allow connectivity from the deployment's ingress IP.
-
Dedicated endpoint, for network traffic through a dedicated endpoint in the assigned subnet in your VCN. You must allow connectivity from this connection's ingress IPs.
Note:
- If a dedicated connection remains unassigned for seven days, then the service converts it to a shared connection.
- Learn more about Oracle GoldenGate connectivity.
-
-
Settings
-
If using this connection for Extract, then drag and drop or select the Consumer or Producer properties file (.properties).
-
To capture from Kafka, create a Kafka Consumer properties file (.properties) with one of the following deserializers or converters:
-
Kafka Consumer properties for JSON deserializer:
key.deserializer=org.apache.kafka.common.serialization.ByteArrayDeserializer value.deserializer=org.apache.kafka.common.serialization.ByteArrayDeserializer -
Kafka Consumer properties for JSON converter:
key.converter=org.apache.kafka.connect.json.JsonConverter value.converter=org.apache.kafka.connect.json.JsonConverter -
Kafka Consumer properties for Avro converter:
key.converter=io.confluent.connect.avro.AvroConverter value.converter=io.confluent.connect.avro.AvroConverter
-
-
-
Security attributes: Add security attributes to control access to this connection using Zero Trust Packet Routing (ZPR).
-
Tags: Add tags to organize your resources.
-
-
-
Select Create.
After the connection is created, it appears in the Connections list. Ensure that you assign the connection to a deployment to use it as a source replication.
Create a target connection
To create a target Microsoft Fabric Eventstream connection:
-
From the OCI GoldenGate Overview page, select Connections.
You can also select Create Connection under the Get started section and skip to step 3.
-
On the Connections page, select Create Connection.
-
On the Create Connection page, complete the fields as follows:
-
For Name, enter a name for the connection.
-
(Optional) For Description, enter a description that helps you distinguish this connection from others.
-
(For GoldenGate on Multicloud only) Select your Subscription, and then complete the following fields.
-
From the Compartment dropdown, select the compartment in which the Resource Anchor resides.
-
Select the Multicloud partner region.
-
Select your Partner availability zone. The available options populate based on the selected Multicloud partner region.
-
-
For Compartment, select the compartment in which to create the connection.
-
From the Type dropdown, select Microsoft Fabric Eventstream.
-
Under Bootstrap servers:
-
Enter the Host and Port number for the Bootstrap server. Enter the Private IP only if the hostname is not resolvable from your subnet or if it uses SSL/TLS.
Note: If you enter a private IP, then OCI GoldenGate rewrites the private IP in the format,
ip-10-0-0-0.ociggsvc.oracle.vcn.com.Tip: All nodes in the cluster must have FQDNs to allow for traversal over private endpoints.
-
(Optional) Select + Bootstrap server to add another bootstrap server.
-
-
For Security protocol, select one of the following and then complete the corresponding fields:
-
Plaintext
-
SASL over plaintext
-
SASL over SSL
-
SSL
-
-
Expand Show advanced options. You can configure the following options:
-
Security
-
Deselect Use vault secrets you prefer not to use password secrets for this connection. If not selected:
-
Select Use Oracle-managed encryption key to leave all encryption key management to Oracle.
-
Select Use customer-managed encryption key to select a specific encryption key stored in your OCI Vault to encrypt your connection credentials.
-
-
-
Network connectivity
-
Shared endpoint, to share an endpoint with the assigned deployment. You must allow connectivity from the deployment's ingress IP.
-
Dedicated endpoint, for network traffic through a dedicated endpoint in the assigned subnet in your VCN. You must allow connectivity from this connection's ingress IPs.
Note:
- If a dedicated connection remains unassigned for seven days, then the service converts it to a shared connection.
- Learn more about Oracle GoldenGate connectivity.
-
-
SettingsTo use Snappy compression in Kafka replication, drag and drop or select Producer properties, and change replication settings as discussed in Using Compression OCI GoldenGate (Confluent) Kafka Replication.
-
Security attributes: Add security attributes to control access to this connection using Zero Trust Packet Routing (ZPR).
-
Tags: Add tags to organize your resources.
-
-
-
Select Create.
After the connection is created, it appears in the Connections list. Ensure that you assign the connection to a deployment to use it as a target in a replication.