Add Extract for Microsoft Fabric Eventstream

Follow the instructions to add Microsoft Fabric Eventstream sources.

Before you begin

Ensure that you:

• Review details specific to this source connection type.

• Create a credential in the Big Data deployment console:

  1. Launch the Big Data deployment console from the deployment details page, and then log in.

  2. In the left navigation menu of the Administration Service, select DB Connections.

  3. On the DB Connections page, select Add Credential (plus icon).

  4. Enter the following details in the fields provided, and then select Submit:

     • For Credential Domain, enter OracleGoldenGate.

     • For Credential Alias, enter kafka.

     • For User ID: enter kafka://

     • For Password, enter a password.

     • For Verify Password, enter the password again.

Add the Extract

1. In the OCI GoldenGate deployment console navigation menu, select Extracts.

2. On the Extracts page, select Add Extract.

3. In the Add Extract panel, on the Extract Information page, complete the following fields as needed, and then select Next:

   • Enter a Process Name, no more than 8 characters long.

   • Enter a Description (optional) to help you distinguish this process from others.

   • Select a Source from the dropdown.

4. On the Extract Options page, complete the following fields as needed, and then select Next:

   1. For Extract Trail:

      1. Enter a Name for the Extract process.

      2. Enter a Subdirectory name to set a custom location for the generated Trail file.

      3. Enter Trail Sequence to set the starting number for Trail files.

      4. Enter a Trail Size to set the max size for the generated trail file.

      5. Select an Encryption Profile. The Local Wallet profile is selected by default if an encryption profile wasn't created.

      6. Select an Encryption Algorithm:

         • NONE

         • AES256

         • AES192

         • AES128

   2. For Source Credentials, select the:

      1. Domain

      2. Alias

      3. When/where to Begin

5. On the Managed Options page, complete the following optional fields as needed, and then select Next:

   • Profile Name

   • Critical to deployment health

   • Auto Start

   • Auto Restart

     Note: Adding a profile and configuring Auto Start and Auto Restart options enables your deployment to restart automatically after a network disruption. See Configure managed processes to learn more.

6. On the Parameter file page, update the following:

   1. Update SOURCEDB USERIDALIAS to SOURCEDB USERIDALIAS kafka DOMAIN OracleGoldenGate

   2. Leave the table mapping as is (TABLE source.*;), to listen to all topics in the given bootstrap server. To capture from a designated topic, change the mapping to TABLE source.<topic-name>; where <topic-name> is the name of the topic to capture from.

      Note: The Extract mapping format is Table SourceSchema.Table. In Kafka, there are no source schemas/tables. OCI GoldenGate writes the first part (“source” in above step) as the schema name and the second part as table name to trail file. This way, you can replicate the captured kafka message into other GoldenGate supported targets.

7. Select Create and Run to create and start the Extract. If you select Create, then you can manually start the Extract later from the Extracts page.