1. Using the Apache Kafka Adapter with Oracle Integration 3
  2. Understand the Apache Kafka Adapter
  3. Apache Kafka Adapter Capabilities

Apache Kafka Adapter Capabilities

The Apache Kafka Adapter enables you to create an integration in Oracle Integration that connects to an Apache Kafka messaging system. The Apache Kafka Adapter connects to the Apache Kafka distributed publish-subscribe messaging system from Oracle Integration and allows for the publishing and consumption of messages from a Kafka topic.

The Apache Kafka Adapter provides the following benefits:

  • Establishes a connection to the Apache Kafka messaging system to enable messages to be published and consumed.
  • Consumes messages from a Kafka topic and produces messages to a Kafka topic in the invoke (outbound) direction.
  • Consumes messages from a topic based on a specified frequency in the trigger (inbound) direction.

    Note:

    Message consumption in the inbound direction is only supported with use of the on-premises connectivity agent.
  • Reads data from topics in the Kafka cluster using the Apache Kafka Streaming API.
  • Enables you to browse the available metadata using the Adapter Endpoint Configuration Wizard (that is, the topics and partitions to which messages are published and consumed).
  • Supports a consumer group.
  • Supports headers.
  • Supports the following message structures:
    • Sample JSON
    • XML schema (XSD) and schema archive upload
    • Sample XML
    • Avro schema

    These schemas are applicable for the following scenarios:

    • Producing and consuming messages - Invoke connections (supported with both direct connectivity and the connectivity agent)
    • Consuming messages - Trigger connections (supported with the connectivity agent only)
  • Supports connecting to private resources that are in your virtual cloud network (VCN) private subnet with a private endpoint. See Connect to Private Resources in Provisioning and Administering Oracle Integration 3 and Configure the Endpoint Access Type. This type of connection does not use the connectivity agent.
  • Supports polling of messages for processing in the Apache Kafka Adapter with or without use of the connectivity agent. See Perform Inbound Polling Without the Connectivity Agent.
  • Supports the following security policies:
    • SASL OAuth (Client Credentials)
    • SASL Plain over SSL
    • TLS
    • Mutual TLS
    • SASL OAuth (Client Credentials using JWT Client Assertion)
    • Simple Authentication and Security Layer Plain (SASL/PLAIN)
  • Supports direct connectivity to an Apache Kafka messaging system over SSL.
  • Supports connectivity to an on-premises Apache Kafka messaging system through the connectivity agent.
  • Supports integration with the Confluent Kafka platform to produce and consume messages.
  • Supports optionally configuring the Kafka producer to be transactional. This enables an application to send messages to multiple partitions atomically. See Topic & Partition Page.
  • Supports connectivity to Azure Event Hub using the SASL OAuth (Client Credentials) and SASL OAuth (Client Credentials using JWT Client Assertion) security policies. This connectivity enables existing Apache Kafka Adapter features to be utilized in Azure Event Hub integrations. See Apache Kafka on Azure Event Hubs.

See http://kafka.apache.org/.

You can configure the Apache Kafka Adapter as a trigger connection and an invoke connection in an integration in Oracle Integration. The Apache Kafka Adapter is one of many predefined adapters included with Oracle Integration. See the Adapters page in the Oracle Help Center.