Steps to build Continuous-ETL and Realtime-Analytics Pipelines

Step Action Description
Step 1 Create a Connection

You must create a connection to an external system, to be

Supported stream sources:
  • Kafka
  • OCI Streaming Service
  • JMS
  • Oracle Advanced Queuing

See Create Connections.

Step 2 Create a Stream

From the Catalog, create a Stream using the Connection from Step 1.

Supported stream definitions:
  • File
  • Kafka
  • JMS
  • AQ
  • GoldenGate

See Create Streams.

Step 3 Create a Pipeline

From the Catalog, create a Pipeline using the Stream from Step 2.

See Create a Pipeline.

Step 4 Add Business Logic

Transform the input data stream, add business logic to the pipeline to analyze the input data stream.

See Transform.

See Analyze.

Step 5 Publish the Pipeline See Publishing a Pipeline.