Basic taskflows

The following taskflows guide you on how to get set up with OCI GoldenGate, Data Transforms, and Stream Analytics quickly and easily. Depending on your use case, you may diverge from the path outlined below, in which case you can choose to follow one of the various quickstarts available.

Data replication taskflow

Task Description More information
Review Security best practices Develop a firm understanding of your responsibilities to keep your OCI GoldenGate deployments and connections secure. Securing OCI GoldenGate
Create OCI resources This task is typically performed by an administrator. Ensure that the required networking resources are created before you begin. Create Oracle Cloud resources
Create deployments A deployment is a container for your OCI GoldenGate resources.

Example OCI GoldenGate topologies

Create deployments
Create connections A connection contains the network connectivity details for a data source or target. About connections
Assign connections to deployments To use a connection as a source or target, you must assign it to a deployment. Create an association between connections and deployments
Launch the OCI GoldenGate deployment console Create your data replication processes in the OCI GoldenGate deployment console. Explore the deployment console
Manage deployment users Add users that can create and manage data replication processes in the deployment console. Manage deployment users
Create an Extract An Extract is a process that captures the data from the source that you want to replicate to the target. Add an Extract
Create a Distribution Path Use a Distribution Path when you need to replicate data in a distributed deployment environment. Add a Distribution Path
Create a Replicat A Replicat is a process that delivers data to the target. Add a Replicat
Monitor performance Monitor the overall health of your deployments to ensure your processes run smoothly. Monitor performance
Maintain trail files Trail files can add up exponentially over time and take up valuable space. Ensure that you create tasks to purge unused trail files periodically. Manage Trail files

Data Transforms taskflow

Task Description More information
Review Security best practices Develop a firm understanding of your responsibilities to keep your OCI GoldenGate deployments and connections secure. Securing OCI GoldenGate
Create OCI resources This task is typically performed by an administrator. Ensure that the required networking resources are created before you begin. Create Oracle Cloud resources
Create deployments A deployment is a container for your OCI GoldenGate resources.

Create a Data Transforms deployment
Create Generic connections Create a generic connection for each Data Transforms data source. Create a Generic connection
Assign connections to deployments To use a connection as a source or target, you must assign it to a deployment. Assign a connection to a deployment
Launch the Data Transforms console Create your data flows and workflows in Data Transforms. Access Data Transforms
Create connections Create connections in Data Transforms to data sources to use in a project. Work with connections
Create a project A project is the top-level container, which can include multiple folders to organize your data flows or work flows into logical groups. Work with Projects
Create and Run a Data Load A data load allows you to load multiple data entities from a source connection to a target connection.

Create a Data Load

Run a Data Load

Monitor Status of Data Loads, Data Flows, and Workflows When you run a data load, data flow, or workflow Oracle Data Transforms runs jobs in the background to complete the request. You can view the status of the job in the panel on the bottom right of the page. Monitor Status of Data Loads, Data Flows, and Workflows
Create Data Flows and Workflows A data flow defines how the data is moved and transformed between different systems. A workflow is made up of multiple flows organized in a sequence in which they must be executed.

Create a Data Flow

Create a New Workflow

Stream and analyze taskflow

Task Description More information
Review Security best practices Develop a firm understanding of your responsibilities to keep your OCI GoldenGate deployments and connections secure. Securing OCI GoldenGate
Create OCI resources This task is typically performed by an administrator. Ensure that the required networking resources are created before you begin. Create Oracle Cloud resources
Create deployments A deployment is a container for your OCI GoldenGate resources.

Example OCI GoldenGate topologies

Create deployments
Create connections A connection contains the network connectivity details for a data source or target. About connections
Assign connections to deployments To use a connection as a source or target, you must assign it to a deployment. Create an association between connections and deployments
Launch the Stream Analytics console Create your data replication processes in the Stream Analytics console. Access Stream Analytics
Create a stream A Stream is a source of continuous and dynamic data. The data can be from a wide variety of data sources such as IoT sensors to information from geospatial services or social networks. Create Streams
Create a pipeline A pipeline includes a sequence of data processing stages such as, Query, Pattern, Rule, Query Group, Custom, and Scoring. Create a Pipeline
Add Business Logic Transform the input data stream, add business logic to the pipeline to analyze the input data stream.

See Transform

See Analyze
Publish the Pipeline To make the pipeline available for all the users of Oracle Stream Analytics and send data to targets, you must publish a pipeline. Publishing a Pipeline

Pipeline taskflow

Task Description More information
Create OCI resources This task is typically performed by an administrator. Ensure that the required networking resources are created before you begin. Create Oracle Cloud resources
Create connections A connection contains the network connectivity details for a data source or target. About connections
Create a Pipeline A pipeline is a predefined data replication use case. Create pipelines
Add mapping rules Determine how source data gets mapped to target tables and schemas. Add mapping rules
Start the pipeline The pipeline initializes based on options set during creation and Start the pipeline
Monitor performance Monitor the overall health of your pipeline processes. Monitor performance