Create an Integration Task to Configure and Run a Data Flow
In Oracle Cloud Infrastructure Data Integration, an integration task lets you to prepare your data flows for execution. You can add parameters to a data flow, so that it can be used with different values each time you run the task. Default parameter values can be updated within an integration task. You can then validate the data flow with the updated parameters, before you publish the task to an Application.
In this tutorial, you:
- Create an integration task to configure runtime context for a data flow.
- Create an Application to contain and run published tasks.
- Publish a task to an Application.
- Create and monitor a task run.
Before You Begin
1. Creating an Integration Task
In the tab bar, click Open tab (plus icon), and then select
- On the Projects page, select DI_Lab.
- On the DI_Lab Project Details page, from the submenu, click Tasks.
Click Create Task, and then select Integration.
The Create Integration Task page opens in a new tab.
On the Create Integration Task page, change the Name to
Load Customers Lab.Entering a Description is optional. The value in the Identifier field is auto-generated based on the value you enter for Name. You can change the auto-generated value, but once you save the task, you cannot update it again.
- In the Data Flow section, click Select.
- In the Select a Data Flow panel, select Load Customers and Revenue Data, and then click Select.
- Click Create and Close.
2. Creating an Application
An Application is a container for published tasks, data flows, and their dependencies. You can run published tasks in an Application for testing, or roll them out into production.
- On the Home page, in the Quick Actions tile, click Create Application.
On the Applications page, enter
Lab Applicationfor Name.
The Application Details page for
Lab Applicationopens in a new tab.
3. Publishing a Task to an Application
- On the DI_Lab Project Details page, select Tasks in the submenu.
- In the Tasks list, from the Actions icon (three dots) for Load Customers Lab, select Publish to Application.
- In the Publish to Application dialog, select Lab Application.
- Click Publish.
You can modify the task or edit its data flow without impacting the published task. This enables you to test a version of your data flow, while working on some new changes.
You can now go to Lab Application to run your published task.
4. Creating and Monitoring a Task Run
- In the tab bar, click Open tab (plus icon), and then select Applications.
- Select Lab Application to open its details page.
- On the Application Details page, in the Tasks list, select Run from the Actions icon (three dots) for Load Customers Lab.
A success message appears. Running a task creates a task run.
- In the submenu, click Runs.The Runs list lets you view all task runs and their status.
Click Refresh to get the latest task run status updates.
Learn more about task runs
In the Application Details page, click Patches, and review
details of the task patch.
A patch contains updates to published tasks in an Application. You can find a list of patches on the Application Details page. When you publish a task, a Publish patch is created. When you unpublish a task, an Unpublish patch is created. Learn more about Patches.
Now that you've created an integration task to configure and run a data flow, you can Load Data into Autonomous Data Warehouse Using a Data Loader Task.