Designing Data Integrator Projects

Oracle Java CAPS Data Integrator is an extract, transform, and load (ETL) tool for data warehousing or data migration.Data Integrator is designed to manage and orchestrate high-volume, high-performance data transformation from within the SOA tier. Data Integrator, along with the Java CAPS platform, offers a comprehensive enterprise integration infrastructure. Oracle Java CAPS Data Integrator is an enterprise module optimized for extracting , transforming , and loading bulk data between files and databases. It provides connectivity to a vast range of heterogeneous and diversified data sources including non relational data sources. It provides an ETL development and runtime environment that is fully integrated into Java CAPS and NetBeans and optimized for handling very large record sets.

The following topics provide instructions on how to design and use Data Integrator projects.

What You Need to Know

These topics provide information you should know before you start customizing a master index application.

• About Data Integrator

• Extracting, Transforming, Loading: ETL

• Oracle Java CAPS Data Integrator Overview

• Oracle Java CAPS Data Integrator Architecture

• Data Integrator Recovery

  ETL Collaboration Overview

What You Need to Do

The topics provide instructions on how to create and configure Data Integrator components.

Creating ETL Collaborations

• Connecting to Source and Target Databases

• Creating a New Data Integrator Project

• Creating an ETL Collaboration Using the Wizard

• Creating a Basic ETL Collaboration

• Creating an Advanced ETL Collaboration

• Creating an ETL Collaboration for a Master Index Staging Database

• Creating a Bulk Loader ETL Collaboration

• Joining Source Tables

Configuring ETL Collaborations

• Joining Source Tables

• Modifying an Existing Join

• Defining Extraction Conditions and Validations

• Adding Tables to an Existing Collaboration

• Forcing Execution Strategies for Collaborations

• Changing the Database URL for Design Time

• Configuring Source Table Properties

• Configuring Target Table Properties

• Using Pre-Created Temporary Staging Tables

• Viewing Table or Join Data

• Viewing the SQL Code

• Viewing Runtime Output Arguments

• Filtering Source Data Using Runtime Inputs

• Setting the Batch Size for Joined Tables

• Using Table Aliases with Multiple Source Table Views

• Grouping Input Data

• Viewing and Modifying Table Data