Go to main content
1/35
Contents
List of Examples
List of Figures
List of Tables
Title and Copyright Information
Preface
Audience
Documentation Accessibility
Related Documents
Conventions
What's New In Oracle Data Integrator?
Part I Introduction to Developing with Oracle Data Integrator
1
Overview of an Integration Project
1.1
Oracle Data Integrator Project Quick Start List
2
Overview of Oracle Data Integrator Topology
2.1
Introduction to the Oracle Data Integrator Topology
2.1.1
Physical Architecture
2.1.2
Contexts
2.1.3
Logical Architecture
2.1.4
Agents
2.1.5
Languages
2.1.6
Repositories
Part II Managing and Reverse-Engineering Metadata
3
Creating and Using Data Models and Datastores
3.1
Introduction to Models
3.1.1
Datastores
3.1.2
Data Integrity
3.1.3
Reverse-engineering
3.1.4
Changed Data Capture
3.2
Creating and Reverse-Engineering a Model
3.2.1
Creating a Model
3.2.2
Creating a Model and Topology Objects
3.2.3
Reverse-engineering a Model
3.3
Creating and Reverse-Engineering a Datastore
3.3.1
Creating a Datastore
3.3.2
Reverse-Engineering File Datastores
3.3.2.1
Reverse-Engineering Fixed Files
3.3.2.2
Reverse-Engineering Delimited Files
3.3.2.3
Reverse-Engineering COBOL Files
3.3.3
Adding and Deleting Datastore Attributes
3.3.4
Adding and Deleting Constraints and Filters
3.3.4.1
Keys
3.3.4.2
References
3.3.4.3
Conditions
3.3.4.4
Mandatory Attributes
3.3.4.5
Filter
3.4
Editing and Viewing a Datastore's Data
3.5
Using Partitioning
3.5.1
Manually Defining Partitions and Sub-Partitions of Model Datastores
3.6
Checking Data Quality in a Model
3.6.1
Introduction to Data Integrity
3.6.2
Checking a Constraint
3.6.3
Perform a Static Check on a Model, Sub-Model or Datastore
3.6.4
Reviewing Erroneous Records
4
Using Journalizing
4.1
Introduction to Changed Data Capture
4.1.1
The Journalizing Components
4.1.2
Simple vs. Consistent Set Journalizing
4.2
Setting up Journalizing
4.2.1
Setting up and Starting Journalizing
4.2.2
Journalizing Infrastructure Details
4.2.3
Journalizing Status
4.3
Using Changed Data
4.3.1
Viewing Changed Data
4.3.2
Using Changed Data: Simple Journalizing
4.3.3
Using Changed Data: Consistent Set Journalizing
4.3.4
Journalizing Tools
4.3.5
Package Templates for Using Journalizing
5
Creating Data Models with Common Format Designer
5.1
Introduction to Common Format Designer
5.1.1
What is a Diagram?
5.1.2
Why assemble datastores and attributes from other models?
5.1.3
Graphical Synonyms
5.2
Using the Diagram
5.2.1
Creating a New Diagram
5.2.2
Create Datastores and Attributes
5.2.3
Creating Graphical Synonyms
5.2.4
Creating and Editing Constraints and Filters
5.2.5
Printing a Diagram
5.3
Generating DDL scripts
5.4
Generating Mapping IN/OUT
Part III Developing Integration Projects
6
Creating an Integration Project
6.1
Introduction to Integration Projects
6.1.1
Oracle Data Integrator Project Components
6.1.1.1
Oracle Data Integrator Project Components
6.1.1.2
Global Components
6.1.2
Project Life Cycle
6.2
Creating a New Project
6.3
Managing Knowledge Modules
6.3.1
Project and Global Knowledge Modules
6.3.2
Knowledge Module Naming Conventions
6.3.3
Choosing the Right Knowledge Modules
6.3.4
Importing and Replacing Knowledge Modules
6.3.5
Encrypting and Decrypting a Knowledge Module
6.4
Organizing the Project with Folders
7
Creating and Using Packages
7.1
Introduction to Packages
7.1.1
Introduction to Steps
7.1.2
Introduction to Creating Packages
7.1.3
Introduction to the Package editor
7.2
Creating a new Package
7.3
Working with Steps
7.3.1
Adding a Step
7.3.1.1
Adding a Mapping step
7.3.1.2
Adding a Procedure step
7.3.1.3
Variable Steps
7.3.1.4
Adding Oracle Data Integrator Tool Steps
7.3.1.5
Adding a Model, Sub-Model or Datastore
7.3.2
Deleting a Step
7.3.3
Duplicating a Step
7.3.4
Running a Step
7.3.5
Editing a Step's Linked Object
7.3.6
Arranging the Steps Layout
7.4
Defining the Sequence of Steps
7.5
Running a Package
8
Creating and Using Mappings
8.1
Introduction to Mappings
8.1.1
Parts of a Mapping
8.1.2
Navigating the Mapping Editor
8.2
Creating a Mapping
8.2.1
Creating a New Mapping
8.2.2
Adding and Removing Components
8.2.3
Connecting and Configuring Components
8.2.3.1
Attribute Matching
8.2.3.2
Connector Points and Connector Ports
8.2.3.3
Defining New Attributes
8.2.3.4
Defining Expressions and Conditions
8.2.4
Defining a Physical Configuration
8.2.5
Running Mappings
8.3
Using Mapping Components
8.3.1
The Expression Editor
8.3.2
Source and Target Datastores
8.3.3
Creating Multiple Targets
8.3.3.1
Specifying Target Order
8.3.4
Adding a Reusable Mapping
8.3.5
Creating Aggregates
8.3.6
Creating Distincts
8.3.7
Creating Expressions
8.3.8
Creating Filters
8.3.9
Creating Joins and Lookups
8.3.10
Creating Pivots
8.3.10.1
Example: Pivoting Sales Data
8.3.10.2
The Row Locator
8.3.10.3
Using the Pivot Component
8.3.11
Creating Sets
8.3.12
Creating Sorts
8.3.13
Creating Splits
8.3.14
Creating Subquery Filters
8.3.15
Creating Table Functions
8.3.16
Creating Unpivots
8.3.16.1
Example: Unpivoting Sales Data
8.3.16.2
The Row Locator
8.3.16.3
Using the Unpivot Component
8.3.17
Creating Flatten Components
8.3.17.1
Using a Flatten Component in a Mapping
8.3.17.2
Considerations for using Flatten component with JSON Source
8.3.18
Creating Jagged Components
8.4
Creating a Mapping Using a Dataset
8.4.1
Differences Between Flow and Dataset Modeling
8.4.2
Creating a Dataset in a Mapping
8.4.3
Converting a Dataset to Flow-Based Mapping
8.5
Physical Design
8.5.1
About the Physical Mapping Diagram
8.5.2
Selecting LKMs, IKMs and CKMs
8.5.3
Configuring Execution Locations
8.5.3.1
Moving Physical Nodes
8.5.3.2
Moving Expressions
8.5.3.3
Defining New Execution Units
8.5.4
Adding Commands to be Executed Before and After a Mapping
8.5.5
Configuring In-Session Parallelism
8.5.6
Configuring Parallel Target Table Load
8.5.7
Configuring Temporary Indexes
8.5.8
Configuring Journalizing
8.5.9
Configuring Extraction Options
8.5.10
Creating and Managing Physical Mapping Designs
8.6
Reusable Mappings
8.6.1
Creating a Reusable Mapping
8.7
Editing Mappings Using the Property Inspector and the Structure Panel
8.7.1
Adding and Removing Components
8.7.1.1
Adding Components
8.7.1.2
Removing Components
8.7.2
Editing a Component
8.7.3
Customizing Tables
8.7.4
Using Keyboard Navigation for Common Tasks
8.8
Flow Control and Static Control
8.8.1
Setting up Flow Control
8.8.2
Setting up Static Control
8.8.3
Defining the Update Key
8.9
Designing E-LT and ETL-Style Mappings
9
Creating and Using Dimensions and Cubes
9.1
Overview of Dimensional Objects
9.1.1
Overview of Dimensions
9.1.2
Overview of Cubes
9.1.2.1
Understanding Measure (Fact)
9.1.2.2
Cube Implementation
9.1.2.3
Error Datastore
9.2
Orphan Management
9.3
Creating Dimensional Objects through ODI
9.3.1
Dimension and Cube Accordion
9.3.2
Using Dimensions in ODI
9.3.3
Using Cubes in ODI
9.3.3.1
Generic Properties
9.3.3.2
Cube Measures
9.3.4
Creating New Dimensional Models
9.3.5
Creating and Editing Dimensional Objects using the Editor
9.3.5.1
Using Dimension Editor
9.3.5.1.1
Definition Tab
9.3.5.1.2
Levels Tab
9.3.5.1.3
Hierarchies Tab
9.3.5.1.4
Orphan Tab
9.3.5.2
Using the Cube Editor
9.3.5.2.1
Definition Tab
9.3.5.2.2
Details Tab
9.3.5.2.3
Orphan Tab
9.4
Using Dimensional Components in Mappings
9.4.1
Using Dimension Component in Mapping
9.4.1.1
Dimension Component Properties Editor
9.4.1.1.1
Attributes
9.4.1.1.2
General Properties
9.4.1.1.3
Connector Points
9.4.1.1.4
History Properties
9.4.1.1.5
Target Properties
9.4.2
Using Cube Component in Mappings
9.4.2.1
Cube Component Properties Editor
9.4.2.1.1
Attributes
9.4.2.1.2
General Properties
9.4.2.1.3
Target Properties
9.4.2.1.4
Connector Points
9.5
Expanding Dimensional Components
9.5.1
Expanding Dimension Component
9.5.2
Expanding Cube Component
10
Using Compatibility Mode
10.1
About Compatibility Mode
10.2
Creating Compatible Mappings
10.2.1
Creating Mappings using Upgrade Assistant
10.2.2
Creating Mappings with the 11g SDK in ODI 12c
10.3
About Internal Identifiers (IDs)
10.4
Renumbering Repositories
11
Creating and Using Procedures, Variables, Sequences, and User Functions
11.1
Working with Procedures
11.1.1
Introduction to Procedures
11.1.2
Creating Procedures
11.1.2.1
Create a New Procedure
11.1.2.2
Define the Procedure's Options
11.1.2.3
Create and Manage the Procedure's Tasks
11.1.3
Using Procedures
11.1.3.1
Executing the Procedure
11.1.3.2
Using a Procedure in a Package
11.1.3.3
Generating a Scenario for a Procedure
11.1.4
Encrypting and Decrypting Procedures
11.2
Working with Variables
11.2.1
Introduction to Variables
11.2.2
Creating Variables
11.2.3
Using Variables
11.2.3.1
Using Variables in Packages
11.2.3.2
Using Variables in Mappings
11.2.3.3
Using Variables in Object Properties
11.2.3.4
Using Variables in Procedures
11.2.3.5
Using Variables within Variables
11.2.3.6
Using Variables in the Resource Name of a Datastore
11.2.3.7
Using Variables in a Server URL
11.2.3.8
Using Variables in On Connect/Disconnect Commands
11.2.3.9
Passing a Variable to a Scenario
11.2.3.10
Generating a Scenario for a Variable
11.2.3.11
Tracking Variables and Sequences
11.3
Working with Sequences
11.3.1
Introduction to Sequences
11.3.2
Creating Sequences
11.3.2.1
Creating Standard Sequences
11.3.2.2
Creating Specific Sequences
11.3.2.3
Creating Native Sequences
11.3.3
Using Sequences and Identity Columns
11.3.3.1
Tips for Using Standard and Specific Sequences
11.3.3.2
Identity Columns
11.3.4
Sequence Enhancements
11.4
Working with User Functions
11.4.1
Introduction to User Functions
11.4.2
Creating User Functions
11.4.3
Using User Functions
12
Using Scenarios
12.1
Introduction to Scenarios
12.2
Generating a Scenario
12.3
Regenerating a Scenario
12.4
Generating a Group of Scenarios
12.5
Controlling Concurrent Execution of Scenarios and Load Plans
12.6
Exporting Scenarios
12.7
Importing Scenarios in Production
12.7.1
Import Scenarios
12.7.2
Replace a Scenario
12.7.3
Working with a Scenario from a Different Repository
12.8
Encrypting and Decrypting a Scenario
13
Using Load Plans
13.1
Introduction to Load Plans
13.1.1
Load Plan Execution Lifecycle
13.1.2
Differences between Packages, Scenarios, and Load Plans
13.1.3
Load Plan Structure
13.1.4
Introduction to the Load Plan Editor
13.2
Creating a Load Plan
13.2.1
Creating a New Load Plan
13.2.2
Defining the Load Plan Step Sequence
13.2.2.1
Adding Load Plan Steps
13.2.2.2
Editing Load Plan Steps
13.2.2.3
Deleting a Step
13.2.2.4
Duplicating a Step
13.2.3
Working with Variables in Load Plans
13.2.3.1
Declaring Load Plan Variables
13.2.3.2
Setting Variable Values in a Step
13.2.4
Handling Load Plan Exceptions and Restartability
13.2.4.1
Defining Exceptions Flows
13.2.4.2
Using Exception Handling
13.2.4.3
Defining the Restart Behavior
13.3
Running Load Plans
13.4
Using Load Plans in Production
13.4.1
Scheduling and Running Load Plans in Production
13.4.2
Exporting, Importing and Versioning Load Plans
13.4.2.1
Exporting Load Plans
13.4.2.2
Importing Load Plans
13.4.2.3
Versioning Load Plans
14
Using Web Services
14.1
Introduction to Web Services in Oracle Data Integrator
14.2
Oracle Data Integrator Run-Time Services and Data Services
14.3
Invoking Third-Party Web Services
14.3.1
Introduction to Web Service Invocation
14.3.2
Creating a SOAP Web Service Data Server
14.3.2.1
Options on the Definition Tab of the SOAP Web Service Data Server
14.3.3
Creating a New Physical Schema for a SOAP Web Service Data Server
14.3.3.1
Configuration Options
14.3.3.2
OWSM Policy Configuration
14.3.4
Creating a REST Service Data Server
14.3.4.1
Options on the Definition Tab of the REST Service Data Server
14.3.5
Creating a New Physical Schema for a REST Service Data Server
14.3.5.1
Configuration Options (Without OWSM)
14.3.5.1.1
Operations Tab
14.3.5.2
OWSM Policy Configuration
14.3.6
Creating Logical Schema for a REST Service Data Server
14.3.7
Using HTTP Analyzer
14.3.7.1
Using HTTP Analyzer: Main Steps
14.3.7.2
What Happens When You Run the HTTP Analyzer
14.3.7.3
How to Specify HTTP Analyzer Settings
14.3.7.4
How to Use the Log Window
14.3.7.5
How to Use the Test Window
14.3.7.6
How to Use the Instances Window
14.3.7.7
How to Use Multiple Instances
14.3.7.8
How to Configure External Web Browsers
14.3.7.9
Using Credentials With HTTP Analyzer
14.3.7.10
Using SSL With HTTP Analyzer
14.3.7.11
How to Debug Web Pages Using the HTTP Analyzer
14.3.7.12
How to Use Rules to Determine Behavior
14.3.7.12.1
Using the Pass Through Rule
14.3.7.12.2
Using the Forward Rule
14.3.7.12.3
Using the URL Substitution Rule
14.3.7.12.4
Using the Tape Rule
14.3.7.13
How to Set Rules
14.3.7.14
Reference: Troubleshooting the HTTP Analyzer
14.3.7.14.1
Running the HTTP Analyzer While Another Application is Running
14.3.7.14.2
Changing Proxy Settings
14.3.8
Using the OdiInvokeWebService Tool
14.3.9
Using the odiInvokeRESTfulService tool
14.3.9.1
Testing OdiInvokeRESTfulService Tool
14.3.9.2
Editing Multipart Body Parameters
14.3.9.3
Editing OdiInvokeRESTfulService Parameters
14.3.9.3.1
Request Header Repeating Parameter
14.3.9.3.2
Request Query Repeating Parameter
14.3.9.3.3
Request Query String (Encoded) Parameter
14.3.9.3.4
Request Template Repeating Parameter
14.3.9.4
Populating Default Parameters
15
Using Shortcuts
15.1
Introduction to Shortcuts
15.1.1
Shortcutting Concepts
15.1.2
Shortcut Objects
15.2
Introduction to the Shortcut Editor
15.3
Creating a Shortcut
15.4
Working with Shortcuts in your Projects
15.4.1
Duplicating a Selection with Shortcuts
15.4.2
Jump to the Reference Shortcut
15.4.3
Jump to the Base Object
15.4.4
Executing Shortcuts
15.4.5
Materializing Shortcuts
15.4.6
Exporting and Importing Shortcuts
15.4.7
Using Release Tags
15.4.8
Advanced Actions
16
Using Groovy Scripting
16.1
Introduction to Groovy
16.2
Introduction to the Groovy Editor
16.3
Using the Groovy Editor
16.3.1
Create a Groovy Script
16.3.2
Open and Edit an Existing Groovy Script
16.3.3
Save a Groovy Script
16.3.4
Execute a Groovy Script
16.3.5
Stop the Execution of a Groovy Script
16.3.6
Perform Advanced Actions
16.4
Automating Development Tasks - Examples
17
Using Component KMs
17.1
Component KM Overview
17.2
Understanding Inheritance
17.3
Writing Old Style KMs
17.4
Types of KMs
17.5
Creating and Editing Component KMs through KM Editor
17.5.1
Working with Definition Tab
17.5.2
Working with Tasks Tab
17.5.2.1
Working with Toolbar of Tasks Tab
17.5.2.2
Understanding the Properties of Tasks Tab of KM Editor
17.5.2.3
Exploring Source/Target Command Editor
17.5.3
Working with Options Tab
17.5.4
Working with Version Tab
17.6
Understanding Global Templates
17.6.1
Creating and Editing Global Templates
17.6.2
Using Template Editor
17.6.3
Working with Context Menu Items for Global Templates
Part IV Managing Integration Projects
18
Exchanging Global ODI Objects
18.1
Using the Check for Updates Wizard
19
Organizing and Documenting Integration Projects
19.1
Organizing Projects with Folders
19.1.1
Creating a New Folder
19.1.2
Arranging Project Folders
19.2
Organizing Models with Folders
19.2.1
Creating a New Model Folder
19.2.2
Arranging Model Folders
19.2.3
Creating and Organizing Sub-Models
19.3
Using Cross-References
19.3.1
Browsing Cross-References
19.3.2
Resolving Missing References
19.4
Using Markers and Memos
19.4.1
Markers
19.4.2
Memos
19.5
Handling Concurrent Changes
19.5.1
Concurrent Editing Check
19.5.2
Object Locking
19.6
Creating PDF Reports
19.6.1
Generating a Topology Report
19.6.2
Generating a Report for the Version Comparison Results
19.6.3
Generating a Report for an Oracle Data Integrator Object
19.6.4
Generating a Diagram Report
20
Using Version Control (Legacy Mode)
20.1
Working with Object Flags
20.2
Working with Versions
20.3
Working with the Version Comparison Tool
20.3.1
Viewing the Differences between two Versions
20.3.2
Using Comparison Filters
20.3.3
Generating and Printing a Report of your Comparison Results
20.4
Working with Labels
20.4.1
Working with Elements in a Label
20.4.2
Synchronizing Labels
20.4.3
Restoring and Checking in a Label
20.4.4
Importing and Exporting Labels
21
Integrating ODI with Version Control Systems
21.1
Introduction to ODI-VCS integration
21.2
Understanding Generic Profiles in ODI
21.3
Setting up a Version Control System
21.3.1
Switching Between Different Versioning Applications
21.3.2
Creating or Editing a VCS Connection
21.3.2.1
Leveraging Password-protected Wallet for storing VCS Passwords
21.3.2.2
HTTP Basic Authentication Options
21.3.2.3
SVN/Git Basic Authentication Options
21.3.2.4
SSH Authentication Options
21.3.2.5
SSL Authentication Options
21.3.2.6
File Based Authentication Options
21.3.3
Cloning Remote Git Repository in Local Directory
21.3.3.1
Clone Git Remote Repository Settings
21.3.4
Configuring Subversion Settings
21.3.4.1
Subversion Settings
21.3.5
Configuring ODI Repository with VCS
21.3.5.1
Options to Configure ODI Repository with Subversion
21.3.5.2
Options to Configure ODI Repository with Git
21.3.5.3
Providing Encryption Support
21.3.6
Reconfiguring ODI Repository with VCS Repository
21.3.7
Creating a Default Subversion Project Structure
21.4
Erasing/Detaching Existing Work Repository from Master Repository
21.5
Populating an ODI Repository from a VCS Branch/Trunk or Tag
21.6
Managing Tags
21.6.1
Creating a Full Tag in the VCS Repository
21.6.2
Creating a Partial Tag in the VCS Repository
21.6.2.1
Create Partial Tag Options
21.6.3
Creating a Branch from a Tag present in the VCS Repository
21.6.3.1
Create Branch from Tag Options
21.7
Unlocking the ODI Repository
21.8
Managing Versions
21.8.1
Adding Non-versioned ODI Objects to the VCS Repository
21.8.2
Adding Non-versioned Child Objects under a Versioned Container to the VCS Repository
21.8.3
Adding a Single Non-versioned ODI Object to the VCS Repository
21.8.4
Deleting, Moving, and Renaming a Version Controlled ODI Object in the VCS Repository
21.8.4.1
Deleting a Version Controlled ODI Object
21.8.4.2
Moving a Version Controlled ODI Object
21.8.4.3
Renaming a Version Controlled ODI Object
21.8.5
Creating Versions of a Version Controlled ODI Object
21.8.5.1
Create Version Options
21.8.6
Restoring a Version Controlled ODI Object to its Previous Version
21.8.6.1
Restore Object from VCS Repository Options
21.8.6.2
Restore with Merge
21.8.6.2.1
Merge Object Selection
21.8.6.2.2
Merge Conflict Resolution
21.8.7
Restoring a Version Controlled ODI Object Deleted in ODI Repository
21.8.7.1
Version Search Criteria - Restore Deleted Object
21.8.8
Viewing Pending Changes from ODI Repository
21.8.8.1
Pending Changes (VCS) Options
21.8.9
Viewing the Version History of a Version Controlled ODI Object
21.8.9.1
Version Search Criteria - Viewing Version History
21.8.10
Comparing Versions of an ODI Object from the Version History Window
21.8.10.1
Types of Compare
21.8.10.2
Icons on the Version Compare Results Window
21.8.11
Viewing Version Tree of a Version Controlled ODI Object
21.8.12
Comparing Versions of an ODI Object from the Version Tree Editor
21.9
Performing a Merge
21.9.1
Viewing Merge Summary
21.9.1.1
Merge Summary Options
22
Release Management
22.1
Managing ODI Releases
22.2
Types of Deployment Archives
22.3
Creating a Deployment Archive from a VCS Label
22.4
Creating an Initial Deployment Archive from the ODI Repository
22.5
Creating a Patch Deployment Archive from the ODI Repository
22.6
Viewing Available Deployment Archives
22.7
Initializing an ODI Repository Using an Initial Deployment Archive
22.8
Updating an ODI Repository Using a Patch Deployment Archive
22.9
Viewing Deployment Archives Applied in an ODI Repository
22.10
Rolling Back a Patch Deployment Archive
23
Life Cycle Management Guidelines
23.1
Guidelines for Choosing the Authentication Type
23.2
General Branching Guidelines
23.3
General Tagging Guidelines
23.4
Branching Guidelines for Single Development Team
23.5
Branching Guidelines for Parallel Development Teams
23.6
Guidelines for Release Branches for Parallel Development Teams
23.7
Guidelines for Versioning During Development
23.8
Guidelines for Deployment in Testing and Production Environments
23.9
Guidelines for Initial Deployment and Patching
24
Exporting and Importing
24.1
Import and Export Concepts
24.1.1
Global Identifiers (GUIDs)
24.1.2
Export Keys
24.1.3
Relationships between Objects
24.1.4
Import Modes
24.1.5
Tips for Import/Export
24.2
Exporting and Importing Objects
24.2.1
Exporting an Object with its Child Components
24.2.2
Exporting an Object without its Child Components
24.2.3
Partial Export/Import
24.2.4
Exporting one ODI Object
24.2.5
Export Multiple ODI Objects
24.2.6
Importing Objects
24.2.7
Smart Export and Import
24.2.7.1
Performing a Smart Export
24.2.7.2
Performing a Smart Import
24.3
Repository-Level Export/Import
24.3.1
Exporting and Importing the Master Repository
24.3.2
Export/Import Topology and Security Settings
24.3.3
Exporting and Importing a Work Repository
24.4
Exporting the Technical Environment
24.5
Exporting and Importing the Log
Scripting on this page enhances content navigation, but does not change the content in any way.