Home
/
Middleware
/
Oracle Data Integrator
1/43
Contents
List of Examples
List of Figures
List of Tables
Title and Copyright Information
Preface
Audience
Documentation Accessibility
Related Documents
Conventions
What's New In Oracle Data Integrator?
New Features in Oracle Data Integrator 12
c
(12.1.2)
Part I Understanding Oracle Data Integrator
1
Introduction to Oracle Data Integrator
Introduction to Data Integration with Oracle Data Integrator
Data Integration
Oracle Data Integrator
E-LT
Oracle Data Integrator Concepts
Introduction to Declarative Design
Introduction to Knowledge Modules
Introduction to Mappings
Datastores
Declarative Rules
Data Flow
Typical ODI Integration Projects
Batch Oriented Integration
Event Oriented Integration
Service-Oriented Architecture
Data Quality with ODI
Managing Environments
Oracle Data Integrator Architecture
Repositories
Users
Design-time Projects
Run-Time Agent
ODI Domains
2
Overview of an Integration Project
Oracle Data Integrator QuickStart List
Part II Administering Oracle Data Integrator Architecture
3
Administering Repositories
Introduction to Oracle Data Integrator Repositories
Creating Repository Storage Spaces
Creating the Master Repository
Connecting to the Master Repository
Creating a Work Repository
Connecting to a Work Repository
Changing a Work Repository Password
Advanced Actions for Administering Repositories
Attaching and Detaching (Deleting) a Work Repository
Erasing a Work Repository
Configuring Repository Connections
4
Setting Up a Topology
Introduction to the Oracle Data Integrator Topology
Physical Architecture
Contexts
Logical Architecture
Agents
Languages
Repositories
Setting Up the Topology
Creating a Context
Creating a Data Server
Pre-requisites and Guidelines
Creating a Data Server
Creating a Data Server (Advanced Settings)
Testing a Data Server Connection
Creating a Physical Schema
Creating a Logical Schema
Creating a Physical Agent
Creating a Logical Agent
Managing Agents
Standalone Agent
Configuring the Standalone Agent
Launching a Standalone Agent
Stopping an Agent
Java EE Agent
Deploying an Agent in a Java EE Application Server
Creating a Server Template for the Java EE Agent
Deploying Datasources from Oracle Data Integrator in an application server for an Agent
Load Balancing Agents
Delegating Sessions
Agent Unavailable
Setting Up Load Balancing
Part III Managing and Reverse-Engineering Metadata
5
Creating and Using Data Models and Datastores
Introduction to Models
Datastores
Data Integrity
Reverse-engineering
Changed Data Capture
Creating and Reverse-Engineering a Model
Creating a Model
Reverse-engineering a Model
Creating and Reverse-Engineering a Datastore
Creating a Datastore
Reverse-Engineering File Datastores
Reverse-Engineering Fixed Files
Reverse-Engineering Delimited Files
Reverse-Engineering COBOL Files
Adding and Deleting Datastore Attributes
Adding and Deleting Constraints and Filters
Keys
References
Conditions
Mandatory Attributes
Filter
Editing and Viewing a Datastore's Data
Using Partitioning
Defining Manually Partitions and Sub-Partitions of Model Datastores
Checking Data Quality in a Model
Introduction to Data Integrity
Checking a Constraint
Perform a Static Check on a Model, Sub-Model or Datastore
Reviewing Erroneous Records
6
Using Journalizing
Introduction to Changed Data Capture
The Journalizing Components
Simple vs. Consistent Set Journalizing
Setting up Journalizing
Setting up and Starting Journalizing
Journalizing Infrastructure Details
Journalizing Status
Using Changed Data
Viewing Changed Data
Using Changed Data: Simple Journalizing
Using Changed Data: Consistent Set Journalizing
Journalizing Tools
Package Templates for Using Journalizing
7
Creating Data Models with Common Format Designer
Introduction to Common Format Designer
What is a Diagram?
Why assemble datastores and attributes from other models?
Graphical Synonyms
Using the Diagram
Creating a New Diagram
Create Datastores and Attributes
Creating Graphical Synonyms
Creating and Editing Constraints and Filters
Printing a Diagram
Generating DDL scripts
Generating Mapping IN/OUT
8
Creating and Using Data Services
Introduction to Data Services
Setting Up Data Services
Configuring the Web Services Container
Setting up the Data Sources
Configuring the Model
Generating and Deploying Data Services
Generating and Deploying Data Services
Overview of Generated Services
Testing Data Services
Part IV Developing Integration Projects
9
Creating an Integration Project
Introduction to Integration Projects
Oracle Data Integrator Project Components
Oracle Data Integrator Project Components
Global Components
Project Life Cycle
Creating a New Project
Managing Knowledge Modules
Project and Global Knowledge Modules
Knowledge Module Naming Conventions
Choosing the Right Knowledge Modules
Importing and Replacing Knowledge Modules
Encrypting and Decrypting a KM
Organizing the Project with Folders
10
Creating and Using Packages
Introduction to Packages
Introduction to Steps
Introduction to Creating Packages
Introduction to the Package editor
Creating a new Package
Working with Steps
Adding a Step
Adding a Mapping step
Adding a Procedure step
Variable Steps
Adding Oracle Data Integrator Tool Steps
Adding a Model, Sub-Model or Datastore
Deleting a Step
Duplicating a Step
Running a Step
Editing a Step's Linked Object
Arranging the Steps Layout
Defining the Sequence of Steps
Running a Package
11
Creating and Using Mappings
Introduction to Mappings
Parts of a Mapping
Navigating the Mapping Editor
Creating a Mapping
Creating a New Mapping
Adding and Removing Components
Connecting and Configuring Components
Attribute Matching
Connector Points and Connector Ports
Defining New Attributes
Defining Expressions and Conditions
Defining a Physical Configuration
Running Mappings
Using Mapping Components
The Expression Editor
Source and Target Datastores
Creating Filters
Creating Joins and Lookups
Creating Sets
Creating Aggregates
Creating Multiple Targets
Specifying Target Order
Creating Sorts
Creating Splits
Creating Distincts
Creating Expressions
Calling a Reusable Mapping
Creating a Mapping Using a Dataset
Differences Between Flow and Dataset Modeling
Creating a Dataset in a Mapping
Physical Design
About the Physical Mapping Diagram
Selecting LKMs, IKMs and CKMs
Configuring Execution Locations
Moving Physical Nodes
Moving Expressions
Defining New Execution Units
Configuring In-Session Parallelism
Configuring Parallel Target Table Load
Configuring Temporary Indexes
Configuring Journalizing
Configuring Extraction Options
Creating and Managing Deployment Specifications
Reusable Mappings
Creating a Reusable Mapping
Editing Mappings Using the Property Inspector and the Structure Panel
Adding and Removing Components
Adding Components
Removing Components
Editing a Component
Customizing Tables
Using Keyboard Navigation for Common Tasks
Flow Control and Static Control
Setting up Flow Control
Setting up Static Control
Defining the Update Key
Designing E-LT and ETL-Style Mappings
12
Using Compatibility Mode
About Compatibility Mode
Creating Compatible Mappings
Creating Mappings using Upgrade Assistant
Creating Mappings with the 11
g
SDK in ODI 12
c
About Internal Identifiers (IDs)
Renumbering Master Repositories
13
Creating and Using Procedures, Variables, Sequences, and User Functions
Working with Procedures
Introduction to Procedures
Creating Procedures
Create a New Procedure
Define the Procedure's Options
Create and Manage the Procedure's Tasks
Using Procedures
Executing the Procedure
Using a Procedure in a Package
Generating a Scenario for a Procedure
Encrypting and Decrypting Procedures
Working with Variables
Introduction to Variables
Creating Variables
Using Variables
Using Variables in Packages
Using Variables in Mappings
Using Variables in Object Properties
Using Variables in Procedures
Using Variables within Variables
Using Variables in the Resource Name of a Datastore
Using Variables in a Server URL
Using Variables in On Connect/Disconnect Commands
Passing a Variable to a Scenario
Generating a Scenario for a Variable
Tracking Variables and Sequences
Working with Sequences
Introduction to Sequences
Creating Sequences
Creating Standard Sequences
Creating Specific Sequences
Creating Native Sequences
Using Sequences and Identity Columns
Tips for Using Standard and Specific Sequences
Identity Columns
Working with User Functions
Introduction to User Functions
Creating User Functions
Using User Functions
14
Using Scenarios
Introduction to Scenarios
Generating a Scenario
Regenerating a Scenario
Generating a Group of Scenarios
Exporting Scenarios
Importing Scenarios in Production
Import Scenarios
Replace a Scenario
Working with a Scenario from a Different Repository
Encrypting and Decrypting a Scenario
15
Using Load Plans
Introduction to Load Plans
Load Plan Execution Lifecycle
Differences between Packages, Scenarios, and Load Plans
Load Plan Structure
Introduction to the Load Plan Editor
Creating a Load Plan
Creating a New Load Plan
Defining the Load Plan Step Sequence
Adding Load Plan Steps
Editing Load Plan Steps
Deleting a Step
Duplicating a Step
Working with Variables in Load Plans
Declaring Load Plan Variables
Setting Variable Values in a Step
Handling Load Plan Exceptions and Restartability
Defining Exceptions Flows
Using Exception Handling
Defining the Restart Behavior
Running Load Plans
Using Load Plans in Production
Running Load Plans in Production
Scheduling Load Plans
Exporting, Importing and Versioning Load Plans
Exporting Load Plans
Importing Load Plans
Versioning Load Plans
16
Using Web Services
Introduction to Web Services in Oracle Data Integrator
Oracle Data Integrator Run-Time Services and Data Services
Invoking Third-Party Web Services
Introduction to Web Service Invocation
Using HTTP Analyzer
Using HTTP Analyzer: Main Steps
What Happens When You Run the HTTP Analyzer
How to Specify HTTP Analyzer Settings
How to Use the Log Window
How to Use the Test Window
How to Use the Instances Window
How to Use Multiple Instances
Using Credentials With HTTP Analyzer
Using SSL With HTTP Analyzer
How to Debug Web Pages Using the HTTP Analyzer
How to Use Rules to Determine Behavior
How to Set Rules
Reference: Troubleshooting the HTTP Analyzer
Using the OdiInvokeWebService Tool
17
Using Shortcuts
Introduction to Shortcuts
Shortcutting Concepts
Shortcut Objects
Introduction to the Shortcut Editor
Creating a Shortcut
Working with Shortcuts in your Projects
Duplicating a Selection with Shortcuts
Jump to the Reference Shortcut
Jump to the Base Object
Executing Shortcuts
Materializing Shortcuts
Exporting and Importing Shortcuts
Using Release Tags
Advanced Actions
Part V Managing Integration Projects
18
Organizing and Documenting Integration Projects
Organizing Projects with Folders
Creating a New Folder
Arranging Project Folders
Organizing Models with Folders
Creating a New Model Folder
Arranging Model Folders
Creating and Organizing Sub-Models
Using Cross-References
Browsing Cross-References
Resolving Missing References
Using Markers and Memos
Markers
Memos
Handling Concurrent Changes
Concurrent Editing Check
Object Locking
Creating PDF Reports
Generating a Topology Report
Generating a Report for the Version Comparison Results
Generating a Report for an Oracle Data Integrator Object
Generating a Diagram Report
19
Using Version Control
Working with Object Flags
Working with Versions
Working with the Version Comparison Tool
Viewing the Differences between two Versions
Using Comparison Filters
Generating and Printing a Report of your Comparison Results
Working with Solutions
Working with Elements in a Solution
Synchronizing Solutions
Restoring and Checking in a Solution
Importing and Exporting Solutions
20
Exporting and Importing
Import and Export Concepts
Global Identifiers (GUIDs)
Relationships between Objects
Import Types
Tips for Import/Export
Exporting and Importing Objects
Exporting an Object with its Child Components
Exporting an Object without its Child Components
Partial Export/Import
Exporting one ODI Object
Export Multiple ODI Objects
Importing Objects
Smart Export and Import
Performing a Smart Export
Performing a Smart Import
Repository-Level Export/Import
Exporting and Importing the Master Repository
Export/Import the Topology and Security Settings
Exporting and Importing a Work Repository
Exporting the Technical Environment
Exporting and Importing the Log
Part VI Running and Monitoring Integration Processes
21
Running Integration Processes
Understanding ODI Executions
Executing Mappings, Procedures, Packages and Model Operations
Executing a Scenario
Executing a Scenario from ODI Studio
Executing a Scenario from a Command Line
Restarting a Session
Restarting a Session from ODI Studio
Restarting a Session from a Command Line
Stopping a Session
Stopping a Session From ODI Studio
Stopping a Session From a Command Line
Executing a Load Plan
Executing a Load Plan from ODI Studio
Executing a Load Plan from a Command Line
Restarting a Load Plan Run
Restarting a Load Plan from ODI Studio
Restarting a Load Plan from a Command Line
Stopping a Load Plan Run
Stopping a Load Plan from ODI Studio
Stopping a Load Plan Run from a Command Line
Scheduling Scenarios and Load Plans
Scheduling a Scenario or a Load Plan with the Built-in Scheduler
Scheduling a Scenario or a Load Plan
Updating an Agent's Schedule
Displaying the Schedule
Scheduling a Scenario or a Load Plan with an External Scheduler
Simulating an Execution
Managing Executions Using Web Services
Introduction to Run-Time Web Services
Executing a Scenario Using a Web Service
Monitoring a Session Status Using a Web Service
Restarting a Session Using a Web Service
Executing a Load Plan Using a Web Service
Stopping a Load Plan Run Using a Web Service
Restarting a Load Plan Instance Using a Web Service
Monitoring a Load Plan Run Status Using a Web Service
Listing Contexts Using a Web Service (Deprecated)
Listing Scenarios Using a Web Service (Deprecated)
Accessing the Web Service from a Command Line
Using the Run-Time Web Services with External Authentication
Using WS-Addressing
Using Asynchronous Web Services with Callback
22
Debugging Integration Processes
About Sessions and Blueprints
Blueprint Source and Target Code
Introduction to Debugging in the Session Editor
Icons
Differences between Debugging Packages, Mappings, and Procedures
Starting a Debugging Session
Connecting to a Running Debugging Session
Built-in Agents and External Agents
Debug Session Lifecycle
Debug Session Options
Suspend Before the First Task
Associate to Current Client
Delay Before Connect
Debug Descendant Sessions
Break On Error
Stepping through a Blueprint in the Session Editor
Steps and Tasks
Using the Debugging Cursor
Debug Actions
Step Into
Pause
Resume
Run to Task End
Run to Next Task
Run to Step End
Run to Next Step
Multiple Cursors
Special Behavior
Using Breakpoints
About the Debug Breakpoints Window
About Design vs. Runtime Breakpoints
Placing Breakpoints
Editing Breakpoints
Removing Breakpoints
Enabling and Disabling Breakpoints
Pass Count
Debugging Data
Get Data
Run SQL Code
Debugging Variables
Modifying Variables
Debugging Threads
Go To Source
Managing Debugging Sessions
Stop Normal and Stop Immediate
Restart Execution
23
Monitoring Integration Processes
Introduction to Monitoring
Introduction to Operator Navigator
Scenarios
Sessions
Load Plans
Load Plan Executions
Schedules
Log
Status
Task Types
Monitoring Executions Results
Monitoring Sessions
Monitoring Load Plan Runs
Handling Failed Sessions
Reviewing Successful Sessions
Handling Failed Load Plans
Reviewing Successful Load Plans
Managing your Executions
Managing Sessions
Cleaning Stale Sessions
Managing Load Plan Executions
Managing the Log
Filtering Sessions
Purging the Log
Organizing the Log with Session Folders
Exporting and Importing Log Data
Runtime Logging for ODI components
Managing Scenarios and Load Plans
Load Plan and Scenario Folders
Importing Load Plans, Scenarios, and Solutions in Production
Managing Schedules
24
Using Oracle Data Integrator Console
Introduction to Oracle Data Integrator Console
Oracle Data Integrator Console Concepts
Oracle Data Integrator Console Interface
Using Oracle Data Integrator Console
Connecting to Oracle Data Integrator Console
Generic User Operations
Managing Scenarios and Sessions
Managing Load Plans
Purging the Log
Using Data Lineage and Flow Map
Performing Administrative Operations
Part VII Managing Security Settings
25
Managing Security in Oracle Data Integrator
Introduction to Oracle Data Integrator Security
Objects, Instances and Methods
Profiles
Users
Roles
Setting up a Security Policy
Security Policy Approaches
Managing Profiles
Creating a New Profile
Duplicating a Profile
Deleting a Profile
Managing Users
Creating a New User in the Internal Repository
Assigning a Profile to a User
Removing a Profile from a User
Deleting a User from the Internal Repository
Managing Privileges
Granting a Profile Method or User Method
Revoking a Profile Method or User Method
Granting an Authorization by Object Instance
Revoking an Authorization by Object Instance
Cleaning up Unused Authorizations
Using a Password-Protected Wallet for Storing Login Credentials
Creating the Password-Protected Wallet
Permitting Repository Access to Other Users
Changing the Wallet Password
Customizing How Login Credentials Are Saved
Setting Up External Password Storage
Setting the Password Storage
Switching the Password Storage
Recovering the Password Storage
Managing the Authentication Mode
Setting the Authentication Mode in the Master Repository
Configuring External Authentication
Configuring Oracle Data Integrator Studio for External Authentication
Set Up the OPSS Configuration File
Create a Wallet File for an LDAP Bootstrap User
Set External Authentication when Creating the Master Repository
Switching an Existing Master Repository to External Authentication Mode
Reactivating Users After Switching to External Authentication
Configuring the Standalone Agent for External Authentication
Mapping Principals Defined in an Identity Store to Oracle Data Integrator Roles
How Enterprise Role Integration Works
Defining and Managing Oracle Data Integrator Roles
Using the Roles Editor
Enforcing Password Policies
Configuring Single Sign-On (SSO) for Oracle Data Integrator Console and Enterprise Manager using Oracle Access Manager 11
g
Best Security Practices for Oracle Data Integrator
Part VIII Appendices
A
Oracle Data Integrator Tools Reference
Using Oracle Data Integrator Tools
Using a Tool in a Package
Using a Tool in a Knowledge Module or Procedure Command
Using a Tool From a Command Line
Using Open Tools
Installing and Declaring an Open Tool
Installing an Open Tool
Declaring a New Open Tool
Using Open Tools in a Package or Procedure
Developing Open Tools
Classes
Developing a New Open Tool
Implementing the Class
Open Tools at Runtime
Oracle Data Integrator Tools by Category
Metadata
Oracle Data Integrator Objects
Utilities
Internet Related Tasks
Files
SAP
XML
Event Detection
Changed Data Capture
Alphabetical List of Oracle Data Integrator Tools
OdiAnt
OdiBeep
OdiDeleteScen
OdiEnterpriseDataQuality
OdiExportAllScen
OdiExportEnvironmentInformation
OdiExportLog
OdiExportMaster
OdiExportObject
OdiExportScen
OdiExportWork
OdiFileAppend
OdiFileCopy
OdiFileDelete
OdiFileMove
OdiFileWait
OdiFtp
OdiFtpGet
OdiFtpPut
OdiGenerateAllScen
OdiImportObject
OdiImportScen
OdiInvokeWebService
OdiKillAgent
OdiManageOggProcess
OdiMkDir
OdiOSCommand
OdiOutFile
OdiPingAgent
OdiPurgeLog
OdiReadMail
OdiRefreshJournalCount
OdiReinitializeSeq
OdiRemoveTemporaryObjects
OdiRetrieveJournalData
OdiReverseGetMetaData
OdiReverseManageShortcut
OdiReverseResetTable
OdiReverseSetMetaData
OdiSAPALEClient and OdiSAPALEClient3
OdiSAPALEServer and OdiSAPALEServer3
OdiScpGet
OdiScpPut
OdiSendMail
OdiSftp
OdiSftpGet
OdiSftpPut
OdiSleep
OdiSqlUnload
OdiStartLoadPlan
OdiStartOwbJob
OdiStartScen
OdiUnZip
OdiUpdateAgentSchedule
OdiWaitForChildSession
OdiWaitForData
OdiWaitForLoadPlans
OdiWaitForLogData
OdiWaitForTable
OdiXMLConcat
OdiXMLSplit
OdiZip
B
Using Groovy Scripting with Oracle Data Integrator
Introduction to Groovy
Introduction to the Groovy Editor
Using the Groovy Editor
Create a Groovy Script
Open and Edit an Existing Groovy Script
Save a Groovy Script
Execute a Groovy Script
Stop the Execution of a Groovy Script
Perform Advanced Actions
Automating Development Tasks - Examples
C
Oracle Warehouse Builder to Oracle Data Integrator Migration Utility Patch
New Features
Pivot Component
Example: Pivoting Sales Data
The Row Locator
Using the Pivot Component
Unpivot Component
Example: Unpivoting Sales Data
The Row Locator
Using the Unpivot Component
Table Function Component
Subquery Filter Component
Enhanced Features
Lookup Component Enhancements
Multiple Match Rows
No-Match Rows
Sequence Enhancements
Scripting on this page enhances content navigation, but does not change the content in any way.