6 Data Integration Technology

This chapter describes the licensing for Data Integration products. It contains the following sections:

6.1 Oracle Data Integrator Enterprise Edition

Oracle Data Integrator Enterprise Edition is a comprehensive software package for enabling scalable data integration in heterogeneous data environments. Oracle Data Integrator Enterprise Edition is separately licensed independent of any Oracle WebLogic Server edition, Oracle Business Intelligence Server Enterprise Edition, or Oracle Business Intelligence Suite Enterprise Edition. Therefore, to obtain high availability in Oracle Data Integrator Enterprise Edition, a separate license for the appropriate edition of Oracle WebLogic Server or Oracle Coherence is required.

Oracle Data Integrator Enterprise Edition includes the following components:

  • Oracle Data Integrator (ODI) — a heterogeneous platform for data integration that includes design time components for modeling and mapping, and run-time components for executing bulk data movement and transformation. ODI includes Job Scheduler Services, Changed Data Capture components, and a complete set of Knowledge Modules for access to an unrestricted number of Source technologies.

  • Oracle Warehouse Builder Enterprise ETL — an enterprise-class data integration platform for the Oracle Database that includes design time components for modeling and mapping, run-time components for executing bulk data movement and transformation, and administration components for managing the metadata repository.

Oracle Warehouse Builder Enterprise ETL extends the Oracle Database ETL features and includes the following functionality:

  • Accessing sources and targets

    • Native support for heterogeneous databases, including the definition of new platform types, JDBC connectivity, knowledge modules, and code templates

    • Support for Exadata hybrid columnar compression

    • Transparent Data Encryption (TDE) support

    • External Table support for Data Pump imports and exports

    • External Table preprocessor support

    • Change Data Capture mappings in ETL

    • Publishing and consuming web services, including integrating with process orchestration technologies such as Oracle BPEL Process Manager

    • Importing Cobol copybooks using the built-in wizard

    • Targeting XML files

  • Data Guard certification and failover support

  • Working with dimensional objects

    • Creating slowly changing dimensions, types 2 and 3

    • Storing data in OLAP cube-organized materialized views

    • Defining orphan management policies

  • Designing and executing ETL jobs

    • Right-time data warehousing utilizing queues and real-time mappings

    • Reusing and embedding mapping code with pluggable mappings

    • Specifying the load order of multiple targets in a single mapping

    • Partitioning and parallelizing updates to tables by utilizing the data chunking feature

    • Scheduling ETL jobs using the built-in Schedule interface

    • Using advanced process flows features (activity templates, use of the following activities: Assign, Set Status, For Loop, While Loop, Route, Notification, EJB, Java Class, and Webservice)

    • Designing mappings to handle complex types using the following operators: varray iterator, construct object, and expand object

    • Rapidly moving large amounts of data with transportable modules

    • Using spatial transformations and streams transformations

    • Compiled PL/SQL code generation

    • Bulk code templates for Oracle --> Oracle, SQL Server --> Oracle, and DB2 --> Oracle

  • Integrating with other products

    • Deploying metadata directly to Oracle Discoverer End User Layer

    • Deriving and deploying metadata to Oracle Business Intelligence Enterprise Edition

  • Administering Warehouse Builder and its metadata repository

    • Support for database failover

    • Managing environments, including promoting from development to test to production, using the multiple configurations functionality

    • Interactively analyzing metadata lineage and impact and automatically propagating metadata change using the Metadata Dependency Manager

    • Extending the metadata repository using the following: user-defined objects, user-defined associations, user-defined modules, creating icon sets and custom icons

    • Hosting the OWB design repository in an Oracle Real Application Clusters (Oracle RAC) environment (executing in an Oracle RAC environment does not require this license)

    • Operating multiple databases with OWB repositories from a single Oracle home

For more information about Warehouse Builder functionality, see the Oracle Database 11.2 Documentation Library for Data Warehousing and Business Intelligence.

6.1.1 Restricted Use Licensing

Oracle Data Integrator Enterprise Edition includes a restricted use license for Oracle WebLogic Server Standard Edition restricted to use for running the Oracle Data Integrator Web Console. Any other use will trigger a Full Use License.

6.2 Oracle Data Integration Suite

Oracle Data Integration Suite is a comprehensive software bundle for enabling scalable, highly-accessible data integration in any heterogeneous data environment. It can be separately licensed, independent of any Oracle Internet Application Server edition.

Oracle Data Integration Suite includes:

  • Oracle Data Integrator Enterprise Edition

  • Hyperion Data Relationship Management (up to maximum of 2,000 records per processor)

6.2.1 Restricted-Use Licensing

Oracle Data Integration Suite includes restricted-use licenses for the following components:

  • Oracle WebLogic Suite is included as host for only ODI Suite components including run-time components to provide Java run-time environment as well as configuration and administration components used for the setup and management of these run-time components.

  • Oracle BPEL Process Manager is included for use with Oracle Data Integrator and/or Hyperion Data Relationship Management as endpoints.

  • Oracle Service Bus is included for use with Oracle Data Integrator and/or Hyperion Data Relationship Management as endpoints.

6.3 Oracle Enterprise Data Quality

Oracle Enterprise Data Quality is a broad-based data quality platform. It includes the following products:

6.3.1 Oracle Enterprise Data Quality Profiling for Oracle Data Integrator

Oracle Enterprise Data Quality Profiling for Oracle Data Integrator enables business users to assess the quality, completeness, and usability of their data through interactive exploration and discovery. This can be used to determine appropriate data quality rules to be applied to the data.

6.3.2 Oracle Enterprise Data Quality Batch Processing for Oracle Data Integrator

Oracle Enterprise Data Quality Batch Processing for Oracle Data Integrator is a data quality platform that enables data parsing, standardization, match, merge, de-duplication, householding and name and address cleansing, as well as broad applicability to other data domains.

6.3.3 Oracle Enterprise Data Quality Address Verification Server for Oracle Data Integrator

Oracle Enterprise Data Quality Address Verification Server for Oracle Data Integrator cleanses and standardizes addresses and verifies them against reference data to determine if they are valid postal addresses.

6.4 Oracle Application Adapters for Data Integration

Oracle Application Adapters for Data Integration provide specific software components for reverse-engineering metadata and extracting bulk data from various ERP software applications. Each unique Application Adapter for Data Integration is licensed separately, but must be used with Oracle Data Integrator Enterprise Edition and the Data Integrator component.

Application Adapters for Data Integration are available for PeopleSoft, JD Edwards, E-Business Suite, Siebel, and SAP Applications. Each Application Adapter for Data Integration is licensed separately.

6.5 Oracle Application Adapters for Warehouse Builder

Oracle Application Adapters for Warehouse Builder provide specific software connectors for reverse-engineering metadata and extracting bulk data from various ERP software applications. Each unique Application Adapter for Warehouse Builder is licensed separately. Any use of Application Adapters for Warehouse Builder, including customers constructing their own application adapters for Warehouse Builder using documented APIs, requires a license for Oracle Data Integrator Enterprise Edition.

Application Adapters for Warehouse Builder are available for PeopleSoft, SAP, Siebel, and E-Business Suite.

6.6 Oracle GoldenGate

Oracle GoldenGate is a log-based, real-time change data capture (CDC) software platform that moves high volumes of transactional data between databases with very low latency, and allows logical data replication. A typical environment includes a capture, pump, and delivery process. Each of these processes can run on most of the popular operating systems. You can replicate all or a portion of your data, and you can even manipulate the data within any of these processes not only for heterogeneous environments but also different database schemas.

The Oracle GoldenGate product can be used in conjunction with Oracle GoldenGate for Non Oracle Database and/or with Oracle GoldenGate for Mainframe and/or with Oracle GoldenGate for Teradata Replication Services in order to achieve heterogeneous replication to an Oracle database from another third party database or from an Oracle database to another third party database.

The license for Oracle GoldenGate includes the ability to capture database transactions from Oracle Database and deliver database transactions to Oracle Database. It also includes a full use license for Oracle Active Data Guard and a full use license for XStream. Note that the capture and deliver features of Oracle GoldenGate work with any edition of the Oracle Database, while Active Data Guard and XStream require Oracle Database Enterprise Edition.

When Oracle GoldenGate is used in an Oracle to Oracle environment, it includes the following components:

  • XStream provides application programming interfaces (APIs) that enable client applications to receive real-time data changes from an Oracle database (using XStream Out APIs) and to send real-time data changes to an Oracle database (using XStream In APIs). These data changes can be shared between Oracle databases and other systems, such as file systems and non-Oracle databases.

  • Oracle Active Data Guard enables a physical standby database to be opened as read-only while changes are applied to it from the primary database, enabling read-only reporting on the physical standby with minimal latency between reporting and production data. Oracle Active Data Guard also allows backup operations to be off-loaded to the standby database using fast incremental backups. Oracle Active Data Guard provides the additional benefit of high availability and disaster protection by quickly failing over to the standby database in the event of a planned or an unplanned outage at the production site.

For more information about Oracle Active Data Guard and XStream functionality, see the Oracle Database 11.2 Documentation Library for High Availability.

A license to Oracle Golden Gate (OGG) includes a restricted-use license to Oracle GoldenGate Applications Adapters for JMS and Flat File (GGAA), with GGAA restricted to the JMS functionality used solely for enabling communication from OGG to separately-licensed Oracle Coherence Grid Edition deployments.

6.7 Oracle GoldenGate for Non Oracle Database

Oracle GoldenGate is a log-based, real-time change data capture (CDC) software platform that moves high volumes of transactional data between databases with very low latency, and allows logical data replication. A typical environment includes a capture, pump and delivery process. Each of these processes can run on most of the popular operating systems. You can replicate all or a portion of your data, and you can even manipulate the data within any of these processes not only for heterogeneous environments but also different database schemas.

The Oracle GoldenGate for Non Oracle Database product can be used in conjunction with Oracle GoldenGate, which supports Oracle Databases, and/or with Oracle GoldenGate for Mainframe, and/or with Oracle GoldenGate for Teradata Replication Services in order to achieve heterogeneous replication. For example, it is possible to use Oracle GoldenGate for Non Oracle Database to capture from a third party database and use Oracle GoldenGate to deliver to an Oracle database, or any other heterogeneous combination.

The license for Oracle GoldenGate for Non Oracle Database includes the ability to capture database transactions from supported non-Oracle open systems databases and deliver database transactions to supported non-Oracle open systems databases.

6.7.1 Database Platform Availability

Oracle GoldenGate for Non Oracle Database 11g Release 1 is currently available for the following database platforms. A detailed certification matrix is available from Oracle Support Services.

  • IBM DB2 database platform on Windows, UNIX, and Linux

  • Microsoft SQL Server 2000, 2005, 2008

  • Sybase on Windows, UNIX, and Linux

  • Teradata on Windows, UNIX, and Linux

  • MySQL on Windows, UNIX, and Linux

  • TimesTen on Windows and Linux (only for delivery)

6.8 Oracle GoldenGate for Mainframe

Oracle GoldenGate is a log-based, real-time change data capture (CDC) software platform running on HP NonStop databases (Enscribe, SQL/MX, and SQL/MP) and DB2 running on z/OS that replicates high volumes of transactional data between homogeneous and heterogeneous database environments. All of the data or a portion of the data can be replicated, and you can even manipulate the data for not only heterogeneous environments but also unequal database schemas too.

The Oracle GoldenGate for Mainframe product can be used in conjunction with Oracle GoldenGate, which supports Oracle Databases, and/or with Oracle GoldenGate for Non Oracle Database, and/or with Oracle GoldenGate for Teradata Replication Services in order to achieve heterogeneous replication. For example, it is possible to use Oracle GoldenGate for Non Oracle Database to capture from a third party database and use Oracle GoldenGate to deliver to an Oracle database, or any other heterogeneous combination.

The license for Oracle GoldenGate for Mainframe includes the ability to capture database transactions from supported mainframe platforms and deliver database transactions to supported mainframe platforms.

6.8.1 SyncFile

When Oracle GoldenGate for Mainframe is used in an HP NonStop environment for products that run on the Guardian operating system (Enscribe and SQL/MP), it includes SyncFile.

SyncFile is a component that manages non-database file duplication. For example, you may want to replicate configuration files, which are small and change infrequently. This is used for maintaining a secondary system that may have frequent database changes, but infrequent configuration file changes.

6.8.2 Database Platform Availability

Oracle GoldenGate for Mainframe 11g Release 1 is currently available for the following database platforms. Detailed certification matrix is available from Oracle Support Services.

  • IBM DB2 database platform on z/OS

  • IBM DB2 for i database platform (only for delivery from Windows using ODBC)

6.9 Oracle GoldenGate for Teradata Replication Services

Oracle GoldenGate is a log-based, real-time change data capture (CDC) software platform that moves high volumes of transactional data between databases with very low latency, and allows logical data replication. A typical environment includes a capture, pump, and delivery process. Each of these processes can run on most of the popular operating systems. You can replicate all or a portion of your data, and you can even manipulate the data within any of these processes not only for heterogeneous environments but also different database schemas.

The Oracle GoldenGate for Teradata Replication Services product can be used in conjunction with Oracle GoldenGate, which supports Oracle Databases, and/or with Oracle GoldenGate for Mainframe, and/or with Oracle GoldenGate for Teradata Replication Services in order to achieve heterogeneous replication. For example, it is possible to use Oracle GoldenGate for Teradata Replication Services to capture from a Teradata database and use Oracle GoldenGate to deliver to an Oracle database or any other heterogeneous combination. Oracle GoldenGate for Teradata Replication Services also allows homogeneous replication between a Teradata source and Teradata target.

The license for Oracle GoldenGate for Teradata Replication Services includes the ability to capture database transactions from Teradata databases and deliver database transactions to Teradata databases.

6.10 Oracle GoldenGate Application Adapters

The following components are licensed together as part of the Oracle GoldenGate Application Adapter for Base24:

  • Oracle GoldenGate D24 — Allows transactional data to be synchronized bi-directionally in real time throughout the day. In the event of an outage on one system, the full transaction load is processed on the remaining systems, ensuring continuous availability.

  • Oracle GoldenGate N24 — Coordinates the notification message to all BASE24 satellite processes once the file refresh process has completed. Coordination is available for bidirectional configurations as well as unidirectional without the need to modify BASE24.

  • Oracle GoldenGate T24 — Does the following:

    • Resolves problems with moving tokenized or segmented data to other platforms and databases

    • Reorganizes and reformats the transaction log (TLF and PTLF) tokens for all transaction types into a configurable order

    • Also reorganizes and re-formats PBF and CAF segments into a defined flat structure that can be propagated into any supported database.

The following components are licensed together as part of the Oracle GoldenGate Application Adapter for JMS and Flat File:

  • Oracle GoldenGate for Flat File — Used for file integration, predominantly for ETL, proprietary, or legacy applications. Oracle GoldenGate can write micro batches to disk to be consumed by tools that expect batch/file input. The data is formatted by Oracle GoldenGate to the specifications of the target application, for example, delimiter separated values, length delimited values, binary, etc. Near real-time feeds to these systems are accomplished by decreasing the time window for batch file rollover to minutes or even seconds.

  • Oracle GoldenGate for Java — Allows customers to execute custom event handlers written in Java to process the transaction operations and metadata changes captured by Oracle GoldenGate on the source system. These custom Java handlers can apply these changes to a third-party Java API exposed by the target system.

6.10.1 Separately Licensed Adapters

Oracle GoldenGate Logger for Enscribe is licensed separately. This adapter provides the mechanism to capture changes on non-audited Enscribe platforms. Logger requires GGSLIB, an intercept library, that binds the Oracle GoldenGate application to the user's NonStop application. When an Enscribe operation (such as WRITE) executes, GGSLIB intercepts it and sends the record to Logger. Logger writes the records to the universal format log trail, which can then be processed like any other log-based source.

Each of the following application adapters for Oracle GoldenGate must also be licensed separately:

  • Oracle GoldenGate for Application Adapter for Base24,

  • Oracle GoldenGate Application Adapter for JMS and Flat File

  • Oracle GoldenGate Application Adapter for Logger for Enscribe

6.11 Oracle GoldenGate Veridata

Oracle GoldenGate Veridata is a high-speed data comparison solution that identifies and reports data discrepancies between databases without interrupting ongoing business processes. Using Oracle GoldenGate Veridata, companies can audit and verify large volumes of data across a variety of business applications with certainty, and maintain reliable data synchronization.

6.12 Oracle Data Service Integrator

Oracle Data Service Integrator provides the ability to do the following:

  • Create canonical data service components for SOA

  • Perform federated query capabilities from databases, Web services, and other sources

  • Execute multi-target database updates

Oracle Data Service Integrator supplies fine-grained security with data redaction, and is natively accessible from the Oracle Service Bus product.

Oracle Data Service Integrator is separately licensed as a standalone product.

6.12.1 Restricted-Use Licensing

Oracle Data Service Integrator includes a restricted-use license for Oracle WebLogic Server Enterprise Edition as host for only Oracle Data Service Integrator, including run-time components to provide Java run-time environment and HTTP support, as well as configuration and administration components used for the setup and management of these run-time components.

6.13 Management Pack for Oracle Data Integrator

Management Pack for Oracle Data Integrator leverages Oracle Enterprise Manager Cloud Control best-in-class application performance management, service level management and configuration management capabilities to provide a centralized management solution for Oracle Data Integrator Enterprise Edition.

For more licensing information please review the Enterprise Manager Licensing Documentation: http://www.oracle.com/technetwork/oem/grid-control/documentation/index.html.

6.14 Management Pack for Oracle GoldenGate

Management Pack for Oracle GoldenGate is a server-based product that features an intuitive graphical interface for centrally designing, configuring, managing, monitoring, and reporting on the Oracle GoldenGate processes implemented across the user's infrastructure. It includes Oracle GoldenGate Director, which allows organizations to easily monitor and manage their Oracle GoldenGate deployments.

6.14.1 Restricted-Use Licensing

A restricted-use license for Oracle WebLogic Server Standard Edition is included when you license Management Pack for Oracle GoldenGate. This restricted-use license permits Oracle WebLogic Server Standard Edition to be used only for hosting Java Enterprise Edition (Java EE) or Java application logic that is distributed as part of Management Pack for Oracle GoldenGate.