Oracle® Cloud

What's New for Oracle Data Integration Platform Cloud

E87304-12

January 2019

What’s New for Oracle Data Integration Platform Cloud

The following sections describe what’s new in Oracle Data Integration Platform Cloud.

As soon as new features become available, cloud tools for managing Oracle Data Integration Platform Cloud instances are upgraded in the data centers where Oracle Cloud services are hosted. You don't need to request an upgrade to be able to use the new features.

Except where noted, upgrades are available to use on your existing Oracle Data Integration Platform Cloud instances. However, new features that change how service instances are created do not affect your existing service instances.

January 2019

Feature Description
Updates to Agents

Architectural changes to Remote Agents require you to recreate the agent if you want to perform new Synchronize Data jobs using Initial Load.

See Set up a Remote Agent for ODI.

Microsoft SQL Server is now available for Windows Remote Agents.

See What's Certified for Agents?

Support for new Connection types

Data Integration Platform Cloud now supports the following data sources:

  • Autonomous Data Warehouse: can be used as a target Connection for Replicate Data, ODI Execution, and Add Data to Data Lake tasks.

  • Amazon S3: can be used as a source Connection for Add Data to Data Lake tasks.

  • Oracle BI Cloud: can be used as a Connection to review metadata in the Catalog.

  • Oracle Object Storage Cloud: can be used as a Connection for ODI Execution tasks.

See What's Certified for Agents?

Synchronize Data

Data Integration Platform Cloud now supports remote execution of a Synchronize Data Task that includes Initial Load from behind a firewall. Before you perform a Synchronize Data Task with Initial Load from inside a firewall, you must download, install, and configure a Remote Agent with Oracle 12c (OGG) and Data Integrator (ODI) components.

See Set up a Remote Agent for ODI.

Replicate Data

You can now deliver data to Autonomous Data Warehouse targets.

See What's Certified for Replicate Data?

Add Data to Data Lake

You can now create a Data Lake using the Data Lake Configuration Element. After you create your Data Lake, you can select it when creating an Add Data to Data Lake task.

Data Integration Platform Cloud now also supports remote execution of the Add Data to Data Lake task from Spark Execution on Big Data Cloud and YARN.

See Before you Add Data to Data Lake.

ODI Execution

The ODI Execution task now supports Autonomous Data Warehouse Cloud and Oracle Object Storage Connection types.

See What's Certified for ODI Execution?

Data Preparation

Data Integration Platform Cloud now supports for Oracle Object Storage Classic as a source or target Connection type.

See What's Certified for Data Preparation?

Scheduling Policies

You can now create Policies to schedule job executions.

See Create Policies.

Catalog

The Catalog now lists Data Assets and Execution Environments after you create them. You can create, view, and edit Data Assets and Execution Environments from the Catalog.

See Work with the Catalog.

August 2018

Feature Description

Oracle-Managed Data Integration Platform Cloud

You can now perform these tasks using Oracle-Managed Data Integration Platform Cloud
  • Synchronize Data (No Initial Load support)

  • ODI Execution

  • Replicate Data (Replicating data from on-premises Oracle databases to Oracle Cloud Database deployments are certified; however, delivering to Kafka Connect targets is not certified.)

Note: Adding Data to Data Lake and Data Preparation tasks are not certified for Oracle-Managed Data Integration Platform Cloud. For these tasks use user-managed instances.

Heterogeneous Support for Agent

Based on the operating system you select (Windows 64–bit or Linux 64–bit), you can download an agent that could connect to multiple source/target systems. And, you can select the connection binaries in the agent so that the size of the binaries are limited to what you use. See Downloading Agent Package.

The components available for different platforms will be different. See Oracle Data Integration Platform Cloud Certifications.

Replicate Data Task

You can use the Data Integration Platform Cloud console to capture new transactions in your Oracle data sources and deliver them to Oracle and Kafka targets. See Setting up a Replicate Data Task.

Data Lake Automation

You can add data from a variety of sources into Data Integration Platform Cloud's Data Lake. It allows you to store vast amounts of data, enabling deep analytics, big data processing, and machine learning. See Adding Data to Datalake.

ODI Support for Remote Agent

The ODI plug-in for agents enables you to perform data integration tasks remotely in an on-premises environment. After you download and configure the agent with its ODI component, then you can run it on the remote environment. This agent gets registered in Data Integration Platform Cloud and appears in the Agents list. See Setting up ODI Remote Agents.

June 2018

Feature Description

Oracle Stream Analytics upgrade

If you have an existing Oracle Stream Analytics 18.1.0.0.0 installation, use these steps to upgrade to Oracle Stream Analytics 18.1.0.0.1. See Upgrading Oracle Stream Analytics.

Oracle Stream Analytics — User Management

Allows you to create, new users, change passwords for the users, and delete users. See Managing Users in Stream Analytics

May 2018

Feature Description

Oracle-Managed Data Integration Platform Cloud

Data Integration Platform Cloud instances are now self-managed! Hosted on Oracle Cloud Infrastructure, all patching, upgrade, rollback, VM start/stop/restart, WebLogic Admin and Managed server start/stop/restart operations are done automatically for you. See Creating Autonomous Data Integration Platform Cloud Instances.

QuickStart your Data Integration Platform Cloud instances

You can now create Data Integration Platform Cloud instances quickly and easily using the QuickStart option without having to perform prerequisites. There are now QuickStart templates for both Oracle-managed and user-managed instances. See Creating Autonomous Data Integration Platform Cloud Instances and Creating User-Managed Instances with QuickStart.

New Elevated Integration Tasks

This release introduces two new elevated integration tasks, Data Preparation and ODI Execution.

  • Data Preparation: Cleanse and organize your data from a File or database source using the interactive transformation tool and store your transformed data to a target database. Run and monitor your Data Preparation job like you would any other task in Data Integration Platform Cloud in the Jobs page. See Setting up a Data Preparation Task.

  • ODI Execution: Import deployment archives created from ODI Studio and execute Scenarios in Data Integration Platform Cloud to perform bulk data transformations. See Setting up an ODI Execution Task.

Enhancements to the Synchronize Data Task

Enhanced features added to the Synchronize Data Task include:

  • Synchronizing data between two different source and target database versions

  • Advanced options to include initial load and replication in a synchronize data task

  • Configuring data entities using the Data Entity Selector tool to include or exclude specific data entities in your synchronize data task

See Setting up a Synchronize Data Task.

Oracle Stream Analytics

You can now use Oracle Stream Analytics Data Integration Platform Cloud’s Enterprise and Governance Editions. Download and install Stream Analytics on your Data Integration Platform Cloud instance VM. Consume data streams through Data Integrator or GoldenGate to Kafka for Stream Analytics to process and analyze enabling you to gain actionable insights from your data. See Analyzing Data Streams.

Replicate data to Oracle Autonomous Data Warehouse

You can now set up Oracle Autonomous Data Warehouse Cloud as a target database to replicate data to. Autonomous Data Warehouse Cloud is a fully-managed data warehouse designed to support all standard SQL and business intelligence tools and deliver scalable analytic query performance. See Replicating Data to Oracle Autonomous Data Warehouse Cloud.

Monitor jobs with the Monitor Dashboard

View information about all Jobs ever started in Data Integration Platform Cloud and whether they’re running, stopped, finished successfully, or failed. Review metrics such as instance health, job health, lag and data reports, and other job details. See Monitor.

Check your Data Usage

View the total data processed and amount of data processed per hour. You access Data Usage reports from the user menu. This page is especially useful for getting information about your volume of processed data, to decide what to choose for the Data processing per hour field when you create an Oracle-managed instance. See Data Usage.

Stop a Job

You can now stop a running job from the Jobs, Job Details, and Monitor pages.Monitoring and Stopping Jobs.

Connection Metadata

In the Catalog, Connections now include a Metadata tab, where you can explore Data Entities harvested from these Connections. See Connections.

Data Entity Editor

You now have the ability to edit Data Entities in the Catalog using the Data Entity Editor. See Data Entity Editor.

View your component’s Job History

Also in the Catalog, when you view the details of a Data Integration Platform Cloud component (Task, Data Entity, or Connection), you can view its edit history in the component’s History tab. See Catalog.

Support for Flat File type connections

Data Integration Platform Cloud now supports Flat File type connections as data sources for Data Preparation Tasks. See Creating a Connection.

SID field reintroduced for Connections

In the Connection dialog, you can now specify either a Service Name or SID for Service. See Creating a Connection.

Use the Instances page to manage tags for categorizing service instances

You can now use the Data Integration Platform Cloud Instances page to create and manage tags for categorizing Data Integration Platform Cloud instances, for example, by purpose, owner, or environment. You can easily identify and search for service instances based on the tags you have assigned to the service instances.

You can:

  • Create tags

  • Assign and unassign tags after an instance is created

  • Search for instances using tags

Previously, this feature was available only in the REST API.

February 2018

Feature Description

Automatic creation of GoldenGate UserIdAlias

You no longer have to manually configure the GoldenGate UserIdAlias. It is automatically configured for you.

Support for GoldenGate 12.3

Data Integration Platform Cloud now supports GoldenGate 12.3 Classic Architecture. See Oracle GoldenGate Certifications.

Support for Oracle Database 12.2

Data Integration Platform Cloud now supports Oracle Database 12.2. See Source and Target Database/Application Certifications.

Tags for categorizing Instances

Create tags for categorizing Oracle Data Integration Platform Cloud instances, for example, by purpose, owner, or environment. Then, identify and search for instances based on the tags that you’ve assigned to the instances. See Creating an Oracle Data Integration Platform Cloud Service Instance.

SID field removed from Create Connection dialog

The Oracle System ID (SID) field has been removed from the Create Connection dialog. You'll now use the Service Name field instead. See Creating a Connection.

CDB menu added to Create Connection dialog

With added support for Oracle Pluggable Databases, a CDB menu is added to the Create Connection dialog to support replication when a PDB is used as a source. Creating a Connection.

Changes to the user interface

Some elements in the Oracle Data Integration Platform Cloud user interface have a new look and feel. For example, there are changes to page layout, tabs, icons, and menus. Overall, the word Service is replaced with Instance. For example, Service Overview page is called Instance Overview and Create Service is called Create Instance and the Services page is now called the Instances page.

Fully automated patching

You don’t need to stop and restart your Data Integration Platform Cloud instances when you patch them.

If you have instances of 17.4.5, patching is available to upgrade to 18.1.3. After you apply a patch through the Administration tile of your instance, a Roll Back button appears in case you want to roll back to 17.4.5 again. Every new patch is accumulative, so whenever a new patch is available, you don’t need to apply any of the older patches.

Instance rollback

You can roll back your instances to a previous version if you upgrade an instance and then change your mind. When you patch an instance, a backup copy of the metadata schema is saved. When you roll back, the rollback replaces all the current schemas with the ones from the previous version.

December 2017

Feature Description

New user experience

Data Integration Platform Cloud’s new user experience includes a new landing page where you’ll find shortcuts to guide you towards common activities such as creating new Connections and Tasks, browsing the Catalog, or creating Policies. See Data Integration Platform Home Page.

Catalog

The Data Integration Platform Cloud Catalog provides you with access to a unified metadata repository. You’ll be able to browse Connections, Data Entities, and Tasks. Advanced search capabilities with inline results and property search is also available for you to use. See Catalog.

Task

Synchronizing data between a source and target schema has never been easier. With Data Integration Platform Cloud, you can easily set up a Synchronized Data Task. Initial load is powered by Oracle Data Integrator, while data capture and delivery is powered by Oracle GoldenGate; proven Oracle technologies offering the best-in-class service in the Cloud. See Setting up a Synchronize Data Task.

Monitoring

Filter and search job instances or drill-down into detailed runtime information with Data Integration Platform Cloud’s powerful monitoring capabilities. You can also set up Policies and receive notifications related to job activities. See Running and Monitoring a Job.

Support for remote agents

Install remote agents anywhere and help Data Integration Platform Cloud move data from on-premises systems to the Cloud, and vice versa. Remote agents can also help you create custom replication policies to move data between two on-premises systems without routing any data to cloud. See Agents.

Documentation Accessibility

For information about Oracle's commitment to accessibility, visit the Oracle Accessibility Program website at http://www.oracle.com/pls/topic/lookup?ctx=acc&id=docacc.

Access to Oracle Support

Oracle customers that have purchased support have access to electronic support through My Oracle Support. For information, visit http://www.oracle.com/pls/topic/lookup?ctx=acc&id=info or visit http://www.oracle.com/pls/topic/lookup?ctx=acc&id=trs if you are hearing impaired.


Oracle Cloud What's New for Oracle Data Integration Platform Cloud

E87304-12

Copyright © 2018, 2019, Oracle and/or its affiliates. All rights reserved.

Documentation that describes new features and functions available in Oracle Data Integration Platform Cloud.

This software and related documentation are provided under a license agreement containing restrictions on use and disclosure and are protected by intellectual property laws. Except as expressly permitted in your license agreement or allowed by law, you may not use, copy, reproduce, translate, broadcast, modify, license, transmit, distribute, exhibit, perform, publish, or display any part, in any form, or by any means. Reverse engineering, disassembly, or decompilation of this software, unless required by law for interoperability, is prohibited.

The information contained herein is subject to change without notice and is not warranted to be error-free. If you find any errors, please report them to us in writing.

If this is software or related documentation that is delivered to the U.S. Government or anyone licensing it on behalf of the U.S. Government, then the following notice is applicable:

U.S. GOVERNMENT END USERS: Oracle programs, including any operating system, integrated software, any programs installed on the hardware, and/or documentation, delivered to U.S. Government end users are "commercial computer software" pursuant to the applicable Federal Acquisition Regulation and agency-specific supplemental regulations. As such, use, duplication, disclosure, modification, and adaptation of the programs, including any operating system, integrated software, any programs installed on the hardware, and/or documentation, shall be subject to license terms and license restrictions applicable to the programs. No other rights are granted to the U.S. Government.

This software or hardware is developed for general use in a variety of information management applications. It is not developed or intended for use in any inherently dangerous applications, including applications that may create a risk of personal injury. If you use this software or hardware in dangerous applications, then you shall be responsible to take all appropriate fail-safe, backup, redundancy, and other measures to ensure its safe use. Oracle Corporation and its affiliates disclaim any liability for any damages caused by use of this software or hardware in dangerous applications.

Oracle and Java are registered trademarks of Oracle and/or its affiliates. Other names may be trademarks of their respective owners.

Intel and Intel Xeon are trademarks or registered trademarks of Intel Corporation. All SPARC trademarks are used under license and are trademarks or registered trademarks of SPARC International, Inc. AMD, Opteron, the AMD logo, and the AMD Opteron logo are trademarks or registered trademarks of Advanced Micro Devices. UNIX is a registered trademark of The Open Group.

This software or hardware and documentation may provide access to or information about content, products, and services from third parties. Oracle Corporation and its affiliates are not responsible for and expressly disclaim all warranties of any kind with respect to third-party content, products, and services unless otherwise set forth in an applicable agreement between you and Oracle. Oracle Corporation and its affiliates will not be responsible for any loss, costs, or damages incurred due to your access to or use of third-party content, products, or services, except as set forth in an applicable agreement between you and Oracle.