Oracle® Cloud

What's New for Oracle Big Data Cloud Service

Version 18.4.5

E79543-28

December 2018

What’s New for Oracle Big Data Cloud Service

This document describes what's new in Oracle Big Data Cloud Service. It's organized by the date a specific feature or capability became available.

If the new release of Oracle Big Data Cloud Service includes a new release of Cloudera Distribution with Apache Hadoop (CDH) or Cloudera Manager, the following applies:

  • If you create a new cluster, it’s created with all the latest software, including CDH and Cloudera Manager.

  • For existing clusters, the new versions of CDH and Cloudera Manager are not automatically installed. However, you can replace them manually at a time of your choice using. See Patching or Updating Cluster Software in Using Oracle Big Data Cloud Service

Topics:

Release 18.4.5 — December 2018

Feature Description

System software updated

The system software is updated to release 4.13.1. This includes Cloudera Distribution with Hadoop (CDH) 5.14.1

Oracle Big Data Manager is enhanced.

  • The Notebook is enhanced as follows:
    • Notebook tools are now built on Apache Zeppelin 0.8.0, upgraded from Apache Zeppelin 0.7.2. See Zeppelin 0.8.0 New Features.
    • The spark interpreter replaces the spark2 interpreter. The new spark interpreter uses Apache Spark Release 2.2. The spark2 interpreter is no longer available.
    • Interpreters can be scoped per user and/or per note.
    • Time-out based interpreter life-cycle management is available.
  • Other new features include:
    • You can upload directories from your local computer to HDFS.
    • Two new job types are available: ODHI Query (for generic queries against Hive) and ODHI Import (for loading data into Hive).
    • On the Data Explorer page, you can right-click an HDFS file and select Preview file content to see partial content of the file with syntax highlighting.
    • When creating a new job, you can select to execute it immediately or to specify its schedule.

Release 18.4.3 - No Release

There was no 18.4.3 release of Oracle Big Data Cloud Service

Release 18.4.1 - No Release

There was no 18.4.1 release of Oracle Big Data Cloud Service

Release 18.3.5 — September 2018

Feature Description

System software updated

The system software is updated to release 4.11.7. This includes Cloudera Distribution with Hadoop (CDH) 5.12

Oracle Big Data Manager is enhanced.

You can use variables when specifying paths.

Release 18.3.3 — August 2018

Feature Description

System software updated

The system software is updated to release 4.11.6. This includes Cloudera Distribution with Hadoop (CDH) 5.12

Oracle Big Data Manager is enhanced.

  • You can track usage.
  • A FAQ is included in the Notebook section.

Release 18.3.1 — July 2018

Feature Description

System software updated

The system software is updated to release 4.11.5. This includes Cloudera Distribution with Hadoop (CDH) 5.12

System software can be patched and updated from the service console.

Starting with release 18.3.1, you can patch (update) a cluster through the service console. It is possible to update release 18.2.3, but you must first apply a patch manually. See Patching or Updating Cluster Software in Using Oracle Big Data Cloud Service.

Oracle Big Data Manager is enhanced.

  • You can use a drag-and-drop pipeline editor to create pipelines that chain jobs together.
  • A Spark 2 interpretor is now supported in notebooks.

Release 18.2.5 — June 2018

Feature Description

System software updated

The system software is updated to release 4.11.4. This includes Cloudera Distribution with Hadoop (CDH) 5.12

Big Data Manager is enhanced.

The bdm-add-user script, used to add new Big Data Manager users, has new options on secure clusters.

Release 18.2.3 — May 2018

Feature Description

System software updated

The system software is updated to release 4.11.3. This includes Cloudera Distribution with Hadoop (CDH) 5.12

Big Data Manager is enhanced.

  • It’s now possible to manage resources for jobs by using sliders in the Oracle Big Data Manager console.

  • odcp (and Oracle Big Data Manager copy jobs) performance is improved.

You can update the Cloudera Manager password.

It’s now possible to update the Cloudera Manager password by using the Service Credentials menu in the Oracle Big Data Cloud Service console.

Release 18.2.1 — April 2018

Feature Description

System software updated

The system software is updated to release 4.11.2 for Oracle Big Data Cloud Service. This includes Cloudera Distribution with Hadoop (CDH) 5.12

Release 18.1.5 — March 2018

Feature Description

Big Data Manager is enhanced.

The Oracle Big Data Manager Administration section now includes tools for managing the firewall included with Oracle Big Data Cloud Service instances in availability domains..

System software updated

The system software is updated to release 4.11.1 for Oracle Big Data Cloud Service. This includes Cloudera Distribution with Hadoop (CDH) 5.12

Release 18.1.3 — February 2018

Feature Description

Big Data Manager is enhanced.

Oracle Big Data Manager now includes a feature for uploading and extracting ZIP archives.

System software updated

The system software is updated to release 4.9.6 for Oracle Big Data Cloud Service. This includes Cloudera Distribution with Hadoop (CDH) 5.11.

Release 18.1.1 — January 2018

Feature Description

Big Data Manager is enhanced.

Oracle Big Data Manager now supports JDBC provider, and you can browse data stored in the Oracle Database, MySQL and Amazon Redshift.

System software updated

The system software is updated to release 4.9.5 for Oracle Big Data Cloud Service. This includes Cloudera Distribution with Hadoop (CDH) 5.11.

Release 17.4.5 — December 2017

Feature Description

Big Data Manager is enhanced.

Oracle Big Data Manager is now integrated with Cloudera Manager. You can start, stop and monitor Oracle Big Data Manager, open the web console, and run notebooks from within Cloudera Manager

System software updated

The system software is updated to release 4.9.4 for Oracle Big Data Cloud Service. This includes Cloudera Distribution with Hadoop (CDH) 5.11

Release 17.4.3 — November 2017

Feature Description

You must specify a storage container manually in order to associate Oracle Cloud Infrastructure Object Storage Classic with an Oracle Big Data Cloud Service instance.

See Creating a Cluster.

System software updated

The system software is updated to release 4.9.3 for Oracle Big Data Cloud Service. This includes Cloudera Distribution with Hadoop (CDH) 5.11

Release 17.4.1 — October 2017

Feature Description

System software updated

The system software is updated to release 4.9.2 for Oracle Big Data Cloud Service. This includes Cloudera Distribution with Hadoop (CDH) 5.11

Release 17.3.5 — September 2017

Feature Description

You can now subscribe to Oracle Big Data Cloud Service by purchasing a monthly universal credits subscription.

A universal credits subscription is a subscription to a category of Oracle Cloud services. You purchase a number of credits that you can apply to any or all of the services in the category. Big Data Cloud Service is in the category that includes Infrastructure as a Service (IaaS) and Platform as a Service (PaaS) services.

With a universal credits subscription, you select specify a monthly or a yearly commitment amount, whether or not you use all the services in the category. Your service usage is metered hourly, and you’re billed monthly. Any unused amount expires at the end of the committed period. Usage above the committed amount results in overage. See Welcome to Oracle Cloud and Buying an Oracle Cloud Subscription in Getting Started with Oracle Cloud.

Contact an Oracle Sales Representative to determine what subscription model is best for your needs.

Big Data Manager is enhanced.

Big Data Manager now has:

  • Tools for easy data transfer via the HTTP protocol.

  • Support for Oracle Bare Metal Cloud Object Storage Service

System software updated

The system software is updated to release 4.9.1 for Oracle Big Data Cloud Service. This includes Cloudera Distribution with Hadoop (CDH) 5.11

Release 17.3.3 — August 2017

Feature Description

Big Data Manager is enhanced with new features and functionality.

  • The bigdatamgr user is created by default, with administrator privileges.

  • Amazon Web Services Simple Storage Service (AWS S3) is supported.

  • A new job type is supported for the Oracle Distributed Diff (odiff) tool. odiff allows you to compare large data sets stored in various locations, including HDFS, OSS, AWS S3.

  • The Oracle Big Data Manager Data Explorer has keyboard shortcuts to perform common actions.

  • Big Data Manager tries to detect if the current user is missing an HDFS home directory and displays an error if so.

  • There is limited support for Oracle Bare Metal Cloud Service. You can browse the storage and copy and compare files with files from other providers. But you can’t edit the Oracle Bare Metal Cloud Service provider directly in Oracle Big Data Manager in this release.

System software updated

The system software is updated to release 4.8.2 for Oracle Big Data Cloud Service. This includes Cloudera Distribution with Hadoop (CDH) 5.10.1

Release 17.3.1 — July 2017

Feature Description
New user interface design for Oracle Big Data Cloud Service console. Some areas of the graphical user interface are slightly modified, which results in some changes to workflow. See, for example, Viewing All Clusters and Viewing Details About a Cluster in Using Oracle Big Data Cloud Service.

System software updated

The system software is updated as follows:

  • Cloudera Distribution with Hadoop (CDH) is upgraded to 5.10.1.

  • Cloudera Manager (CM) is upgraded to 5.10.1.

  • The above CDH and CM versions are based on software release 4.8.1 for Oracle Big Data Cloud Service.

Release 17.2.3 — May 2017

Feature Description
Big Data Manager Use Oracle Big Data Manager to copy data and manage copy jobs. Oracle Big Data Manager includes a graphical user interface, a command-line interface utility, bdm-cli, and a REST API. See Using Big Data Manager to Copy Data in Using Oracle Big Data Cloud Service.

System software updated

The system software is updated to release 4.7.3 forOracle Big Data Cloud Service:

Release 17.2.1 — April 2017

Feature Description

Oracle Big Data SQL Cloud Service

 You can now add Oracle Big Data SQL Cloud Service to an Oracle Big Data Cloud Service subscription. With Oracle Big Data SQL, you can use SQL queries to access data in your Big Data Cloud Service Hadoop cluster as well as in Oracle Database Exadata Cloud Service. An entitlement to Oracle Database Exadata Express Cloud Service is included with the Oracle Big Data SQL Cloud Service subscription. See Using Oracle Big Data SQL Cloud Service with Oracle Big Data Cloud Service in Using Oracle Big Data Cloud Service.

Fast provisioning

The time it takes to create and extend clusters has been significantly reduced.

System software updated

The system software is updated to release 4.7.2 for Oracle Big Data Cloud Service:

Release 17.1.5 — March 2017

Feature Description
Metered service available In previous releases, the only subscription option was a nonmetered subscription, where you purchased an entitlement to specified resources for a specified period of time. Now you can purchase either a nonmetered subscription or a metered subscription. With a metered service, you’re billed in arrears for your actual usage. See How to Begin with Oracle Big Data Cloud Service Subscriptions in Using Oracle Big Data Cloud Service.
Bursting limits increased to 480 OCPUs (or 15 nodes) You can now add up to 480 OCPUs (15 cluster compute nodes). The previous limit was 192 OCPUs (6 nodes). See Adding Cluster Compute Nodes to a Cluster (Bursting) in Using Oracle Big Data Cloud Service.
odcp supports Amazon Simple Storage Service (Amazon S3) The Oracle Big Data Cloud Service odcp distributed copy utility now supports Amazon Web Services Simple Storage Service (Amazon S3) as a storage provider. See Copying Data with odcp in Using Oracle Big Data Cloud Service.

System software updated

The system software is updated as follows:

  • Cloudera Distribution with Hadoop (CDH) is upgraded from 5.8 to 5.9.1.

  • Cloudera Manager (CM) is upgraded from 5.8.1 to 5.9.

  • The above CDH and CM versions are based on software release 4.7.1 for Oracle Big Data Cloud Service.

Release 17.1.3 — February 2017

Feature Description
Add edge nodes to a cluster You can now designate some nodes as edge nodes in the cluster. The cluster must have at least four permanent Hadoop nodes before any additional nodes can be designated as edge nodes. See About Oracle Big Data Cloud Service Nodes, Creating a Cluster, and Adding Permanent Nodes to a Cluster in Using Oracle Big Data Cloud Service.

Release 17.1.1 — January 2017

Feature Description

System software updated

The system software is updated as follows:

  • The software release for Oracle Big Data Cloud Service is upgraded from 4.6.3 to 4.6.4.

Release 16.4.5 — December 2016

Feature Description

Copy data on a secure cluster

 You can now use the odcp distributed copy tool to copy large files on a secure cluster. See Using the odcp Command Line Utility to Copy Data in Using Oracle Big Data Cloud Service.

System software updated

The system software is updated as follows:

  • The software release forOracle Big Data Cloud Service is upgraded from 4.6.1 to 4.6.3.

Release 16.4.3 — November 2016

Feature Description

Changes to the user interface look and feel

The visual style of the user interface has been updated to a cleaner look. There is also some reorganization of the controls, but all the old functionality is retained.

Release 16.4.1 — October 2016

Feature Description

New workflow for creating service instances and clusters.

There is a new process for creating clusters. First, you create a service instance to allocate the resources (nodes) specified in your subscription. Then you specify the details for the cluster and create the cluster itself. See Creating Service Instance and Creating a Cluster in Using Oracle Big Data Cloud Service.

Add cluster compute nodes to a cluster (bursting).

You can now add and remove up to six cluster compute nodes (192 OCPUs) at any time to an existing cluster. Cluster compute nodes include Oracle Compute Units (OCPUs) and memory only, with no storage. These nodes provide increased computing power when you need it for heavy loads. See Adding Cluster Compute Nodes to a Cluster (Bursting) in Using Oracle Big Data Cloud Service.

System software updated

The system software is updated as follows:

  • Cloudera Distribution with Hadoop (CDH) is upgraded from 5.7 to 5.8.

  • Cloudera Manager (CM) is upgraded from 5.7 to 5.8.1.

  • The above CDH and CM versions are based on software release 4.6.1 for Oracle Big Data Cloud Service.

First Release — October 2015

Oracle Big Data Cloud Service was first released in October 2015. Various updates between then and release 16.4.1, documented above, have been superseded by newer features.

Documentation Accessibility

For information about Oracle's commitment to accessibility, visit the Oracle Accessibility Program website at http://www.oracle.com/pls/topic/lookup?ctx=acc&id=docacc.

Access to Oracle Support

Oracle customers that have purchased support have access to electronic support through My Oracle Support. For information, visit http://www.oracle.com/pls/topic/lookup?ctx=acc&id=info or visit http://www.oracle.com/pls/topic/lookup?ctx=acc&id=trs if you are hearing impaired.

Oracle Cloud What's New for Oracle Big Data Cloud Service, Version 18.4.5

E79543-28

Copyright © 2016, 2018, Oracle and/or its affiliates. All rights reserved.

This software and related documentation are provided under a license agreement containing restrictions on use and disclosure and are protected by intellectual property laws. Except as expressly permitted in your license agreement or allowed by law, you may not use, copy, reproduce, translate, broadcast, modify, license, transmit, distribute, exhibit, perform, publish, or display any part, in any form, or by any means. Reverse engineering, disassembly, or decompilation of this software, unless required by law for interoperability, is prohibited.

The information contained herein is subject to change without notice and is not warranted to be error-free. If you find any errors, please report them to us in writing.

If this is software or related documentation that is delivered to the U.S. Government or anyone licensing it on behalf of the U.S. Government, then the following notice is applicable:

U.S. GOVERNMENT END USERS: Oracle programs, including any operating system, integrated software, any programs installed on the hardware, and/or documentation, delivered to U.S. Government end users are "commercial computer software" pursuant to the applicable Federal Acquisition Regulation and agency-specific supplemental regulations. As such, use, duplication, disclosure, modification, and adaptation of the programs, including any operating system, integrated software, any programs installed on the hardware, and/or documentation, shall be subject to license terms and license restrictions applicable to the programs. No other rights are granted to the U.S. Government.

This software or hardware is developed for general use in a variety of information management applications. It is not developed or intended for use in any inherently dangerous applications, including applications that may create a risk of personal injury. If you use this software or hardware in dangerous applications, then you shall be responsible to take all appropriate fail-safe, backup, redundancy, and other measures to ensure its safe use. Oracle Corporation and its affiliates disclaim any liability for any damages caused by use of this software or hardware in dangerous applications.

Oracle and Java are registered trademarks of Oracle and/or its affiliates. Other names may be trademarks of their respective owners.

Intel and Intel Xeon are trademarks or registered trademarks of Intel Corporation. All SPARC trademarks are used under license and are trademarks or registered trademarks of SPARC International, Inc. AMD, Opteron, the AMD logo, and the AMD Opteron logo are trademarks or registered trademarks of Advanced Micro Devices. UNIX is a registered trademark of The Open Group.

This software or hardware and documentation may provide access to or information about content, products, and services from third parties. Oracle Corporation and its affiliates are not responsible for and expressly disclaim all warranties of any kind with respect to third-party content, products, and services unless otherwise set forth in an applicable agreement between you and Oracle. Oracle Corporation and its affiliates will not be responsible for any loss, costs, or damages incurred due to your access to or use of third-party content, products, or services, except as set forth in an applicable agreement between you and Oracle.