Changes in This Release for Oracle Big Data Connectors User's Guide

This preface lists changes in the Oracle Big Data Connectors User's Guide.

Changes in Oracle Big Data Connectors Release 2 (2.3)

The following are changes in Oracle Big Data Connectors User's Guide for Oracle Big Data Connectors Release 2 (2.3).

The name Oracle R Connector for Hadoop changed to Oracle R Advanced Analytics for Hadoop.

New Features

The following features are new in this release.

Oracle XQuery for Hadoop

Oracle XQuery for Hadoop is a transformation engine for semi-structured data stored in Apache Hadoop. It runs transformations expressed in the XQuery language by translating them into a series of MapReduce jobs, which are executed in parallel on the Hadoop cluster.

See Part III, "Oracle XQuery for Hadoop"
Oracle SQL Connector for HDFS
- You can now override the default data type mappings by setting various configuration properties.
  
  See "About Configurable Column Mappings."
- Oracle SQL Connector for HDFS supports extended data types (VARCHAR2, NVARCHAR, and CLOB for Apache Hive and text data sources.
  
  See "oracle.hadoop.exttab.colMap.columnLength." and "oracle.hadoop.exttab.colMap.columnType."
- The --output option to the hadoop command can write the generated DDL to a file.
  
  See "Using the ExternalTable Command-Line Tool."
Oracle Loader for Hadoop

Configuration parameters replace loader maps. A utility is provided to convert a loader map file into a configuration file.

See "Converting a Loader Map File."

Other Changes

The following are additional changes in the release:

Oracle R Advanced Analytics for Hadoop

Two additional, dependent ORE packages must be installed on client nodes.

See "Oracle R Advanced Analytics for Hadoop Setup."

Changes in Oracle Big Data Connectors Release 2 (2.2)

The following are changes in Oracle Big Data Connectors User's Guide for Oracle Big Data Connectors Release 2 (2.2).

New Features

The following features are new in this release.

Oracle SQL Connector for Hadoop Distributed File System

Supports the Apache Hive decimal data type.
Oracle Loader for Hadoop

Supports Hive 0.10.0.

Deprecated Features

The following features are deprecated in this release, and may be desupported in a future release

Oracle Loader for Hadoop
- oracle.hadoop.loader.libjars
- oracle.hadoop.loader.sharedlibs

Other Changes

The following are additional changes in the release:

Oracle Loader for Hadoop

The file names of the two kits in the installation zip archive have changed to the following format:
- oraloader-version-h1.x86_64.zip for CDH4
- oraloader-version-h2.x86_64.zip for Apache Hadoop 0.20.2 and CDH3

Changes in Oracle Big Data Connectors Release 2 (2.0)

The following are changes in Oracle Big Data Connectors User's Guide for Oracle Big Data Connectors Release 2 (2.0).

New Features

Oracle Big Data Connectors support Cloudera's Distribution including Apache Hadoop version 4 (CDH4). For other supported platforms, see the individual connectors in Chapter 1.

The name of Oracle Direct Connector for Hadoop Distributed File System changed to Oracle SQL Connector for Hadoop Distributed File System.

Oracle SQL Connector for Hadoop Distributed File System
- Automatic creation of Oracle Database external tables from Hive tables, Data Pump files, or delimited text files.
- Management of location files.
See Chapter 2.
Oracle Loader for Hadoop
- Support for Sockets Direct Protocol (SDP) for direct path loads
- Support for secondary sort on user-specified columns
- New input formats for regular expressions and Oracle NoSQL Database. The Avro record InputFormat is supported code instead of sample code.
- Simplified date format specification
- New reject limit threshold
- Improved job reporting and diagnostics
See Chapter 3.
Oracle R Advanced Analytics for Hadoop

Several analytic algorithms are now available: linear regression, neural networks for prediction, matrix completion using low rank matrix factorization, clustering, and nonnegative matrix factorization.

Oracle R Advanced Analytics for Hadoop supports Hive data sources in addition to HDFS files.

Oracle R Advanced Analytics for Hadoop can move data between HDFS and Oracle Database. Oracle R Enterprise is not required for this basic transfer of data.

The following functions are new in this release:
```
as.ore.*
hadoop.jobs
hdfs.head
hdfs.tail
is.ore.*
orch.connected
orch.dbg.lasterr
orch.evaluate
orch.export.fit
orch.lm 
orch.lmf
orch.neural
orch.nmf
orch.nmf.NMFalgo
orch.temp.path
ore.*
predict.orch.lm
print.summary.orch.lm
summary.orch.lm
```
See Chapter 8.

Deprecated Features

The following features are deprecated in this release, and may be desupported in a future release:

Oracle SQL Connector for Hadoop Distributed File System
- Location file format (version 1): Existing external tables with content published using Oracle Direct Connector for HDFS version 1 must be republished using Oracle SQL Connector for HDFS version 2, because of incompatible changes to the location file format.
  
  When Oracle SQL Connector for HDFS creates new location files, it does not delete the old location files.
  
  See Chapter 2.
- oracle.hadoop.hdfs.exttab namespace (version 1): Oracle SQL Connector for HDFS uses the following new namespaces for all configuration properties:
  - oracle.hadoop.connection: Oracle Database connection and wallet properties
  - oracle.hadoop.exttab: All other properties
  See Chapter 2.
- HDFS_BIN_PATH directory: The preprocessor directory name is now OSCH_BIN_PATH.
  
  See "Oracle SQL Connector for Hadoop Distributed File System Setup."
Oracle R Advanced Analytics for Hadoop
- keyval: Use orch.keyval to generate key-value pairs.
- orch.reconnect: Use orch.connect to reconnect using a connection object returned by orch.dbcon.

Desupported Features

The following features are no longer supported by Oracle.

Oracle Loader for Hadoop
- oracle.hadoop.loader.configuredCounters
  
  See Chapter 3.

Other Changes

The following are additional changes in the release:

Oracle Loader for Hadoop

The installation zip archive now contains two kits:
- oraloader-2.0.0-1.x86_64.zip for Apache Hadoop 0.20.2 and CDH3
- oraloader-2.0.0-2.x86_64.zip for CDH4
See "Oracle Loader for Hadoop Setup."