This preface lists changes in the Oracle Big Data Connectors User's Guide.
The following are changes in Oracle Big Data Connectors User's Guide for Oracle Big Data Connectors Release 2 (2.3).
The name Oracle R Connector for Hadoop changed to Oracle R Advanced Analytics for Hadoop.
The following features are new in this release.
Oracle XQuery for Hadoop
Oracle XQuery for Hadoop is a transformation engine for semi-structured data stored in Apache Hadoop. It runs transformations expressed in the XQuery language by translating them into a series of MapReduce jobs, which are executed in parallel on the Hadoop cluster.
Oracle SQL Connector for HDFS
You can now override the default data type mappings by setting various configuration properties.
Oracle SQL Connector for HDFS supports extended data types (VARCHAR2
, NVARCHAR
, and CLOB
for Apache Hive and text data sources.
See "oracle.hadoop.exttab.colMap.columnLength." and "oracle.hadoop.exttab.colMap.columnType."
The --output
option to the hadoop
command can write the generated DDL to a file.
Oracle Loader for Hadoop
Configuration parameters replace loader maps. A utility is provided to convert a loader map file into a configuration file.
The following are changes in Oracle Big Data Connectors User's Guide for Oracle Big Data Connectors Release 2 (2.2).
The following features are new in this release.
Oracle SQL Connector for Hadoop Distributed File System
Supports the Apache Hive decimal data type.
Oracle Loader for Hadoop
Supports Hive 0.10.0.
The following are changes in Oracle Big Data Connectors User's Guide for Oracle Big Data Connectors Release 2 (2.0).
Oracle Big Data Connectors support Cloudera's Distribution including Apache Hadoop version 4 (CDH4). For other supported platforms, see the individual connectors in Chapter 1.
The name of Oracle Direct Connector for Hadoop Distributed File System changed to Oracle SQL Connector for Hadoop Distributed File System.
Oracle SQL Connector for Hadoop Distributed File System
Automatic creation of Oracle Database external tables from Hive tables, Data Pump files, or delimited text files.
Management of location files.
See Chapter 2.
Oracle Loader for Hadoop
Support for Sockets Direct Protocol (SDP) for direct path loads
Support for secondary sort on user-specified columns
New input formats for regular expressions and Oracle NoSQL Database. The Avro record InputFormat is supported code instead of sample code.
Simplified date format specification
New reject limit threshold
Improved job reporting and diagnostics
See Chapter 3.
Oracle R Advanced Analytics for Hadoop
Several analytic algorithms are now available: linear regression, neural networks for prediction, matrix completion using low rank matrix factorization, clustering, and nonnegative matrix factorization.
Oracle R Advanced Analytics for Hadoop supports Hive data sources in addition to HDFS files.
Oracle R Advanced Analytics for Hadoop can move data between HDFS and Oracle Database. Oracle R Enterprise is not required for this basic transfer of data.
The following functions are new in this release:
as.ore.* hadoop.jobs hdfs.head hdfs.tail is.ore.* orch.connected orch.dbg.lasterr orch.evaluate orch.export.fit orch.lm orch.lmf orch.neural orch.nmf orch.nmf.NMFalgo orch.temp.path ore.* predict.orch.lm print.summary.orch.lm summary.orch.lm
See Chapter 8.
The following features are deprecated in this release, and may be desupported in a future release:
Oracle SQL Connector for Hadoop Distributed File System
Location file format (version 1): Existing external tables with content published using Oracle Direct Connector for HDFS version 1 must be republished using Oracle SQL Connector for HDFS version 2, because of incompatible changes to the location file format.
When Oracle SQL Connector for HDFS creates new location files, it does not delete the old location files.
See Chapter 2.
oracle.hadoop.hdfs.exttab
namespace (version 1): Oracle SQL Connector for HDFS uses the following new namespaces for all configuration properties:
oracle.hadoop.connection
: Oracle Database connection and wallet properties
oracle.hadoop.exttab
: All other properties
See Chapter 2.
HDFS_BIN_PATH directory: The preprocessor directory name is now OSCH_BIN_PATH.
See "Oracle SQL Connector for Hadoop Distributed File System Setup."
Oracle R Advanced Analytics for Hadoop
keyval
: Use orch.keyval
to generate key-value pairs.
orch.reconnect
: Use orch.connect
to reconnect using a connection object returned by orch.dbcon
.
The following features are no longer supported by Oracle.
Oracle Loader for Hadoop
oracle.hadoop.loader.configuredCounters
See Chapter 3.