This preface lists changes in the Oracle Big Data Connectors User's Guide.
The following are changes in Oracle Big Data Connectors User's Guide for Oracle Big Data Connectors Release 2 (2.0).
Oracle Big Data Connectors support Cloudera's Distribution including Apache Hadoop version 4 (CDH4). For other supported platforms, see the individual connectors in Chapter 1.
The name of Oracle Direct Connector for Hadoop Distributed File System changed to Oracle SQL Connector for Hadoop Distributed File System.
Oracle SQL Connector for Hadoop Distributed File System
Automatic creation of Oracle Database external tables from Hive tables, Data Pump files, or delimited text files.
Management of location files.
See Chapter 2.
Oracle Loader for Hadoop
Support for Sockets Direct Protocol (SDP) for direct path loads
Support for secondary sort on user-specified columns
New input formats for regular expressions and Oracle NoSQL Database. The Avro record InputFormat is supported code instead of sample code.
Simplified date format specification
New reject limit threshold
Improved job reporting and diagnostics
See Chapter 3.
Oracle Data Integrator Application Adapter for Hadoop
Uses Oracle SQL Connector for HDFS or Oracle Loader for Hadoop to load data from Hadoop into an Oracle database.
Oracle R Connector for Hadoop
Several analytic algorithms are now available: linear regression, neural networks for prediction, matrix completion using low rank matrix factorization, clustering, and non-negative matrix factorization.
Oracle R Connector for Hadoop supports Hive data sources in addition to HDFS files.
Oracle R Connector for Hadoop can move data between HDFS and Oracle Database. Oracle R Enterprise is not required for this basic transfer of data.
The following functions are new in this release:
as.ore.* hadoop.jobs hdfs.head hdfs.tail is.ore.* orch.connected orch.dbg.lasterr orch.evaluate orch.export.fit orch.lm orch.lmf orch.neural orch.nmf orch.nmf.NMFalgo orch.temp.path ore.* predict.orch.lm print.summary.orch.lm summary.orch.lm
See Chapter 5.
The following features are deprecated in this release, and may be desupported in a future release:
Oracle SQL Connector for Hadoop Distributed File System
Location file format (version 1): Existing external tables with content published using Oracle Direct Connector for HDFS version 1 must be republished using Oracle SQL Connector for HDFS version 2, because of incompatible changes to the location file format.
When Oracle SQL Connector for HDFS creates new location files, it does not delete the old location files.
See Chapter 2.
oracle.hadoop.hdfs.exttab namespace (version 1): Oracle SQL Connector for HDFS uses the following new namespaces for all configuration properties:
oracle.hadoop.connection: Oracle Database connection and wallet properties
oracle.hadoop.exttab: All other properties
See Chapter 2.
HDFS_BIN_PATH directory: The preprocessor directory name is now OSCH_BIN_PATH.
See "Oracle SQL Connector for Hadoop Distributed File System Setup."
Oracle R Connector for Hadoop
keyval: Use orch.keyval to generate key-value pairs.
orch.reconnect: Use orch.connect to reconnect using a connection object returned by orch.dbcon.
The following features are no longer supported by Oracle.
Oracle Loader for Hadoop
oracle.hadoop.loader.configuredCounters
See Chapter 3.