Index

A B C D E F G H I J K L M N O P Q R S T U V W X

Symbols

put annotation, 4.4.1

%annotation

See annotations alphabetically by name

%oracle-property annotations, 5

%ora-java

binding annotation, 4.4.4, 4.4.4

%output annotation, 5

%updating annotation, 4.4.1

A

access privileges, Oracle Database, 1.4.4

adapters

Avro, 5

Oracle NoSQL Database, 5

sequence file, 5

text file, 5

XML file, 5

aggregate function, 7.5.4

aggregate functions for Hive, 7.5.4

ALLOW_BACKSLASH_ESCAPING_ANY_CHARACTER property, 5

ALLOW_COMMENTS property, 5

ALLOW_NON_NUMERIC_NUMBERS property, 5

ALLOW_NUMERIC_LEADING_ZEROS property, 5

ALLOW_SINGLE_QUOTES property, 5

ALLOW_UNQUOTED_CONTROL_CHARS property, 5

ALLOW_UNQUOTED_FIELD_NAMES property, 5

ALTER SESSION commands, 2.12

analytic functions in R, 7.5.1

analyze-string function, 4.4.2

annotations

Avro collection, 5

equal to Oracle Loader for Hadoop configuration properties, 5

for writing to Oracle NoSQL Database, 5

Oracle Database adapter, 5

Oracle NoSQL Database adapter, 5

reading from Oracle NoSQL Database, 5

reading sequence files, 5

reading text files, 5

reading XML files, 5

writing text files, 5

B

balancing loads in Oracle Loader for Hadoop, 3.12

bashrc configuration file, 1.7.1.1

batchSize property, 5, 5

bzip2 input files, 2.11.2

C

CDH3 distribution, 1.5.1

character encoding, 5, 5

character methods for Hive, 7.3.3

client libraries, 1.5.2

clients

configuring Hadoop, 1.4.2, 1.7.3.2

coersing data types in R, 7.5.7

collection annotation

text files, 5

collection annotations

Avro, 5

collection function (XQuery)

description, 4.3

collection functions

Oracle NoSQL Database adapter, 5

sequence files, 5

text files, 5

columnCount property (OSCH), 2.11.2

columnLength property (OSCH), 2.11.2, 2.11.2

columnNames property (OSCH), 2.11.2

columnType property (OSCH), 2.11.2, 2.11.2, 2.11.2

compressed data files, 2.11.2

compressed files, 2.11.2

compression

data in database tables, 2.2

sequence files, 5

compression codec, 5

compression methods

Avro output files, 5

CompressionCodec property (OSCH), 2.11.2

configuration properties

for Oracle XQuery for Hadoop, 5

JSON file adapter, 5

Oracle NoSQL Database adapter, 5

Oracle XQuery for Hadoop, 4.7

configuration settings

Hadoop client, 1.4.2, 1.7.3.2

Sqoop utility, 1.7.1.2

configuring a Hadoop client, 1.4.2, 1.7.3.2

connecting to Oracle Database from R, 7.5.5

consistency property, 5, 5

CREATE SESSION privilege, 1.4.4

CREATE TABLE

configuration properties, 6.4.2

examples, 6.4.3

syntax, 6.4.1

CREATE TABLE privilege, 1.4.4

CSV files, 2.11.2, 3.14

D

Data Pump files, 2.6.2

XML template, 2.6.2.3, 2.6.2.3

data type mappings

between XQuery and Avro, 5

between XQuery and Oracle Database, 5

Oracle Database and XQuery, 5

data type mappings, Hive (OSCH), 2.11.2

data type testing in R, 7.5.7

data types

Oracle Loader for Hadoop, 3.4.1

database directories

for Oracle SQL Connector for HDFS, 1.4.3

database patches, 1.4.1, 1.5.1, 1.5.1, 2.6.2

database privileges, 1.4.4

database system, configuring to run MapReduce jobs, 1.4.2

database tables

writing using Oracle XQuery for Hadoop, 5

databaseName property, Hive (OSCH), 2.11.2

dataCompressionCodec property (OSCH), 2.11.2

dataPathFilter property (OSCH), 2.11.2

dataPaths property (OSCH), 2.11.2

dateMask property (OSCH), 2.11.2, 2.11.2

defaultDirectory property (OSCH), 2.11.2

deflate compression, 5

delimited text files

XML templates, 2.6.5.4

DelimitedTextInputFormat class, 3.7.1, 3.14, 3.14

Oracle Loader for Hadoop, 3.7.1.3

DelimitedTextOutputFormat class, 3.14

delimiter

for splitting text files, 5

Direct Connector for HDFS

See SQL Connector for HDFS

directories

default HDFS for XQuery, 4.7

Oracle SQL Connector for HDFS home, 1.4.3

Sqoop home, 1.7.1.2

See also database directories; root directory

Directory property (OSCH), 2.11.2

disable_directory_link_check access parameter, 2.6.2

distributed cache

accessing from Oracle XQuery for Hadoop, 4.4.3

downloading software, 1.3, 1.4.1, 1.7.1.1, 1.7.1.2, 1.7.1.4, 1.7.3.4

drivers

JDBC, 1.7.1.2, 3.9.1.1

ORACLE_DATAPUMP, 3.9.4.1

ORACLE_LOADER, 2.10, 2.10

durability property, 5

E

encoding characters, 5, 5

error logging for Oracle XQuery for Hadoop, 4.7

exponential functions (XQuery), 4.4.2

external tables

about, 2.1

EXTERNAL VARIABLE DATA access parameter, 2.6.2

ExternalTable command

syntax, 2.5.2

F

fieldLength property (OSCH), 2.11.2, 2.11.2

fieldTerminator property (OSCH), 2.11.2

file paths

locating in XQuery, 5

fivenum function, 7.5.4

FLWOR requirements, 4.4.1

nilled function, 5, 5

fn functions, 4.4.2

frame methods for Hive, 7.3.3

functions

for writing to Oracle NoSQL Database, 5

Oracle NoSQL Database, 5

reading and writing sequence files, 5

reading and writing text files, 5

reading Avro files, 5

reading from Oracle NoSQL Database, 5, 5

reading JSON files, 5

reading sequence files, 5

reading text files, 5

reading XML files, 5, 5

writing Avro files, 5

writing sequence files, 5

writing text files, 5

G

get function

Oracle NoSQL Database adapter, 5

gzip input files, 2.11.2

H

Hadoop client

configuring, 1.4.2, 1.7.3.2

installing, 1.4.2

HADOOP_HOME environment variable, 1.7.1.1

HADOOP_LIBEXEC_DIR environment variable, 1.7.1.1

hadoop.exec function, 7.5.8

hadoop.jobs function, 7.5.8

hadoop.run function, 7.5.8

HDFS client

See Hadoop client

HDFS commands

issuing from R, 7.5.2

HDFS data

copying in R, 7.5.6

hdfs dfs command, 1.4.2

HDFS directories

creating in R, 7.5.2

HDFS directory, 4.7

HDFS files

loading data into an Oracle database, 3.7.6

restrictions in Oracle R Advanced Analytics for Hadoop, 7.2

hdfs_stream Bash shell script, 1.4.3

hdfs.attach function, 7.5.6

hdfs.cd function, 7.5.2

hdfs.cp function, 7.5.2

hdfs.describe function, 7.5.2

hdfs.download function, 7.5.6

hdfs.exists function, 7.5.2

hdfs.fromHive function, 7.5.3

hdfs.get function, 7.5.6

hdfs.head function, 7.5.2

hdfs.id function, 7.5.2

hdfs.ls function, 7.5.2

hdfs.mkdir function, 7.5.2

hdfs.mv function, 7.5.2

hdfs.parts function, 7.5.2

hdfs.pull function, 7.5.6

hdfs.push function, 7.5.6

hdfs.put function, 7.5.6

hdfs.pwd function, 7.5.2

hdfs.rm function, 7.5.2

hdfs.rmdir function, 7.5.2

hdfs.root function, 7.5.2

hdfs.sample function, 7.5.6

hdfs.setroot function, 7.5.2

hdfs.size function, 7.5.2

hdfs.tail function, 7.5.2

hdfs.toHive function, 7.5.3

hdfs.upload function, 7.5.6

hints for optimizing queries, 2.12

Hive access from R, 7.3

Hive access in R, 7.5.3

Hive data type mappings (OSCH), 2.11.2

Hive data types, support for, 7.3.4

Hive database for Oracle Loader for Hadoop, 1.5.1

Hive distribution, 1.5.1

Hive JAR files for Oracle Loader for Hadoop, 3.10.1

Hive tables

XML format, 2.6.3.5

hive.columnType property (OSCH), 2.11.2

hive.databaseName property (OSCH), 2.11.2

HiveToAvroInputFormat class, 3.7.3, 3.10.1

hosts property, 5

I

IndexedRecord, 3.8.1

InputFormat class

Oracle Loader for Hadoop, 3.7.1.3

installation

Apache Hadoop, 1.4.2

CDH, 1.4.2

Hadoop client, 1.4.2

Oracle Loader for Hadoop, 1.5

Oracle R Advanced Analytics for Hadoop, 1.7

Oracle SQL Connector for HDFS, 1.4

Sqoop utility, 1.7.1.2

installation instructions, 1

Instant Client libraries, 1.5.2

interquartile range, 7.5.4

IQR function, 7.5.4

is.hdfs.id function, 7.5.6

is.ore.* functions, 7.5.7

J

JDBC drivers, 1.7.1.2, 3.9.1.1

json

get function, 5

parse-as-xml function, 5

JSON data formats

converting to XML, 5

JSON file adapter

configuration properties, 5

JSON files

reading, 5

JSON module, 5

examples, 5

K

collection annotation, 5

collection-avroxml function, 5

collection-binxml function, 5

collection-text function, 5

collection-xml function, 5

get annotation, 5

get-avroxml function, 5

get-binxml function, 5

get-text function, 5

get-xml function, 5

key annotation, 5, 5

key-range function, 5, 5

put annotation, 5

put-binxml function, 5

put-text function, 5

put-xml function, 5

KVAvroInputFormat class, 3.10.2

kv.hosts property, 5

kv.kvstore property, 5

kvstore property, 5, 5

L

licenses, 4.8

licenses, third-party, 3.15

load balancing

in Oracle Loader for Hadoop, 3.12, 3.12

loadCI, 3.12.2

log4j.logger.oracle.hadoop.xquery property, 4.7

logical methods for Hive, 7.3.3

M

mapping

JSON to XML, 5

mappings

Oracle Database and XQuery data types, 5

mappings, Hive to Oracle Database (OSCH), 2.11.2

MapReduce functions

writing in R, 7.5.8

MasterPolicy durability, 5

matrix methods for Hive, 7.3.3

maxLoadFactor property, 3.12.2

median function, 7.5.4

N

nilled elements, 5

nilled function, 5

null values in Avro, 5

numeric methods for Hive, 7.3.3

O

OCI Direct Path, 3.14

OLH_HOME environment variable, 1.5.2, 1.5.3, 1.6.2

operating system user permissions, 1.4.3

oracle

columns annotation, 5

put annotation, 5

Oracle Database

annotations for writing, 5

connecting from R, 7.5.5

put function, 5

user privileges, 1.4.4

Oracle Database access from ORCH, 7.4

Oracle Database adapter, 5

configuration properties, 5

examples, 5

Oracle Database Adapter

using Oracle Loader for Hadoop, 5

Oracle Direct Connector for HDFS

See Oracle SQL Connector for HDFS

Oracle Exadata Database Machine

installing a Hadoop client, 1.4.2

Oracle Instant Client libraries, 1.5.2

Oracle Loader for Hadoop

description, 3.1

input formats, 3.7.6

installing, 1.5

supported database versions, 1.5.1

Oracle NoSQL Database

annotations for writing, 5

Oracle NoSQL Database adapter, 5

annotations for reading, 5

collection function, 5

get function, 5

reading Avro as XML, 5

writing XML as Avro, 5

Oracle NoSQL Database Adapter

configuration properties, 5

examples, 5

Oracle NoSQL Database functions, 5

Oracle OCI Direct Path, 3.14, 3.14

Oracle permissions, 1.4.3

Oracle R Advanced Analytics for Hadoop

categorical list of functions, 7.5

connecting to Oracle Database, 7.5.5

copying HDFS data, 7.5.6

debugging functions, 7.5.9

description, 1.1, 7.1.2

HDFS commands issued from, 7.5.2

installation, 1.7

MapReduce functions, 7.5.8

Oracle RAC systems, installing a Hadoop client, 1.4.2

Oracle Software Delivery Cloud, 1.3

Oracle SQL Connector for HDFS

description, 2.1

installation, 1.4

pattern-matching characters, 2.11.2

query optimization, 2.12

Oracle Technology Network

downloads, 1.3, 1.7.1.2

Oracle XQuery for Hadoop, 4

accessing the distributed cache, 4.4.3

accessing user-defined XQuery library modules and XML schemas, 4.4.5

basic transformation examples, 4.4.6

calling custom Java external functions, 4.4.4

configuration properties, 4.7

configuring Oracle NoSQL Database server, 5

description, 4.1

error logging levels, 4.7

error recovery setting, 4.7

hadoop command, 4.5

JSON module, 5

Oracle NoSQL Database adapter, 5

output directory, 4.7

running queries, 4.5

running queries locally, 4.5.3

sequence file adapter, 5

temp directory, 4.7

text file adapter, 5

time zone, 4.7

XML file adapter, 5

Oracle XQuery for Hadoop adapters

overview, 4.3.1

Oracle XQuery for Hadoop modules

overview, 4.3.2

ORACLE_DATAPUMP driver, 3.9.4.1

ORACLE_LOADER driver, 2.10, 2.10

oracle.hadoop.loader.logBadRecords property, 3.11.1

oracle.hadoop.loader.rejectLimit property, 3.11.2

oracle.hadoop.loader.sampler.enableSampling property, 3.12.1

oracle.hadoop.xquery.* properties, 4.7

oracle.hadoop.xquery.json.parser.*

See individual properties by name

oracle.hadoop.xquery.kv.config.durability property, 5

oracle.hadoop.xquery.kv.config.requestLimit property, 5

oracle.hadoop.xquery.kv.config.requestTimeout property, 5

oracle.hadoop.xquery.kv.config.socketOpenTimeout property, 5

oracle.hadoop.xquery.kv.config.socketReadTimeout property, 5

oracle.hadoop.xquery.lib.share property, 4.7

oracle.kv.batchSize property, 5

oracle.kv.consistency property, 5

oracle.kv.hosts configuration property, 5

oracle.kv.hosts property, 5, 5

oracle.kv.kvstore configuration property, 5

oracle.kv.kvstore property, 5, 5

oracle.kv.timeout property, 5

oracle-property annotation, 5

orahdfs-version/bin directory, 1.4.3

orahdfs-version.zip file, 1.4.3

ora-java

binding annotation, 4.4.4, 4.4.4

OraLoader, 3.10, 3.14

OraLoaderMetadata utility program, 3.6.2

oraloader-version directory, 1.5.2, 1.6.2

oraloader-version.zip file, 1.4.3, 1.5.2, 1.5.3, 1.6.2

ORCH package

installation, 1.7.1.1, 1.7.1.5

ORCH package version, 7.5.9

orch.connect function, 7.5.5

orch.connected function, 7.5.5

orch.cor function, 7.5.1

orch.cov function, 7.5.1

orch.create.parttab function, 7.5.8

orch.dbcon function, 7.5.5

orch.dbg.lasterr function, 7.5.9

orch.dbg.on/off function, 7.5.9

orch.dbg.output function, 7.5.9

orch.dbinfo function, 7.5.5

orch.debug function, 7.5.9

orch.disconnect function, 7.5.5

orch.dryrun function, 7.5.8

orch.export function, 7.5.8

orch.getXlevels function, 7.5.1

orch.glm function, 7.5.1

orch.keyval function, 7.5.8

orch.keyvals function, 7.5.8

orch.kmeans function, 7.5.1

orch.lm function, 7.5.1

orch.lmf function, 7.5.1

orch.neural function, 7.5.1

orch.nmf function, 7.5.1

orch.nmf.NMFalgo function, 7.5.1

orch.pack functions, 7.5.8

orch.princomp function, 7.5.1

orch.recommend function, 7.5.1

orch.reconnect function, 7.5.5

orch.tempPath function, 7.5.8

orch.tgz package, 1.7.1.5

orch.unpack function, 7.5.8

orch.version function, 7.5.9

ORE functions for Hive, 7.3.2

ore.create function, 7.3.5, 7.5.3

ore.drop function, 7.5.3

ore.exec function, 7.3.5

ore.get function, 7.5.3

ore.pull function, 7.5.3

ore.push function, 7.5.3

ore.recode function, 7.5.3

ore.warn.order option, 7.3.5

OSCH_BIN_PATH directory, 1.4.4

output

encoding annotation, 5, 5, 5, 5

output annotation, 5, 5

output directory for Oracle XQuery for Hadoop, 4.7

oxh

find function, 5

increment-counter function, 5

println function, 5

println-xml function, 5

property function, 5

oxh utility, 4.5

oxh-charset property, 6.4.2

oxh-column property, 6.4.2

oxh-default-namespace property, 6.4.2

oxh-elements property, 6.4.2

oxh-entity.name property, 6.4.2

oxh-namespace.prefix property, 6.4.2

OXMLSerDe, 6.4.1

P

parallel processing, 1.2.1, 2.12

parse-xml function, 4.4.2

parsing options for JSON files, 5

partitioning, 3.4.2

PathFilter property (OSCH), 2.11.2

Paths property (OSCH), 2.11.2

pattern matching, 4.7

pattern matching (OSCH), 2.11.2

pattern-matching characters in Oracle SQL Connector for HDFS, 2.11.2

PQ_DISTRIBUTE hint, 2.12

preprocessor access parameter, 2.6.2

privileges, Oracle Database, 1.4.4

put function (XQuery)

description, 4.3

put functions

Oracle NoSQL Database adapter, 5

sequence files, 5

text files, 5

Q

quantile function, 7.5.4

queries

running in Oracle XQuery for Hadoop, 4.5

running locally in Oracle XQuery for Hadoop, 4.5.3

query optimization for Oracle SQL Connector for HDFS, 2.12

R

R data types, converting and testing, 7.5.7

R distribution, 1.7.1.1, 1.7.3.1

R Distribution, 1.7.1.4, 1.7.3.4

R functions

categorical listing, 7.5

R functions for Hive, 7.3.3

random order messages, 7.3.5

reading Avro files, 5

reading sequence files, 5

reading text files, 5

records, rejected, 3.11.2

rejected records, 3.11.2

ReplicaAck policy, 5

ReplicaPolicy durability, 5

requestLimit property, 5

requestTimeout property, 5, 5

S

sampling data

from Oracle Loader for Hadoop, 3.12.1

scripts

debugging in R, 7.5.9

sd function, 7.5.4

seq

collection annotation, 5

collection function, 5

collection-binxml function, 5

collection-xml function, 5

compress annotation, 5

file annotation, 5

key annotation, 5

put annotation, 5

put functions, 5

put-binxml function, 5

put-xml function, 5

split-max annotation, 5

split-min annotation, 5

sequence file adapter, 5

annotations for writing, 5

collection function, 5

examples, 5

sequence file adapter functions, 5

sequence files

compression, 5

output file name, 5

reading, 5

split size, 5

writing, 5

serialization parameter, 5, 5

serialization parameters, 5

serialize function, 4.4.2

skiperrors property for Oracle XQuery for Hadoop, 4.7

skiperrors.counters property, 4.7

skiperrors.log.max property, 4.7

skiperrors.max property, 4.7

snappy compression, 5

socketOpenTimeout property, 5

socketReadTimeout property, 5

software downloads, 1.3, 1.4.1, 1.7.1.1, 1.7.1.2, 1.7.1.4, 1.7.3.4

split size

for Avro files, 5

sequence files, 5

text files, 5

split sizes, 5

splitting XML files, 5

SQL*Loader, 3.9.3.1

Sqoop, 7.4.1

Sqoop utility

installing on a Hadoop client, 1.7.3.3

installing on a Hadoop cluster, 1.7.1.2

standard deviation, 7.5.4

subrange specification, Oracle NoSQL Database adapter, 5

T

tables

compression in database, 2.2

copying data from HDFS, 3.1

writing to Oracle Database, 5

temp directory, setting for Oracle XQuery for Hadoop, 4.7

text

collection annotation, 5

collection function, 5

collection-xml function, 5

compress annotation, 5

file annotation, 5

put annotation, 5

put function, 5

put-xml function, 5

split annotation, 5

split-max annotation, 5

trace function, 5

text file adapter, 5

collection function, 5

put function, 5

text files

converting to Avro, 5

delimiter, 5

reading, 5

reading and writing, 5

split size, 5

writing, 5

third-party licenses, 3.15, 4.8

time zones in XQuery, 5

timeout property, 5, 5

timestampMask property (OSCH), 2.11.2, 2.11.2

timestampTZMask property (OSCH), 2.11.2, 2.11.2

timezone property for Oracle XQuery for Hadoop, 4.7

trignonometric functions (XQuery), 4.4.2

Tukey’s five-number summary, 7.5.4

type mappings

between XQuery and Avro, 5

between XQuery and Oracle Database, 5

U

uncompressed files, 2.11.2

unparsed-text function, 4.4.2, 4.4.3

unparsed-text-available function, 4.4.2

unparsed-text-lines function, 4.4.3

unparsed-text-lines functions, 4.4.2

updating functions, 4.4.1, 4.4.1

UTF-8 encoding, 5, 5

UTL_FILE package, 1.4.4

V

var function, 7.5.4

variance calculation, 7.5.4

vector methods for Hive, 7.3.3

version, R software, 7.5.9

W

wildcards, 4.7

writing Avro files, 5

writing sequence files, 5

writing text files, 5

writing to Oracle tables, 5

X

XML

writing as Avro arrays, 5

writing as Avro maps, 5

writing as Avro primitives, 5

writing as Avro records, 5

writing as Avro unions, 5

XML file adapter, 5

examples, 5

XML files

reading, 5, 5

restrictions on splitting, 5

XML schemas

accessing user-defined, 4.4.5

XML template for Data Pump files, 2.6.2.3

XML templates

Data Pump files, 2.6.2.3

delimited text files, 2.6.5.4

Hive tables, 2.6.3.5

XML_EXISTS function, 6.4.3.3

XML_QUERY function, 6.4.3.3

XML_QUERY_AS_primitive function, 6.4.3.3

XML_TABLE function, 6.4.3.3

xmlf

collection annotation, 5

collection functions, 5

split annotation, 5

split-entity annotation, 5

split-max annotation, 5

split-min annotation, 5, 5

split-namespace annotation, 5

XQuery

See Oracle XQuery for Hadoop

XQuery library modules

accessing user-defined, 4.4.5

XQuery specification support, 4.4.2

XQuery transformations

requirements, 4.4.1

xquery.output property, 4.7

xquery.scratch property, 4.7

xquery.skiperrors property, 4.7

xquery.skiperrors.counters property, 4.7

xquery.skiperrors.log.max property, 4.7

xquery.skiperrors.max property, 4.7

xquery.timezone property, 4.7

xsi

nil attribute, 5