Table of Contents
- Title and Copyright Information
- Preface
- 1 Big Data Integration with Oracle Data Integrator
- 2 Hadoop Data Integration Concepts
-
3
Setting Up the Environment for Integrating Big Data
- Configuring Big Data technologies using the Big Data Configurations Wizard
- Creating and Initializing the Hadoop Data Server
- Creating a Hadoop Physical Schema
- Configuring the Oracle Data Integrator Agent to Execute Hadoop Jobs
- Configuring Oracle Loader for Hadoop
- Configuring Oracle Data Integrator to Connect to a Secure Cluster
- Configuring Oracle Data Integrator Studio for Executing Hadoop Jobs on the Local Agent
-
4
Integrating Hadoop Data
- Integrating Hadoop Data
- Setting Up File Data Sources
- Setting Up HDFS Data Sources
- Setting Up Hive Data Sources
- Setting Up HBase Data Sources
- Setting Up Kafka Data Sources
- Setting Up Cassandra Data Sources
- Importing Hadoop Knowledge Modules
- Creating ODI Models and Data Stores to represent Hive, HBase and Cassandra Tables, and HDFS Files
- Password Handling in Hadoop
- Loading Data from Files into Hive
- Loading Data from Hive to Files
- Loading Data from HBase into Hive
- Loading Data from Hive into HBase
- Loading Data from an SQL Database into Hive, HBase, and File using SQOOP
- Loading Data from an SQL Database into Hive using SQOOP
- Loading Data from an SQL Database into HDFS File using SQOOP
- Loading Data from an SQL Database into HBase using SQOOP
- Validating and Transforming Data Within Hive
- Loading Data into an Oracle Database from Hive and File
- Loading Data into an SQL Database from Hbase, Hive, and File using SQOOP
- Loading Data from Kafka to Spark Processing Engine
- 5 Executing Oozie Workflows
- 6 Using Query Processing Engines to Generate Code in Different Languages
- 7 Working with Spark
- 8 Working with Unstructured Data
- 9 Working with Complex Datatypes and HDFS File Formats
-
A
Hive Knowledge Modules
- LKM SQL to Hive SQOOP
- LKM SQL to File SQOOP Direct
- LKM SQL to HBase SQOOP Direct
- LKM File to SQL SQOOP
- LKM Hive to SQL SQOOP
- LKM HBase to SQL SQOOP
- LKM HDFS File to Hive Load Data
- LKM HDFS File to Hive Load Data (Direct)
- IKM Hive Append
- IKM Hive Incremental Update
- LKM File to Hive LOAD DATA
- LKM File to Hive LOAD DATA Direct
- LKM HBase to Hive HBASE-SERDE
- LKM Hive to HBase Incremental Update HBASE-SERDE Direct
- LKM Hive to File Direct
- XKM Hive Sort
- LKM File to Oracle OLH-OSCH
- LKM File to Oracle OLH-OSCH Direct
- LKM Hive to Oracle OLH-OSCH
- LKM Hive to Oracle OLH-OSCH Direct
- RKM Hive
- RKM HBase
- IKM File to Hive (Deprecated)
- LKM HBase to Hive (HBase-SerDe) [Deprecated]
- IKM Hive to HBase Incremental Update (HBase-SerDe) [Deprecated]
- IKM SQL to Hive-HBase-File (SQOOP) [Deprecated]
- IKM Hive Control Append (Deprecated)
- CKM Hive
- IKM Hive Transform (Deprecated)
- IKM File-Hive to Oracle (OLH-OSCH) [Deprecated]
- IKM File-Hive to SQL (SQOOP) [Deprecated]
-
B
Pig Knowledge Modules
- LKM File to Pig
- LKM Pig to File
- LKM HBase to Pig
- LKM Pig to HBase
- LKM Hive to Pig
- LKM Pig to Hive
- LKM SQL to Pig SQOOP
- XKM Pig Aggregate
- XKM Pig Distinct
- XKM Pig Expression
- XKM Pig Filter
- XKM Pig Flatten
- XKM Pig Join
- XKM Pig Lookup
- XKM Pig Pivot
- XKM Pig Set
- XKM Pig Sort
- XKM Pig Split
- XKM Pig Subquery Filter
- XKM Pig Table Function
- XKM Pig Unpivot
-
C
Spark Knowledge Modules
- LKM File to Spark
- LKM Spark to File
- LKM Hive to Spark
- LKM Spark to Hive
- LKM HDFS to Spark
- LKM Spark to HDFS
- LKM Kafka to Spark
- LKM Spark to Kafka
- LKM SQL to Spark
- LKM Spark to SQL
- LKM Spark to Cassandra
- RKM Cassandra
- XKM Spark Aggregate
- XKM Spark Distinct
- XKM Spark Expression
- XKM Spark Filter
- XKM Spark Input Signature and Output Signature
- XKM Spark Join
- XKM Spark Lookup
- XKM Spark Pivot
- XKM Spark Set
- XKM Spark Sort
- XKM Spark Split
- XKM Spark Table Function
- IKM Spark Table Function
- XKM Spark Unpivot
- D Component Knowledge Modules
- E Considerations, Limitations, and Issues