Table of Contents

• Title and Copyright Information
• Preface
  • Audience
  • Documentation Accessibility
  • Related Documents
  • Conventions
  • Backus-Naur Form Syntax
  • Changes in Oracle Big Data Appliance Release 4.14
• Part I Administration
  • 1 Introducing Oracle Big Data Appliance
    • 1.1 What Is Big Data?
      • 1.1.1 High Variety
      • 1.1.2 High Complexity
      • 1.1.3 High Volume
      • 1.1.4 High Velocity
    • 1.2 The Oracle Big Data Solution
    • 1.3 Software for Big Data Appliance
      • 1.3.1 Software Component Overview
    • 1.4 Acquiring Data for Analysis
      • 1.4.1 Hadoop Distributed File System
      • 1.4.2 Apache Hive
      • 1.4.3 Oracle NoSQL Database
    • 1.5 Organizing Big Data
      • 1.5.1 MapReduce
      • 1.5.2 Oracle Big Data SQL
      • 1.5.3 Oracle Big Data Connectors
        • 1.5.3.1 Oracle SQL Connector for Hadoop Distributed File System
        • 1.5.3.2 Oracle Loader for Hadoop
        • 1.5.3.3 Oracle Data Integrator Enterprise Edition
        • 1.5.3.4 Oracle XQuery for Hadoop
        • 1.5.3.5 Oracle R Advanced Analytics for Hadoop
        • 1.5.3.6 Oracle Shell for Hadoop Loaders
      • 1.5.4 Oracle R Support for Big Data
    • 1.6 Analyzing and Visualizing Big Data
    • 1.7 Best Practices
  • 2 Security for Oracle Big Data Appliance
    • 2.1 Overview
    • 2.2 About Predefined Users and Groups
    • 2.3 About HDFS Transparent Encryption
    • 2.4 About User Authentication
    • 2.5 About Fine-Grained Authorization
    • 2.6 Port Numbers Used on Oracle Big Data Appliance
    • 2.7 About Puppet Security
    • 2.8 About HTTPS/Network Encryption
      • 2.8.1 Configuring Web Browsers to use Kerberos Authentication
    • 2.9 Additional Guidance for Securing Clusters
  • 3 Administering Oracle Big Data Appliance
    • 3.1 Monitoring Multiple Clusters Using Oracle Enterprise Manager
      • 3.1.1 Using the Enterprise Manager Web Interface
      • 3.1.2 Using the Enterprise Manager Command-Line Interface
    • 3.2 Managing Operations Using Cloudera Manager
      • 3.2.1 Monitoring the Status of Oracle Big Data Appliance
      • 3.2.2 Performing Administrative Tasks
      • 3.2.3 Managing CDH Services With Cloudera Manager
    • 3.3 Using Hadoop Monitoring Utilities
      • 3.3.1 Monitoring MapReduce Jobs
      • 3.3.2 Monitoring the Health of HDFS
    • 3.4 Using Cloudera Hue to Interact With Hadoop
    • 3.5 About the Oracle Big Data Appliance Software
      • 3.5.1 Software Components
      • 3.5.2 Unconfigured Software
      • 3.5.3 Allocating Resources Among Services
    • 3.6 About CDH Clusters
      • 3.6.1 Services on a Three-Node Development Cluster
      • 3.6.2 Service Locations on Rack 1 of a CDH Cluster with Four or More Nodes
      • 3.6.3 Service Locations on Additional Racks of a Cluster
      • 3.6.4 About MapReduce
      • 3.6.5 Automatic Failover of the NameNode
      • 3.6.6 Automatic Failover of the ResourceManager
      • 3.6.7 Map and Reduce Resource Allocation
    • 3.7 About Oracle NoSQL Database Clusters
    • 3.8 About Kafka Clusters
      • 3.8.1 Where Do the Services Run on a Kafka Cluster?
    • 3.9 Effects of Hardware on Software Availability
      • 3.9.1 Logical Disk Layout
      • 3.9.2 Critical and Noncritical CDH Nodes
        • 3.9.2.1 High Availability or Single Points of Failure?
        • 3.9.2.2 Where Do the Critical Services Run?
      • 3.9.3 First NameNode Node
      • 3.9.4 Second NameNode Node
      • 3.9.5 First ResourceManager Node
      • 3.9.6 Second ResourceManager Node
      • 3.9.7 Noncritical CDH Nodes
    • 3.10 Managing a Hardware Failure
      • 3.10.1 Prerequisites for Managing a Failing Node
      • 3.10.2 Managing a Failing CDH Critical Node
      • 3.10.3 Managing a Failing Noncritical Node
    • 3.11 Stopping and Starting Oracle Big Data Appliance
      • 3.11.1 Prerequisites
      • 3.11.2 Stopping Oracle Big Data Appliance
        • 3.11.2.1 Stopping All Managed Services
        • 3.11.2.2 Stopping Cloudera Manager Server
        • 3.11.2.3 Stopping Oracle Data Integrator Agent
        • 3.11.2.4 Dismounting NFS Directories
        • 3.11.2.5 Stopping the Servers
        • 3.11.2.6 Stopping the InfiniBand and Cisco Switches
      • 3.11.3 Starting Oracle Big Data Appliance
        • 3.11.3.1 Powering Up Oracle Big Data Appliance
        • 3.11.3.2 Starting the HDFS Software Services
        • 3.11.3.3 Starting Oracle Data Integrator Agent
    • 3.12 Managing Oracle Big Data SQL
      • 3.12.1 Adding and Removing the Oracle Big Data SQL Service
      • 3.12.2 Choosing Between Ethernet and InfiniBand Connections For Oracle Big Data SQL
      • 3.12.3 Allocating Resources to Oracle Big Data SQL
    • 3.13 Auditing Oracle Big Data Appliance
    • 3.14 Collecting Diagnostic Information for Oracle Customer Support
  • 4 Supporting User Access to Oracle Big Data Appliance
    • 4.1 About Accessing a Kerberos-Secured Cluster
    • 4.2 Providing Remote Client Access to CDH
      • 4.2.1 Prerequisites
      • 4.2.2 Installing a CDH Client on Any Supported Operating System
      • 4.2.3 Configuring a CDH Client for an Unsecured Cluster
      • 4.2.4 Configuring a CDH Client for a Kerberos-Secured Cluster
      • 4.2.5 Verifying Access to a Cluster from the CDH Client
    • 4.3 Providing Remote Client Access to Hive
    • 4.4 Managing User Accounts
      • 4.4.1 Creating Hadoop Cluster Users
        • 4.4.1.1 Creating Users on an Unsecured Cluster
        • 4.4.1.2 Creating Users on a Secured Cluster
      • 4.4.2 Providing User Login Privileges (Optional)
    • 4.5 Recovering Deleted Files
      • 4.5.1 Restoring Files from the Trash
      • 4.5.2 Changing the Trash Interval
      • 4.5.3 Disabling the Trash Facility
        • 4.5.3.1 Completely Disabling the Trash Facility
        • 4.5.3.2 Disabling the Trash Facility for Local HDFS Clients
        • 4.5.3.3 Disabling the Trash Facility for a Remote HDFS Client
  • 5 Configuring Oracle Exadata Database Machine for Use with Oracle Big Data Appliance
    • 5.1 About Optimizing Communications
      • 5.1.1 About Applications that Pull Data Into Oracle Exadata Database Machine
      • 5.1.2 About Applications that Push Data Into Oracle Exadata Database Machine
    • 5.2 Prerequisites for Optimizing Communications
    • 5.3 Specifying the InfiniBand Connections to Oracle Big Data Appliance
    • 5.4 Specifying the InfiniBand Connections to Oracle Exadata Database Machine
    • 5.5 Enabling SDP on Exadata Database Nodes
    • 5.6 Creating an SDP Listener on the InfiniBand Network
• Part II Oracle Table Access for Hadoop and Spark
  • 6 Oracle DataSource for Apache Hadoop (OD4H)
    • 6.1 Operational Data, Big Data and Requirements
    • 6.2 Overview of Oracle DataSource for Apache Hadoop (OD4H)
      • 6.2.1 Opportunity with Hadoop 2.x
      • 6.2.2 Oracle Tables as Hadoop Data Source
      • 6.2.3 External Tables
        • 6.2.3.1 TBLPROPERTIES
        • 6.2.3.2 SERDE PROPERTIES
      • 6.2.4 List of jars in the OD4H package
    • 6.3 How does OD4H work?
      • 6.3.1 Create a new Oracle Database Table or Reuse an Existing Table
      • 6.3.2 Hive DDL
      • 6.3.3 Creating External Tables in Hive
    • 6.4 Features of OD4H
      • 6.4.1 Performance And Scalability Features
        • 6.4.1.1 Splitters
        • 6.4.1.2 Choosing a Splitter
        • 6.4.1.3 Predicate Pushdown
        • 6.4.1.4 Projection Pushdown
        • 6.4.1.5 Partition Pruning
      • 6.4.2 Smart Connection Management
      • 6.4.3 Security Features
        • 6.4.3.1 Improved Authentication
    • 6.5 Using HiveQL with OD4H
    • 6.6 Using Spark SQL with OD4H
    • 6.7 Writing Back to Oracle Database
• Glossary
• Index