1/28
Contents
Title and Copyright Information
Preface
Audience
Documentation Accessibility
Related Documentation
Conventions
Backus-Naur Form Syntax
Changes in This Release for Oracle Big Data Appliance Owner's Guide
Changes in Oracle Big Data Appliance Release 2 (2.1)
Changes in Oracle Big Data Appliance Release 2 (2.0.1)
Changes in Oracle Big Data Appliance Release 2 (2.0)
Part I Preinstallation
1
Introduction to Oracle Big Data Appliance
1.1
About Oracle Big Data Appliance
1.2
Oracle Big Data Appliance Rack Components
1.3
Server Components
1.4
Spare Parts Kit Components
1.5
Oracle Big Data Appliance Management Software
1.6
Oracle Big Data Appliance Restrictions on Use
2
Site Requirements for Oracle Big Data Appliance
2.1
General Environmental Requirements
2.2
Space Requirements
2.2.1
Receiving and Unpacking Requirements
2.2.2
Maintenance Access Requirements
2.3
Flooring Requirements
2.4
Electrical Power Requirements
2.4.1
PDUs for Oracle Big Data Appliance
2.4.1.1
Low-Voltage 15 kVA Single-Phase PDUs
2.4.1.2
Low-Voltage 15 kVA Three-Phase PDUs
2.4.1.3
High-Voltage 15 kVA Single-Phase PDUs
2.4.1.4
High-Voltage 15 kVA Three-Phase PDUs
2.4.2
Facility Power Requirements
2.4.3
Circuit Breaker Requirements
2.4.4
Grounding Guidelines
2.5
Temperature and Humidity Requirements
2.6
Ventilation and Cooling Requirements
2.7
Network Connection Requirements
2.8
Ensuring That the Site Is Ready
3
Understanding the Network Requirements
3.1
Overview of Network Requirements
3.1.1
Default Network Connections
3.1.2
Minimum Requirements for the Networks
3.1.3
Network Diagram
3.2
Cabling the Client Network
3.2.1
How the Servers Connect to the Gateway Switches
3.2.2
Using Splitter Cables for Connecting to the 40 Gbps Physical Ports
3.2.3
What About Data Centers Without a 10 GbE Infrastructure?
3.2.4
Configuring Multiple Racks into a Single Hadoop Cluster
3.3
Factory Network Settings
3.4
Port Assignments for Oracle Big Data Appliance Software
3.5
Preparing the Network for Oracle Big Data Appliance
4
Using the Oracle Big Data Appliance Configuration Utility
4.1
Overview of the Oracle Big Data Appliance Configuration Utility
4.2
Using the Oracle Big Data Appliance Configuration Utility
4.2.1
Using OpenOffice Spreadsheet
4.2.2
Generating the Configuration Files
4.2.3
About the Configuration Files
4.3
Welcome Page
4.4
Network Configuration
4.5
Software Configuration
5
Setting Up Auto Service Request
5.1
Understanding Auto Service Request
5.2
Getting Ready to Install ASR
5.3
Installing ASR Manager
5.4
Verifying the ASR Manager Installation
5.5
Configuring the Trap Destinations on Oracle Big Data Appliance
5.6
Verifying ASR Assets
5.7
Validating Auto Service Request on Oracle Big Data Appliance
5.8
Troubleshooting ASR
Part II Hardware Installation and Configuration
6
Installing Oracle Big Data Appliance at the Site
6.1
Reviewing Safety Guidelines
6.2
Unpacking Oracle Big Data Appliance
6.2.1
Contents of the Shipping Kit
6.2.2
Removing Oracle Big Data Appliance from the Shipping Crate
6.3
Placing Oracle Big Data Appliance in Its Allocated Space
6.3.1
Moving Oracle Big Data Appliance
6.3.2
Stabilizing Oracle Big Data Appliance
6.3.2.1
Stabilize the Oracle Big Data Appliance Rack with Leveling Feet
6.3.2.2
Stabilize the Oracle Big Data Appliance Rack with Mounting Brackets
6.3.3
Attaching a Ground Cable (Optional)
6.4
Powering On the System for the First Time
6.4.1
Inspecting the Oracle Big Data Appliance Rack After It Is in Place
6.4.2
Connecting Power Cords
6.4.3
Powering On Oracle Big Data Appliance
7
Configuring Oracle Big Data Appliance
7.1
Configuring the KVM Switch
7.1.1
Starting the KVM Switch
7.1.2
Connecting the KVM Switch to the Management Network
7.1.3
Checking the KVM Firmware Version
7.1.4
Configuring the KVM Switch to Access the Servers
7.1.5
Accessing a Server by Using the KVM Switch
7.2
Configuring the Cisco Ethernet Switch
7.2.1
Scope of the Configuration
7.2.2
Prerequisites for Configuring the Ethernet Switch
7.2.3
Configuring the Ethernet Switch on the Customer Network
7.2.4
Setting Up Telnet Access
7.2.5
Configuring SSH
7.2.6
Identifying the DNS Servers
7.2.7
Setting the Clock and Time Zone
7.2.8
Configuring the NTP Servers
7.2.9
Disabling the Spanning Tree
7.2.10
Verifying the Ethernet Configuration
7.3
Configuring the InfiniBand Leaf and Spine Switches
7.3.1
Configuring an InfiniBand Switch
7.3.2
Setting the Time Zone and Clock on an InfiniBand Switch
7.3.3
Checking the Health of an InfiniBand Switch
7.4
Configuring the Power Distribution Units
7.4.1
Connecting the PDUs to the Network
7.4.2
Verifying the PDU Firmware Version
7.4.3
Configuring the Threshold Settings for the PDUs
7.5
Configuring the Oracle Big Data Appliance Servers
7.6
Configuring the Network
7.6.1
Verifying the Factory Software Image
7.6.2
Copying the Configuration Files to Oracle Big Data Appliance
7.6.3
Starting the Network Configuration
7.6.4
Connecting to the Network
7.6.5
Completing the Network Configuration
8
Connecting Multiple Oracle Big Data Appliance Racks
8.1
Extending a Rack by Adding Another Rack
8.2
Cabling Two Racks Together
8.3
Cabling Several Racks Together
Part III Software Installation and Configuration
9
Installing the Oracle Big Data Appliance Software
9.1
Installing the Software on a New Rack
9.1.1
Installing the Software on a Single or Primary Rack
9.2
Adding Servers to a Cluster
9.3
What If an Error Occurs During the Installation?
9.4
Upgrading the Software on Oracle Big Data Appliance
9.4.1
About the Changes from Version 1.1 to Version 2.0.1
9.4.2
Upgrading from Software Version 1.1
9.4.3
About the Mammoth Steps in an Upgrade
9.5
Changing the Configuration of Optional Software
9.6
Reinstalling the Base Image
9.7
Mammoth Utility Syntax
9.7.1
Mammoth Utility Options
9.7.2
Mammoth Installation Steps
9.8
Mammoth Reconfiguration Utility Syntax
Part IV Maintenance
10
Maintaining Oracle Big Data Appliance
10.1
Monitoring the Ambient Temperature of Servers
10.2
Powering On and Off Oracle Big Data Appliance
10.2.1
Nonemergency Power Procedures
10.2.1.1
Powering On Oracle Big Data Appliance
10.2.1.2
Powering On Servers Remotely Using Oracle ILOM
10.2.1.3
Powering Off Oracle Big Data Appliance
10.2.1.4
Powering On and Off Network Switches
10.2.2
Emergency Power-Off Considerations
10.2.2.1
Emergency Power-Off Procedure
10.2.2.2
Emergency Power-Off Switch
10.2.3
Cautions and Warnings
10.3
Adding Memory to the Servers
10.3.1
Adding Memory to Sun Server X3-2L Servers
10.3.2
Adding Memory to Sun Fire X4270 M2 Servers
10.4
Maintaining the Physical Disks of Servers
10.4.1
Verifying the Server Configuration
10.4.1.1
Verifying Disk Controller Configuration
10.4.1.2
Verifying Virtual Drive Configuration
10.4.1.3
Verifying Physical Drive Configuration
10.5
Replacing a Server Disk
10.5.1
Overview of the Disk Replacement Process
10.5.2
About Disk Drive Identifiers
10.5.2.1
Standard Disk Drive Mappings
10.5.2.2
Standard Mount Points
10.5.2.3
Obtaining the Physical Slot Number of a Disk Drive
10.5.3
Prerequisites for Replacing a Working Disk
10.5.4
What If a Server Fails to Restart?
10.5.5
Replacing a Disk Drive
10.5.6
Identifying the Function of a Disk Drive
10.5.6.1
Checking for Use by the Operating System
10.5.6.2
Checking for Use by Oracle NoSQL Database
10.5.7
Configuring an Operating System Disk
10.5.7.1
Partitioning the Operating System Disk
10.5.7.2
Repairing the RAID Arrays
10.5.7.3
Formatting the HDFS Partition of an Operating System Disk
10.5.7.4
Restoring the Swap Partition
10.5.7.5
Restoring the GRUB Master Boot Records
10.5.8
Configuring an Oracle NoSQL Database Disk
10.5.8.1
Removing the Logical Volume for Oracle NoSQL Database
10.5.8.2
Stopping the Oracle NoSQL Database Service
10.5.9
Configuring an HDFS Disk
10.5.9.1
Partitioning a Disk for HDFS
10.5.10
Verifying the Disk Configuration
10.6
Changing InfiniBand IP Addresses
10.7
Maintaining the InfiniBand Network
10.7.1
Backing Up and Restoring Oracle ILOM Settings
10.7.1.1
Backing Up the Oracle ILOM Configuration Settings
10.7.1.2
Restoring Oracle ILOM Configuration Settings
10.7.2
Replacing a Failed InfiniBand Switch
10.7.3
Verifying InfiniBand Network Operation
10.7.4
Understanding the Network Subnet Manager Master
10.8
Changing the Number of Connections to a Gateway Switch
10.9
Changing the NTP Servers
11
Monitoring the Health of Oracle Big Data Appliance
bdacheckcluster
bdacheckhw
bdacheckib
bdachecknet
bdachecksw
bdadiag
bdaid
bdaimagevalidate
bdaredoclientnet
bdaserials
bdaswapoff
bdaswapon
bdaupdatefw
iblinkinfo
imagehistory
imageinfo
listlinkup
remove-root-ssh
setup-root-ssh
showvlan
showvnics
12
Using the dcli Utility
12.1
Overview of the dcli Utility
12.1.1
Setting Up Passwordless SSH
12.1.2
Basic Use of dcli
12.1.2.1
Getting Help
12.1.2.2
Identifying the Target Servers
12.1.2.3
Specifying the Commands
12.1.2.4
Controlling the Output Levels
12.2
dcli Syntax
12.3
dcli Return Values
12.4
dcli Examples
13
Using Oracle Integrated Lights Out Manager
13.1
Oracle ILOM Overview
13.1.1
Oracle ILOM Interfaces
13.1.2
Oracle ILOM Users
13.2
Administrative Network Diagram
13.3
Oracle ILOM IP Addresses for Oracle Big Data Appliance Components
13.4
Connecting to Oracle ILOM Using the Network
13.4.1
Connecting to the Command-Line Interface
13.4.2
Connecting to the Web GUI
13.5
Connecting to Oracle ILOM Using a Serial Connection
13.5.1
Connecting to the Oracle ILOM of a Server
13.5.2
Connecting to the Oracle ILOM of an InfiniBand Switch
Part V Appendixes
A
Error Messages for Oracle Big Data Appliance
A.1
Auto Service Request Alerts: DISKALRT-02001 to DISKALRT-02006
B
Replacement Units
B.1
Understanding Repair Categories
B.2
Disk Controller Batteries
B.3
LED Status Descriptions
B.3.1
Sun Server LEDs
B.3.2
Sun InfiniBand Switch LEDs
B.4
Parts for Oracle Big Data Appliance Servers
B.5
Parts for Sun Datacenter InfiniBand Switch 36
B.6
Parts for Sun Network QDR InfiniBand Gateway Switches
B.7
Parts for the Cisco Ethernet Switch
B.8
Parts for Power Distribution Units
B.9
Cables and Cable Accessories for an Oracle Big Data Appliance Rack
C
In-Rack Cabling Tables for Oracle Big Data Appliance X3-2
C.1
Cable Color Coding
C.2
Oracle Big Data Appliance Rack Layout
C.3
Administrative Gigabit Ethernet Cable Connections
C.4
Oracle Integrated Lights Out Manager Cable Connections
C.5
Single-Phase Power Distribution Unit Cable Connections
C.6
Three-Phase Power Distribution Unit Cable Connections
C.7
In-Rack InfiniBand Switch-to-Switch Cable Connections
C.8
In-Rack InfiniBand Switch-to-Server Cable Connections
D
In-Rack Cabling Tables for Oracle Big Data Appliance
D.1
Cable Color Coding
D.2
Oracle Big Data Appliance Rack Layout
D.3
KVM Network Cable Connections
D.4
Administrative Gigabit Ethernet Cable Connections
D.5
Oracle Integrated Lights Out Manager Cable Connections
D.6
Single-Phase Power Distribution Unit Cable Connections
D.7
Three-Phase Power Distribution Unit Cable Connections
D.8
In-Rack InfiniBand Switch-to-Switch Cable Connections
D.9
In-Rack InfiniBand Switch-to-Server Cable Connections
E
Multirack Cabling Tables
E.1
Understanding Multirack Cabling
E.1.1
Cabling the Switches in One Rack
E.1.2
Cabling the Switches in Two Racks
E.1.3
Cabling the Switches in Up to Eight Racks
E.2
Key to Cabling Table Abbreviations
E.3
Two-Rack Cabling
E.4
Three-Rack Cabling
E.5
Four-Rack Cabling
E.6
Five-Rack Cabling
E.7
Six-Rack Cabling
E.8
Seven-Rack Cabling
E.9
Eight-Rack Cabling
Index
Scripting on this page enhances content navigation, but does not change the content in any way.