Go to main content
1/30
Contents
List of Figures
List of Tables
Title and Copyright Information
Preface
Audience
Documentation Accessibility
Related Documentation
Conventions
Part I Preinstallation
1
Introduction to Recovery Appliance
1.1
About Recovery Appliance
1.2
Recovery Appliance Rack Components
1.3
Compute Server Components
1.4
Storage Server Components
1.5
Spares Kit Components for Recovery Appliance
1.6
About Tape Backup Infrastructure
1.6.1
Oracle Recommended Stack
1.6.2
Third-Party Tape Systems
1.7
Restrictions on Modifying Recovery Appliance
2
Site Requirements for Recovery Appliance
2.1
General Environmental Requirements
2.2
Space Requirements
2.2.1
Receiving and Unpacking Requirements
2.2.2
Maintenance Access Requirements
2.3
Flooring Requirements
2.4
Electrical Power Requirements
2.4.1
PDUs for Recovery Appliance
2.4.1.1
Single-Phase PDUs for North America, South America, Japan, and Taiwan
2.4.1.2
Three-Phase PDUs for North America, South America, Japan, and Taiwan
2.4.1.3
Single-Phase PDUs for Europe, the Middle East, Africa, and Asia Pacific
2.4.1.4
Three-Phase PDUs for Europe, the Middle East, Africa, and Asia Pacific
2.4.2
Facility Power Requirements
2.4.3
Circuit Breaker Requirements
2.4.4
Grounding Guidelines
2.5
Temperature and Humidity Requirements
2.6
Ventilation and Cooling Requirements
2.7
Network Connection Requirements for Recovery Appliance
2.8
Ensuring That the Site Is Ready
2.8.1
Generate the Configuration Files
2.8.2
Configure the Network
2.8.3
Prepare the Site
3
Preparing Your Networks for Recovery Appliance
3.1
Overview of Network Requirements
3.1.1
About the Network Components and Interfaces
3.1.2
About the Networks
3.1.3
Example of Network Connections for Recovery Appliance
3.1.4
Connecting Recovery Appliance Rack Components to the Networks
3.1.5
Connecting Recovery Appliance to a Tape Library
3.1.5.1
Oracle Recommended Stack
3.1.5.2
Third-Party Tape Systems
3.1.6
Using Network VLAN Tagging with Recovery Appliance
3.2
Registering Recovery Appliance in the Domain Name System
3.3
Factory IP Address Settings
3.4
Port Assignments When Using a Firewall
4
Setting Up Auto Service Request
4.1
Understanding Auto Service Request
4.2
Getting Ready to Install ASR
4.3
Installing ASR Manager
4.4
Verifying the ASR Manager Installation
4.5
About the Trap Destinations on Recovery Appliance
4.6
Troubleshooting ASR
5
Using the Deployment Assistant
5.1
Overview of the Deployment Assistant
5.2
Generating the Configuration Files
5.3
About the Configuration Files
5.4
Customer Details Page
5.5
Hardware Selection Page
5.6
Define Customer Networks Page
5.6.1
Network Configuration Choices
5.6.2
Cabling Considerations
5.7
Administration Network Page
5.7.1
Modifying the Administration Host Name Format
5.8
Ingest Network Page
5.8.1
Modifying the Ingest Name Format
5.9
InfiniBand Network Configuration Page
5.9.1
Modifying the InfiniBand Host Name Format
5.10
Replication Network Page
5.10.1
Modifying the Replication Host Name Format
5.11
Identify Compute Node OS Page
5.12
Review and Edit Page
5.13
Define Clusters Page
5.14
Cluster Page
5.14.1
Cluster
5.14.2
Users and Groups
5.14.3
Software Locations
5.14.4
Disk Group Details
5.14.5
Initial Database
5.14.6
Ingest Network
5.14.7
Replication Network
5.15
Review and Edit Page
5.16
Replication Network SCAN Page
5.17
Cell Alerting Page
5.18
Platinum Configuration Page
5.18.1
Customer Details
5.18.2
Platinum Gateway Details
5.18.3
Platinum Agent Configuration Details
5.19
Oracle Configuration Manager Page
5.20
Auto Service Request Page
5.21
Grid Control Agent Page
5.22
Tape Library Connectivity Page
5.23
Comments Page
5.24
Generate Page
5.25
Finish Page
Part II Installation and Configuration
6
Installing the
Recovery Appliance
at the Site
6.1
Reviewing Safety Guidelines
6.2
Unpacking
ZDLRA Rack
6.2.1
Contents of the Shipping Kit
6.2.2
Removing
ZDLRA Rack
from the Shipping Crate
6.3
Placing
ZDLRA Rack
in Its Allocated Space
6.3.1
Moving
ZDLRA Rack
6.3.2
Stabilizing
ZDLRA Rack
6.3.2.1
Stabilize
ZDLRA Rack
with Leveling Feet
6.3.2.2
Stabilize
ZDLRA Rack
X7 with Leveling Feet
6.3.3
Attaching a Ground Cable (Optional)
6.4
Installing the Fiber Channel Adapters
6.5
Acclimating the
Recovery Appliance
6.6
Powering on the System for the First Time
6.6.1
Inspecting Recovery Appliance After It Is in Place
6.6.2
Connecting Power Cords
6.6.3
Powering Up Recovery Appliance
7
Expanding a Recovery Appliance Rack with Additional Storage Servers
7.1
Preparing to Extend Recovery Appliance
7.1.1
Estimating InfiniBand Cable Path Lengths
7.1.2
Obtaining the Current Configuration Information
7.1.3
Generating the Network Configuration Files
7.1.4
Moving the Audit and Diagnostic Files
7.1.5
Synchronizing Release and Patch Levels
7.2
Precautions and Guidelines
7.2.1
General Safety Precautions
7.2.2
InfiniBand Cable Precautions
7.2.3
InfiniBand Cable Bundling Guidelines
7.2.4
Cable Management Arm Guidelines
7.3
Adding Storage Servers to a Rack
7.3.1
Checking the Recovery Appliance Rack
7.3.2
Unpacking and Labeling the New Storage Servers
7.3.3
Recovery Appliance X7, X6, and X5 Population Rules
7.3.4
Removing the Doors
7.3.5
Adding New Servers
7.3.6
Cabling the Storage Servers
7.3.7
Closing the Rack
7.4
Making New Storage Available
8
Extending Recovery Appliance with Multiple Racks
8.1
About Multirack Configurations
8.2
Extending a Rack by Adding Another Rack
8.3
Adding the Spine Switches
8.4
Floor and Underfloor Delivery of InfiniBand Cables
8.5
Cabling Two Racks Together
8.6
Cabling Several Racks Together
8.7
Configuring Multiple Racks
9
Configuring Ingest Over InfiniBand
9.1
About Ingest Over InfiniBand
9.2
Cabling Recovery Appliance to Oracle Exadata Database Machine
9.3
Adding VIPs to the Recovery Appliance InfiniBand Network
9.4
Updating Recovery Appliance With the New VIPs for InfiniBand
9.5
Update the Database Initialization Parameters
10
Configuring a Recovery Appliance Rack
10.1
Supporting Auto Service Request
10.1.1
Prerequisites for Using Auto Service Request
10.1.2
Checking an Existing ASR Manager Installation
10.1.3
Installing ASR Manager
10.2
Installing the Tape Hardware
10.3
Connecting Recovery Appliance to Your Networks
10.4
Configuring the InfiniBand Switches
10.4.1
Configuring an InfiniBand Switch
10.4.2
Setting the Time on an InfiniBand Switch
10.4.3
Setting the Serial Number on a Spine Switch
10.4.4
Checking the Health of an InfiniBand Switch
10.4.5
Setting a Spine Switch as the Subnet Manager Master
10.5
Configuring the Cisco Ethernet Switch
10.5.1
Scope of the Configuration
10.5.2
Prerequisites for Configuring the Ethernet Switch
10.5.3
Configuring the Ethernet Switch on the Data Center Network
10.5.4
Disabling Telnet Connections
10.5.5
Configuring SSH on the Ethernet Switch
10.5.6
Setting the Clock and Time Zone on the Ethernet Switch
10.5.7
Disabling Spanning Tree on the Ethernet Switch
10.5.8
Verifying the Ethernet Configuration
10.6
Configuring the Power Distribution Units
10.6.1
Assigning Network Addresses to the PDUs
10.6.2
Configuring the PDU System Time Settings
10.6.3
Upgrading the PDU Firmware
10.7
Checking the Health of the Compute Servers
10.8
Checking the Health of the Storage Servers
10.9
Verifying the InfiniBand Network
10.10
Configuring the IP Addresses of the Servers
11
Installing the Recovery Appliance Software
11.1
About the Installation Software
11.2
Software Installation Prerequisites
11.2.1
About Adding a Rack to an Existing Rack
11.2.2
About Adding New Storage Servers to an Existing Rack
11.3
Reclaiming Disk Space on the Compute Servers
11.4
Installing the Software on Recovery Appliance
11.5
Install Utility Syntax
11.5.1
Install Utility Parameters
11.5.2
Install Utility Syntax Examples
11.5.3
About the Install Utility Steps
11.6
Setting Up Enterprise Manager to Administer Recovery Appliance
11.6.1
Deploying the Enterprise Manager Agents
11.6.2
Discovering the Cluster
11.6.3
Discovering the Cluster Database Targets
11.6.4
Discovering the Recovery Appliance
Part III Maintenance of Recovery Appliance
12
Maintaining the Recovery Appliance Hardware
12.1
Cautions and Warnings
12.2
Determining the Server Model
12.3
Powering On and Off a Recovery Appliance Rack
12.3.1
Emergency Power-Off Procedure
12.3.1.1
Powering Off in an Emergency
12.3.1.2
About the Emergency Power-Off Switch
12.3.2
Shutting Down Recovery Appliance
12.3.2.1
Stopping Recovery Appliance Services
12.3.2.2
Powering Down the Servers
12.3.2.3
Powering the Network Switches
12.3.3
Starting Up Recovery Appliance
12.3.3.1
Starting Up Recovery Appliance Components
12.3.3.2
Startup Sequence
12.3.3.3
Powering On Servers Remotely
12.3.3.4
Starting the Recovery Appliance Software
12.4
Replacing the Disk Controller Batteries
12.4.1
Monitoring Batteries in the Compute Servers
12.4.2
Replacing Batteries in Disk Controllers
12.5
Replacing a Power Distribution Unit
12.5.1
PDU Replacement Guidelines
12.5.2
Replacing a PDU
12.6
Resetting a Non-Responsive Oracle ILOM
12.6.1
Resetting Oracle ILOM Using SSH
12.6.2
Resetting Oracle ILOM Using the Remote Console
12.6.3
Resetting Oracle ILOM Using IPMItool
12.6.4
Resetting Oracle ILOM By Removing Power
12.7
Maintaining the Compute Servers
12.7.1
Verifying the RAID Status of a Compute Server
12.8
Reimaging a Compute Server
12.8.1
Contacting Oracle Support Services
12.8.2
Downloading the Latest Release of the Cluster Verification Utility
12.8.3
Removing the Failed Compute Server from the Cluster
12.8.4
Preparing the USB Flash Drive for Imaging
12.8.5
Copying the Image to the New Compute Server
12.8.6
Configuring the Replacement Compute Server
12.8.7
Preparing the Replacement Compute Server for the Cluster
12.8.8
Applying Patch Bundles to a Replacement Compute Server
12.8.9
Cloning the Oracle Grid Infrastructure
12.8.10
Clone Oracle Database Homes to the Replacement Compute Server
12.9
Maintaining the Storage Servers
12.9.1
Shutting Down a Storage Server
12.9.2
Enabling Network Connectivity Using the Diagnostics ISO
12.10
Maintaining the Physical Disks of Storage Servers
12.10.1
About System Disks and Data Disks
12.10.2
Monitoring the Status of Physical Disks
12.10.3
What Happens When Disk Errors Occur?
12.10.4
About Detecting Underperforming Disks
12.10.5
About Rebalancing the Data
12.10.6
Monitoring Hard Disk Controller Write-Through Cache Mode
12.10.7
Replacing a Failed Physical Disk
12.10.8
Replacing a Faulty Physical Disk
12.10.9
Removing an Underperforming Physical Disk
12.10.10
Moving All Drives from One Storage Server to Another
12.10.11
Removing and Replacing the Same Physical Disk
12.10.12
Reenabling a Rejected Physical Disk
12.11
Maintaining the Flash Disks of Storage Servers
12.11.1
About the Flash Disks
12.11.2
Faulty Status Indicators
12.11.3
Identifying Flash Disks in Poor Health
12.11.4
Identifying Underperforming Flash Disks
12.11.5
When Is It Safe to Replace a Faulty Flash Disk?
12.11.6
Replacing a Failed Flash Disk
12.11.7
Replacing a Faulty Flash Disk
12.11.8
Removing an Underperforming Flash Disk
12.11.9
About Write-Back Flash Cache
12.12
Replacing a Disk Controller Battery Backup Unit
12.12.1
Replacing a Disk Controller BBU on a Compute Server
12.12.2
Replacing a Disk Controller BBU on a Storage Server
12.13
Using the Storage Server Rescue Procedure
12.13.1
First Steps Before Rescuing the Storage Server
12.13.1.1
If the Server Has Normal Redundancy
12.13.1.2
If the Server Has High Redundancy
12.13.2
About the Rescue Procedure
12.13.3
Rescuing a Server Using the CELLBOOT USB Flash Drive
12.13.4
Reconfiguring the Rescued Storage Server
12.13.5
Recreating a Damaged CELLBOOT USB Flash Drive
13
Reconfiguring the Hardware
13.1
Changing Component Passwords
13.1.1
Changing the Compute Server Passwords
13.1.1.1
Changing the User Account Password
13.1.1.2
Changing the GRUB Account Password
13.1.2
Changing the Storage Server Passwords
13.1.3
Creating New Users and Changing Passwords on a PDU
13.1.4
Changing the Oracle ILOM Password
13.1.5
Changing an InfiniBand Switch Password
13.1.6
Changing the Cisco Ethernet Switch Password
13.1.7
Changing the Recovery Appliance Database User Password
13.1.8
Changing OSB Tape Backup Passwords
13.2
Changing the DNS Servers
13.2.1
Changing the DNS Server Address on an InfiniBand Switch
13.2.2
Changing the DNS Server Address on the Cisco Ethernet Switch
13.2.3
Changing the DNS Server Address on the Compute Server
13.2.4
Changing the DNS Server on Storage Servers
13.3
Changing the NTP Servers
13.3.1
Setting the NTP Server Address on the Compute Servers
13.3.2
Setting the NTP Server Address on the InfiniBand Switches
13.3.3
Set the NTP Server Address on the Cisco Ethernet Switch
13.3.4
Setting the NTP Server on the Storage Servers
13.3.5
Restart Recovery Appliance
13.4
Changing the Time Zone Settings
13.4.1
Changing the Time Zone Settings on the Storage Servers
13.4.2
Change Time Zone Settings on the Compute Servers
13.4.3
Change the Time Zone Settings on the InfiniBand Switches
13.4.4
Change the Time Zone Settings on the Cisco Switch
Part IV Appendixes
A
RACLI Overview
A.1
racli add
A.2
racli add acfs
A.3
racli add cloud_storage
A.4
racli add credential
A.5
racli add credential_wallet
A.6
racli add keystore
A.7
racli add nfs
A.8
racli add storage_cells
A.9
racli add storage_disks
A.10
racli add vpc_user
A.11
racli alter
A.12
racli alter cloud_storage
A.13
racli alter credential_wallet
A.14
racli alter keystore
A.15
racli alter passphrase
A.16
racli alter rasys_user
A.17
racli alter vpc_user
A.18
racli disable
A.19
racli disable cloud_storage
A.20
racli disable keystore
A.21
racli disable nfs
A.22
racli enable
A.23
racli enable cloud_storage
A.24
racli enable keystore
A.25
racli enable nfs
A.26
racli export
A.27
racli export appliance
A.28
racli help
A.29
racli install
A.30
racli install appliance
A.31
racli install okv_endpoint
A.32
racli list
A.33
racli list cloud_storage
A.34
racli list nfs
A.35
racli list okv_endpoint
A.36
racli patch
A.37
racli patch appliance
A.38
racli remove
A.39
racli remove acfs
A.40
racli remove cloud_storage
A.41
racli remove keystore
A.42
racli remove nfs
A.43
racli remove vpc_user
A.44
racli start
A.45
racli start nfs
A.46
racli status
A.47
racli status appliance
A.48
racli status cloud_storage
A.49
racli status disk_group
A.50
racli status keystore
A.51
racli status nfs
A.52
racli status okv_endpoint
A.53
racli stop
A.54
racli stop nfs
A.55
racli uninstall
A.56
racli uninstall appliance
A.57
racli uninstall okv_endpoint
A.58
racli update
A.59
racli update storage_location
A.60
racli update support_tools
A.61
racli upgrade
A.62
racli upgrade appliance
A.63
racli version
B
Default User Accounts
C
Error Messages
C.1
Contacting Oracle Support Services
C.2
Generic Alert Messages: HALRT-00001 to HALRT-00500
C.3
Temperature Alert Messages: HALRT-00513 to HALRT-00600
C.4
Fan Alert Messages: HALRT-00616 to HALRT-00700
C.5
Power Supply/Converters Alert Messages: HALRT-00717 to HALRT-00800
C.6
Network Alert Messages: HALRT-00912 to HALRT-01000
C.7
Hard Disk and Flash Disk Alert Messages: HALRT-01015 to HALRT-01200
C.8
Accelerator/Controller Alert Messages: HALRT-01209 to HALRT-01300
C.9
Voltage Alert Messages: HALRT-01301 to HALRT-01400
C.10
Physical Disk Alert Messages: HALRT-01401 to HALRT-01500
C.11
Auto Service Request Alert Messages for Storage Servers: HALRT-02001 to HALRT-02013
C.12
HDD Controller Battery Alert Messages: HALRT-02101 to HALRT-02200
C.13
Generic Actions for Alert Messages: HALRT-10001 to HALRT-10500
C.14
Generic Actions for Alert Messages: HALRT-10503 to HALRT-11000
C.15
Generic Actions for Alert Messages: HALRT-11001 to HALRT-11100
D
Replacement Units
D.1
About Warranty Coverage
D.2
Understanding Repair Categories
D.3
LED Status Descriptions
D.3.1
Oracle Server LEDs
D.3.2
Sun Datacenter InfiniBand Switch 36 LEDs
D.4
Parts for Compute Servers
D.4.1
Oracle Server
X7
Oracle Database Server Parts
D.4.2
Oracle Server X6-2 and X5-2 Parts
D.4.3
Sun Server X4-2 Parts
D.5
Parts for Storage Servers
D.5.1
Oracle Exadata Storage Server X7-2 High Capacity
Server Parts
D.5.2
Oracle Server X6-2L and X5-2L Parts
D.5.3
Sun Server X4-2L Parts
D.6
Parts for InfiniBand Switches
D.7
Parts for Cisco Switch
D.8
Parts for Power Distribution Units
D.9
Cables and Cable Accessories for Recovery Appliance
E
In-Rack Cabling Tables for Recovery Appliance X7, X6, and X5
E.1
Cable Color Coding
E.2
Recovery Appliance X7, X6, and X5 Rack Layout
E.3
Oracle Integrated Lights Out Manager Cabling Connections
E.4
Administrative Gigabit Ethernet Cabling Connections
E.5
Single-Phase Power Distribution Unit Cabling Connections
E.6
Three-Phase Power Distribution Unit Cabling Connections
E.7
InfiniBand Switch-to-Switch Cabling Connections
E.8
InfiniBand Switch-to-Server Cabling Connections
F
In-Rack Cabling Tables for Recovery Appliance X4
F.1
Recovery Appliance X4 Rack Layout
F.2
Oracle Integrated Lights Out Manager Cabling Connections
F.3
Administrative Gigabit Ethernet Cabling Connections
F.4
Single-Phase Power Distribution Unit Cabling Connections
F.5
Three-Phase Power Distribution Unit Cabling Connections
F.6
InfiniBand Switch-to-Switch Cabling Connections
F.7
InfiniBand Switch-to-Server Cabling Connections
G
Multirack Cabling Tables
G.1
About Multirack Cabling
G.1.1
Cables Provided With a Spine Switch
G.1.2
Optical Cables Required for Four or More Racks
G.1.3
Cabling Three Switches Within a Rack
G.1.4
Cabling the Switches in Two Racks
G.1.5
Cabling the Switches in Up to Eight Racks
G.1.6
Cabling Switches in Up to 18 Racks
G.2
Key to Cabling Table Abbreviations
G.3
Two-Rack Cabling
G.4
Three-Rack Cabling
G.5
Four-Rack Cabling
G.6
Five-Rack Cabling
G.7
Six-Rack Cabling
G.8
Seven-Rack Cabling
G.9
Eight-Rack Cabling
G.10
Nine-Rack Cabling
G.11
10-Rack Cabling
G.12
11-Rack Cabling
G.13
12-Rack Cabling
G.14
13-Rack Cabling
G.15
14-Rack Cabling
G.16
15-Rack Cabling
G.17
16-Rack Cabling
G.18
17-Rack Cabling
G.19
18-Rack Cabling
Index
Scripting on this page enhances content navigation, but does not change the content in any way.