Table of Contents

• List of Figures
• List of Tables
• Title and Copyright Information
• Preface
  • Audience
  • Documentation Accessibility
  • Related Documentation
  • Conventions
• Part I Preinstallation
  • 1 Introduction to Recovery Appliance
    • About Recovery Appliance
    • Recovery Appliance Rack Components
    • Compute Server Components
    • Storage Server Components
    • Spares Kit Components for Recovery Appliance
    • About Tape Backup Infrastructure
      • Oracle Recommended Stack
      • Third-Party Tape Systems
    • Restrictions on Modifying Recovery Appliance
  • 2 Site Requirements for Recovery Appliance
    • General Environmental Requirements
    • Space Requirements
      • Space Requirements for Recovery Appliance X7-2 and Later Systems
      • Space Requirements for Racks up to Recovery Appliance X6-2
    • Receiving and Unpacking Requirements
    • Maintenance Access Requirements
    • Flooring Requirements
    • Electrical Power Requirements
      • PDUs for Recovery Appliance
        • Single-Phase PDUs for North America, South America, Japan, and Taiwan
        • Three-Phase PDUs for North America, South America, Japan, and Taiwan
        • Single-Phase PDUs for Europe, the Middle East, Africa, and Asia Pacific
        • Three-Phase PDUs for Europe, the Middle East, Africa, and Asia Pacific
      • Facility Power Requirements
      • Circuit Breaker Requirements
      • Grounding Guidelines
    • Temperature and Humidity Requirements
    • Ventilation and Cooling Requirements
    • Network Connection Requirements for Recovery Appliance
    • Ensuring That the Site Is Ready
      • Generate the Configuration Files
      • Configure the Network
      • Prepare the Site
  • 3 Preparing Your Networks for Recovery Appliance
    • Overview of Network Requirements
      • About the Network Components and Interfaces
      • About the Networks
      • Example of Network Connections for Recovery Appliance
      • Connecting Recovery Appliance Rack Components to the Networks
      • Connecting Recovery Appliance to a Tape Library
        • Oracle Recommended Stack
        • Third-Party Tape Systems
      • Using Network VLAN Tagging with Recovery Appliance
    • Registering Recovery Appliance in the Domain Name System
    • Factory IP Address Settings
    • Port Assignments When Using a Firewall
  • 4 Setting Up Auto Service Request
    • Understanding Auto Service Request
    • Getting Ready to Install ASR
    • Installing ASR Manager
    • Verifying the ASR Manager Installation
    • About the Trap Destinations on Recovery Appliance
    • Troubleshooting ASR
  • 5 Using the Deployment Assistant
    • Overview of the Deployment Assistant
    • Generating the Configuration Files
    • About the Configuration Files
    • Customer Details Page
    • Hardware Selection Page
    • Define Customer Networks Page
      • Network Configuration Choices
      • Cabling Considerations
    • Administration Network Page
      • Modifying the Administration Host Name Format
    • Ingest Network Page
      • Modifying the Ingest Name Format
    • InfiniBand Network Configuration Page
      • Modifying the InfiniBand Host Name Format
    • Replication Network Page
      • Modifying the Replication Host Name Format
    • Identify Compute Node OS Page
    • Review and Edit Page
    • Define Clusters Page
    • Cluster Page
      • Cluster
      • Users and Groups
      • Software Locations
      • Disk Group Details
      • Initial Database
      • Ingest Network
      • Replication Network
    • Review and Edit Page
    • Replication Network SCAN Page
    • Cell Alerting Page
    • Platinum Configuration Page
      • Customer Details
      • Platinum Gateway Details
      • Platinum Agent Configuration Details
    • Oracle Configuration Manager Page
    • Auto Service Request Page
    • Grid Control Agent Page
    • Tape Library Connectivity Page
    • Comments Page
    • Generate Page
    • Finish Page
• Part II Installation and Configuration
  • 6 Installing the Recovery Appliance at the Site
    • Reviewing Safety Guidelines
    • Unpacking ZDLRA Rack
      • Contents of the Shipping Kit
      • Removing ZDLRA Rack from the Shipping Crate
    • Placing ZDLRA Rack in Its Allocated Space
      • Moving ZDLRA Rack
      • Stabilizing ZDLRA Rack
        • Stabilize ZDLRA Rack with Leveling Feet
        • Stabilize ZDLRA Rack X7 and Later with Leveling Feet
      • Attaching a Ground Cable (Optional)
    • Installing the Fiber Channel Adapters
    • Acclimating the Recovery Appliance
    • Powering on the System for the First Time
      • Inspecting Recovery Appliance After It Is in Place
      • Connecting Power Cords
      • Powering Up Recovery Appliance
  • 7 Expanding a Recovery Appliance Rack with Additional Storage Servers
    • Preparing to Extend Recovery Appliance
      • Estimating InfiniBand Cable Path Lengths
      • Obtaining the Current Configuration Information
      • Generating the Network Configuration Files
      • Moving the Audit and Diagnostic Files
      • Synchronizing Release and Patch Levels
    • Precautions and Guidelines
      • General Safety Precautions
      • InfiniBand Cable Precautions
      • InfiniBand Cable Bundling Guidelines
      • Cable Management Arm Guidelines
    • Adding Storage Servers to a Rack
      • Checking the Recovery Appliance Rack
      • Unpacking and Labeling the New Storage Servers
      • Recovery Appliance X7, X6, and X5 Population Rules
      • Removing the Doors
      • Adding New Servers
      • Cabling the Storage Servers
      • Closing the Rack
    • Making New Storage Available
  • 8 Extending Recovery Appliance with Multiple Racks
    • About Multirack Configurations
    • Extending a Rack by Adding Another Rack
    • Adding the Spine Switches
    • Floor and Underfloor Delivery of InfiniBand Cables
    • Cabling Two Racks Together
    • Cabling Several Racks Together
    • Configuring Multiple Racks
  • 9 Configuring Ingest Over InfiniBand
    • About Ingest Over InfiniBand
    • Cabling Recovery Appliance to Oracle Exadata Database Machine
    • Adding VIPs to the Recovery Appliance InfiniBand Network
    • Updating Recovery Appliance With the New VIPs for InfiniBand
    • Update the Database Initialization Parameters
  • 10 Configuring a Recovery Appliance Rack
    • Supporting Auto Service Request
      • Prerequisites for Using Auto Service Request
      • Checking an Existing ASR Manager Installation
      • Installing ASR Manager
    • Installing the Tape Hardware
    • Connecting Recovery Appliance to Your Networks
    • Configuring the InfiniBand Switches
      • Configuring an InfiniBand Switch
      • Setting the Time on an InfiniBand Switch
      • Setting the Serial Number on a Spine Switch
      • Checking the Health of an InfiniBand Switch
      • Setting a Spine Switch as the Subnet Manager Master
    • Configuring the Cisco Ethernet Switch
      • Scope of the Configuration
      • Prerequisites for Configuring the Ethernet Switch
      • Configuring the Ethernet Switch on the Data Center Network
      • Disabling Telnet Connections
      • Configuring SSH on the Ethernet Switch
      • Setting the Clock and Time Zone on the Ethernet Switch
      • Disabling Spanning Tree on the Ethernet Switch
      • Verifying the Ethernet Configuration
    • Configuring the Power Distribution Units
      • Assigning Network Addresses to the PDUs
      • Configuring the PDU System Time Settings
      • Upgrading the PDU Firmware
    • Checking the Health of the Compute Servers
    • Checking the Health of the Storage Servers
    • Verifying the InfiniBand Network
    • Configuring the IP Addresses of the Servers
  • 11 Installing the Recovery Appliance Software
    • About the Installation Software
    • Software Installation Prerequisites
      • About Adding a Rack to an Existing Rack
      • About Adding New Storage Servers to an Existing Rack
    • Reclaiming Disk Space on the Compute Servers
    • Installing the Software on Recovery Appliance
    • Install Utility Syntax
      • Install Utility Parameters
      • Install Utility Syntax Examples
      • About the Install Utility Steps
    • Setting Up Enterprise Manager to Administer Recovery Appliance
      • Deploying the Enterprise Manager Agents
      • Discovering the Cluster
      • Discovering the Cluster Database Targets
      • Discovering the Recovery Appliance
• Part III Maintenance of Recovery Appliance
  • 12 Maintaining the Recovery Appliance Hardware
    • Cautions and Warnings
    • Determining the Server Model
    • Powering On and Off a Recovery Appliance Rack
      • Emergency Power-Off Procedure
        • Powering Off in an Emergency
        • About the Emergency Power-Off Switch
      • Shutting Down Recovery Appliance
        • Stopping Recovery Appliance Services
        • Powering Down the Servers
        • Powering the Network Switches
      • Starting Up Recovery Appliance
        • Starting Up Recovery Appliance Components
        • Startup Sequence
        • Powering On Servers Remotely
        • Starting the Recovery Appliance Software
    • Replacing the Disk Controller Batteries
      • Monitoring Batteries in the Compute Servers
      • Replacing Batteries in Disk Controllers
    • Replacing a Power Distribution Unit
      • PDU Replacement Guidelines
      • Replacing a PDU
    • Resetting a Non-Responsive Oracle ILOM
      • Resetting Oracle ILOM Using SSH
      • Resetting Oracle ILOM Using the Remote Console
      • Resetting Oracle ILOM Using IPMItool
      • Resetting Oracle ILOM By Removing Power
    • Maintaining the Compute Servers
      • Verifying the RAID Status of a Compute Server
    • Reimaging a Compute Server
      • Contacting Oracle Support Services
      • Downloading the Latest Release of the Cluster Verification Utility
      • Removing the Failed Compute Server from the Cluster
      • Preparing the USB Flash Drive for Imaging
      • Copying the Image to the New Compute Server
      • Configuring the Replacement Compute Server
      • Preparing the Replacement Compute Server for the Cluster
      • Applying Patch Bundles to a Replacement Compute Server
      • Cloning the Oracle Grid Infrastructure
      • Clone Oracle Database Homes to the Replacement Compute Server
    • Maintaining the Storage Servers
      • Shutting Down a Storage Server
      • Enabling Network Connectivity Using the Diagnostics ISO
    • Maintaining the Physical Disks of Storage Servers
      • About System Disks and Data Disks
      • Monitoring the Status of Physical Disks
      • What Happens When Disk Errors Occur?
      • About Detecting Underperforming Disks
      • About Rebalancing the Data
      • Monitoring Hard Disk Controller Write-Through Cache Mode
      • Replacing a Failed Physical Disk
      • Replacing a Faulty Physical Disk
      • Removing an Underperforming Physical Disk
      • Moving All Drives from One Storage Server to Another
      • Removing and Replacing the Same Physical Disk
      • Reenabling a Rejected Physical Disk
    • Maintaining the Flash Disks of Storage Servers
      • About the Flash Disks
      • Faulty Status Indicators
      • Identifying Flash Disks in Poor Health
      • Identifying Underperforming Flash Disks
      • When Is It Safe to Replace a Faulty Flash Disk?
      • Replacing a Failed Flash Disk
      • Replacing a Faulty Flash Disk
      • Removing an Underperforming Flash Disk
      • About Write-Back Flash Cache
    • Replacing a Disk Controller Battery Backup Unit
      • Replacing a Disk Controller BBU on a Compute Server
      • Replacing a Disk Controller BBU on a Storage Server
    • Using the Storage Server Rescue Procedure
      • First Steps Before Rescuing the Storage Server
        • If the Server Has Normal Redundancy
        • If the Server Has High Redundancy
      • About the Rescue Procedure
      • Rescuing a Server Using the CELLBOOT USB Flash Drive
      • Reconfiguring the Rescued Storage Server
      • Recreating a Damaged CELLBOOT USB Flash Drive
  • 13 Reconfiguring the Hardware
    • Changing Component Passwords
      • Changing the Compute Server Passwords
        • Changing the User Account Password
        • Changing the GRUB Account Password
      • Changing the Storage Server Passwords
      • Creating New Users and Changing Passwords on a PDU
      • Changing the Oracle ILOM Password
      • Changing an InfiniBand Switch Password
      • Changing the Cisco Ethernet Switch Password
      • Changing the Recovery Appliance Database User Password
      • Changing OSB Tape Backup Passwords
    • Changing the DNS Servers
      • Changing the DNS Server Address on an InfiniBand Switch
      • Changing the DNS Server Address on the Cisco Ethernet Switch
      • Changing the DNS Server Address on the Compute Server
      • Changing the DNS Server on Storage Servers
    • Changing the NTP Servers
      • Setting the NTP Server Address on the Compute Servers
      • Setting the NTP Server Address on the InfiniBand Switches
      • Set the NTP Server Address on the Cisco Ethernet Switch
      • Setting the NTP Server on the Storage Servers
      • Restart Recovery Appliance
    • Changing the Time Zone Settings
      • Changing the Time Zone Settings on the Storage Servers
      • Change Time Zone Settings on the Compute Servers
      • Change the Time Zone Settings on the InfiniBand Switches
      • Change the Time Zone Settings on the Cisco Switch
• Part IV Appendixes
• A RACLI Overview
  • racli add
  • racli add acfs
  • racli add cloud_storage
  • racli add credential
  • racli add credential_wallet
  • racli add keystore
  • racli add nfs
  • racli add storage_cells
  • racli add storage_disks
  • racli add vpc_user
  • racli alter
  • racli alter cloud_storage
  • racli alter credential_wallet
  • racli alter keystore
  • racli alter passphrase
  • racli alter rasys_user
  • racli alter vpc_user
  • racli disable
  • racli disable check
  • racli disable cloud_storage
  • racli disable keystore
  • racli disable nfs
  • racli enable
  • racli enable acfs
  • racli enable check
  • racli enable cloud_storage
  • racli enable keystore
  • racli enable nfs
  • racli export
  • racli export appliance
  • racli help
  • racli install
  • racli install appliance
  • racli install okv_endpoint
  • racli list
  • racli list check
  • racli list cloud_storage
  • racli list compute_nodes
  • racli list nfs
  • racli list okv_endpoint
  • racli list storage_cells
  • racli patch
  • racli patch appliance
  • racli remove
  • racli remove acfs
  • racli remove cloud_storage
  • racli remove keystore
  • racli remove nfs
  • racli remove vpc_user
  • racli run
  • racli run check
  • racli start
  • racli start nfs
  • racli status
  • racli status appliance
  • racli status cloud_storage
  • racli status disk_group
  • racli status keystore
  • racli status nfs
  • racli status okv_endpoint
  • racli stop
  • racli stop nfs
  • racli uninstall
  • racli uninstall appliance
  • racli uninstall okv_endpoint
  • racli update
  • racli update storage_location
  • racli update support_tools
  • racli upgrade
  • racli upgrade appliance
  • racli version
• B Default User Accounts
• C Error Messages
  • Contacting Oracle Support Services
  • Generic Alert Messages: HALRT-00001 to HALRT-00500
  • Temperature Alert Messages: HALRT-00513 to HALRT-00600
  • Fan Alert Messages: HALRT-00616 to HALRT-00700
  • Power Supply/Converters Alert Messages: HALRT-00717 to HALRT-00800
  • Network Alert Messages: HALRT-00912 to HALRT-01000
  • Hard Disk and Flash Disk Alert Messages: HALRT-01015 to HALRT-01200
  • Accelerator/Controller Alert Messages: HALRT-01209 to HALRT-01300
  • Voltage Alert Messages: HALRT-01301 to HALRT-01400
  • Physical Disk Alert Messages: HALRT-01401 to HALRT-01500
  • Auto Service Request Alert Messages for Storage Servers: HALRT-02001 to HALRT-02013
  • HDD Controller Battery Alert Messages: HALRT-02101 to HALRT-02200
  • Generic Actions for Alert Messages: HALRT-10001 to HALRT-10500
  • Generic Actions for Alert Messages: HALRT-10503 to HALRT-11000
  • Generic Actions for Alert Messages: HALRT-11001 to HALRT-11100
• D Replacement Units
  • About Warranty Coverage
  • Understanding Repair Categories
  • LED Status Descriptions
    • Oracle Server LEDs
    • Sun Datacenter InfiniBand Switch 36 LEDs
  • Parts for Compute Servers
    • Oracle Server X7 Oracle Database Server Parts
    • Oracle Server X6-2 and X5-2 Parts
    • Sun Server X4-2 Parts
  • Parts for Storage Servers
    • Oracle Exadata Storage Server X7-2 High Capacity Server Parts
    • Oracle Server X6-2L and X5-2L Parts
    • Sun Server X4-2L Parts
  • Parts for InfiniBand Switches
  • Parts for Cisco Switch
  • Parts for Power Distribution Units
  • Cables and Cable Accessories for Recovery Appliance
• E In-Rack Cabling Tables for Recovery Appliance X8, X7, X6, and X5
  • Cable Color Coding
  • Recovery Appliance X8, X7, X6, and X5 Rack Layout
  • Oracle Integrated Lights Out Manager Cabling Connections
  • Administrative Gigabit Ethernet Cabling Connections
  • Single-Phase Power Distribution Unit Cabling Connections X8
  • Single-Phase Power Distribution Unit Cabling Connections X7 and Earlier
  • Three-Phase Power Distribution Unit Cabling Connections X8
  • Three-Phase Power Distribution Unit Cabling Connections
  • InfiniBand Switch-to-Switch Cabling Connections
  • InfiniBand Switch-to-Server Cabling Connections
• F In-Rack Cabling Tables for Recovery Appliance X4
  • Recovery Appliance X4 Rack Layout
  • Oracle Integrated Lights Out Manager Cabling Connections
  • Administrative Gigabit Ethernet Cabling Connections
  • Single-Phase Power Distribution Unit Cabling Connections
  • Three-Phase Power Distribution Unit Cabling Connections
  • InfiniBand Switch-to-Switch Cabling Connections
  • InfiniBand Switch-to-Server Cabling Connections
• G Multirack Cabling Tables
  • About Multirack Cabling
    • Cables Provided With a Spine Switch
    • Optical Cables Required for Four or More Racks
    • Cabling Three Switches Within a Rack
    • Cabling the Switches in Two Racks
    • Cabling the Switches in Up to Eight Racks
    • Cabling Switches in Up to 18 Racks
  • Key to Cabling Table Abbreviations
  • Two-Rack Cabling
  • Three-Rack Cabling
  • Four-Rack Cabling
  • Five-Rack Cabling
  • Six-Rack Cabling
  • Seven-Rack Cabling
  • Eight-Rack Cabling
  • Nine-Rack Cabling
  • 10-Rack Cabling
  • 11-Rack Cabling
  • 12-Rack Cabling
  • 13-Rack Cabling
  • 14-Rack Cabling
  • 15-Rack Cabling
  • 16-Rack Cabling
  • 17-Rack Cabling
  • 18-Rack Cabling
• Index