Go to main content
1/207
Contents
List of Examples
List of Figures
List of Tables
Title and Copyright Information
Preface
Audience
Revision History
Documentation Accessibility
Related Documents
Conventions
1
Learn About the Exalogic Machine
1.1
About Oracle Exalogic
1.1.1
Features of Exalogic
1.2
Hardware Components of Exalogic
1.2.1
PDUs in Exalogic
1.2.2
Spares Kit for Exalogic
1.2.3
Pre-cabling for Exalogic X4-2 and newer Machines
1.3
Exalogic Machine Rack Layout
1.4
Operational Procedures for Exalogic Machines
1.4.1
Non-emergency Power Procedure
1.4.1.1
Power On Sequence
1.4.1.2
Power Off Sequence
1.4.2
Emergency Power-off Considerations
1.4.2.1
Emergency Power-off Procedure
1.4.2.2
Emergency Power-off Switch
1.4.3
Cautions and Warnings
2
Site Requirements
2.1
Environmental Requirements
2.2
Space Requirements
2.2.1
Receiving and Unpacking Requirements
2.2.2
Maintenance Access Requirements
2.3
Flooring Requirements
2.4
Electrical Power Requirements
2.4.1
Facility Power Requirements
2.4.2
Circuit Breaker Requirements
2.4.3
Grounding Guidelines
2.5
Temperature and Humidity Requirements
2.6
Ventilation and Cooling Requirements
3
Install Planning and Procedure
3.1
Installation Overview
3.2
Prepare to Install an Exalogic Machine
3.2.1
Before You Begin
3.2.2
Exalogic Installation Safety Guidelines
3.2.3
Unpack the Exalogic Machine Rack
3.2.4
Tools for Installation
3.2.5
Prepare the Installation Site
3.2.6
Place the Exalogic Machine in Its Allocated Space
3.2.6.1
Move the Exalogic Machine
3.2.6.2
Stabilize the Exalogic Machine
3.2.6.3
Stabilize the Exalogic Machine with Leveling Feet
3.2.6.4
Stabilize the Exalogic Machine with Mounting Brackets
3.2.6.5
Attach a Ground Cable (Optional)
3.3
Power on the System the First Time
3.3.1
Inspect the Machine After It Is in Place
3.3.2
Connect the Power Cords
3.3.3
Power On the Exalogic Machine
3.4
Connect a Laptop to the Exalogic Machine
3.5
What Next?
4
Default IP Addresses and Ports
4.1
Exalogic Machine Full Rack
4.2
Exalogic Machine Half Rack
4.3
Exalogic Machine Quarter Rack
4.4
Exalogic Machine Eighth Rack
4.5
Default Port Assignments
5
Add the Exalogic Machine to Your Network
5.1
Default State of the Exalogic Machine Network Configuration
5.2
Verify the Factory Configuration
5.3
Prerequisites for Connecting Exalogic Machine to External Ethernet Network
5.4
Initial Network Configuration of Exalogic Machine
5.4.1
Configuring the Cisco Ethernet Switch
6
Understand Network Requirements and Configuration
6.1
Overview of Network Requirements
6.2
Naming Conventions
6.3
Important Notes for Oracle Solaris Users
6.4
Network Connection and IP Address Requirements
6.4.1
Network Connection Requirements
6.4.2
IP Address Requirements
6.5
Default InfiniBand Bonded IP Addresses
6.6
Introduction to Oracle Exalogic Network Configuration
6.6.1
InfiniBand Fabric
6.6.2
InfiniBand Switches
6.6.3
Default Bonded Interfaces
6.6.4
IPMP Overview for Oracle Solaris Users
6.6.4.1
IPMP Components
6.6.4.2
IPMP Groups
6.6.5
Connectivity Between Exalogic Compute Nodes
6.6.6
Connectivity Between Exalogic Machine and External LAN Through Sun Network QDR InfiniBand Gateway Switch
6.6.6.1
Ethernet Device Requirements
6.6.6.2
Network Interface Configuration for Compute Nodes
6.6.6.3
Transceiver and Cable Requirements
6.6.7
Additional InfiniBand Network Requirements and Specifications
6.7
Prepare to Reconfigure the Networking of Exalogic Machine
6.8
Subnet Manager Requirements for Connecting Exalogic to Exadata
6.9
Network Configuration Worksheets
6.9.1
General Network Configuration Worksheet (Required)
6.9.2
Management Network Configuration Worksheet (Required)
6.9.3
Client Access Network Configuration Worksheet (Required)
6.9.4
Private InfiniBand Network Configuration Worksheet (Required)
7
Set Up ILOM on the Compute Nodes
7.1
ILOM Overview
7.1.1
ILOM Interfaces
7.2
Important Notes Before You Begin
7.3
Management Network Diagram for Exalogic Machine
7.4
ILOM IP Addresses for Exalogic Machine Components
7.5
Connect to ILOM via the Network
7.5.1
Connect to the CLI
7.5.2
Connect to the Web GUI
7.5.3
Launch a Remote KVM Session
7.6
Connect to ILOM via a Serial Connection
7.6.1
Connect to the ILOM of a Compute Node
7.6.2
Connect to the ILOM of a Sun Network QDR InfiniBand Gateway Switch
7.7
Reconfigure the Network Access
7.7.1
Reconfigure the Network Access Using a Serial Connection
7.7.2
Reconfigure the Network Access Using the Ethernet Connection
7.7.3
Use the Ipmitool Commands when SP Network Information is Lost
7.7.4
Configure ILOM IP Addresses Manually
7.8
What Next?
8
Configure the Storage Appliance
8.1
Prerequisites
8.2
Getting Started
8.3
Storage Appliance Overview
8.3.1
Introduction to Projects
8.3.2
Introduction to Shares
8.4
Configuration Overview
8.4.1
Initial Configuration
8.4.2
Connect Storage Heads to the Management Network and Accessing the Web Interface
8.4.3
Cluster Network Configuration
8.4.4
Network Configuration Options
8.4.4.1
Configure Option 1: ASR Support and Separate Paths for Management and Disaster Recovery
8.4.4.2
Configure Option 2: ASR Support and Shared Path for Management and Disaster Recovery, with Single Management URL
8.4.4.3
Configure Option 3: ASR Support and No Disaster Recovery, But with Single Management URL
8.4.5
Default Storage Configuration
8.4.6
Custom Configuration
8.5
Create Custom Projects
8.6
Create Custom Shares
8.7
Use the Phone Home Service to Manage the Storage Appliance
8.7.1
Register Your Storage Appliance
9
Configure NFS Version 4 on Exalogic
9.1
Overview
9.1.1
NFSv3
9.1.2
NFSv4
9.1.3
Naming Service
9.2
Verify the NIS Setting on Exalogic
9.3
Configure the Storage Appliance
9.3.1
Configure the NFS Service
9.3.2
Configure the NIS Service
9.4
Configure an Exalogic Linux Compute Node to Use NFSv4
9.5
Create NFSv4 Mount Points on Oracle Linux
10
Configure Ethernet Over InfiniBand
10.1
Introduction to Virtual NICs (VNICs)
10.1.1
VNIC Resource Limit
10.2
Set Up Ethernet Over InfiniBand (EoIB) on Oracle Linux
10.3
Set Up Ethernet Over InfiniBand (EoIB) on Oracle Solaris
10.3.1
Set Up Ethernet Over InfiniBand on Oracle Solaris 11.1
10.3.2
Set Up Ethernet Over InfiniBand on Oracle Solaris 11.2
11
Set Up Virtual LANs
11.1
Introduction to VLAN
11.2
Example Scenario
11.3
Tag the Ethernet Connectors With a VLAN Identifier
11.4
Oracle Linux: Creating VNICs and Associating Them with VLANs
11.5
Oracle Solaris: Creating VNICs and Associating Them with VLANs
12
Use the InfiniBand Gateway Switches
12.1
Using Sun Network QDR InfiniBand Gateway Switches
12.1.1
Physical Specifications
12.1.2
Access the Command-Line Interface (CLI) of a Gateway Switch
12.1.3
Verify the Status of a Gateway Switch
12.1.4
Start the Subnet Manager Manually
12.1.5
Check Link Status
12.1.6
Verify the InfiniBand Fabric
12.1.6.1
Discover the InfiniBand Network Topology
12.1.6.2
Perform Diagnostics on the InfiniBand Fabric
12.1.6.3
Validate and Check Errors in the InfiniBand Fabric
12.1.7
Monitor a Gateway Switch Using Web Interface
12.2
What Next?
13
Manage the InfiniBand Network Using Subnet Manager
13.1
Understand Administrative Commands
13.1.1
Hardware Command Overview
13.1.2
InfiniBand Command Overview
13.2
Manage InfiniBand Network Using Subnet Manager
13.2.1
Overview of Subnet Manager
13.2.2
Subnet Manager Operation in Different Rack Configurations
13.2.2.1
Run the SM in Configurations with Varying Switch Firmware Versions
13.2.3
Monitor the Subnet Manager
13.2.3.1
Display the Subnet Manager Status
13.2.3.2
Display Recent Subnet Manager Activity
13.2.4
Control the Subnet Manager
13.2.4.1
Identify the Location of Master Subnet Manager
13.2.4.2
Relocate the Master Subnet Manager
13.2.4.3
Enable Subnet Manager on a Switch
13.2.4.4
Disable Subnet Manager on a Switch
13.3
Work with the Default Rack-Level InfiniBand Partition
13.3.1
Partition in Exalogic Machine
13.3.2
Verify the Default Partition
14
Use the Sun Datacenter InfiniBand Switch 36 in Multirack Configurations
14.1
Physical Specifications
14.2
Access the CLI of a Sun Datacenter InfiniBand Switch 36
14.3
Verify the Switch Status
14.4
Start the Subnet Manager in Multirack Configuration Scenarios
14.5
Check Link Status
14.6
Verify the InfiniBand Fabric in a Multirack Configuration
14.6.1
Discover the InfiniBand Network Topology in a Multirack Configuration
14.6.2
Perform Diagnostics on the InfiniBand Fabric in a Multirack Configuration
14.6.3
Check for Errors in the InfiniBand Fabric in a Multirack Configuration
14.7
Monitor the Spine Switch Using Web Interface
14.8
What Next?
15
Monitor and Control the InfiniBand Fabric
15.1
Monitor the InfiniBand Fabric
15.1.1
Identify All Switches in the Fabric
15.1.2
Identify All HCAs in the Fabric
15.1.3
Display the InfiniBand Fabric Topology
15.1.4
Display a Route Through the Fabric
15.1.5
Display the Link Status of a Node
15.1.6
Display Counters for a Node
15.1.7
Display Data Counters for a Node
15.1.8
Display Low-Level Detailed Information for a Node
15.1.9
Display Low-Level Detailed Information for a Port
15.1.10
Map LIDs to GUIDs
15.1.11
Perform Comprehensive Diagnostics for the Entire Fabric
15.1.12
Perform Comprehensive Diagnostics for a Route
15.1.13
Determine Changes to the InfiniBand Topology
15.1.14
Determine Which Links Are Experiencing Significant Errors
15.1.15
Check All Ports
15.2
Control the InfiniBand Fabric
15.2.1
Clear Error Counters
15.2.2
Clear Data Counters
15.2.3
Reset a Port
15.2.4
Set Port Speed
15.2.5
Disable a Port
15.2.6
Enable a Port
15.3
For More Information
16
Use InfiniBand Partitions in Exalogic Physical Environments
16.1
Overview of Partitioning
16.2
Understand Partition Keys
16.2.1
Guidelines for Managing pkey Allocation in a Hybrid Rack
16.3
Before You Begin
16.3.1
Verify the Firmware of InfiniBand Switch
16.3.2
Gather Port GUIDs of Compute Nodes and BridgeX Ports of Gateway Switches
16.3.2.1
Identify BridgeX Ports on Gateway Switches
16.3.3
Identify All InfiniBand Switches in the Fabric
16.3.4
Determine the SM Priority on an InfiniBand Switch
16.3.5
Log In to the InfiniBand Switch That Runs Master SM
16.4
Move from a Default Partition to a Custom Partition
16.5
Create an IPoIB Partition and Adding Ports
16.6
Delete a Partition
16.7
Create a Partition for EoIB and Associating the pkey with a VNIC and VLAN
16.8
Perform the Post-Configuration Steps
16.9
Important Notes for Combined Exalogic-Exadata Fabric Users
16.10
Partitioning Limitations
17
Monitoring the Exalogic Machine Using Oracle Enterprise Manager Ops Center
17.1
Overview
17.2
Key Features
17.3
Prerequisites
17.4
Accessing Oracle Enterprise Manager Ops Center Documentation
17.5
Launching Oracle Enterprise Manager Ops Center
17.6
Understanding the Workflow
17.7
Managing Users and Roles
17.8
Discovering and Managing Exalogic Machine Hardware
17.9
Grouping Exalogic Machine Hardware Assets
17.9.1
Prerequisites
17.9.2
Creating the Exalogic Top-Level Group
17.9.3
Creating a Sub-Group for Exalogic Compute Nodes
17.9.4
Creating a Sub-Group for the Storage Appliance
17.9.5
Creating a Sub-Group for InfiniBand Switches
17.9.6
Adding Assets to a Group
17.10
Viewing Exalogic Compute Nodes
17.11
Viewing InfiniBand Switches
17.12
Viewing the Storage Appliance
17.13
Viewing the InfiniBand Fabric and Its Nodes
17.14
About Problem Management
17.15
Using Monitoring Profiles and Rules
17.15.1
Creating a Monitoring Profile
17.15.2
Adding a Monitoring Rule from the Asset View
17.16
Using Reports in Oracle Enterprise Manager Ops Center
17.17
Using Oracle Services in Oracle Enterprise Manager Ops Center
17.17.1
Prerequisites for Using Oracle Services in Oracle Enterprise Manager Ops Center
17.17.2
Viewing Service Requests
17.17.3
Filing a Service Request
18
Install the ASR Software
18.1
About Oracle Auto Service Request (ASR)
18.2
Recommended Configuration
18.3
Before You Begin
18.4
Prerequisites for Installing ASR Manager
18.5
Install ASR Manager on a Standalone System
18.5.1
Install Service Tags for Oracle Linux
18.5.2
Install SASM Package
18.5.3
Install ASR Package
18.6
Register the ASR Manager
18.7
Activate ILOM for Exalogic Compute Nodes
18.8
Activate the Storage Appliance
18.9
Approve and Verify ASR Activation for Exalogic Machine Assets
18.9.1
Approve Exalogic Machine Assets in My Oracle Support
18.9.2
View and Verify ASR Assets
A
Configure the Exalogic Machine Using ECU
A.1
Overview
A.2
Important Notes Before You use the ECU
A.3
Configuration Tasks
B
Site Checklists
B.1
System Components Checklist
B.2
Data Center Room Checklist
B.3
Data Center Environment Checklist
B.4
Access Route Checklist
B.5
Facility Power Checklist
B.6
Power Checklist
B.7
Safety Checklist
B.8
Logistics Checklist
B.9
Network Specification Checklist
B.10
Reracking Checklists
B.10.1
Rack Recycling
C
Cabling Diagrams
C.1
Exalogic Eighth Rack
C.2
Exalogic Quarter Rack
C.3
Exalogic Half Rack
C.4
Exalogic Full Rack
D
Replacement Units
D.1
Rack-Level FRUs for Exalogic X5-2
D.2
Rack-Level FRUs for Exalogic X4-2
D.3
Rack-Level FRUs for Exalogic X2-2 and X3-2
D.4
Parts for ZS3-ES Storage Appliance for Exalogic X5-2
D.5
Parts for ZS3-ES Storage Appliance for Exalogic X4-2
D.6
Parts for Sun ZFS Storage 7320 Appliance
D.7
Parts for Oracle Server X5-2 Compute Nodes
D.8
Parts for Sun Server X4-2 Compute Nodes
D.9
Parts for Sun Server X3-2 Compute Nodes
D.10
Parts for X4170 M2 Compute Nodes
D.11
Parts for Sun Network QDR InfiniBand Gateway Switch for Exalogic X5-2
D.12
Parts for Sun Network QDR InfiniBand Gateway Switch for Exalogic X4-2
D.13
Parts for Sun Network QDR InfiniBand Gateway Switch for Exalogic X2-2 and X3-2
D.14
Parts for Sun Datacenter InfiniBand Switch 36 for Exalogic X5-2
D.15
Parts for Sun Datacenter InfiniBand Switch 36 for Exalogic X4-2
D.16
Parts for Sun Datacenter InfiniBand Switch 36 for Exalogic X2-2 and X3-2
D.17
Parts for the Cisco Catalyst 4948E-F-S Switch
D.18
Parts for the Cisco Catalyst 4948 Switch
D.19
Parts for the Gari DE2-24C Disk Enclosure for Exalogic X5-2
D.20
Parts for the Gari DE2-24C Disk Enclosure
E
Cabling Tables
E.1
Administrative Gigabit Ethernet Network-Cabling Tables
E.2
InfiniBand Network Cabling Tables
E.2.1
Exalogic Machine Full Rack
E.2.2
Exalogic Machine Half Rack
E.2.3
Exalogic Machine Quarter Rack
E.2.4
Exalogic Machine Eighth Rack
E.3
Power Distribution Unit Cabling Tables
E.3.1
Single Phase PDU Power Cabling Half Rack
E.3.2
Single Phase PDU Power Cabling Quarter Rack
E.3.3
Single Phase PDU Power Cabling Eighth Rack
E.3.4
Three Phase PDU Power Cabling Full Rack
E.3.5
Three Phase PDU Power Cabling Half Rack
E.3.6
Three Phase PDU Power Cabling Quarter Rack
E.3.7
Three Phase PDU Power Cabling Eighth Rack
F
Manage Solaris Zones on Exalogic
F.1
Requirements
F.2
Terminology
F.3
Create a Solaris Zone
F.3.1
Prerequisites
F.3.1.1
Create an iSCSI Target
F.3.1.2
Create an iSCSI Initiator
F.3.1.3
Create the Project and LUN
F.3.1.4
Disable the Write Cache
F.3.1.5
Format the LUN
F.3.1.6
Set Up the Exclusive 10 GbE Network for the Zone
F.3.2
Set Up a Solaris Zone
F.3.2.1
Create a Zone
F.3.2.2
Install and Boot Up the Zone
F.4
Migrate a Zone to a New Host
G
Customize Linux on the Compute Nodes
G.1
RPMs That Must Not Be Modified or Removed
G.2
Prepare the Compute Nodes for Yum Updates
G.3
Install, Update, and Remove RPMs Using Yum
Scripting on this page enhances content navigation, but does not change the content in any way.