Skip Navigation Links
Oracle SuperCluster M6-32 HTML Owner’s Guide
Search Scope:
This Document
Entire Library
Oracle SuperCluster M6-32 HTML Owner’s Guide
September 2015
Browse the combined overview, installation, and administration documentation.
Document Information
Using This Documentation
Product Documentation Library
Feedback
Overview
Determining SuperCluster M6-32 Configurations
Configuration Flowchart
Determine the Number of Compute Servers
Determine the Number of DCUs in Each Compute Server
Determine the Number of CMUs in Each DCU
CMU Overview
Determine the Amount of Memory in Each DCU
Determine the PDomain Configuration on Each Compute Server
Determine the LDom Configuration for Each PDomain
Determining the Best Configuration for Your Situation
Understanding PDomain Configurations
Understanding High Redundancy
High Redundancy Flowchart
Number of Compute Servers
Type of Configuration PDomains
Allocating CPU Resources for LDoms
CPU Resources for LDoms Flowchart
Compute Server Level Considerations
LDom Level Considerations
Allocating Memory Resources for LDoms
Memory Resources for LDoms Flowchart
Compute Server Level Considerations
LDom Level Considerations
Understanding PCIe Cards and Slots for LDoms
PCIe Cards and Slots for LDoms Flowchart
Compute Server Level Considerations
LDom Level Considerations
Understanding Storage for LDoms
Storage for LDoms Flowchart
Compute Server Level Considerations
LDom Level Considerations
Understanding the Hardware
Understanding SuperCluster M6-32
SuperCluster M6-32 Overview
Spares Kit Components
Configuration Restrictions
Identifying SuperCluster M6-32 Components
Understanding the Compute Server
Compute Server Overview
Front Components
Rear Components
Storage Rack Overview
Understanding DCUs
DCU Overview
Understanding DCU Configurations
PCIe Device Root Complexes Overview
PCIe Communication and Paths Overview
Understanding DCU PCIe and EMS Slot Locations
DCU 0 PCIe and EMS Slot Locations
DCU 1 PCIe and EMS Slot Locations
DCU 2 PCIe and EMS Slot Locations
DCU 3 PCIe and EMS Slot Locations
Understanding Half-Populated DCU Root Complexes
Half-Populated DCU 0 PCIe Slot Root Complexes
Half-Populated DCU 1 PCIe Slot Root Complexes
Half-Populated DCU 2 PCIe Slot Root Complexes
Half-Populated DCU 3 PCIe Slot Root Complexes
Understanding Fully-Populated DCU Root Complexes
Fully-Populated DCU 0 PCIe Slot Root Complexes
Fully-Populated DCU 1 PCIe Slot Root Complexes
Fully-Populated DCU 2 PCIe Slot Root Complexes
Fully-Populated DCU 3 PCIe Slot Root Complexes
Understanding PDomains
PDomains Overview
PDomain Guidelines
Extended Configuration PDomain Overview
Understanding Extended Configuration PDomains
Understanding Four DCUs in One Compute Server (R1 Extended Configuration PDomains)
Four Fully-Populated DCUs (R1_1 PDomain Configuration)
Two Fully-Populated DCUs and Two Half-Populated DCUs (R1_2 PDomain Configuration)
Four Half-Populated DCUs (R1_3 PDomain Configuration)
Understanding Four DCUs Across Two Compute Servers (R2 Extended Configuration PDomains)
Four Fully-Populated DCUs (R2_1 PDomain Configuration)
Two Fully-Populated DCUs and Two Half-Populated DCUs (R2_2 PDomain Configuration)
Four Half-Populated DCUs (R2_3 PDomain Configuration)
Base Configuration Overview
Understanding Base Configuration PDomains
Understanding Four DCUs on One Compute Server (R3 Base Configuration PDomains)
Four Fully-Populated DCUs (R3_1 PDomain Configuration)
Two Fully-Populated DCUs and Two Half-Populated DCUs (R3_2 PDomain Configuration)
Four Half-Populated DCUs (R3_3 PDomain Configuration)
Understanding Four DCUs Across Two Compute Servers (R4 Base Configuration PDomains)
Four Fully-Populated DCUs (R4_1 PDomain Configuration)
Two Fully-Populated DCUs and Two Half-Populated DCUs (R4_2 PDomain Configuration)
Four Half-Populated DCUs (R4_3 PDomain Configuration)
Two Fully-Populated DCUs and Two Half-Populated DCUs (R4_4 PDomain Configuration)
Understanding Two DCUs on One Compute Server (R5 Base Configuration PDomains)
Two Fully-Populated DCUs (R5_1 PDomain Configuration)
Understanding Two DCUs Across Two Compute Servers (R6 Base Configuration PDomains)
Two Fully-Populated DCUs (R6_1 PDomain Configuration)
Understanding LDoms
Understanding Compute Server Hardware and Networks
CPU and Memory Resources Overview
LDoms and the PCIe Slots Overview
Management Network Overview
10GbE Client Access Network Overview
Understanding the IB Network
IB Network Overview
IB Network Data Paths for a Database Domain
IB Network Data Paths for an Application Domain
Understanding Domains
Dedicated Domains
Understanding SR-IOV Domain Types
Root Domains
I/O Domains
Understanding LDom Configurations for Extended Configuration PDomains
Understanding LDom Configurations for Fully-Populated DCUs (Extended Configuration PDomains)
LDom Configurations for Fully-Populated DCUs (Extended Configuration PDomains)
E4-1 LDom Configuration
E4-2 LDom Configuration
E4-3 LDom Configuration
E4-4 LDom Configuration
Understanding LDom Configurations for Half-Populated DCUs (Extended Configuration PDomains)
LDom Configurations for Half-Populated DCUs (Extended Configuration PDomains)
E2-1 LDom Configuration
E2-2 LDom Configuration
E2-3 LDom Configuration
E2-4 LDom Configuration
Understanding LDom Configurations for Base Configuration PDomains
Understanding LDom Configurations for Fully-Populated DCUs (Base Configuration PDomains)
LDom Configurations for Fully-Populated DCUs (Base Configuration PDomains)
B4-1 LDom Configuration
B4-2 LDom Configuration
B4-3 LDom Configuration
B4-4 LDom Configuration
Understanding LDom Configurations for Half-Populated DCUs (Base Configuration PDomains)
LDom Configurations for Half-Populated DCUs (Base Configuration PDomains)
B2-1 LDom Configuration
B2-2 LDom Configuration
B2-3 LDom Configuration
B2-4 LDom Configuration
Understanding Clustering Software
Cluster Software Overview
Cluster Software for the Database Domain
Cluster Software for the Oracle Solaris Application Domains
Understanding System Administration Resources
Oracle ILOM Overview
Understanding Platform-Specific Oracle ILOM Features
SPARC: Server-Specific and New Oracle ILOM Features and Requirements
Unsupported Oracle ILOM Features
Oracle Solaris OS Overview
OpenBoot Overview
Oracle ILOM Remote Console Plus Overview
Oracle Hardware Management Pack Overview
Time Synchronization and NTP Service
SNMP Service
Multidomain Extensions to Oracle ILOM MIBs
LDAP/SSL
Active Directory
Hardware Installation
Installing SuperCluster M6-32
Hardware Installation Overview
Weight Specifications
Hardware Installation Task Overview
Hardware Installation Documents
Preparing the Site (Storage Rack and Expansion Racks)
Prepare the Site for the Racks
Storage Rack Components
Physical Specifications
Reviewing Power Requirements
PDU Power Specifications
Facility Power Requirements
PDU Thresholds
Preparing for Cooling
Heat Dissipation Specifications
Airflow Requirements
Perforated Floor Tiles
Environmental Specifications
Preparing the Network
Network Topology
Network Infrastructure Requirements
Compute Server Default Host Names and IP Addresses
Install Cable Drops
Prepare DNS
Cabling SuperCluster M6-32
Compute Server Network Components
Storage Rack Network Components
Cable the ZFS Storage Appliance
ZFS Appliance Power Cord Connection Reference
ZFS Storage Appliance Cabling Reference
Cable IB Switches
Leaf Switch 1 Cabling Reference
Leaf Switch 2 Cabling Reference
IB Switch-to-Switch Cabling Reference
Cable the Ethernet Management Switch
Ethernet Management Switch Cabling Reference
Connect SuperCluster M6-32 to the Facility Networks
Connecting Expansion Racks
Expansion Rack Overview
Expansion Rack Components
Expansion Rack Layouts
Installing Expansion Racks
One Expansion Rack Cabling
Two Expansion Racks Cabling
Three Expansion Racks Cabling
Four Expansion Racks Cabling
Five Expansion Racks Cabling
Six Expansion Racks Cabling
Seven Expansion Racks Cabling
Expansion Rack Default IP Addresses
Understanding Internal Cabling (Expansion Rack)
Oracle ILOM Cabling
Administrative Gigabit Ethernet Port Cabling
Single-Phase PDU Cabling
Three-Phase PDU Cabling (Full Rack)
IB Network Cabling
Administration
Understanding SuperCluster Software
Identify the Version of SuperCluster Software
SuperCluster Tools
Controlling SuperCluster M6-32
Cautions
Power On SuperCluster M6-32
Powering Off SuperCluster M6-32 Gracefully
Shut Down the Oracle Solaris Cluster
Shut Down the Enterprise Controller (Ops Center)
Shut Down the Database
Shut Down the Storage Servers
Power Off the Storage Servers
Shut Down the LDoms
Shut Down the OS on the Compute Servers
Shut Down the ZFS Storage Appliance
Power Off the Switches and Racks
Power Off SuperCluster M6-32 in an Emergency
Monitoring SuperCluster M6-32 (OCM)
OCM Overview
Access OCM Documentation
Monitoring the System With ASR
ASR Overview
ASR Resources
ASR Installation Overview
Configure ASR on the Compute Servers (Oracle ILOM)
Configure SNMP Trap Destinations for Storage Servers
Configure ASR on the ZFS Storage Appliance
Configuring ASR on the Compute Servers (Oracle Solaris 11)
Enable the HTTP Receiver on the ASR Manager
Enable HTTPS on ASR Manager (Optional)
Register Compute Servers With Oracle Solaris 11 or Database Domains to ASR Manager
Approve and Verify ASR Asset Activation
Tuning SuperCluster M6-32
ssctuner
Overview
Monitor
ssctuner
Activity
View Log Files
Change
ssctuner
Properties and Disable Features
Install
ssctuner
Enable
ssctuner
Configuring CPU and Memory Resources (
osc-setcoremem
)
osc-setcoremem Overview
Minimum and Maximum Resources (Dedicated Domains)
Supported Domain Configurations
Plan CPU and Memory Allocations
Display the Current Domain Configuration (
osc-setcoremem
)
Display the Current Domain Configuration (
ldm
)
Change CPU/Memory Allocations (Socket Granularity)
Change CPU/Memory Allocations (Core Granularity)
Park Cores and Memory
Access
osc-setcoremem
Log Files
View the SP Configuration
Revert to a Previous CPU/Memory Configuration
Remove a CPU/Memory Configuration
Obtaining the EM Exadata Plug-in
Confirm System Requirements
Known Issues With the EM Exadata Plug-in
Configuring the Exalogic Software
Exalogic Software Overview
Prepare to Configure the Exalogic Software
Enable Domain-Level Enhancements
Enable Cluster-Level Session Replication Enhancements
Configuring Grid Link Data Source for
Dept1_Cluster1
Fast Connection Failover
Runtime Connection Load Balancing
XA Affinity
SCAN Addresses
Secure Communication With Oracle Wallet
Create a Grid Link Data Source on
Dept1_Cluster1
Configuring SDP-Enabled JDBC Drivers for
Dept1_Cluster1
Configure the Database to Support IB
Enable SDP Support for JDBC
Monitor SDP Sockets
Create an SDP Listener on the IB Network
Administering Oracle Solaris 11 Boot Environments
Advantages to Maintaining Multiple Boot Environments
Create a Boot Environment
Mount to a Different Build Environment
Reboot to the Original Boot Environment
Create a Snapshot of a Boot Environment
Remove Unwanted Boot Environments
Administering DISM
DISM Restrictions
Disable DISM
Administering Storage Servers
Monitor Write-through Caching Mode
Shut Down or Reboot a Storage Server
Drop a Storage Server
Glossary
Index
A
B
C
D
E
F
G
H
I
L
M
N
O
P
R
S
T
V
W