JavaScript is required to for searching.
Skip Navigation Links
Exit Print View
Oracle SuperCluster M6-32 HTML Owner’s Guide
search filter icon
search icon

Document Information

Using This Documentation

Product Documentation Library

Feedback

Overview

Determining SuperCluster M6-32 Configurations

Configuration Flowchart

Determine the Number of Compute Servers

Determine the Number of DCUs in Each Compute Server

Determine the Number of CMUs in Each DCU

CMU Overview

Determine the Amount of Memory in Each DCU

Determine the PDomain Configuration on Each Compute Server

Determine the LDom Configuration for Each PDomain

Determining the Best Configuration for Your Situation

Understanding PDomain Configurations

Understanding High Redundancy

Allocating CPU Resources for LDoms

Allocating Memory Resources for LDoms

Understanding PCIe Cards and Slots for LDoms

Understanding Storage for LDoms

Understanding the Hardware

Understanding SuperCluster M6-32

Identifying SuperCluster M6-32 Components

Understanding DCUs

DCU Overview

Understanding DCU Configurations

Understanding Half-Populated DCU Root Complexes

Understanding Fully-Populated DCU Root Complexes

Understanding PDomains

PDomains Overview

PDomain Guidelines

Extended Configuration PDomain Overview

Understanding Extended Configuration PDomains

Base Configuration Overview

Understanding Base Configuration PDomains

Understanding LDoms

Understanding Compute Server Hardware and Networks

Understanding Domains

Understanding LDom Configurations for Extended Configuration PDomains

Understanding LDom Configurations for Base Configuration PDomains

Understanding Clustering Software

Cluster Software Overview

Cluster Software for the Database Domain

Cluster Software for the Oracle Solaris Application Domains

Understanding System Administration Resources

Oracle ILOM Overview

Understanding Platform-Specific Oracle ILOM Features

Oracle Solaris OS Overview

OpenBoot Overview

Oracle ILOM Remote Console Plus Overview

Oracle Hardware Management Pack Overview

Time Synchronization and NTP Service

SNMP Service

Multidomain Extensions to Oracle ILOM MIBs

LDAP/SSL

Active Directory

Hardware Installation

Installing SuperCluster M6-32

Hardware Installation Overview

Weight Specifications

Hardware Installation Task Overview

Hardware Installation Documents

Preparing the Site (Storage Rack and Expansion Racks)

Prepare the Site for the Racks

Storage Rack Components

Physical Specifications

Reviewing Power Requirements

Preparing for Cooling

Preparing the Network

Network Topology

Network Infrastructure Requirements

Compute Server Default Host Names and IP Addresses

Install Cable Drops

Prepare DNS

Cabling SuperCluster M6-32

Compute Server Network Components

Storage Rack Network Components

Cable the ZFS Storage Appliance

ZFS Appliance Power Cord Connection Reference

ZFS Storage Appliance Cabling Reference

Cable IB Switches

Leaf Switch 1 Cabling Reference

Leaf Switch 2 Cabling Reference

IB Switch-to-Switch Cabling Reference

Cable the Ethernet Management Switch

Ethernet Management Switch Cabling Reference

Connect SuperCluster M6-32 to the Facility Networks

Connecting Expansion Racks

Expansion Rack Overview

Expansion Rack Components

Expansion Rack Layouts

Installing Expansion Racks

One Expansion Rack Cabling

Two Expansion Racks Cabling

Three Expansion Racks Cabling

Four Expansion Racks Cabling

Five Expansion Racks Cabling

Six Expansion Racks Cabling

Seven Expansion Racks Cabling

Expansion Rack Default IP Addresses

Understanding Internal Cabling (Expansion Rack)

Oracle ILOM Cabling

Administrative Gigabit Ethernet Port Cabling

Single-Phase PDU Cabling

Three-Phase PDU Cabling (Full Rack)

IB Network Cabling

Administration

Understanding SuperCluster Software

Identify the Version of SuperCluster Software

SuperCluster Tools

Controlling SuperCluster M6-32

Cautions

Power On SuperCluster M6-32

Powering Off SuperCluster M6-32 Gracefully

Power Off SuperCluster M6-32 in an Emergency

Monitoring SuperCluster M6-32 (OCM)

OCM Overview

Access OCM Documentation

Monitoring the System With ASR

ASR Overview

ASR Resources

ASR Installation Overview

Configure ASR on the Compute Servers (Oracle ILOM)

Configure SNMP Trap Destinations for Storage Servers

Configure ASR on the ZFS Storage Appliance

Configuring ASR on the Compute Servers (Oracle Solaris 11)

Approve and Verify ASR Asset Activation

Tuning SuperCluster M6-32

ssctuner Overview

Monitor ssctuner Activity

View Log Files

Change ssctuner Properties and Disable Features

Install ssctuner

Enable ssctuner

Configuring CPU and Memory Resources (osc-setcoremem)

osc-setcoremem Overview

Minimum and Maximum Resources (Dedicated Domains)

Supported Domain Configurations

Plan CPU and Memory Allocations

Display the Current Domain Configuration (osc-setcoremem)

Display the Current Domain Configuration (ldm)

Change CPU/Memory Allocations (Socket Granularity)

Change CPU/Memory Allocations (Core Granularity)

Park Cores and Memory

Access osc-setcoremem Log Files

View the SP Configuration

Revert to a Previous CPU/Memory Configuration

Remove a CPU/Memory Configuration

Obtaining the EM Exadata Plug-in

Confirm System Requirements

Known Issues With the EM Exadata Plug-in

Configuring the Exalogic Software

Exalogic Software Overview

Prepare to Configure the Exalogic Software

Enable Domain-Level Enhancements

Enable Cluster-Level Session Replication Enhancements

Configuring Grid Link Data Source for Dept1_Cluster1

Configuring SDP-Enabled JDBC Drivers for Dept1_Cluster1

Create an SDP Listener on the IB Network

Administering Oracle Solaris 11 Boot Environments

Advantages to Maintaining Multiple Boot Environments

Create a Boot Environment

Mount to a Different Build Environment

Reboot to the Original Boot Environment

Create a Snapshot of a Boot Environment

Remove Unwanted Boot Environments

Administering DISM

DISM Restrictions

Disable DISM

Administering Storage Servers

Monitor Write-through Caching Mode

Shut Down or Reboot a Storage Server

Drop a Storage Server

Glossary

Index

Three Expansion Racks Cabling

These abbreviations are used in the tables:

Table 53 IB Switch Connections for the Storage Rack When Adding Three Expansion Racks

Leaf Switch
Connection
Cable Length
SR-U22 within SR
SR-U22-P8A to SR-U1-P3A

SR-U22-P8B to SR-U1-P4A

3 m
SR-U22 to R1
SR-U22-P9A to R1-U1-P5A

SR-U22-P9B to R1-U1-P6A

5 m
SR-U22 to R2
SR-U22-P10A to R2-U1-P7A

SR-U22-P10B to R2-U1-P8A

5 m
SR-U22 to R3
SR-U22-P11A to R3-U1-P9A

SR-U22-P11B to R3-U1-P10A

10 m
SR-U20 within SR
SR-U20-P8A to SR-U1-P3B

SR-U20-P8B to SR-U1-P4B

5 m
SR-U20 to R1
SR-U20-P9A to R1-U1-P5B

SR-U20-P9B to R1-U1-P6B

5 m
SR-U20 to R2
SR-U20-P10A to R2-U1-P7B

SR-U20-P10B to R2-U1-P8B

5 m
SR-U20 to R3
SR-U20-P11A to R3-U1-P9B

SR-U20-P11B to R3-U1-P10B

10 m

Table 54 IB Switch Connections for the First Expansion Rack of Three

Leaf Switch
Connection
Cable Length
R1-U22 within R1
R1-U22-P8A to R1-U1-P3A

R1-U22-P8B to R1-U1-P4A

3 m
R1-U22 to SR
R1-U22-P11A to SR-U1-P9A

R1-U22-P11B to SR-U1-P10A

5 m
R1-U22 to R2
R1-U22-P9A to R2-U1-P5A

R1-U22-P9B to R2-U1-P6A

5 m
R1-U22 to R3
R1-U22-P10A to R3-U1-P7A

R1-U22-P10B to R3-U1-P8A

5 m
R1-U20 within R1
R1-U20-P8A to R1-U1-P3B

R1-U20-P8B to R1-U1-P4B

5 m
R1-U20 to SR
R1-U20-P11A to SR-U1-P9B

R1-U20-P11B to SR-U1-P10B

5 m
R1-U20 to R2
R1-U20-P9A to R2-U1-P5B

R1-U20-P9B to R2-U1-P6B

5 m
R1-U20 to R3
R1-U20-P10A to R3-U1-P7B

R1-U20-P10B to R3-U1-P8B

5 m

Table 55 IB Switch Connections for the Second Expansion Rack of Three

Leaf Switch
Connection
Cable Length
R2-U22 within R2
R2-U22-P8A to R2-U1-P3A

R2-U22-P8B to R2-U1-P4A

3 m
R2-U22 to SR
R2-U22-P10A to SR-U1-P7A

R2-U22-P10B to SR-U1-P8A

5 m
R2-U22 to R1
R2-U22-P11A to R1-U1-P9A

R2-U22-P11B to R1-U1-P10A

5 m
R2-U22 to R3
R2-U22-P9A to R3-U1-P5A

R2-U22-P9B to R3-U1-P6A

5 m
R2-U20 within R2
R2-U20-P8A to R2-U1-P3B

R2-U20-P8B to R2-U1-P4B

5 m
R2-U20 to SR
R2-U20-P10A to SR-U1-P7B

R2-U20-P10B to SR-U1-P8B

5 m
R2-U20 to R1
R2-U20-P11A to R1-U1-P9B

R2-U20-P11B to R1-U1-P10B

5 m
R2-U20 to R3
R2-U20-P9A to R3-U1-P5B

R2-U20-P9B to R3-U1-P6B

5 m

Table 56 IB Switch Connections for the Third Expansion Rack of Three

Leaf Switch
Connection
Cable Length
R3-U22 within R3
R3-U22-P8A to R3-U1-P3A

R3-U22-P8B to R3-U1-P4A

3 m
R3-U22 to SR
R3-U22-P9A to SR-U1-P5A

R3-U22-P9B to SR-U1-P6A

10 m
R3-U22 to R1
R3-U22-P10A to R1-U1-P7A

R3-U22-P10B to R1-U1-P8A

5 m
R3-U22 to R2
R3-U22-P11A to R2-U1-P9A

R3-U22-P11B to R2-U1-P10A

5 m
R3-U20 within R3
R3-U20-P8A to R3-U1-P3B

R3-U20-P8B to R3-U1-P4B

5 m
R3-U20 to SR
R3-U20-P9A to SR-U1-P5B

R3-U20-P9B to SR-U1-P6B

10 m
R3-U20 to R1
R3-U20-P10A to R1-U1-P7B

R3-U20-P10B to R1-U1-P8B

5 m
R3-U20 to R2
R3-U20-P11A to R2-U1-P9B

R3-U20-P11B to R2-U1-P10B

5 m
Related Information