JavaScript is required to for searching.
Skip Navigation Links
Exit Print View
Oracle SuperCluster M6-32 HTML Owner’s Guide
Oracle Technology Network
Library
PDF
Print View
Feedback
search filter icon
search icon

Document Information

Using This Documentation

Product Documentation Library

Feedback

Overview

Determining SuperCluster M6-32 Configurations

Configuration Flowchart

Determine the Number of Compute Servers

Determine the Number of DCUs in Each Compute Server

Determine the Number of CMUs in Each DCU

CMU Overview

Determine the Amount of Memory in Each DCU

Determine the PDomain Configuration on Each Compute Server

Determine the LDom Configuration for Each PDomain

Determining the Best Configuration for Your Situation

Understanding PDomain Configurations

Understanding High Redundancy

Allocating CPU Resources for LDoms

Allocating Memory Resources for LDoms

Understanding PCIe Cards and Slots for LDoms

Understanding Storage for LDoms

Understanding the Hardware

Understanding SuperCluster M6-32

Identifying SuperCluster M6-32 Components

Understanding DCUs

DCU Overview

Understanding DCU Configurations

Understanding Half-Populated DCU Root Complexes

Understanding Fully-Populated DCU Root Complexes

Understanding PDomains

PDomains Overview

PDomain Guidelines

Extended Configuration PDomain Overview

Understanding Extended Configuration PDomains

Base Configuration Overview

Understanding Base Configuration PDomains

Understanding LDoms

Understanding Compute Server Hardware and Networks

Understanding Domains

Understanding LDom Configurations for Extended Configuration PDomains

Understanding LDom Configurations for Base Configuration PDomains

Understanding Clustering Software

Cluster Software Overview

Cluster Software for the Database Domain

Cluster Software for the Oracle Solaris Application Domains

Understanding System Administration Resources

Oracle ILOM Overview

Understanding Platform-Specific Oracle ILOM Features

Oracle Solaris OS Overview

OpenBoot Overview

Oracle ILOM Remote Console Plus Overview

Oracle Hardware Management Pack Overview

Time Synchronization and NTP Service

SNMP Service

Multidomain Extensions to Oracle ILOM MIBs

LDAP/SSL

Active Directory

Hardware Installation

Installing SuperCluster M6-32

Hardware Installation Overview

Weight Specifications

Hardware Installation Task Overview

Hardware Installation Documents

Preparing the Site (Storage Rack and Expansion Racks)

Prepare the Site for the Racks

Storage Rack Components

Physical Specifications

Reviewing Power Requirements

Preparing for Cooling

Preparing the Network

Network Topology

Network Infrastructure Requirements

Compute Server Default Host Names and IP Addresses

Install Cable Drops

Prepare DNS

Cabling SuperCluster M6-32

Compute Server Network Components

Storage Rack Network Components

Cable the ZFS Storage Appliance

ZFS Appliance Power Cord Connection Reference

ZFS Storage Appliance Cabling Reference

Cable IB Switches

Leaf Switch 1 Cabling Reference

Leaf Switch 2 Cabling Reference

IB Switch-to-Switch Cabling Reference

Cable the Ethernet Management Switch

Ethernet Management Switch Cabling Reference

Connect SuperCluster M6-32 to the Facility Networks

Connecting Expansion Racks

Expansion Rack Overview

Expansion Rack Components

Expansion Rack Layouts

Installing Expansion Racks

One Expansion Rack Cabling

Two Expansion Racks Cabling

Three Expansion Racks Cabling

Four Expansion Racks Cabling

Five Expansion Racks Cabling

Six Expansion Racks Cabling

Seven Expansion Racks Cabling

Expansion Rack Default IP Addresses

Understanding Internal Cabling (Expansion Rack)

Administration

Understanding SuperCluster Software

Identify the Version of SuperCluster Software

SuperCluster Tools

Controlling SuperCluster M6-32

Cautions

Power On SuperCluster M6-32

Powering Off SuperCluster M6-32 Gracefully

Power Off SuperCluster M6-32 in an Emergency

Monitoring SuperCluster M6-32 (OCM)

OCM Overview

Access OCM Documentation

Monitoring the System With ASR

ASR Overview

ASR Resources

ASR Installation Overview

Configure ASR on the Compute Servers (Oracle ILOM)

Configure SNMP Trap Destinations for Storage Servers

Configure ASR on the ZFS Storage Appliance

Configuring ASR on the Compute Servers (Oracle Solaris 11)

Approve and Verify ASR Asset Activation

Tuning SuperCluster M6-32

ssctuner Overview

Monitor ssctuner Activity

View Log Files

Change ssctuner Properties and Disable Features

Install ssctuner

Enable ssctuner

Configuring CPU and Memory Resources (osc-setcoremem)

osc-setcoremem Overview

Minimum and Maximum Resources (Dedicated Domains)

Supported Domain Configurations

Plan CPU and Memory Allocations

Display the Current Domain Configuration (osc-setcoremem)

Display the Current Domain Configuration (ldm)

Change CPU/Memory Allocations (Socket Granularity)

Change CPU/Memory Allocations (Core Granularity)

Park Cores and Memory

Access osc-setcoremem Log Files

View the SP Configuration

Revert to a Previous CPU/Memory Configuration

Remove a CPU/Memory Configuration

Obtaining the EM Exadata Plug-in

Confirm System Requirements

Known Issues With the EM Exadata Plug-in

Configuring the Exalogic Software

Exalogic Software Overview

Prepare to Configure the Exalogic Software

Enable Domain-Level Enhancements

Enable Cluster-Level Session Replication Enhancements

Configuring Grid Link Data Source for Dept1_Cluster1

Configuring SDP-Enabled JDBC Drivers for Dept1_Cluster1

Create an SDP Listener on the IB Network

Administering Oracle Solaris 11 Boot Environments

Advantages to Maintaining Multiple Boot Environments

Create a Boot Environment

Mount to a Different Build Environment

Reboot to the Original Boot Environment

Create a Snapshot of a Boot Environment

Remove Unwanted Boot Environments

Administering DISM

DISM Restrictions

Disable DISM

Administering Storage Servers

Monitor Write-through Caching Mode

Shut Down or Reboot a Storage Server

Drop a Storage Server

Glossary

Index

Hardware Installation Task Overview

This table provides a summary of the installation process that is performed by Oracle service personnel.

Because Oracle SuperCluster M6-32 comprises various Oracle products that are documented, this document only provides installation information that is not described in other documents.

Use this table in conjunction with the installation documents listed in Hardware Installation Documents.

Steps
Links
1. Prepare the site.
  1. Ensure that the site meets all the requirements for each SuperCluster M6-32 major component. Specifications for these requirements are listed in each product installation guide:

    - Physical space, receiving area, and access route

    - Facility power, circuit breakers, and receptacles

    - Cooling

  2. Complete the customer site checklists and configuration worksheets.

  3. Review the network requirements.
2. Prepare for installation.
  1. Review the safety precautions, guidelines, site checklists, and site requirements.

  2. Gather the tools and equipment needed for installation.

  3. Ensure that power intended for SuperCluster M6-32 is disconnected at the facility circuit breakers.

  4. Route network drops to the installation area.

  5. Prepare DNS for SuperCluster M6-32.
3. Unpack and place SuperCluster racks in their intended locations.
  1. Unpack the racks as described in the unpacking guides that are attached to the shipping cartons.

  2. Place the racks in their allocated space. If two compute servers are included, place the storage rack between the two compute servers.

    Note – Due to cable length restrictions, the storage rack must be installed adjacent to the SPARC M6-32 servers. If you have two SPARC M6-32 servers, the storage rack must be installed between the two SPARC M6-32 servers

  3. If additional expansion racks are included (up to 17), position them adjacent to the other SuperCluster racks.

  4. Stabilize and level all racks.

4. Apply power to the compute servers (minimum 1, maximum 2)
  1. Connect each compute server to the facility power source, routing the power cords either through the top or bottom of the cabinet, connecting and securing each cord to the rack.

  2. Connect the SP serial cables to both SPs.

  3. Switch on the facility circuit breakers.

  4. Wait several minutes for the SPs to boot.

  5. Verify that server standby power is on and that there are no fault indicators illuminated.

  6. Inspect and verify the hardware.

Note - Do not connect SuperCluster M6-32 to any external networks at this time.

5. Apply power to the storage and expansion racks.
  1. Connect the storage rack to the facility power source, routing the power cord either through the top or bottom of the cabinet.

  2. Switch on the facility circuit breakers.

  3. Switch on the storage rack PDU breakers.

  4. Wait several minutes for all SPs to boot.

  5. Verify that standby power is on and that there are no fault indicators illuminated.

  6. Either press the Power On buttons, or turn on the storage servers through Oracle ILOM.

  7. Verify that power is applied to the Ethernet management switch.

  8. Verify that power is applied to the IB switches.

  9. Inspect and verify the storage and expansion rack storage hardware.

6. Apply power to any optional expansion racks.
  1. Connect the expansion racks to the facility power source, routing the power cord either through the top or bottom of the cabinet.

  2. Switch on the facility circuit breakers.

  3. Switch on the expansion rack PDU breakers.

  4. Wait several minutes for POST device checks to finish and for all SPs to boot.

  5. Verify that standby power is on and that there are no fault indicators illuminated.

  6. Either press the Power On buttons, or turn on the storage servers through Oracle ILOM.

  7. Verify that power is applied to the Ethernet management switch.

  8. Verify that power is applied to the IB switches.

  9. Inspect and verify the expansion rack storage hardware.

  10. Repeat these steps for additional optional expansion racks.

7. Install the ZFS storage appliance into the storage rack.
  1. Unpack the ZFS storage appliance.

  2. Install the mounting brackets on both ZFS storage controllers.

  3. Install one set of the slide rails in the storage rack at U25 and the other set at U26.

  4. Slide both ZFS storage controllers into the slide rails.

  5. Attach CMAs to the back of the slide rails.

  6. Install rails for the disk shelf (DE-24C) in the storage rack at U27.

  7. Install the disk shelf onto the rails and slide the enclosure into the rack.

  8. Cable the controllers to the shelf and route the cables through the CMA.

  9. Connect the power cords to the controllers and shelf. Route the cords through the CMA and plug them into specific outlets in the storage rack PDUs.

  10. Wait several minutes for devices to initialize and for all SPs to boot.

  11. Verify that server standby power is on and that there are no fault indicators illuminated.

  12. If the ZFS storage controllers do not start up, press the switches located on the front of the two ZFS storage controllers.

  13. Wait 3 to 5 minutes for the ZFS storage appliance to initiate services.

  14. Inspect and verify the ZFS storage appliance hardware.
8. (If included) Install 1 spine switch in each quarter and eighth populated expansion racks.

Note - The spine switch is already factory installed in full and half expansion racks, so the subsequent steps only need to be performed if quarter and eighth racks are included.
  1. Unpack the IB switch.

  2. Install the rails and cable management extenders in the expansion rack at U1.

  3. Install the mounting brackets on the IB switch.

  4. Slide the IB switch into the slide rails.

  5. Connect the power cord to the IB switch then to a rack PDU outlet.

  6. Wait several minutes for the IB switch to initialize.

  7. Verify that power is on and that no fault indicators are illuminated.
9. Cable SuperCluster M6-32.
The standard IB cables that ship with SuperCluster M6-32 must be routed over the top of the cabinets. The standard cables are not long enough to be routed down and under a raised floor.

  1. Cable the IB switch in U1.

  2. Cable the IB switch in U20.

  3. Cable the Ethernet management switch in U21.

  4. Cable the IB switch in U22.

  5. Route and dress the cables with velcro ties so that components can be serviced.

Note - Do not connect SuperCluster M6-32 to any external networks at this time.

10. Authorized Oracle service personnel configure SuperCluster software according to site requirements.
Contact your Oracle support representative for details.
11. Connect SuperCluster M6-32 to external networks.
  1. Ensure that the default factory installed IP addresses do not conflict with the site IP addresses.

  2. Connect the SuperCluster M6-32 Ethernet management switch to the facility management network.

  3. Connect the SuperCluster M6-32 10GbE EMS ports to the facility network.
12. Log in to SuperCluster M6-32.
There are a variety of methods you can use to log in to SuperCluster M6-32. The method you choose depends on the state of SuperCluster M6-32. Refer to the SPARC M5-32 and SPARC M6-32 Administration Guide for details.
Related Information
Copyright © 2013, 2015, Oracle and/or its affiliates. All rights reserved. Legal Notices
Previous Next