JavaScript is required to for searching.
Skip Navigation Links
Exit Print View
Oracle SuperCluster M6-32

Owner's Guide: Installation

search filter icon
search icon

Document Information

Using This Documentation

Product Documentation Library

Feedback

Installing SuperCluster M6-32

Hardware Installation Overview

Weight Specifications

Hardware Installation Task Overview

Hardware Installation Documents

Preparing the Site (Storage Rack and Expansion Racks)

Prepare the Site for the Racks

Storage Rack Components

Physical Specifications

Reviewing Power Requirements

PDU Power Specifications

Facility Power Requirements

PDU Thresholds

Preparing for Cooling

Heat Dissipation Specifications

Airflow Requirements

Perforated Floor Tiles

Environmental Specifications

Preparing the Network

Network Topology

Network Infrastructure Requirements

Compute Server Default Host Names and IP Addresses

Install Cable Drops

Prepare DNS

Cabling SuperCluster M6-32

Compute Server Network Components

Storage Rack Network Components

Cable the ZFS Storage Appliance

ZFS Appliance Power Cord Connection Reference

ZFS Storage Appliance Cabling Reference

Cable IB Switches

Leaf Switch 1 Cabling Reference

Leaf Switch 2 Cabling Reference

IB Switch-to-Switch Cabling Reference

Cable the Ethernet Management Switch

Ethernet Management Switch Cabling Reference

Connect SuperCluster M6-32 to the Facility Networks

Connecting Expansion Racks

Expansion Rack Overview

Expansion Rack Components

Expansion Rack Layouts

Installing Expansion Racks

One Expansion Rack Cabling

Two Expansion Racks Cabling

Three Expansion Racks Cabling

Four Expansion Racks Cabling

Five Expansion Racks Cabling

Six Expansion Racks Cabling

Seven Expansion Racks Cabling

Expansion Rack Default IP Addresses

Understanding Internal Cabling (Expansion Rack)

Oracle ILOM Cabling

Administrative Gigabit Ethernet Port Cabling

Single-Phase PDU Cabling

Three-Phase PDU Cabling (Full Rack)

IB Network Cabling

Glossary

Index

Hardware Installation Task Overview

This table provides a summary of the installation process that is performed by Oracle service personnel.

Because Oracle SuperCluster M6-32 comprises various Oracle products that are documented, this document only provides installation information that is not described in other documents.

Use this table in conjunction with the installation documents listed in Hardware Installation Documents.

Steps
Links
1. Prepare the site.
  1. Ensure that the site meets all the requirements for each SuperCluster M6-32 major component. Specifications for these requirements are listed in each product installation guide:

    - Physical space, receiving area, and access route

    - Facility power, circuit breakers, and receptacles

    - Cooling

  2. Complete the customer site checklists and configuration worksheets.

  3. Review the network requirements.

2. Prepare for installation.
  1. Review the safety precautions, guidelines, site checklists, and site requirements.
  2. Gather the tools and equipment needed for installation.

  3. Ensure that power intended for SuperCluster M6-32 is disconnected at the facility circuit breakers.

  4. Route network drops to the installation area.

  5. Prepare DNS for SuperCluster M6-32.

3. Unpack and place SuperCluster racks in their intended locations.
  1. Unpack the racks as described in the unpacking guides that are attached to the shipping cartons.
  2. Place the racks in their allocated space. If two compute servers are included, place the storage rack between the two compute servers.

    Note – Due to cable length restrictions, the storage rack must be installed adjacent to the SPARC M6-32 servers. If you have two SPARC M6-32 servers, the storage rack must be installed between the two SPARC M6-32 servers

  3. If additional expansion racks are included (up to 17), position them adjacent to the other SuperCluster racks.

  4. Stabilize and level all racks.

4. Apply power to the compute servers (minimum 1, maximum 2)
  1. Connect each compute server to the facility power source, routing the power cords either through the top or bottom of the cabinet, connecting and securing each cord to the rack.
  2. Connect the SP serial cables to both SPs.

  3. Switch on the facility circuit breakers.

  4. Wait several minutes for the SPs to boot.

  5. Verify that server standby power is on and that there are no fault indicators illuminated.

  6. Inspect and verify the hardware.


Note - Do not connect SuperCluster M6-32 to any external networks at this time.


5. Apply power to the storage and expansion racks.
  1. Connect the storage rack to the facility power source, routing the power cord either through the top or bottom of the cabinet.
  2. Switch on the facility circuit breakers.

  3. Switch on the storage rack PDU breakers.

  4. Wait several minutes for all SPs to boot.

  5. Verify that standby power is on and that there are no fault indicators illuminated.

  6. Either press the Power On buttons, or turn on the storage servers through Oracle ILOM.

  7. Verify that power is applied to the Ethernet management switch.

  8. Verify that power is applied to the IB switches.

  9. Inspect and verify the storage and expansion rack storage hardware.

6. Apply power to any optional expansion racks.
  1. Connect the expansion racks to the facility power source, routing the power cord either through the top or bottom of the cabinet.
  2. Switch on the facility circuit breakers.

  3. Switch on the expansion rack PDU breakers.

  4. Wait several minutes for POST device checks to finish and for all SPs to boot.

  5. Verify that standby power is on and that there are no fault indicators illuminated.

  6. Either press the Power On buttons, or turn on the storage servers through Oracle ILOM.

  7. Verify that power is applied to the Ethernet management switch.

  8. Verify that power is applied to the IB switches.

  9. Inspect and verify the expansion rack storage hardware.

  10. Repeat these steps for additional optional expansion racks.

7. Install the ZFS storage appliance into the storage rack.
  1. Unpack the ZFS storage appliance.
  2. Install the mounting brackets on both ZFS storage controllers.

  3. Install one set of the slide rails in the storage rack at U25 and the other set at U26.

  4. Slide both ZFS storage controllers into the slide rails.

  5. Attach CMAs to the back of the slide rails.

  6. Install rails for the disk shelf (DE-24C) in the storage rack at U27.

  7. Install the disk shelf onto the rails and slide the enclosure into the rack.

  8. Cable the controllers to the shelf and route the cables through the CMA.

  9. Connect the power cords to the controllers and shelf. Route the cords through the CMA and plug them into specific outlets in the storage rack PDUs.

  10. Wait several minutes for devices to initialize and for all SPs to boot.

  11. Verify that server standby power is on and that there are no fault indicators illuminated.

  12. If the ZFS storage controllers do not start up, press the switches located on the front of the two ZFS storage controllers.

  13. Wait 3 to 5 minutes for the ZFS storage appliance to initiate services.

  14. Inspect and verify the ZFS storage appliance hardware.

8. (If included) Install 1 spine switch in each quarter and eighth populated expansion racks.

Note - The spine switch is already factory installed in full and half expansion racks, so the subsequent steps only need to be performed if quarter and eighth racks are included.


  1. Unpack the IB switch.
  2. Install the rails and cable management extenders in the expansion rack at U1.

  3. Install the mounting brackets on the IB switch.

  4. Slide the IB switch into the slide rails.

  5. Connect the power cord to the IB switch then to a rack PDU outlet.

  6. Wait several minutes for the IB switch to initialize.

  7. Verify that power is on and that no fault indicators are illuminated.

9. Cable SuperCluster M6-32.
The standard IB cables that ship with SuperCluster M6-32 must be routed over the top of the cabinets. The standard cables are not long enough to be routed down and under a raised floor.
  1. Cable the IB switch in U1.

  2. Cable the IB switch in U20.

  3. Cable the Ethernet management switch in U21.

  4. Cable the IB switch in U22.

  5. Route and dress the cables with velcro ties so that components can be serviced.


Note - Do not connect SuperCluster M6-32 to any external networks at this time.


10. Authorized Oracle service personnel configure SuperCluster software according to site requirements.
Contact your Oracle support representative for details.
11. Connect SuperCluster M6-32 to external networks.
  1. Ensure that the default factory installed IP addresses do not conflict with the site IP addresses.
  2. Connect the SuperCluster M6-32 Ethernet management switch to the facility management network.

  3. Connect the SuperCluster M6-32 10GbE EMS ports to the facility network.

12. Log in to SuperCluster M6-32.
There are a variety of methods you can use to log in to SuperCluster M6-32. The method you choose depends on the state of SuperCluster M6-32. Refer to the SPARC M5-32 and SPARC M6-32 Administration Guide for details.
Related Information