JavaScript is required to for searching.
Skip Navigation Links
Exit Print View
Oracle SuperCluster M6-32

Owner's Guide: Installation

search filter icon
search icon

Document Information

Using This Documentation

Product Documentation Library

Feedback

Installing SuperCluster M6-32

Hardware Installation Overview

Weight Specifications

Hardware Installation Task Overview

Hardware Installation Documents

Preparing the Site (Storage Rack and Expansion Racks)

Prepare the Site for the Racks

Storage Rack Components

Physical Specifications

Reviewing Power Requirements

PDU Power Specifications

Facility Power Requirements

PDU Thresholds

Preparing for Cooling

Heat Dissipation Specifications

Airflow Requirements

Perforated Floor Tiles

Environmental Specifications

Preparing the Network

Network Topology

Network Infrastructure Requirements

Compute Server Default Host Names and IP Addresses

Install Cable Drops

Prepare DNS

Cabling SuperCluster M6-32

Compute Server Network Components

Storage Rack Network Components

Cable the ZFS Storage Appliance

ZFS Appliance Power Cord Connection Reference

ZFS Storage Appliance Cabling Reference

Cable IB Switches

Leaf Switch 1 Cabling Reference

Leaf Switch 2 Cabling Reference

IB Switch-to-Switch Cabling Reference

Cable the Ethernet Management Switch

Ethernet Management Switch Cabling Reference

Connect SuperCluster M6-32 to the Facility Networks

Connecting Expansion Racks

Expansion Rack Overview

Expansion Rack Components

Expansion Rack Layouts

Installing Expansion Racks

One Expansion Rack Cabling

Two Expansion Racks Cabling

Three Expansion Racks Cabling

Four Expansion Racks Cabling

Five Expansion Racks Cabling

Six Expansion Racks Cabling

Seven Expansion Racks Cabling

Expansion Rack Default IP Addresses

Understanding Internal Cabling (Expansion Rack)

Oracle ILOM Cabling

Administrative Gigabit Ethernet Port Cabling

Single-Phase PDU Cabling

Three-Phase PDU Cabling (Full Rack)

IB Network Cabling

Glossary

Index

IB Network Cabling

Table 63 IB Network Cabling for the Expansion Rack (Full Rack)

From IB Switch Rack Unit
Port
To Rack Unit
Type of Equipment
Port
Cable Description
U24
0A
U41
Exadata Storage Server
PCIe 3, P1
3 m QDR IB cable
U24
0B
U39
Exadata Storage Server
PCIe 3, P1
3 m QDR IB cable
U24
1A
U37
Exadata Storage Server
PCIe 3, P1
3 m QDR IB cable
U24
1B
U35
Exadata Storage Server
PCIe 3, P1
3 m QDR IB cable
U24
2A
U33
Exadata Storage Server
PCIe 3, P1
3 m QDR IB cable
U24
2B
U31
Exadata Storage Server
PCIe 3, P1
3 m QDR IB cable
U24
3A
U29
Exadata Storage Server
PCIe 3, P1
3 m QDR IB cable
U24
4A
U27
Exadata Storage Server
PCIe 2, P1
2 m QDR IB cable
U24
5A
U25
Exadata Storage Server
PCIe 2, P1
2 m QDR IB cable
U24
13A
U18
Exadata Storage Server
PCIe 2, P2
2 m QDR IB cable
U24
14A
U16
Exadata Storage Server
PCIe 2, P2
2 m QDR IB cable
U24
14B
U14
Exadata Storage Server
PCIe 3, P2
3 m QDR IB cable
U24
15A
U12
Exadata Storage Server
PCIe 3, P2
3 m QDR IB cable
U24
15B
U10
Exadata Storage Server
PCIe 3, P2
3 m QDR IB cable
U24
16A
U8
Exadata Storage Server
PCIe 3, P2
3 m QDR IB cable
U24
16B
U6
Exadata Storage Server
PCIe 3, P2
3 m QDR IB cable
U24
17A
U4
Exadata Storage Server
PCIe 3, P2
3 m QDR IB cable
U24
17B
U2
Exadata Storage Server
PCIe 3, P2
3 m QDR IB cable
U20
0A
U41
Exadata Storage Server
PCIe 3, P2
3 m QDR IB cable
U20
0B
U39
Exadata Storage Server
PCIe 3, P2
3 m QDR IB cable
U20
1A
U37
Exadata Storage Server
PCIe 3, P2
3 m QDR IB cable
U20
1B
U35
Exadata Storage Server
PCIe 3, P2
3 m QDR IB cable
U20
2A
U33
Exadata Storage Server
PCIe 3, P2
3 m QDR IB cable
U20
2B
U31
Exadata Storage Server
PCIe 3, P2
3 m QDR IB cable
U20
3A
U29
Exadata Storage Server
PCIe 3, P2
3 m QDR IB cable
U20
4A
U27
Exadata Storage Server
PCIe 2, P2
2 m QDR IB cable
U20
5A
U25
Exadata Storage Server
PCIe 2, P2
2 m QDR IB cable
U20
13A
U18
Exadata Storage Server
PCIe 2, P1
2 m QDR IB cable
U20
14A
U16
Exadata Storage Server
PCIe 2, P1
2 m QDR IB cable
U20
14B
U14
Exadata Storage Server
PCIe 3, P1
2 m QDR IB cable
U20
15A
U12
Exadata Storage Server
PCIe 3, P1
3 m QDR IB cable
U20
15B
U10
Exadata Storage Server
PCIe 3, P1
3 m QDR IB cable
U20
16A
U8
Exadata Storage Server
PCIe 3, P1
3 m QDR IB cable
U20
16B
U6
Exadata Storage Server
PCIe 3, P1
3 m QDR IB cable
U20
17A
U4
Exadata Storage Server
PCIe 3, P1
3 m QDR IB cable
U20
17B
U2
Exadata Storage Server
PCIe 3, P1
3 m QDR IB cable
U20
9B
U24
Sun Datacenter InfiniBand Switch 36 switch
9A
2 m QDR IB cable
U20
10B
U24
Sun Datacenter InfiniBand Switch 36 switch
10A
2 m QDR IB cable
U20
11B
U24
Sun Datacenter InfiniBand Switch 36 switch
11A
2 m QDR IB cable
U20
8A
U24
Sun Datacenter InfiniBand Switch 36 switch
8A
2 m QDR IB cable
U20
9A
U24
Sun Datacenter InfiniBand Switch 36 switch
9B
2 m QDR IB cable
U20
10A
U24
Sun Datacenter InfiniBand Switch 36 switch
10B
2 m QDR IB cable
U20
11A
U24
Sun Datacenter InfiniBand Switch 36 switch
11B
2 m QDR IB cable
U1
1B
U20
Sun Datacenter InfiniBand Switch 36 switch
8B
3 m QDR IB cable
U1
0B
U24
Sun Datacenter InfiniBand Switch 36 switch
8B
3 m QDR IB cable

Table 64 IB Network Cabling for the Expansion Rack (Half Rack)

From IB Switch Rack Unit
Port
To Rack Unit
Type of Equipment
Port
Cable Description
U24
13A
U18
Exadata Storage Server
PCIe 2, P2
2 m QDR IB cable
U24
14A
U16
Exadata Storage Server
PCIe 2, P2
2 m QDR IB cable
U24
14B
U14
Exadata Storage Server
PCIe 3, P2
3 m QDR IB cable
U24
15A
U12
Exadata Storage Server
PCIe 3, P2
3 m QDR IB cable
U24
15B
U10
Exadata Storage Server
PCIe 3, P2
3 m QDR IB cable
U24
16A
U8
Exadata Storage Server
PCIe 3, P2
3 m QDR IB cable
U24
16B
U6
Exadata Storage Server
PCIe 3, P2
3 m QDR IB cable
U24
17A
U4
Exadata Storage Server
PCIe 3, P2
3 m QDR IB cable
U24
17B
U2
Exadata Storage Server
PCIe 3, P2
3 m QDR IB cable
U20
13A
U18
Exadata Storage Server
PCIe 2, P1
2 m QDR IB cable
U20
14A
U16
Exadata Storage Server
PCIe 2, P1
2 m QDR IB cable
U20
14B
U14
Exadata Storage Server
PCIe 3, P1
2 m QDR IB cable
U20
15A
U12
Exadata Storage Server
PCIe 3, P1
3 m QDR IB cable
U20
15B
U10
Exadata Storage Server
PCIe 3, P1
3 m QDR IB cable
U20
16A
U8
Exadata Storage Server
PCIe 3, P1
3 m QDR IB cable
U20
16B
U6
Exadata Storage Server
PCIe 3, P1
3 m QDR IB cable
U20
17A
U4
Exadata Storage Server
PCIe 3, P1
3 m QDR IB cable
U20
17B
U2
Exadata Storage Server
PCIe 3, P1
3 m QDR IB cable
U20
9B
U24
Sun Datacenter InfiniBand Switch 36 switch
9A
2 m QDR IB cable
U20
10B
U24
Sun Datacenter InfiniBand Switch 36 switch
10A
2 m QDR IB cable
U20
11B
U24
Sun Datacenter InfiniBand Switch 36 switch
11A
2 m QDR IB cable
U20
8A
U24
Sun Datacenter InfiniBand Switch 36 switch
8A
2 m QDR IB cable
U20
9A
U24
Sun Datacenter InfiniBand Switch 36 switch
9B
2 m QDR IB cable
U20
10A
U24
Sun Datacenter InfiniBand Switch 36 switch
10B
2 m QDR IB cable
U20
11A
U24
Sun Datacenter InfiniBand Switch 36 switch
11B
2 m QDR IB cable
U1
1B
U20
Sun Datacenter InfiniBand Switch 36 switch
8B
3 m QDR IB cable
U1
0B
U24
Sun Datacenter InfiniBand Switch 36 switch
8B
3 m QDR IB cable

Table 65 IB Network Cabling for the Expansion Rack (Quarter Rack)

From IB Switch Rack Unit
Port
To Rack Unit
Type of Equipment
Port
Cable Description
U24
16A
U8
Exadata Storage Server
PCIe 2, P2
2 m QDR IB cable
U24
16B
U6
Exadata Storage Server
PCIe 3, P2
3 m QDR IB cable
U24
17A
U4
Exadata Storage Server
PCIe 3, P2
3 m QDR IB cable
U24
17B
U2
Exadata Storage Server
PCIe 3, P2
3 m QDR IB cable
U20
16A
U8
Exadata Storage Server
PCIe 2, P1
2 m QDR IB cable
U20
16B
U6
Exadata Storage Server
PCIe 3, P1
3 m QDR IB cable
U20
17A
U4
Exadata Storage Server
PCIe 3, P1
3 m QDR IB cable
U20
17B
U2
Exadata Storage Server
PCIe 3, P1
3 m QDR IB cable
U20
9B
U24
Sun Datacenter InfiniBand Switch 36 switch
9A
2 m QDR IB cable
U20
10B
U24
Sun Datacenter InfiniBand Switch 36 switch
10A
2 m QDR IB cable
U20
11B
U24
Sun Datacenter InfiniBand Switch 36 switch
11A
2 m QDR IB cable
U20
8A
U24
Sun Datacenter InfiniBand Switch 36 switch
8A
2 m QDR IB cable
U20
9A
U24
Sun Datacenter InfiniBand Switch 36 switch
9B
2 m QDR IB cable
U20
10A
U24
Sun Datacenter InfiniBand Switch 36 switch
10B
2 m QDR IB cable
U20
11A
U24
Sun Datacenter InfiniBand Switch 36 switch
11B
2 m QDR IB cable
Related Information