Seven Expansion Racks Cabling - Oracle SuperCluster M6-32

Skip Navigation Links
Exit Print View
	Oracle SuperCluster M6-32 Owner's Guide: Installation

Oracle Technology Network

Document Information

Using This Documentation

Product Documentation Library

Installing SuperCluster M6-32

Hardware Installation Overview

Weight Specifications

Hardware Installation Task Overview

Hardware Installation Documents

Preparing the Site (Storage Rack and Expansion Racks)

Prepare the Site for the Racks

Storage Rack Components

Physical Specifications

Reviewing Power Requirements

PDU Power Specifications

Facility Power Requirements

Preparing for Cooling

Heat Dissipation Specifications

Airflow Requirements

Perforated Floor Tiles

Environmental Specifications

Preparing the Network

Network Topology

Network Infrastructure Requirements

Compute Server Default Host Names and IP Addresses

Install Cable Drops

Cabling SuperCluster M6-32

Compute Server Network Components

Storage Rack Network Components

Cable the ZFS Storage Appliance

ZFS Appliance Power Cord Connection Reference

ZFS Storage Appliance Cabling Reference

Cable IB Switches

Leaf Switch 1 Cabling Reference

Leaf Switch 2 Cabling Reference

IB Switch-to-Switch Cabling Reference

Cable the Ethernet Management Switch

Ethernet Management Switch Cabling Reference

Connect SuperCluster M6-32 to the Facility Networks

Connecting Expansion Racks

Expansion Rack Overview

Expansion Rack Components

Expansion Rack Layouts

Installing Expansion Racks

One Expansion Rack Cabling

Two Expansion Racks Cabling

Three Expansion Racks Cabling

Four Expansion Racks Cabling

Five Expansion Racks Cabling

Six Expansion Racks Cabling

Seven Expansion Racks Cabling

Expansion Rack Default IP Addresses

Understanding Internal Cabling (Expansion Rack)

Oracle ILOM Cabling

Administrative Gigabit Ethernet Port Cabling

Single-Phase PDU Cabling

Three-Phase PDU Cabling (Full Rack)

IB Network Cabling

Seven Expansion Racks Cabling

These abbreviations are used in the tables:

SR – SuperCluster M6-32 storage rack
Rn – Rack n (R1 is the first expansion rack, R2 is the second, and so on.)
U1 – Spine switch in U1
U20 – Leaf switch 1 in U20
U22 – Leaf switch 2 in U22
Pn – Port n

Table 43 IB Switch Connections for the Storage Rack When Adding Seven Expansion Racks

Leaf Switch	Connection	Cable Length
SR U22 within SR	SR-U22-P8A to SR-U1-P3A	3 m
SR U22 to R1	SR-U22-P8B to R1-U1-P4A	5 m
SR U22 to R2	SR-U22-P9A to R2-U1-P5A	5 m
SR U22 to R3	SR-U22-P9B to R3-U1-P6A	10 m
SR U22 to R4	SR-U22-P10A to R4-U1-P7A	10 m
SR U22 to R5	SR-U22-P10B to R5-U1-P8A	10 m
SR U22 to R6	SR-U22-P11A to R6-U1-P9A	10 m
SR U22 to R7	SR-U22-P11B to R7-U1-P10A	10 m
SR U20 within SR	SR-U20-P8A to SR-U1-P3B	3 m
SR U20 to R1	SR-U20-P8B to R1-U1-P4B	5 m
SR U20 to R2	SR-U20-P9A to R2-U1-P5B	5 m
SR U20 to R3	SR-U20-P9B to R3-U1-P6B	10 m
SR U20 to R4	SR-U20-P10A to R4-U1-P7B	10 m
SR U20 to R5	SR-U20-P10B to R5-U1-P8B	10 m
SR U20 to R6	SR-U20-P11A to R6-U1-P8B	10 m
SR U20 to R7	SR-U20-P11B to R7-U1-P10B	10 m

Table 44 IB Switch Connections for the First Expansion Rack of Seven

Leaf Switch	Connection	Cable Length
R1 U22 within R1	R1-U22-P8A to R1-U1-P3A	3 m
R1 U22 to SR	R1-U22-P11B to SR-U1-P10A	5 m
R1 U22 to R2	R1-U22-P8B to R2-U1-P4A	5 m
R1 U22 to R3	R1-U22-P9A to R3-U1-P5A	5 m
R1 U22 to R4	R1-U22-P9B to R4-U1-P6A	10 m
R1 U22 to R5	R1-U22-P10A to R5-U1-P7A	10 m
R1 U22 to R6	R1-U22-P10B to R6-U1-P8A	10 m
R1 U22 to R7	R1-U22-P11A to R7-U1-P9A	10 m
R1 U20 within R1	R1-U20-P8A to R1-U1-P3B	3 m
R1 U20 to SR	R1-U20-P11B to SR-U1-P10B	5 m
R1 U20 to R2	R1-U20-P8B to R2-U1-P4B	5 m
R1 U20 to R3	R1-U20-P9A to R3-U1-P5B	5 m
R1 U20 to R4	R1-U20-P9B to R4-U1-P6B	10 m
R1 U20 to R5	R1-U20-P10A to R5-U1-P7B	10 m
R1 U20 to R6	R1-U20-P10B to R6-U1-P8B	10 m
R1 U20 to R7	R1-U20-P11A to R7-U1-P9B	10 m

Table 45 IB Switch Connections for the Second Expansion Rack of Seven

Leaf Switch	Connection	Cable Length
R2 U22 within R2	R2-U22-P8A to R2-U1-P3A	3 m
R2 U22 to SR	R2-U22-P11A to SR-U1-P9A	5 m
R2 U22 to R1	R2-U22-P11B to R1-U1-P10A	5 m
R2 U22 to R3	R2-U22-P8B to R3-U1-P4A	5 m
R2 U22 to R4	R2-U22-P9A to R4-U1-P5A	5 m
R2 U22 to R5	R2-U22-P9B to R5-U1-P6A	5 m
R2 U22 to R6	R2-U22-P10A to R6-U1-P7A	10 m
R2 U22 to R7	R2-U22-P10B to R7-U1-P8A	10 m
R2 U20 within R2	R2-U20-P8A to R2-U1-P3B	3 m
R2 U20 to SR	R2-U20-P11A to SR-U1-P9B	5 m
R2 U20 to R1	R2-U20-P11B to R1-U1-P10B	5 m
R2 U20 to R3	R2-U20-P8B to R3-U1-P4B	5 m
R2 U20 to R4	R2-U20-P9A to R4-U1-P5B	5 m
R2 U20 to R5	R2-U20-P9B to R5-U1-P6B	5 m
R2 U20 to R6	R2-U20-P10A to R6-U1-P7B	10 m
R2 U20 to R7	R2-U20-P10B to R7-U1-P8B	10 m

Table 46 IB Switch Connections for the Third Expansion Rack of Seven

Leaf Switch	Connection	Cable Length
R3 U22 within R3	R3-U22-P8A to R3-U1-P3A	3 m
R3 U22 to SR	R3-U22-P10B to SR-U1-P8A	10 m
R3 U22 to R1	R3-U22-P11A to R1-U1-P9A	5 m
R3 U22 to R2	R3-U22-P11B to R2-U1-P10A	5 m
R3 U22 to R4	R3-U22-P8B to R4-U1-P4A	5 m
R3 U22 to R5	R3-U22-P9A to R5-U1-P5A	5 m
R3 U22 to R6	R3-U22-P9B to R6-U1-P6A	10 m
R3 U22 to R7	R3-U22-P10A to R7-U1-P7A	10 m
R3 U20 within R3	R3-U20-P8A to R3-U1-P3B	3 m
R3 U20 to SR	R3-U20-P10B to SR-U1-P8B	10 m
R3 U20 to R1	R3-U20-P11A to R1-U1-P9B	5 m
R3 U20 to R2	R3-U20-P11B to R2-U1-P10B	5 m
R3 U20 to R4	R3-U20-P8B to R4-U1-P4B	5 m
R3 U20 to R5	R3-U20-P9A to R5-U1-P5B	5 m
R3 U20 to R6	R3-U20-P9B to R6-U1-P6B	10 m
R3 U20 to R7	R3-U20-P10A to R7-U1-P7B	10 m

Table 47 IB Switch Connections for the Fourth Expansion Rack of Seven

Leaf Switch	Connection	Cable Length
R4 U22 within R4	R4-U22-P8A to R4-U1-P3A	3 m
R4 U22 to SR	R4-U22-P10A to SR-U1-P7A	10 m
R4 U22 to R1	R4-U22-P10B to R1-U1-P8A	10 m
R4 U22 to R2	R4-U22-P11A to R2-U1-P9A	5 m
R4 U22 to R3	R4-U22-P11B to R3-U1-P10A	5 m
R4 U22 to R5	R4-U22-P8B to R5-U1-P4A	5 m
R4 U22 to R6	R4-U22-P9A to R6-U1-P5A	5 m
R4 U22 to R7	R4-U22-P9B to R7-U1-P6A	10 m
R4 U20 within R4	R4-U20-P8A to R4-U1-P3B	3 m
R4 U20 to SR	R4-U20-P10A to SR-U1-P7B	10 m
R4 U20 to R1	R4-U22-P10B to R1-U1-P8B	10 m
R4 U20 to R2	R4-U20-P11A to R2-U1-P9B	5 m
R4 U20 to R3	R4-U20-P11B to R3-U1-P10B	5 m
R4 U20 to R5	R4-U20-P8B to R5-U1-P4B	5 m
R4 U20 to R6	R4-U20-P9A to R6-U1-P5B	5 m
R4 U20 to R7	R4-U20-P9B to R7-U1-P6B	10 m

Table 48 IB Switch Connections for the Fifth Expansion Rack of Seven

Leaf Switch	Connection	Cable Length
R5 U22 within R5	R5-U22-P8A to R5-U1-P3A	3 m
R5 U22 to SR	R5-U22-P9B to SR-U1-P6A	10 m
R5 U22 to R1	R5-U22-P10A to R1-U1-P7A	10 m
R5 U22 to R2	R5-U22-P10B to R2-U1-P8A	5 m
R5 U22 to R3	R5-U22-P11A to R3-U1-P9A	5 m
R5 U22 to R4	R5-U22-P11B to R4-U1-P10A	5 m
R5 U22 to R6	R5-U22-P8B to R6-U1-P4A	5 m
R5 U22 to R7	R5-U22-P9A to R7-U1-P5A	5 m
R5 U20 within R5	R5-U20-P8A to R5-U1-P3B	3 m
R5 U20 to SR	R5-U20-P9B to SR-U1-P6B	10 m
R5 U20 to R1	R5-U22-P10A to R1-U1-P7B	10 m
R5 U20 to R2	R5-U20-P10B to R2-U1-P8B	5 m
R5 U20 to R3	R5-U20-P11A to R3-U1-P9B	5 m
R5 U20 to R4	R5-U20-P11B to R4-U1-P10B	5 m
R5 U20 to R6	R5-U22-P8B to R6-U1-P4B	5 m
R5 U20 to R7	R5-U20-P9A to R7-U1-P5B	5 m

Table 49 IB Switch Connections for the Sixth Expansion Rack of Seven

Leaf Switch	Connection	Cable Length
R6 U22 within R6	R6-U22-P8A to R6-U1-P3A	3 m
R6 U22 to SR	R6-U22-P9A to SR-U1-P5A	10 m
R6 U22 to R1	R6-U22-P9B to R1-U1-P6A	10 m
R6 U22 to R2	R6-U22-P10A to R2-U1-P7A	10 m
R6 U22 to R3	R6-U22-P10B to R3-U1-P8A	10 m
R6 U22 to R4	R6-U22-P11A to R4-U1-P9A	5 m
R6 U22 to R5	R6-U22-P11B to R5-U1-P10A	5 m
R6 U22 to R7	R6-U22-P8B to R7-U1-P4A	5 m
R6 U20 within R6	R6-U20-P8A to R6-U1-P3B	3 m
R6 U20 to SR	R6-U20-P9A to SR-U1-P5B	10 m
R6 U20 to R1	R6-U22-P9B to R1-U1-P6B	10 m
R6 U20 to R2	R6-U20-P10A to R2-U1-P7B	10 m
R6 U20 to R3	R6-U20-P10B to R3-U1-P8B	10 m
R6 U20 to R4	R6-U20-P11A to R4-U1-P9B	5 m
R6 U20 to R5	R6-U22-P11B to R5-U1-P10B	5 m
R6 U20 to R7	R6-U22-P8B to R7-U1-P4B	5 m

Table 50 IB Switch Connections for the Seventh Expansion Rack of Seven

Leaf Switch	Connection	Cable Length
R7 U22 within R7	R7-U22-P8A to R7-U1-P3A	3 m
R7 U22 to SR	R7-U22-P8B to SR-U1-P4A	10 m
R7 U22 to R1	R7-U22-P9A to R1-U1-P5A	10 m
R7 U22 to R2	R7-U22-P9B to R2-U1-P6A	10 m
R7 U22 to R3	R7-U22-P10A to R3-U1-P7A	10 m
R7 U22 to R4	R7-U22-P10B to R4-U1-P8A	5 m
R7 U22 to R5	R7-U22-P11A to R5-U1-P9A	5 m
R7 U22 to R6	R7-U22-P11B to R6-U1-P10A	5 m
R7 U20 within R7	R7-U20-P8A to R7-U1-P3B	3 m
R7 U20 to SR	R7-U20-P8B to SR-U1-P4B	10 m
R7 U20 to R1	R7-U22-P9A to R1-U1-P5B	10 m
R7 U20 to R2	R7-U20-P9B to R2-U1-P6B	10 m
R7 U20 to R3	R7-U20-P10A to R3-U1-P7B	10 m
R7 U20 to R4	R7-U20-P10B to R4-U1-P8B	5 m
R7 U20 to R5	R7-U22-P11A to R5-U1-P9B	5 m
R7 U20 to R6	R7-U22-P1B to R6-U1-P10B	5 m

Related Information

Copyright © 2013, 2015, Oracle and/or its affiliates. All rights reserved. Legal Notices

Previous

Next