Private Cloud ApplianceX10-2c GPU Expansion Rack Cabling
This section describes the cabling of an X10-2c GPU expansion rack. Inter-rack cabling information is critical to connect the GPU expansion rack to the appliance base rack correctly. The internal component cabling information can be used as a reference, for example in case of hardware maintenance or when installing additional GPU nodes.
Inter-Rack Ethernet Connections
The table lists the cabling connections between the Private Cloud Appliance base rack and up to two X10-2c GPU expansion racks. These are Ethernet connections between the management and data network switches installed in each rack.
| Base Rack Unit | From Switch/Port | GPU Rack 1 | GPU Rack 2 | To Switch/Port |
|---|---|---|---|---|
|
U24 (pcaswmn01) |
MgmtBase: port 49 |
U22 (pcaswmn02) |
-- |
MgmtExp1: port 49 |
|
U24 (pcaswmn01) |
MgmtBase: port 50 |
U22 (pcaswmn02) |
-- |
MgmtExp1: port 50 |
|
U24 (pcaswmn01) |
MgmtBase: port 51 |
-- |
U22 (pcaswmn03) |
MgmtExp2: port 49 |
|
U24 (pcaswmn01) |
MgmtBase: port 52 |
-- |
U22 (pcaswmn03) |
MgmtExp2: port 50 |
|
U29 (pcaswsp01) |
Spine1: port 11 |
U18 (pcaswlf03) |
-- |
Leaf1Exp1: port 33 |
|
U29 (pcaswsp01) |
Spine1: port 12 |
U18 (pcaswlf03) |
-- |
Leaf1Exp1: port 34 |
|
U29 (pcaswsp01) |
Spine1: port 13 |
U19 (pcaswlf04) |
-- |
Leaf2Exp1: port 33 |
|
U29 (pcaswsp01) |
Spine1: port 14 |
U19 (pcaswlf04) |
-- |
Leaf2Exp1: port 34 |
|
U29 (pcaswsp01) |
Spine1: port 15 |
-- |
U18 (pcaswlf05) |
Leaf1Exp2: port 33 |
|
U29 (pcaswsp01) |
Spine1: port 16 |
-- |
U18 (pcaswlf05) |
Leaf1Exp2: port 34 |
|
U29 (pcaswsp01) |
Spine1: port 17 |
-- |
U19 (pcaswlf06) |
Leaf2Exp2: port 33 |
|
U29 (pcaswsp01) |
Spine1: port 18 |
-- |
U19 (pcaswlf06) |
Leaf2Exp2: port 34 |
|
U30 (pcaswsp02) |
Spine2: port 11 |
U18 (pcaswlf03) |
-- |
Leaf1Exp1: port 35 |
|
U30 (pcaswsp02) |
Spine2: port 12 |
U18 (pcaswlf03) |
-- |
Leaf1Exp1: port 36 |
|
U30 (pcaswsp02) |
Spine2: port 13 |
U19 (pcaswlf04) |
-- |
Leaf2Exp1: port 35 |
|
U30 (pcaswsp02) |
Spine2: port 14 |
U19 (pcaswlf04) |
-- |
Leaf2Exp1: port 36 |
|
U30 (pcaswsp02) |
Spine2: port 15 |
-- |
U18 (pcaswlf05) |
Leaf1Exp2: port 35 |
|
U30 (pcaswsp02) |
Spine2: port 16 |
-- |
U18 (pcaswlf05) |
Leaf1Exp2: port 36 |
|
U30 (pcaswsp02) |
Spine2: port 17 |
-- |
U19 (pcaswlf06) |
Leaf2Exp2: port 35 |
|
U30 (pcaswsp02) |
Spine2: port 18 |
-- |
U19 (pcaswlf06) |
Leaf2Exp2: port 36 |
Management Switch Internal Ethernet Connections
The table lists the internal cabling connections for the management switch. These are Ethernet connections intended for the appliance administration network.
| From Rack Unit | From Component and Port | To Management Switch Rack Unit and Port |
|---|---|---|
|
U28-30 |
X10-2c GPU node: Bay11 port 0 |
U22: port 28 |
|
U28-30 |
X10-2c GPU node: NETMGT |
U22: port 27 |
|
U24-26 |
X10-2c GPU node: Bay11 port 0 |
U22: port 26 |
|
U24-26 |
X10-2c GPU node: NETMGT |
U22: port 25 |
|
U21 |
PDU: NETMGT |
U22: port 4 |
|
U20 |
PDU: NETMGT |
U22: port 3 |
|
U19 |
Leaf switch: NET MGMT |
U22: port 46 |
|
U18 |
Leaf switch: NET MGMT |
U22: port 45 |
|
U14-16 |
X10-2c GPU node: Bay11 port 0 |
U22: port 24 |
|
U14-16 |
X10-2c GPU node: NETMGT |
U22: port 23 |
|
U10-12 |
X10-2c GPU node: Bay11 port 0 |
U22: port 22 |
|
U10-12 |
X10-2c GPU node: NETMGT |
U22: port 21 |
|
U06-08 |
X10-2c GPU node: Bay11 port 0 |
U22: port 20 |
|
U06-08 |
X10-2c GPU node: NETMGT |
U22: port 19 |
|
U02-04 |
X10-2c GPU node: Bay11 port 0 |
U22: port 18 |
|
U02-04 |
X10-2c GPU node: NETMGT |
U22: port 17 |
|
N/A |
Oracle Support |
U22: port 1 |
Leaf Switch Internal Ethernet Connections
The table lists the internal cabling connections for the leaf switches. These are high speed (100Gbps) Ethernet connections intended for the appliance data network.
| From Rack Unit | From Component and Port | To Leaf Switch Rack Unit and Port |
|---|---|---|
|
U28-30 |
X10-2c GPU node: Bay14 port 1 |
U18: port 19 |
|
U28-30 |
X10-2c GPU node: Bay14 port 2 |
U19: port 19 |
|
U28-30 |
X10-2c GPU node: Bay12 port 1 |
U18: port 18 |
|
U28-30 |
X10-2c GPU node: Bay12 port 2 |
U19: port 18 |
|
U24-26 |
X10-2c GPU node: Bay14 port 1 |
U18: port 17 |
|
U24-26 |
X10-2c GPU node: Bay14 port 2 |
U19: port 17 |
|
U24-26 |
X10-2c GPU node: Bay12 port 1 |
U18: port 16 |
|
U24-26 |
X10-2c GPU node: Bay12 port 2 |
U19: port 16 |
|
U14-16 |
X10-2c GPU node: Bay14 port 1 |
U18: port 15 |
|
U14-16 |
X10-2c GPU node: Bay14 port 2 |
U19: port 15 |
|
U14-16 |
X10-2c GPU node: Bay12 port 1 |
U18: port 14 |
|
U14-16 |
X10-2c GPU node: Bay12 port 2 |
U19: port 14 |
|
U10-12 |
X10-2c GPU node: Bay14 port 1 |
U18: port 13 |
|
U10-12 |
X10-2c GPU node: Bay14 port 2 |
U19: port 13 |
|
U10-12 |
X10-2c GPU node: Bay12 port 1 |
U18: port 12 |
|
U10-12 |
X10-2c GPU node: Bay12 port 2 |
U19: port 12 |
|
U06-08 |
X10-2c GPU node: Bay14 port 1 |
U18: port 11 |
|
U06-08 |
X10-2c GPU node: Bay14 port 2 |
U19: port 11 |
|
U06-08 |
X10-2c GPU node: Bay12 port 1 |
U18: port 10 |
|
U06-08 |
X10-2c GPU node: Bay12 port 2 |
U19: port 10 |
|
U02-04 |
X10-2c GPU node: Bay14 port 1 |
U18: port 9 |
|
U02-04 |
X10-2c GPU node: Bay14 port 2 |
U19: port 9 |
|
U02-04 |
X10-2c GPU node: Bay12 port 1 |
U18: port 8 |
|
U02-04 |
X10-2c GPU node: Bay12 port 2 |
U19: port 8 |