Private Cloud ApplianceX10-2c GPU Expansion Rack Cabling
This section describes the cabling of an X10-2c GPU expansion rack. Inter-rack cabling information is critical to connect the GPU expansion rack to the appliance base rack correctly. The internal component cabling information can be used as a reference, for example in case of hardware maintenance or when installing additional GPU nodes.
Inter-Rack Ethernet Connections
The table lists the cabling connections between the Private Cloud Appliance base rack and up to two X10-2c GPU expansion racks. These are Ethernet connections between the management and data network switches installed in each rack.
Base Rack Unit | From Switch/Port | GPU Rack 1 | GPU Rack 2 | To Switch/Port |
---|---|---|---|---|
U24 (pcaswmn01) |
MgmtBase: port 49 |
U22 (pcaswmn02) |
-- |
MgmtExp1: port 49 |
U24 (pcaswmn01) |
MgmtBase: port 50 |
U22 (pcaswmn02) |
-- |
MgmtExp1: port 50 |
U24 (pcaswmn01) |
MgmtBase: port 51 |
-- |
U22 (pcaswmn03) |
MgmtExp2: port 49 |
U24 (pcaswmn01) |
MgmtBase: port 52 |
-- |
U22 (pcaswmn03) |
MgmtExp2: port 50 |
U29 (pcaswsp01) |
Spine1: port 11 |
U18 (pcaswlf03) |
-- |
Leaf1Exp1: port 33 |
U29 (pcaswsp01) |
Spine1: port 12 |
U18 (pcaswlf03) |
-- |
Leaf1Exp1: port 34 |
U29 (pcaswsp01) |
Spine1: port 13 |
U19 (pcaswlf04) |
-- |
Leaf2Exp1: port 33 |
U29 (pcaswsp01) |
Spine1: port 14 |
U19 (pcaswlf04) |
-- |
Leaf2Exp1: port 34 |
U29 (pcaswsp01) |
Spine1: port 15 |
-- |
U18 (pcaswlf05) |
Leaf1Exp2: port 33 |
U29 (pcaswsp01) |
Spine1: port 16 |
-- |
U18 (pcaswlf05) |
Leaf1Exp2: port 34 |
U29 (pcaswsp01) |
Spine1: port 17 |
-- |
U19 (pcaswlf06) |
Leaf2Exp2: port 33 |
U29 (pcaswsp01) |
Spine1: port 18 |
-- |
U19 (pcaswlf06) |
Leaf2Exp2: port 34 |
U30 (pcaswsp02) |
Spine2: port 11 |
U18 (pcaswlf03) |
-- |
Leaf1Exp1: port 35 |
U30 (pcaswsp02) |
Spine2: port 12 |
U18 (pcaswlf03) |
-- |
Leaf1Exp1: port 36 |
U30 (pcaswsp02) |
Spine2: port 13 |
U19 (pcaswlf04) |
-- |
Leaf2Exp1: port 35 |
U30 (pcaswsp02) |
Spine2: port 14 |
U19 (pcaswlf04) |
-- |
Leaf2Exp1: port 36 |
U30 (pcaswsp02) |
Spine2: port 15 |
-- |
U18 (pcaswlf05) |
Leaf1Exp2: port 35 |
U30 (pcaswsp02) |
Spine2: port 16 |
-- |
U18 (pcaswlf05) |
Leaf1Exp2: port 36 |
U30 (pcaswsp02) |
Spine2: port 17 |
-- |
U19 (pcaswlf06) |
Leaf2Exp2: port 35 |
U30 (pcaswsp02) |
Spine2: port 18 |
-- |
U19 (pcaswlf06) |
Leaf2Exp2: port 36 |
Management Switch Internal Ethernet Connections
The table lists the internal cabling connections for the management switch. These are Ethernet connections intended for the appliance administration network.
From Rack Unit | From Component and Port | To Management Switch Rack Unit and Port |
---|---|---|
U28-30 |
X10-2c GPU node: Bay11 port 0 |
U22: port 28 |
U28-30 |
X10-2c GPU node: NETMGT |
U22: port 27 |
U24-26 |
X10-2c GPU node: Bay11 port 0 |
U22: port 26 |
U24-26 |
X10-2c GPU node: NETMGT |
U22: port 25 |
U21 |
PDU: NETMGT |
U22: port 4 |
U20 |
PDU: NETMGT |
U22: port 3 |
U19 |
Leaf switch: NET MGMT |
U22: port 46 |
U18 |
Leaf switch: NET MGMT |
U22: port 45 |
U14-16 |
X10-2c GPU node: Bay11 port 0 |
U22: port 24 |
U14-16 |
X10-2c GPU node: NETMGT |
U22: port 23 |
U10-12 |
X10-2c GPU node: Bay11 port 0 |
U22: port 22 |
U10-12 |
X10-2c GPU node: NETMGT |
U22: port 21 |
U06-08 |
X10-2c GPU node: Bay11 port 0 |
U22: port 20 |
U06-08 |
X10-2c GPU node: NETMGT |
U22: port 19 |
U02-04 |
X10-2c GPU node: Bay11 port 0 |
U22: port 18 |
U02-04 |
X10-2c GPU node: NETMGT |
U22: port 17 |
N/A |
Oracle Support |
U22: port 1 |
Leaf Switch Internal Ethernet Connections
The table lists the internal cabling connections for the leaf switches. These are high speed (100Gbps) Ethernet connections intended for the appliance data network.
From Rack Unit | From Component and Port | To Leaf Switch Rack Unit and Port |
---|---|---|
U28-30 |
X10-2c GPU node: Bay14 port 1 |
U18: port 19 |
U28-30 |
X10-2c GPU node: Bay14 port 2 |
U19: port 19 |
U28-30 |
X10-2c GPU node: Bay12 port 1 |
U18: port 18 |
U28-30 |
X10-2c GPU node: Bay12 port 2 |
U19: port 18 |
U24-26 |
X10-2c GPU node: Bay14 port 1 |
U18: port 17 |
U24-26 |
X10-2c GPU node: Bay14 port 2 |
U19: port 17 |
U24-26 |
X10-2c GPU node: Bay12 port 1 |
U18: port 16 |
U24-26 |
X10-2c GPU node: Bay12 port 2 |
U19: port 16 |
U14-16 |
X10-2c GPU node: Bay14 port 1 |
U18: port 15 |
U14-16 |
X10-2c GPU node: Bay14 port 2 |
U19: port 15 |
U14-16 |
X10-2c GPU node: Bay12 port 1 |
U18: port 14 |
U14-16 |
X10-2c GPU node: Bay12 port 2 |
U19: port 14 |
U10-12 |
X10-2c GPU node: Bay14 port 1 |
U18: port 13 |
U10-12 |
X10-2c GPU node: Bay14 port 2 |
U19: port 13 |
U10-12 |
X10-2c GPU node: Bay12 port 1 |
U18: port 12 |
U10-12 |
X10-2c GPU node: Bay12 port 2 |
U19: port 12 |
U06-08 |
X10-2c GPU node: Bay14 port 1 |
U18: port 11 |
U06-08 |
X10-2c GPU node: Bay14 port 2 |
U19: port 11 |
U06-08 |
X10-2c GPU node: Bay12 port 1 |
U18: port 10 |
U06-08 |
X10-2c GPU node: Bay12 port 2 |
U19: port 10 |
U02-04 |
X10-2c GPU node: Bay14 port 1 |
U18: port 9 |
U02-04 |
X10-2c GPU node: Bay14 port 2 |
U19: port 9 |
U02-04 |
X10-2c GPU node: Bay12 port 1 |
U18: port 8 |
U02-04 |
X10-2c GPU node: Bay12 port 2 |
U19: port 8 |