Private Cloud Appliance Compute Expansion Rack Cabling
This section describes the cabling of a compute expansion rack. Inter-rack cabling information is critical to connect the compute expansion rack to the appliance base rack correctly. The internal component cabling information can be used as a reference, for example in case of hardware maintenance or when installing additional compute nodes.
Inter-Rack Ethernet Connections
The table lists the cabling connections between the Private Cloud Appliance base rack and up to two compute expansion racks. These are Ethernet connections between the management and data network switches installed in each rack.
| Base Rack Unit | From Switch/Port | Exp Rack 1 | Exp Rack 2 | To Switch/Port |
|---|---|---|---|---|
|
U24 (pcaswmn01) |
MgmtBase: port 49 |
U18 (pcaswmn02) |
-- |
MgmtExp1: port 49 |
|
U24 (pcaswmn01) |
MgmtBase: port 50 |
U18 (pcaswmn02) |
-- |
MgmtExp1: port 50 |
|
U24 (pcaswmn01) |
MgmtBase: port 51 |
-- |
U18 (pcaswmn03) |
MgmtExp2: port 49 |
|
U24 (pcaswmn01) |
MgmtBase: port 52 |
-- |
U18 (pcaswmn03) |
MgmtExp2: port 50 |
|
U29 (pcaswsp01) |
Spine1: port 11 |
U19 (pcaswlf03) |
-- |
Leaf1Exp1: port 33 |
|
U29 (pcaswsp01) |
Spine1: port 12 |
U19 (pcaswlf03) |
-- |
Leaf1Exp1: port 34 |
|
U29 (pcaswsp01) |
Spine1: port 13 |
U20 (pcaswlf04) |
-- |
Leaf2Exp1: port 33 |
|
U29 (pcaswsp01) |
Spine1: port 14 |
U20 (pcaswlf04) |
-- |
Leaf2Exp1: port 34 |
|
U29 (pcaswsp01) |
Spine1: port 15 |
-- |
U19 (pcaswlf05) |
Leaf1Exp2: port 33 |
|
U29 (pcaswsp01) |
Spine1: port 16 |
-- |
U19 (pcaswlf05) |
Leaf1Exp2: port 34 |
|
U29 (pcaswsp01) |
Spine1: port 17 |
-- |
U20 (pcaswlf06) |
Leaf2Exp2: port 33 |
|
U29 (pcaswsp01) |
Spine1: port 18 |
-- |
U20 (pcaswlf06) |
Leaf2Exp2: port 34 |
|
U30 (pcaswsp02) |
Spine2: port 11 |
U19 (pcaswlf03) |
-- |
Leaf1Exp1: port 35 |
|
U30 (pcaswsp02) |
Spine2: port 12 |
U19 (pcaswlf03) |
-- |
Leaf1Exp1: port 36 |
|
U30 (pcaswsp02) |
Spine2: port 13 |
U20 (pcaswlf04) |
-- |
Leaf2Exp1: port 35 |
|
U30 (pcaswsp02) |
Spine2: port 14 |
U20 (pcaswlf04) |
-- |
Leaf2Exp1: port 36 |
|
U30 (pcaswsp02) |
Spine2: port 15 |
-- |
U19 (pcaswlf05) |
Leaf1Exp2: port 35 |
|
U30 (pcaswsp02) |
Spine2: port 16 |
-- |
U19 (pcaswlf05) |
Leaf1Exp2: port 36 |
|
U30 (pcaswsp02) |
Spine2: port 17 |
-- |
U20 (pcaswlf06) |
Leaf2Exp2: port 35 |
|
U30 (pcaswsp02) |
Spine2: port 18 |
-- |
U20 (pcaswlf06) |
Leaf2Exp2: port 36 |
Management Switch Internal Ethernet Connections
The table lists the internal cabling connections for the management switch. These are Ethernet connections intended for the appliance administration network.
| From Rack Unit | From Component and Port | To Management Switch Rack Unit and Port |
|---|---|---|
|
U32-33 |
compute node: NETMGT |
U18: port 40 |
|
U32-33 |
compute node: NET0 |
U18: port 39 |
|
U30-31 |
compute node: NETMGT |
U18: port 38 |
|
U30-31 |
compute node: NET0 |
U18: port 37 |
|
U28-29 |
compute node: NETMGT |
U18: port 36 |
|
U28-29 |
compute node: NET0 |
U18: port 35 |
|
U26-27 |
compute node: NETMGT |
U18: port 34 |
|
U26-27 |
compute node: NET0 |
U18: port 33 |
|
U24-25 |
compute node: NETMGT |
U18: port 32 |
|
U24-25 |
compute node: NET0 |
U18: port 31 |
|
U22-23 |
compute node: NETMGT |
U18: port 30 |
|
U22-23 |
compute node: NET0 |
U18: port 29 |
|
U20 |
Leaf switch: NET MGMT |
U18: port 46 |
|
U19 |
Leaf switch: NET MGMT |
U18: port 45 |
|
U16-17 |
compute node: NETMGT |
U18: port 28 |
|
U16-17 |
compute node: NET0 |
U18: port 27 |
|
U14-15 |
compute node: NETMGT |
U18: port 26 |
|
U14-15 |
compute node: NET0 |
U18: port 25 |
|
U12-13 |
compute node: NETMGT |
U18: port 24 |
|
U12-13 |
compute node: NET0 |
U18: port 23 |
|
U10-11 |
(reserved) |
|
|
U10-11 |
(reserved) |
|
|
U08-09 |
(reserved) |
|
|
U08-09 |
(reserved) |
|
|
U06-07 |
compute node: NETMGT |
U18: port 22 |
|
U06-07 |
compute node: NET0 |
U18: port 21 |
|
U04-05 |
compute node: NETMGT |
U18: port 20 |
|
U04-05 |
compute node: NET0 |
U18: port 19 |
|
U02-03 |
compute node: NETMGT |
U18: port 18 |
|
U02-03 |
compute node: NET0 |
U18: port 17 |
|
N/A |
Oracle Support |
U18: port 1 |
Leaf Switch Internal Ethernet Connections
The table lists the internal cabling connections for the leaf switches. These are high speed (100Gbps) Ethernet connections intended for the appliance data network.
| From Rack Unit | From Node Slot 1 and Port | To Leaf Switch Rack Unit and Port | From Node Slot 2 and Port | To Leaf Switch Rack Unit and Port |
|---|---|---|---|---|
|
U32-33 |
compute node: PCIe5 port 1 |
U19: port 31 |
compute node: PCIe5 port 2 |
U20: port 31 |
|
U32-33 |
compute node: PCIe1 port 1 |
U19: port 30 |
compute node: PCIe1 port 2 |
U20: port 30 |
|
U30-31 |
compute node: PCIe5 port 1 |
U19: port 29 |
compute node: PCIe5 port 2 |
U20: port 29 |
|
U30-31 |
compute node: PCIe1 port 1 |
U19: port 28 |
compute node: PCIe1 port 2 |
U20: port 28 |
|
U28-29 |
compute node: PCIe5 port 1 |
U19: port 27 |
compute node: PCIe5 port 2 |
U20: port 27 |
|
U28-29 |
compute node: PCIe1 port 1 |
U19: port 26 |
compute node: PCIe1 port 2 |
U20: port 26 |
|
U26-27 |
compute node: PCIe5 port 1 |
U19: port 25 |
compute node: PCIe5 port 2 |
U20: port 25 |
|
U26-27 |
compute node: PCIe1 port 1 |
U19: port 24 |
compute node: PCIe1 port 2 |
U20: port 24 |
|
U24-25 |
compute node: PCIe5 port 1 |
U19: port 23 |
compute node: PCIe5 port 2 |
U20: port 23 |
|
U24-25 |
compute node: PCIe1 port 1 |
U19: port 22 |
compute node: PCIe1 port 2 |
U20: port 22 |
|
U22-23 |
compute node: PCIe5 port 1 |
U19: port 21 |
compute node: PCIe5 port 2 |
U20: port 21 |
|
U22-23 |
compute node: PCIe1 port 1 |
U19: port 20 |
compute node: PCIe1 port 2 |
U20: port 20 |
|
U16-17 |
compute node: PCIe5 port 1 |
U19: port 19 |
compute node: PCIe5 port 2 |
U20: port 19 |
|
U16-17 |
compute node: PCIe1 port 1 |
U19: port 18 |
compute node: PCIe1 port 2 |
U20: port 18 |
|
U14-15 |
compute node: PCIe5 port 1 |
U19: port 17 |
compute node: PCIe5 port 2 |
U20: port 17 |
|
U14-15 |
compute node: PCIe1 port 1 |
U19: port 16 |
compute node: PCIe1 port 2 |
U20: port 16 |
|
U12-13 |
compute node: PCIe5 port 1 |
U19: port 15 |
compute node: PCIe5 port 2 |
U20: port 15 |
|
U12-13 |
compute node: PCIe1 port 1 |
U19: port 14 |
compute node: PCIe1 port 2 |
U20: port 14 |
|
U10-11 |
(reserved) |
U19: port 6 |
(reserved) |
U20: port 6 |
|
U08-09 |
(reserved) |
U19: port 5 |
(reserved) |
U20: port 5 |
|
U06-07 |
compute node: PCIe5 port 1 |
U19: port 13 |
compute node: PCIe5 port 2 |
U20: port 13 |
|
U06-07 |
compute node: PCIe1 port 1 |
U19: port 12 |
compute node: PCIe1 port 2 |
U20: port 12 |
|
U04-05 |
compute node: PCIe5 port 1 |
U19: port 11 |
compute node: PCIe5 port 2 |
U20: port 11 |
|
U04-05 |
compute node: PCIe1 port 1 |
U19: port 10 |
compute node: PCIe1 port 2 |
U20: port 10 |
|
U02-03 |
compute node: PCIe5 port 1 |
U19: port 9 |
compute node: PCIe5 port 2 |
U20: port 9 |
|
U02-03 |
compute node: PCIe1 port 1 |
U19: port 8 |
compute node: PCIe1 port 2 |
U20: port 8 |