10 Cabling Reference
This appendix provides a reference for the cabling between components of Oracle Private Cloud Appliance.
Cisco Nexus 9348GC-FXP Switch Management Ethernet Connections
This section lists the cabling connections for the Cisco Nexus 9348GC-FXP Switch. They are Ethernet connections intended for the internal administration network.
Table 10-1 Cabling Connections for Cisco Nexus 9348GC-FXP Switch
| From Rack Unit | From Component and Port | To Cisco Nexus 9348GC-FXP Switch Rack Unit and Port |
|---|---|---|
|
U39 |
compute node: NET0 |
U21: port 20 |
|
U38 |
compute node: NET0 |
U21: port 19 |
|
U37 |
compute node: NET0 |
U21: port 18 |
|
U36 |
compute node: NET0 |
U21: port 17 |
|
U35 |
compute node: NET0 |
U21: port 16 |
|
U34 |
compute node: NET0 |
U21: port 15 |
|
U33 |
compute node: NET0 |
U21: port 42 |
|
U32 |
compute node: NET0 |
U21: port 41 |
|
U31 |
compute node: NET0 |
U21: port 40 |
|
U30 |
compute node: NET0 |
U21: port 39 |
|
U29 |
compute node: NET0 |
U21: port 38 |
|
U28 |
compute node: NET0 |
U21: port 37 |
|
U27 |
compute node: NET0 |
U21: port 36 |
|
U26 |
compute node: NET0 |
U21: port 35 |
|
U23 |
Cisco Nexus 9336C-FX2 Switch: NET MGMT |
U21: port 14 |
|
U22 |
Cisco Nexus 9336C-FX2 Switch: NET MGMT |
U21: port 13 |
|
U16 |
Cisco Nexus 9336C-FX2 Switch: NET MGMT |
U21: port 34 |
|
U15 |
Cisco Nexus 9336C-FX2 Switch: NET MGMT |
U21: port 33 |
|
U14 |
compute node: NET0 |
U21: port 12 |
|
U13 |
compute node: NET0 |
U21: port 11 |
|
U12 |
compute node: NET0 |
U21: port 10 |
|
U11 |
compute node: NET0 |
U21: port 9 |
|
U10 |
compute node: NET0 |
U21: port 8 |
|
U09 |
compute node: NET0 |
U21: port 7 |
|
U08 |
compute node: NET0 |
U21: port 6 |
|
U07 |
compute node: NET0 |
U21: port 5 |
|
U06 |
management node: NET0 |
U21: port 32 |
|
U05 |
management node: NET0 |
U21: port 31 |
|
U03 |
ZFS storage appliance controller: NET0 |
U21: port 28 |
|
U03 |
ZFS storage appliance controller: PCIe 5/0 |
U21: port 29 |
|
U03 |
ZFS storage appliance controller: PCIe 5/1 |
U21: port 30 |
|
U01 |
ZFS storage appliance controller: NET0 |
U21: port 25 |
|
U01 |
ZFS storage appliance controller: PCIe 5/0 |
U21: port 26 |
|
U01 |
ZFS storage appliance controller: PCIe 5/1 |
U21: port 27 |
|
N/A |
PDU-A |
U21: port 24 |
|
N/A |
PDU-B |
U21: port 43 |
|
N/A |
Oracle Support |
U21: port 1 |
Cisco Nexus 9336C-FX2 Switch Data Network Connections
This section lists the cabling connections for the Cisco Nexus 9336C-FX2 Switch. They are high speed Ethernet connections up to 100Gbit, intended for the internal data network.
Table 10-2 Cabling Connections for Cisco Nexus 9336C-FX2 Switch
| From Rack Unit | From Component and Port | To Cisco Nexus 9336C-FX2 Switch Rack Unit and Port |
|---|---|---|
|
U39 |
compute node: CX-5 HCA port 1 |
U15: port 28 |
|
U39 |
compute node: CX-5 HCA port 2 |
U16: port 28 |
|
U38 |
compute node: CX-5 HCA port 1 |
U15: port 27 |
|
U38 |
compute node: CX-5 HCA port 2 |
U16: port 27 |
|
U37 |
compute node: CX-5 HCA port 1 |
U15: port 26 |
|
U37 |
compute node: CX-5 HCA port 2 |
U16: port 26 |
|
U36 |
compute node: CX-5 HCA port 1 |
U15: port 25 |
|
U36 |
compute node: CX-5 HCA port 2 |
U16: port 25 |
|
U35 |
compute node: CX-5 HCA port 1 |
U15: port 24 |
|
U35 |
compute node: CX-5 HCA port 2 |
U16: port 24 |
|
U34 |
compute node: CX-5 HCA port 1 |
U15: port 23 |
|
U34 |
compute node: CX-5 HCA port 2 |
U16: port 23 |
|
U33 |
compute node: CX-5 HCA port 1 |
U15: port 22 |
|
U33 |
compute node: CX-5 HCA port 2 |
U16: port 22 |
|
U32 |
compute node: CX-5 HCA port 1 |
U15: port 21 |
|
U32 |
compute node: CX-5 HCA port 2 |
U16: port 21 |
|
U31 |
compute node: CX-5 HCA port 1 |
U15: port 20 |
|
U31 |
compute node: CX-5 HCA port 2 |
U16: port 20 |
|
U30 |
compute node: CX-5 HCA port 1 |
U15: port 19 |
|
U30 |
compute node: CX-5 HCA port 2 |
U16: port 19 |
|
U29 |
compute node: CX-5 HCA port 1 |
U15: port 18 |
|
U29 |
compute node: CX-5 HCA port 2 |
U16: port 18 |
|
U28 |
compute node: CX-5 HCA port 1 |
U15: port 17 |
|
U28 |
compute node: CX-5 HCA port 2 |
U16: port 17 |
|
U27 |
compute node: CX-5 HCA port 1 |
U15: port 16 |
|
U27 |
compute node: CX-5 HCA port 2 |
U16: port 16 |
|
U26 |
compute node: CX-5 HCA port 1 |
U15: port 15 |
|
U26 |
compute node: CX-5 HCA port 2 |
U16: port 15 |
|
U14 |
compute node: CX-5 HCA port 1 |
U15: port 14 |
|
U14 |
compute node: CX-5 HCA port 2 |
U16: port 14 |
|
U13 |
compute node: CX-5 HCA port 1 |
U15: port 13 |
|
U13 |
compute node: CX-5 HCA port 2 |
U16: port 13 |
|
U12 |
compute node: CX-5 HCA port 1 |
U15: port 12 |
|
U12 |
compute node: CX-5 HCA port 2 |
U16: port 12 |
|
U11 |
compute node: CX-5 HCA port 1 |
U15: port 11 |
|
U11 |
compute node: CX-5 HCA port 2 |
U16: port 11 |
|
U10 |
compute node: CX-5 HCA port 1 |
U15: port 10 |
|
U10 |
compute node: CX-5 HCA port 2 |
U16: port 10 |
|
U09 |
compute node: CX-5 HCA port 1 |
U15: port 9 |
|
U09 |
compute node: CX-5 HCA port 2 |
U16: port 9 |
|
U08 |
compute node: CX-5 HCA port 1 |
U15: port 8 |
|
U08 |
compute node: CX-5 HCA port 2 |
U16: port 8 |
|
U07 |
compute node: CX-5 HCA port 1 |
U15: port 7 |
|
U07 |
compute node: CX-5 HCA port 2 |
U16: port 7 |
|
U06 |
management node: CX-5 HCA port 1 |
U15: port 6 |
|
U06 |
management node: CX-5 HCA port 2 |
U16: port 6 |
|
U05 |
management node: CX-5 HCA port 1 |
U15: port 5 |
|
U05 |
management node: CX-5 HCA port 2 |
U16: port 5 |
|
U04 |
Oracle ZFS Storage Appliance ZS7-2 controller: slot 4 port 1 |
U22: port 35 |
|
U04 |
Oracle ZFS Storage Appliance ZS7-2 controller: slot 4 port 2 |
U23: port 35 |
|
U03 |
Oracle ZFS Storage Appliance ZS7-2 controller: slot 8 port 1 |
U22: port 36 |
|
U03 |
Oracle ZFS Storage Appliance ZS7-2 controller: slot 8 port 2 |
U23: port 36 |
|
U02 |
Oracle ZFS Storage Appliance ZS7-2 controller: slot 4 port 1 |
U22: port 33 |
|
U02 |
Oracle ZFS Storage Appliance ZS7-2 controller: slot 4 port 2 |
U23: port 33 |
|
U01 |
Oracle ZFS Storage Appliance ZS7-2 controller: slot 8 port 1 |
U22: port 34 |
|
U01 |
Oracle ZFS Storage Appliance ZS7-2 controller: slot 8 port 2 |
U23: port 34 |
Data and Spine Switch Interconnects
This section lists the cabling connections between the Cisco Nexus 9348GC-FXP Switches performing the role of either data switch or spine switch. They are 100GbE Ethernet connections intended for high bandwidth traffic between the data and spine switches.
Spine Switch to Data Switch Connections
Table 10-3 lists the cabling connections between the data switches and spine switches.
Table 10-3 Cabling Connections Between Spine and Data Switches
| From Rack Unit | From Component and Port | To Rack Unit | To Component and Port |
|---|---|---|---|
|
U22 |
spine switch: port 23 |
U15 |
data switch: port 33 |
|
U22 |
spine switch: port 24 |
U15 |
data switch: port 34 |
|
U22 |
spine switch: port 25 |
U16 |
data switch: port 35 |
|
U22 |
spine switch: port 26 |
U16 |
data switch: port 36 |
|
U23 |
spine switch: port 23 |
U16 |
data switch: port 33 |
|
U23 |
spine switch: port 24 |
U16 |
data switch: port 34 |
|
U23 |
spine switch: port 25 |
U15 |
data switch: port 35 |
|
U23 |
spine switch: port 26 |
U15 |
data switch: port 36 |
Data Switch to Data Switch Connections
Table 10-4 lists the cabling connections between the data switches.
Table 10-4 Cabling Connections Between Data Switches
| From Rack Unit | From Component and Port | To Rack Unit | To Component and Port |
|---|---|---|---|
|
U15 |
data switch: port 3 |
U16 |
data switch: port 3 |
|
U15 |
data switch: port 4 |
U16 |
data switch: port 4 |
Spine Switch to Spine Switch Connections
Table 10-5 lists the cabling connections between the spine switches.
Table 10-5 Cabling Connections Between Spine Switches
| From Rack Unit | From Component and Port | To Rack Unit | To Component and Port |
|---|---|---|---|
|
U22 |
spine switch: port 28 |
U23 |
spine switch: port 28 |
|
U22 |
spine switch: port 29 |
U23 |
spine switch: port 29 |
|
U22 |
spine switch: port 30 |
U23 |
spine switch: port 30 |
|
U22 |
spine switch: port 31 |
U23 |
spine switch: port 31 |
|
U22 |
spine switch: port 32 |
U23 |
spine switch: port 32 |