Appendix B Cabling Reference

This appendix provides a reference for the cabling between components of Oracle Private Cloud Appliance.

B.1 Cisco Nexus 9348GC-FXP Switch Management Ethernet Connections

This section lists the cabling connections for the Cisco Nexus 9348GC-FXP Switch. They are Ethernet connections intended for the internal administration network.

Table B.1 Cabling Connections for Cisco Nexus 9348GC-FXP Switch

From Rack Unit

From Component and Port

To Cisco Nexus 9348GC-FXP Switch Rack Unit and Port

U39

compute node: NET0

U21: port 20

U38

compute node: NET0

U21: port 19

U37

compute node: NET0

U21: port 18

U36

compute node: NET0

U21: port 17

U35

compute node: NET0

U21: port 16

U34

compute node: NET0

U21: port 15

U33

compute node: NET0

U21: port 42

U32

compute node: NET0

U21: port 41

U31

compute node: NET0

U21: port 40

U30

compute node: NET0

U21: port 39

U29

compute node: NET0

U21: port 38

U28

compute node: NET0

U21: port 37

U27

compute node: NET0

U21: port 36

U26

compute node: NET0

U21: port 35

U23

Cisco Nexus 9336C-FX2 Switch: NET MGMT

U21: port 14

U22

Cisco Nexus 9336C-FX2 Switch: NET MGMT

U21: port 13

U16

Cisco Nexus 9336C-FX2 Switch: NET MGMT

U21: port 34

U15

Cisco Nexus 9336C-FX2 Switch: NET MGMT

U21: port 33

U14

compute node: NET0

U21: port 12

U13

compute node: NET0

U21: port 11

U12

compute node: NET0

U21: port 10

U11

compute node: NET0

U21: port 9

U10

compute node: NET0

U21: port 8

U09

compute node: NET0

U21: port 7

U08

compute node: NET0

U21: port 6

U07

compute node: NET0

U21: port 5

U06

management node: NET0

U21: port 32

U05

management node: NET0

U21: port 31

U03

ZFS storage appliance controller: NET0

U21: port 28

U03

ZFS storage appliance controller: PCIe 5/0

U21: port 29

U03

ZFS storage appliance controller: PCIe 5/1

U21: port 30

U01

ZFS storage appliance controller: NET0

U21: port 25

U01

ZFS storage appliance controller: PCIe 5/0

U21: port 26

U01

ZFS storage appliance controller: PCIe 5/1

U21: port 27

N/A

PDU-A

U21: port 24

N/A

PDU-B

U21: port 43

N/A

Oracle Support

U21: port 1


B.2 Cisco Nexus 9336C-FX2 Switch Data Network Connections

This section lists the cabling connections for the Cisco Nexus 9336C-FX2 Switch. They are high speed Ethernet connections up to 100Gbit, intended for the internal data network.

Table B.2 Cabling Connections for Cisco Nexus 9336C-FX2 Switch

From Rack Unit

From Component and Port

To Cisco Nexus 9336C-FX2 Switch Rack Unit and Port

U39

compute node: CX-5 HCA port 1

U15: port 28

U39

compute node: CX-5 HCA port 2

U16: port 28

U38

compute node: CX-5 HCA port 1

U15: port 27

U38

compute node: CX-5 HCA port 2

U16: port 27

U37

compute node: CX-5 HCA port 1

U15: port 26

U37

compute node: CX-5 HCA port 2

U16: port 26

U36

compute node: CX-5 HCA port 1

U15: port 25

U36

compute node: CX-5 HCA port 2

U16: port 25

U35

compute node: CX-5 HCA port 1

U15: port 24

U35

compute node: CX-5 HCA port 2

U16: port 24

U34

compute node: CX-5 HCA port 1

U15: port 23

U34

compute node: CX-5 HCA port 2

U16: port 23

U33

compute node: CX-5 HCA port 1

U15: port 22

U33

compute node: CX-5 HCA port 2

U16: port 22

U32

compute node: CX-5 HCA port 1

U15: port 21

U32

compute node: CX-5 HCA port 2

U16: port 21

U31

compute node: CX-5 HCA port 1

U15: port 20

U31

compute node: CX-5 HCA port 2

U16: port 20

U30

compute node: CX-5 HCA port 1

U15: port 19

U30

compute node: CX-5 HCA port 2

U16: port 19

U29

compute node: CX-5 HCA port 1

U15: port 18

U29

compute node: CX-5 HCA port 2

U16: port 18

U28

compute node: CX-5 HCA port 1

U15: port 17

U28

compute node: CX-5 HCA port 2

U16: port 17

U27

compute node: CX-5 HCA port 1

U15: port 16

U27

compute node: CX-5 HCA port 2

U16: port 16

U26

compute node: CX-5 HCA port 1

U15: port 15

U26

compute node: CX-5 HCA port 2

U16: port 15

U14

compute node: CX-5 HCA port 1

U15: port 14

U14

compute node: CX-5 HCA port 2

U16: port 14

U13

compute node: CX-5 HCA port 1

U15: port 13

U13

compute node: CX-5 HCA port 2

U16: port 13

U12

compute node: CX-5 HCA port 1

U15: port 12

U12

compute node: CX-5 HCA port 2

U16: port 12

U11

compute node: CX-5 HCA port 1

U15: port 11

U11

compute node: CX-5 HCA port 2

U16: port 11

U10

compute node: CX-5 HCA port 1

U15: port 10

U10

compute node: CX-5 HCA port 2

U16: port 10

U09

compute node: CX-5 HCA port 1

U15: port 9

U09

compute node: CX-5 HCA port 2

U16: port 9

U08

compute node: CX-5 HCA port 1

U15: port 8

U08

compute node: CX-5 HCA port 2

U16: port 8

U07

compute node: CX-5 HCA port 1

U15: port 7

U07

compute node: CX-5 HCA port 2

U16: port 7

U06

management node: CX-5 HCA port 1

U15: port 6

U06

management node: CX-5 HCA port 2

U16: port 6

U05

management node: CX-5 HCA port 1

U15: port 5

U05

management node: CX-5 HCA port 2

U16: port 5

U04

Oracle ZFS Storage Appliance ZS7-2 controller: slot 4 port 1

U22: port 35

U04

Oracle ZFS Storage Appliance ZS7-2 controller: slot 4 port 2

U23: port 35

U03

Oracle ZFS Storage Appliance ZS7-2 controller: slot 8 port 1

U22: port 36

U03

Oracle ZFS Storage Appliance ZS7-2 controller: slot 8 port 2

U23: port 36

U02

Oracle ZFS Storage Appliance ZS7-2 controller: slot 4 port 1

U22: port 33

U02

Oracle ZFS Storage Appliance ZS7-2 controller: slot 4 port 2

U23: port 33

U01

Oracle ZFS Storage Appliance ZS7-2 controller: slot 8 port 1

U22: port 34

U01

Oracle ZFS Storage Appliance ZS7-2 controller: slot 8 port 2

U23: port 34


B.3 Data and Spine Switch Interconnects

This section lists the cabling connections between the Cisco Nexus 9348GC-FXP Switches performing the role of either data switch or spine switch. They are 100GbE Ethernet connections intended for high bandwidth traffic between the data and spine switches.

B.3.1 Spine Switch to Data Switch Connections

Table B.3 lists the cabling connections between the data switches and spine switches.

Table B.3 Cabling Connections Between Spine and Data Switches

From Rack Unit

From Component and Port

To Rack Unit

To Component and Port

U22

spine switch: port 23

U15

data switch: port 33

U22

spine switch: port 24

U15

data switch: port 34

U22

spine switch: port 25

U16

data switch: port 35

U22

spine switch: port 26

U16

data switch: port 36

U23

spine switch: port 23

U16

data switch: port 33

U23

spine switch: port 24

U16

data switch: port 34

U23

spine switch: port 25

U15

data switch: port 35

U23

spine switch: port 26

U15

data switch: port 36


B.3.2 Data Switch to Data Switch Connections

Table B.4 lists the cabling connections between the data switches.

Table B.4 Cabling Connections Between Data Switches

From Rack Unit

From Component and Port

To Rack Unit

To Component and Port

U15

data switch: port 3

U16

data switch: port 3

U15

data switch: port 4

U16

data switch: port 4


B.3.3 Spine Switch to Spine Switch Connections

Table B.5 lists the cabling connections between the spine switches.

Table B.5 Cabling Connections Between Spine Switches

From Rack Unit

From Component and Port

To Rack Unit

To Component and Port

U22

spine switch: port 28

U23

spine switch: port 28

U22

spine switch: port 29

U23

spine switch: port 29

U22

spine switch: port 30

U23

spine switch: port 30

U22

spine switch: port 31

U23

spine switch: port 31

U22

spine switch: port 32

U23

spine switch: port 32