6 Cabling Reference

This section provides a reference for the cabling between components of Oracle Private Cloud Appliance.

Management Switch Ethernet Connections

This section lists the cabling connections for the management switch. They are Ethernet connections intended for the internal administration network.

From Rack Unit From Component and Port To Management Switch Rack Unit and Port

--

bastion

U26: port 2

U41*

compute node: NET0

U26: port 42

U40*

compute node: NET0

U26: port 41

U39*

compute node: NET0

U26: port 40

U38*

compute node: NET0

U26: port 39

U37*

compute node: NET0

U26: port 38

U36*

compute node: NET0

U26: port 37

U35*

compute node: NET0

U26: port 36

U34*

compute node: NET0

U26: port 35

U32

leaf switch: NET MGMT

U26: port 14

U31

leaf switch: NET MGMT

U26: port 13

U25

spine switch: NET MGMT

U26: port 34

U24

spine switch: NET MGMT

U26: port 33

U23*

compute node: NET0

U26: port 23

U22*

compute node: NET0

U26: port 22

U21*

compute node: NET0

U26: port 21

U20*

compute node: NET0

U26: port 20

U19*

compute node: NET0

U26: port 19

U18*

compute node: NET0

U26: port 18

U17*

compute node: NET0

U26: port 17

U16*

compute node: NET0

U26: port 16

U15

compute node: NET0

U26: port 15

U14

compute node: NET0

U26: port 12

U13

compute node: NET0

U26: port 11

U12

compute node: NET0

U26: port 10

U11

compute node: NET0

U26: port 9

U10

compute node: NET0

U26: port 8

U09

compute node: NET0

U26: port 7

U08

compute node: NET0

U26: port 6

U07

management node: NET0

U26: port 5

U06

management node: NET0

U26: port 32

U05

management node: NET0

U26: port 31

U03

ZFS storage appliance controller: NET0

U26: port 28

U03

ZFS storage appliance controller: PCIe 6-2

U26: port 29

U01

ZFS storage appliance controller: NET0

U26: port 25

U01

ZFS storage appliance controller: PCIe 6-2

U26: port 26

N/A

PDU-A

U26: port 24

N/A

PDU-B

U26: port 43

N/A

Oracle Support

U26: port 1

* Indicates a rack unit designated as a flex bay. These rack units can contain compute nodes or storage nodes. The rack unit and port numbers assigned to flex bays only apply when a compute node is installed in that location.

Spine and Leaf Switch Data Network Connections

This section lists the cabling connections for the spine and leaf switches. They are high speed Ethernet connections up to 100Gbit, intended for the internal data network.

From Rack Unit From Component and Port To Spine or Leaf Switch Rack Unit and Port

U41

compute node: port 1

U24: port 31

U41

compute node: port 2

U25: port 31

U40

compute node: port 1

U24: port 30

U40

compute node: port 2

U25: port 30

U39

compute node: port 1

U24: port 29

U39

compute node: port 2

U25: port 29

U38

compute node: port 1

U24: port 28

U38

compute node: port 2

U25: port 28

U37

compute node: port 1

U24: port 27

U37

compute node: port 2

U25: port 27

U36

compute node: port 1

U24: port 26

U36

compute node: port 2

U25: port 26

U35

compute node: port 1

U24: port 25

U35

compute node: port 2

U25: port 25

U34

compute node: port 1

U24: port 24

U34

compute node: port 2

U25: port 24

U23

compute node: port 1

U24: port 23

U23

compute node: port 2

U25: port 23

U22

compute node: port 1

U24: port 22

U22

compute node: port 2

U25: port 22

U21

compute node: port 1

U24: port 21

U21

compute node: port 2

U25: port 21

U20

compute node: port 1

U24: port 20

U20

compute node: port 2

U25: port 20

U19

compute node: port 1

U24: port 19

U19

compute node: port 2

U25: port 19

U18

compute node: port 1

U24: port 18

U18

compute node: port 2

U25: port 18

U17

compute node: port 1

U24: port 17

U17

compute node: port 2

U25: port 17

U16

compute node: port 1

U24: port 16

U16

compute node: port 2

U25: port 16

U15

compute node: port 1

U24: port 15

U15

compute node: port 2

U25: port 15

U14

compute node: port 1

U24: port 14

U14

compute node: port 2

U25: port 14

U13

compute node: port 1

U24: port 13

U13

compute node: port 2

U25: port 13

U12

compute node: port 1

U24: port 12

U12

compute node: port 2

U25: port 12

U11

compute node: port 1

U24: port 11

U11

compute node: port 2

U25: port 11

U10

compute node: port 1

U24: port 10

U10

compute node: port 2

U25: port 10

U09

compute node: port 1

U24: port 9

U09

compute node: port 2

U25: port 9

U08

compute node: port 1

U24: port 8

U08

compute node: port 2

U25: port 8

U07

management node: port 1

U24: port 7

U07

management node: port 2

U25: port 7

U06

management node: port 1

U24: port 6

U06

management node: port 2

U25: port 6

U05

management node: port 1

U24: port 5

U05

management node: port 2

U25: port 5

U03

Oracle ZFS Storage Appliance ZS9-2 controller: PCIE3 port 1

U31: port 35

U03

Oracle ZFS Storage Appliance ZS9-2 controller: PCIE10 port 1

U32: port 35

U01

Oracle ZFS Storage Appliance ZS9-2 controller: PCIE3 port 1

U31: port 33

U01

Oracle ZFS Storage Appliance ZS9-2 controller: PCIE10 port 1

U32: port 33

Data and Spine Switch Interconnects

This section lists the cabling connections between the data and spine switches. They are 100GbE Ethernet connections intended for high bandwidth traffic between the data and spine switches.

Spine Switch to Data Switch Connections

This section lists the cabling connections between the data switches and spine switches.

From Rack Unit From Component and Port To Rack Unit To Component and Port

U31

spine switch: port 23

U24

data switch: port 33

U31

spine switch: port 24

U24

data switch: port 34

U31

spine switch: port 25

U25

data switch: port 35

U31

spine switch: port 26

U25

data switch: port 36

U32

spine switch: port 23

U25

data switch: port 33

U32

spine switch: port 24

U25

data switch: port 34

U32

spine switch: port 25

U24

data switch: port 35

U32

spine switch: port 26

U24

data switch: port 36

Data Switch to Data Switch Connections

This section lists the cabling connections between the data switches.

From Rack Unit From Component and Port To Rack Unit To Component and Port

U24

data switch: port 3

U25

data switch: port 3

U24

data switch: port 4

U25

data switch: port 4

Spine Switch to Spine Switch Connections

This section lists the cabling connections between the spine switches.

From Rack Unit From Component and Port To Rack Unit To Component and Port

U31

spine switch: port 28

U32

spine switch: port 28

U31

spine switch: port 29

U32

spine switch: port 29

U31

spine switch: port 30

U32

spine switch: port 30

U31

spine switch: port 31

U32

spine switch: port 31

U31

spine switch: port 32

U32

spine switch: port 32