Private Cloud ApplianceX10-2c GPU Expansion Rack Cabling

This section describes the cabling of an X10-2c GPU expansion rack. Inter-rack cabling information is critical to connect the GPU expansion rack to the appliance base rack correctly. The internal component cabling information can be used as a reference, for example in case of hardware maintenance or when installing additional GPU nodes.

Inter-Rack Ethernet Connections

The table lists the cabling connections between the Private Cloud Appliance base rack and up to two X10-2c GPU expansion racks. These are Ethernet connections between the management and data network switches installed in each rack.

Base Rack Unit From Switch/Port GPU Rack 1 GPU Rack 2 To Switch/Port

U24 (pcaswmn01)

MgmtBase: port 49

U22 (pcaswmn02)

--

MgmtExp1: port 49

U24 (pcaswmn01)

MgmtBase: port 50

U22 (pcaswmn02)

--

MgmtExp1: port 50

U24 (pcaswmn01)

MgmtBase: port 51

--

U22 (pcaswmn03)

MgmtExp2: port 49

U24 (pcaswmn01)

MgmtBase: port 52

--

U22 (pcaswmn03)

MgmtExp2: port 50

U29 (pcaswsp01)

Spine1: port 11

U18 (pcaswlf03)

--

Leaf1Exp1: port 33

U29 (pcaswsp01)

Spine1: port 12

U18 (pcaswlf03)

--

Leaf1Exp1: port 34

U29 (pcaswsp01)

Spine1: port 13

U19 (pcaswlf04)

--

Leaf2Exp1: port 33

U29 (pcaswsp01)

Spine1: port 14

U19 (pcaswlf04)

--

Leaf2Exp1: port 34

U29 (pcaswsp01)

Spine1: port 15

--

U18 (pcaswlf05)

Leaf1Exp2: port 33

U29 (pcaswsp01)

Spine1: port 16

--

U18 (pcaswlf05)

Leaf1Exp2: port 34

U29 (pcaswsp01)

Spine1: port 17

--

U19 (pcaswlf06)

Leaf2Exp2: port 33

U29 (pcaswsp01)

Spine1: port 18

--

U19 (pcaswlf06)

Leaf2Exp2: port 34

U30 (pcaswsp02)

Spine2: port 11

U18 (pcaswlf03)

--

Leaf1Exp1: port 35

U30 (pcaswsp02)

Spine2: port 12

U18 (pcaswlf03)

--

Leaf1Exp1: port 36

U30 (pcaswsp02)

Spine2: port 13

U19 (pcaswlf04)

--

Leaf2Exp1: port 35

U30 (pcaswsp02)

Spine2: port 14

U19 (pcaswlf04)

--

Leaf2Exp1: port 36

U30 (pcaswsp02)

Spine2: port 15

--

U18 (pcaswlf05)

Leaf1Exp2: port 35

U30 (pcaswsp02)

Spine2: port 16

--

U18 (pcaswlf05)

Leaf1Exp2: port 36

U30 (pcaswsp02)

Spine2: port 17

--

U19 (pcaswlf06)

Leaf2Exp2: port 35

U30 (pcaswsp02)

Spine2: port 18

--

U19 (pcaswlf06)

Leaf2Exp2: port 36

Management Switch Internal Ethernet Connections

The table lists the internal cabling connections for the management switch. These are Ethernet connections intended for the appliance administration network.

From Rack Unit From Component and Port To Management Switch Rack Unit and Port

U28-30

X10-2c GPU node: Bay11 port 0

U22: port 28

U28-30

X10-2c GPU node: NETMGT

U22: port 27

U24-26

X10-2c GPU node: Bay11 port 0

U22: port 26

U24-26

X10-2c GPU node: NETMGT

U22: port 25

U21

PDU: NETMGT

U22: port 4

U20

PDU: NETMGT

U22: port 3

U19

Leaf switch: NET MGMT

U22: port 46

U18

Leaf switch: NET MGMT

U22: port 45

U14-16

X10-2c GPU node: Bay11 port 0

U22: port 24

U14-16

X10-2c GPU node: NETMGT

U22: port 23

U10-12

X10-2c GPU node: Bay11 port 0

U22: port 22

U10-12

X10-2c GPU node: NETMGT

U22: port 21

U06-08

X10-2c GPU node: Bay11 port 0

U22: port 20

U06-08

X10-2c GPU node: NETMGT

U22: port 19

U02-04

X10-2c GPU node: Bay11 port 0

U22: port 18

U02-04

X10-2c GPU node: NETMGT

U22: port 17

N/A

Oracle Support

U22: port 1

Leaf Switch Internal Ethernet Connections

The table lists the internal cabling connections for the leaf switches. These are high speed (100Gbps) Ethernet connections intended for the appliance data network.

From Rack Unit From Component and Port To Leaf Switch Rack Unit and Port

U28-30

X10-2c GPU node: Bay14 port 1

U18: port 19

U28-30

X10-2c GPU node: Bay14 port 2

U19: port 19

U28-30

X10-2c GPU node: Bay12 port 1

U18: port 18

U28-30

X10-2c GPU node: Bay12 port 2

U19: port 18

U24-26

X10-2c GPU node: Bay14 port 1

U18: port 17

U24-26

X10-2c GPU node: Bay14 port 2

U19: port 17

U24-26

X10-2c GPU node: Bay12 port 1

U18: port 16

U24-26

X10-2c GPU node: Bay12 port 2

U19: port 16

U14-16

X10-2c GPU node: Bay14 port 1

U18: port 15

U14-16

X10-2c GPU node: Bay14 port 2

U19: port 15

U14-16

X10-2c GPU node: Bay12 port 1

U18: port 14

U14-16

X10-2c GPU node: Bay12 port 2

U19: port 14

U10-12

X10-2c GPU node: Bay14 port 1

U18: port 13

U10-12

X10-2c GPU node: Bay14 port 2

U19: port 13

U10-12

X10-2c GPU node: Bay12 port 1

U18: port 12

U10-12

X10-2c GPU node: Bay12 port 2

U19: port 12

U06-08

X10-2c GPU node: Bay14 port 1

U18: port 11

U06-08

X10-2c GPU node: Bay14 port 2

U19: port 11

U06-08

X10-2c GPU node: Bay12 port 1

U18: port 10

U06-08

X10-2c GPU node: Bay12 port 2

U19: port 10

U02-04

X10-2c GPU node: Bay14 port 1

U18: port 9

U02-04

X10-2c GPU node: Bay14 port 2

U19: port 9

U02-04

X10-2c GPU node: Bay12 port 1

U18: port 8

U02-04

X10-2c GPU node: Bay12 port 2

U19: port 8