13.3 RDMA Network Fabric Cabling for Oracle Exadata Database Machine X10M

This topic contains RDMA Network Fabric cabling details for Oracle Exadata Database Machine X10M.

The RDMA Network Fabric leaf switches are located in rack units 20 and 22 for Oracle Exadata Database Machine X10M.

The following table describes the connections between the servers and the RDMA Network Fabric leaf switches in an Oracle Exadata Database Machine X10M rack that is fully populated with database servers and storage servers. All connections in this table use QSFP28 100G cables that are 3 meters long.

In the following tables, UN denotes the rack unit location, where U42 is at the top of the rack and U1 is at the bottom of the rack.

Table 13-2 RDMA Network Fabric Cabling for Oracle Exadata Database Machine X10M Servers and Leaf Switches

From Server in Rack Unit Server Port To RDMA Network Fabric Switch in Rack Unit RDMA Network Fabric Switch Port

U41

PCIe Slot 5, Port 2

U22

15

U41

PCIe Slot 5, Port 1

U20

15

U39

PCIe Slot 5, Port 2

U22

08

U39

PCIe Slot 5, Port 1

U20

08

U37

PCIe Slot 5, Port 2

U22

09

U37

PCIe Slot 5, Port 1

U20

09

U35

PCIe Slot 5, Port 2

U22

10

U35

PCIe Slot 5, Port 1

U20

10

U33

PCIe Slot 5, Port 2

U22

11

U33

PCIe Slot 5, Port 1

U20

11

U31

PCIe Slot 5, Port 2

U22

12

U31

PCIe Slot 5, Port 1

U20

12

U29

PCIe Slot 5, Port 2

U22

13

U29

PCIe Slot 5, Port 1

U20

13

U27

PCIe Slot 5, Port 2

U22

14

U27

PCIe Slot 5, Port 1

U20

14

U25

PCIe Slot 5, Port 2

U22

16

U25

PCIe Slot 5, Port 1

U20

16

U23

PCIe Slot 5, Port 2

U22

18

U23

PCIe Slot 5, Port 1

U20

18

U18

PCIe Slot 5, Port 2

U22

20

U18

PCIe Slot 5, Port 1

U20

20

U16

PCIe Slot 5, Port 2

U22

22

U16

PCIe Slot 5, Port 1

U20

22

U14

PCIe Slot 5, Port 2

U22

23

U14

PCIe Slot 5, Port 1

U20

23

U12

PCIe Slot 5, Port 2

U22

24

U12

PCIe Slot 5, Port 1

U20

24

U10

PCIe Slot 5, Port 2

U22

25

U10

PCIe Slot 5, Port 1

U20

25

U8

PCIe Slot 5, Port 2

U22

26

U8

PCIe Slot 5, Port 1

U20

26

U6

PCIe Slot 5, Port 2

U22

27

U6

PCIe Slot 5, Port 1

U20

27

U4

PCIe Slot 5, Port 2

U22

28

U4

PCIe Slot 5, Port 1

U20

28

U2

PCIe Slot 5, Port 2

U22

29

U2

PCIe Slot 5, Port 1

U20

29

The following table describes the inter-switch connections between the RDMA Network Fabric leaf switches in an Oracle Exadata Database Machine X10M rack. All connections in this table use QSFP28 100G cables that are 1 meter long.

Table 13-3 RDMA Network Fabric Inter-Switch Cabling for Oracle Exadata Database Machine X10M

From RDMA Network Fabric Switch in Rack Unit Port To RDMA Network Fabric Switch in Rack Unit Port

U20

04

U22

04

U20

05

U22

05

U20

06

U22

06

U20

07

U22

07

U20

30

U22

30

U20

31

U22

31

U20

32

U22

32

U20

33

U22

33