15.6.1 RDMA Network Fabric Network Cabling Tables for X8M-2 Racks

This topic contains the tables for RDMA Network Fabric network cabling for Oracle Exadata X8M-2 racks.

The RoCE Network Fabric switches are located in rack units 20 and 22 for Oracle Exadata X8M-2.

You can use the following tables for both flexible and fixed configurations. This first table contains RDMA Network Fabric cabling information for the database servers, each of which occupies 1RU. The second table covers the storage servers, each of which occupies 2RU. The last table contains the inter-switch cabling between the leaf switches.

Note:

Not all the slots shown in the tables below will be used in a single configuration. Match the rack component with the appropriate slot in the tables below to determine how to cable that particular component.

In the following tables, Un denotes the slot in the rack, where n is the number, such as U20. Pn denotes the RDMA Network Fabric port n, where n is port number, such as P1. The cables used for the RDMA Network Fabric switch are black in color. The following tables are in this section:

• Table 15-9 RDMA Network Fabric Network Cabling for Oracle Exadata X8M-2 Database Servers
• Table 15-10 RDMA Network Fabric Network Cabling for Oracle Exadata X8M-2 Storage Servers
• Table 15-11 RDMA Network Fabric Inter-Switch Cabling for Oracle Exadata X8M-2

The following table lists the location, ports and cables for the RDMA Network Fabric connections for database servers in an Oracle Exadata X8M-2 rack.

Table 15-9 RDMA Network Fabric Network Cabling for Oracle Exadata Database Machine X8M-2 Database Servers

From Rack Unit	Port	To RDMA Network Fabric Switch	Port	Description
U39	PCIe 2, P2	U22	08	3 meters
U39	PCIe 2, P1	U20	08	3 meters
U37	PCIe 2, P2	U22	09	3 meters
U37	PCIe 2, P1	U20	09	3 meters
U35	PCIe 2, P2	U22	10	3 meters
U35	PCIe 2, P1	U20	10	3 meters
U33	PCIe 2, P2	U22	11	3 meters
U33	PCIe 2, P1	U20	11	3 meters
U31	PCIe 2, P2	U22	12	3 meters
U31	PCIe 2, P1	U20	12	3 meters
U29	PCIe 2, P2	U22	13	3 meters
U29	PCIe 2, P1	U20	13	3 meters
U27	PCIe 2, P2	U22	14	3 meters
U27	PCIe 2, P1	U20	14	3 meters
U26	PCIe 2, P2	U22	15	3 meters
U26	PCIe 2, P1	U20	15	3 meters
U25	PCIe 2, P2	U22	16	3 meters
U25	PCIe 2, P1	U20	16	3 meters
U24	PCIe 2, P2	U22	17	3 meters
U24	PCIe 2, P1	U20	17	3 meters
U23	PCIe 2, P2	U22	18	3 meters
U23	PCIe 2, P1	U20	18	3 meters
U19	PCIe 2, P2	U22	19	3 meters
U19	PCIe 2, P1	U20	19	3 meters
U18	PCIe 2, P2	U22	20	3 meters
U18	PCIe 2, P1	U20	20	3 meters
U17	PCIe 2, P2	U22	21	3 meters
U17	PCIe 2, P1	U20	21	3 meters
U16	PCIe 2, P2	U22	22	3 meters
U16	PCIe 2, P1	U20	22	3 meters
U14	PCIe 2, P2	U22	23	3 meters
U14	PCIe 2, P1	U20	23	3 meters
U12	PCIe 2, P2	U22	24	3 meters
U12	PCIe 2, P1	U20	24	3 meters
U10	PCIe 2, P2	U22	25	3 meters
U10	PCIe 2, P1	U20	25	3 meters
U08	PCIe 2, P2	U22	26	3 meters
U08	PCIe 2, P1	U20	26	3 meters

The following table lists the location, ports and cables for the RDMA Network Fabric connections for storage servers in an Oracle Exadata X8M-2 rack.

Table 15-10 RDMA Network Fabric Network Cabling for Oracle Exadata Database Machine X8M-2 Storage Servers

From Rack Unit	Port	To RDMA Network Fabric Switch	Port	Description
U41	PCIe 1, P2	U22	15	3 meters
U41	PCIe 1, P1	U20	15	3 meters
U39	PCIe 1, P2	U22	08	3 meters
U39	PCIe 1, P1	U20	08	3 meters
U37	PCIe 1, P2	U22	09	3 meters
U37	PCIe 1, P1	U20	09	3 meters
U35	PCIe 1, P2	U22	10	3 meters
U35	PCIe 1, P1	U20	10	3 meters
U33	PCIe 1, P2	U22	11	3 meters
U33	PCIe 1, P1	U20	11	3 meters
U31	PCIe 1, P2	U22	12	3 meters
U31	PCIe 1, P1	U20	12	3 meters
U29	PCIe 1, P2	U22	13	3 meters
U29	PCIe 1, P1	U20	13	3 meters
U27	PCIe 1, P2	U22	14	3 meters
U27	PCIe 1, P1	U20	14	3 meters
U25	PCIe 1, P2	U22	16	3 meters
U25	PCIe 1, P1	U20	16	3 meters
U23	PCIe 1, P2	U22	18	3 meters
U23	PCIe 1, P1	U20	18	3 meters
U18	PCIe 1, P2	U22	20	3 meters
U18	PCIe 1, P1	U20	20	3 meters
U14	PCIe 1, P2	U22	23	3 meters
U14	PCIe 1, P1	U20	23	3 meters
U12	PCIe 1, P2	U22	24	3 meters
U12	PCIe 1, P1	U20	24	3 meters
U10	PCIe 1, P2	U22	25	3 meters
U10	PCIe 1, P1	U20	25	3 meters
U08	PCIe 1, P2	U22	26	3 meters
U08	PCIe 1, P1	U20	26	3 meters
U06	PCIe 1, P2	U22	27	3 meters
U06	PCIe 1, P1	U20	27	3 meters
U04	PCIe 1, P2	U22	28	3 meters
U04	PCIe 1, P1	U20	28	3 meters
U02	PCIe 1, P2	U22	29	3 meters
U02	PCIe 1, P1	U20	29	3 meters

The following table lists the location, ports and cables for the RDMA Network Fabric connections for the leaf switches in an Oracle Exadata X8M-2 rack.

Table 15-11 RDMA Network Fabric Inter-Switch Cabling for Oracle Exadata Database Machine X8M-2

From Rack Unit	Port	To RDMA Network Fabric Switch	Port	Description
U20	04	U22	04	1 meter
U20	05	U22	05	1 meter
U20	06	U22	06	1 meter
U20	07	U22	07	1 meter
U20	30	U22	30	1 meter
U20	31	U22	31	1 meter
U20	32	U22	32	1 meter
U20	33	U22	33	1 meter