14 Cabling Tables for Oracle Exadata X8M
These tables show the cable layouts for Oracle Exadata X8M-2 and X8M-8.
Note:
For ease of reading, the name "Oracle Exadata Rack" is used when information refers to both Oracle Exadata and Oracle Exadata Storage Expansion Rack.- Rack Layout Diagrams
The diagrams in this topic show the rack layout for Oracle Exadata X8M-2 and X8M-8. - Integrated Lights Out Manager (ILOM) Cabling Tables
This topic contains the tables for the ILOM network cabling. - Administrative Ethernet Port Cabling Tables
This topic contains the tables for the administrative network cabling. - Single Phase Power Distribution Unit Cabling Tables
These tables show the cabling routes from each single-phase power distribution unit (PDU) to the power supplies configured in an Oracle Exadata Database Machine X8M-2 and X8M-8. - Three-Phase Power Distribution Unit Cabling Tables
The following topics contains the tables for a three-phase power distribution unit (PDU) in Oracle Exadata X8M-2 and X8M-8. - RDMA Network Fabric Network Cabling Tables
This section contains the tables for RDMA Network Fabric network cabling for Oracle Exadata X8M-2 and X8M-8 racks.
Parent topic: Cabling Information for Oracle Exadata Database Machine
14.1 Rack Layout Diagrams
The diagrams in this topic show the rack layout for Oracle Exadata X8M-2 and X8M-8.
The slot numbers for each component is shown in the following images.
The following image shows the front and rear views of the component positioning in Oracle Exadata X8M-2 Full Rack. The front view is shown on the left, and the rear view is shown on the right.
Figure 14-1 Rack Layout of Oracle Exadata X8M-2 Full Rack
The following image shows the front and rear views of the component positioning in Oracle Exadata X8M-8.
Figure 14-2 Rack Layout of Oracle Exadata X8M-8
Parent topic: Cabling Tables for Oracle Exadata X8M
14.2 Integrated Lights Out Manager (ILOM) Cabling Tables
This topic contains the tables for the ILOM network cabling.
The following tables are in this section:
- Table 14-1 ILOM Cabling for Oracle Exadata X8M-2 Full Rack
- Table 14-2 ILOM Cabling for Oracle Exadata X8M-8 Full Rack
In the following tables, Un denotes the unit height in the rack, where n is the number, such as U20. The cables used for ILOM are red in color.
The following table shows the cable connections from the ILOM port (NET MGT) on the servers to the Management Network Switch:
Table 14-1 ILOM Cabling for Oracle Exadata X8M-2 Full Rack
| From Rack Unit | Type of Equipment | Management Network Switch Port |
|---|---|---|
|
U39 |
Storage Server |
2 |
|
U37 |
Storage Server |
4 |
|
U35 |
Storage Server |
6 |
|
U33 |
Storage Server |
8 |
|
U31 |
Storage Server |
10 |
|
U29 |
Storage Server |
12 |
|
U27 |
Storage Server |
14 |
|
U26 |
Database server |
16 |
|
U25 |
Database server |
18 |
|
U24 |
Database server |
20 |
|
U23 |
Database server |
22 |
|
U22 (NET MGT 0) |
Leaf switch |
45 |
|
U20 (NET MGT 0) |
Leaf switch |
46 |
|
U19 |
Database server |
24 |
|
U18 |
Database server |
26 |
|
U17 |
Database server |
28 |
|
U16 |
Database server |
30 |
|
U14 |
Storage Server |
32 |
|
U12 |
Storage Server |
34 |
|
U10 |
Storage Server |
36 |
|
U8 |
Storage Server |
38 |
|
U6 |
Storage Server |
40 |
|
U4 |
Storage Server |
42 |
|
U2 |
Storage Server |
44 |
The following table shows the cable connections from the ILOM port on the servers to the Management Network Switch:
Table 14-2 ILOM Cabling for Oracle Exadata X8M-8 Full Rack
| From Rack Unit | Type of Equipment | Management Network Switch Port |
|---|---|---|
|
U41 |
Storage Server |
2 |
|
U39 |
Storage Server |
4 |
|
U37 |
Storage Server |
6 |
|
U35 |
Storage Server |
8 |
|
U33 |
Storage Server |
10 |
|
U31 |
Storage Server |
12 |
|
U29 |
Storage Server |
14 |
|
U24 |
Database server |
16 |
|
U16 |
Database server |
18 |
|
U14 |
Storage Server |
20 |
|
U12 |
Storage Server |
22 |
|
U10 |
Storage Server |
24 |
|
U8 |
Storage Server |
26 |
|
U6 |
Storage Server |
28 |
|
U4 |
Storage Server |
30 |
|
U2 |
Storage Server |
32 |
Parent topic: Cabling Tables for Oracle Exadata X8M
14.3 Administrative Ethernet Port Cabling Tables
This topic contains the tables for the administrative network cabling.
The Management Network Switch is located in rack unit 21 on Oracle Exadata X8M-2 racks and in rack unit 22 on Oracle Exadata X8M-8 racks.
In the following tables, Un denotes the unit height in the rack, where n is the number, such as U20. The cables used for the Management Network Switch are blue in color. The following tables are in this section:
- Table 14-3 Administrative Network Cabling for Oracle Exadata X8M-2 Full Rack
- Table 14-4 Administrative Network Cabling for Oracle Exadata X8M-8 Full Rack
The following table shows the cable connections from the Admin port in the rack components to the Management Network Switch:
Table 14-3 Administrative Network Cabling for Oracle Exadata X8M-2 Full Rack
| From Rack Unit | Type of Equipment | Management Network Switch Port |
|---|---|---|
|
U39 |
Storage Server |
1 |
|
U37 |
Storage Server |
3 |
|
U35 |
Storage Server |
5 |
|
U33 |
Storage Server |
7 |
|
U31 |
Storage Server |
9 |
|
U29 |
Storage Server |
11 |
|
U27 |
Storage Server |
13 |
|
U26 |
Database server |
15 |
|
U25 |
Database server |
17 |
|
U24 |
Database server |
19 |
|
U23 |
Database server |
21 |
|
U22 |
RDMA Network Fabric Switch |
45 |
|
U20 |
RDMA Network Fabric Switch |
46 |
|
U19 |
Database server |
23 |
|
U18 |
Database server |
25 |
|
U17 |
Database server |
27 |
|
U16 |
Database server |
29 |
|
U14 |
Storage Server |
31 |
|
U12 |
Storage Server |
33 |
|
U10 |
Storage Server |
35 |
|
U8 |
Storage Server |
37 |
|
U6 |
Storage Server |
39 |
|
U4 |
Storage Server |
41 |
|
U2 |
Storage Server |
43 |
|
U1 |
RDMA Network Fabric Switch Note that the spine switch is not included by default on Oracle Exadata X8M-2 racks, but port 47 is still reserved on the Management Network Switch for the spine RDMA Network Fabric switch. |
47 |
The following table shows the cable connections from the Admin port in the rack components to the Management Network Switch:
Table 14-4 Administrative Network Cabling for Oracle Exadata X8M-8 Full Rack
| From Rack Unit | Type of Equipment | Management Network Switch Port |
|---|---|---|
|
U41 |
Storage Server |
1 |
|
U39 |
Storage Server |
3 |
|
U37 |
Storage Server |
5 |
|
U35 |
Storage Server |
7 |
|
U33 |
Storage Server |
9 |
|
U31 |
Storage Server |
11 |
|
U29 |
Storage Server |
13 |
|
U24 |
Database server |
15 |
|
U23 |
RDMA Network Fabric Switch |
33 |
|
U21 |
RDMA Network Fabric Switch |
34 |
|
U16 |
Database server |
17 |
|
U14 |
Storage Server |
19 |
|
U12 |
Storage Server |
21 |
|
U10 |
Storage Server |
23 |
|
U8 |
Storage Server |
25 |
|
U6 |
Storage Server |
27 |
|
U4 |
Storage Server |
29 |
|
U2 |
Storage Server |
31 |
|
U1 |
RDMA Network Fabric Switch Note that the spine switch is not included by default on Oracle Exadata X8M-8 racks, but port 47 is still reserved on the Management Network Switch for the spine RDMA Network Fabric switch. |
35 |
Parent topic: Cabling Tables for Oracle Exadata X8M
14.4 Single Phase Power Distribution Unit Cabling Tables
These tables show the cabling routes from each single-phase power distribution unit (PDU) to the power supplies configured in an Oracle Exadata Database Machine X8M-2 and X8M-8.
- Single Phase PDU Cabling for Oracle Exadata Database Machine X8M-2 Full Rack
Single phase cabling for the Oracle Exadata Database Machine X8M-2 Full Rack routes from each power distribution unit (PDU) to the power supplies. - Single Phase PDU Cabling for Oracle Exadata Database Machine X8M-8 Full Rack
Single phase cabling for the Oracle Exadata Database Machine X8M-8 Full Rack routes from each power distribution unit (PDU) to the power supplies.
Parent topic: Cabling Tables for Oracle Exadata X8M
14.4.1 Single Phase PDU Cabling for Oracle Exadata Database Machine X8M-2 Full Rack
Single phase cabling for the Oracle Exadata Database Machine X8M-2 Full Rack routes from each power distribution unit (PDU) to the power supplies.
The cables are terminated to PDU-A on the left (when looking at the rear of the rack), and routed to the right to enter the cable management arm (CMA). The cables are bundled in groups of four. The PDU connections list the group and outlet on the PDU. So, for example, G5-5 refers to group 5 outlet 5.
Table 14-5 Single Phase PDU Cabling for Oracle Exadata Database Machine X8M-2 Full Rack
| Rack Unit | PS | PDU-A | PDU-B/PS1 | Cable Length |
|---|---|---|---|---|
|
U42 |
PS0 |
G5-3 |
G0-3 |
2 meters |
|
U41 |
PS0 |
G5-5 |
G0-1 |
2 meters |
|
U40 |
PS0 |
G5-6 |
G0-0 |
2 meters |
|
U39 |
PS0 |
G3-6 |
G2-0 |
2 meters |
|
U37 |
PS0 |
G3-0 |
G2-6 |
2 meters |
|
U35 |
PS0 |
G5-4 |
G0-2 |
2 meters |
|
U33 |
PS0 |
G4-1 |
G1-5 |
2 meters |
|
U31 |
PS0 |
G5-2 |
G0-4 |
2 meters |
|
U29 |
PS0 |
G5-1 |
G0-5 |
2 meters |
|
U27 |
PS0 |
G4-3 |
G1-3 |
2 meters |
|
U26 |
PS0 |
G4-6 |
G1-0 |
2 meters |
|
U25 |
PS0 |
G4-5 |
G1-1 |
2 meters |
|
U24 |
PS0 |
G4-2 |
G1-4 |
2 meters |
|
U23 |
PS0 |
G4-0 |
G1-6 |
2 meters |
|
U22 |
PS2 |
G1-6 |
G4-0 |
2 meters |
|
U21 |
PS2 |
G1-5 |
G4-1 |
2 meters |
|
U20 |
PS2 |
G1-2 |
G4-4 |
2 meters |
|
U19 |
PS0 |
G3-2 |
G2-4 |
2 meters |
|
U18 |
PS0 |
G2-6 |
G3-0 |
2 meters |
|
U17 |
PS0 |
G0-6 |
G5-0 |
2 meters |
|
U16 |
PS0 |
G0-3 |
G5-3 |
2 meters |
|
U14 |
PS0 |
G2-3 |
G3-3 |
2 meters |
|
U12 |
PS0 |
G2-4 |
G3-2 |
2 meters |
|
U10 |
PS0 |
G2-0 |
G3-6 |
2 meters |
|
U8 |
PS0 |
G2-5 |
G3-1 |
2 meters |
|
U6 |
PS0 |
G0-0 |
G5-6 |
2 meters |
|
U4 |
PS0 |
G0-1 |
G5-5 |
2 meters |
|
U2 |
PS0 |
G1-0 |
G4-6 |
2 meters |
|
U1 |
PS2 |
G3-5 |
G2-1 |
3 meters |
Parent topic: Single Phase Power Distribution Unit Cabling Tables
14.4.2 Single Phase PDU Cabling for Oracle Exadata Database Machine X8M-8 Full Rack
Single phase cabling for the Oracle Exadata Database Machine X8M-8 Full Rack routes from each power distribution unit (PDU) to the power supplies.
The cables are terminated to PDU-A on the left (when looking at the rear of the rack), and routed to the right to enter the cable management arm (CMA). The cables are bundled in groups of four. The PDU connections in the table below list the group and outlet on the PDU. So, for example, G5-5 refers to group 5 outlet 5.
Table 14-6 Single Phase PDU Cabling for Oracle Exadata Database Machine X8M-8 Full Rack
| Rack Unit | PS | PDU-A | PDU-B/PSU 1 | Cable Length |
|---|---|---|---|---|
|
U41 |
PS0 |
G3-5 |
G2-1 |
2 meters |
|
U39 |
PS0 |
G5-4 |
G0-2 |
2 meters |
|
U37 |
PS0 |
G5-2 |
G0-4 |
2 meters |
|
U35 |
PS0 |
G5-0 |
G0-6 |
2 meters |
|
U33 |
PS0 |
G3-4 |
G2-2 |
2 meters |
|
U31 |
PS0 |
G4-3 |
G1-3 |
2 meters |
|
U29 |
PS0 |
G3-6 |
G2-0 |
2 meters |
|
U24 |
PS0 |
G2-7 (PS2) |
G3-7 (PS3) |
1 meter |
|
U24 |
PS0 |
G4-7 |
G1-7 |
1 meter |
|
U23 |
PS2 |
G3-1 |
G2-5 |
2 meters |
|
U22 |
PS2 |
G2-6 |
G3-0 |
2 meters |
|
U21 |
PS2 |
G1-6 |
G4-0 |
2 meters |
|
U16 |
PS0 |
G1-7 (PS2) |
G4-7 (PS3) |
1 meter |
|
U16 |
PS0 |
G3-7 |
G2-7 |
1 meter |
|
U14 (only 2 DB servers) |
PS0 |
G2-0 |
G3-6 |
2 meters |
|
U12 (only 2 DB servers) |
PS0 |
G1-3 |
G4-3 |
2 meters |
|
U10 (only 2 DB servers) |
PS0 |
G1-0 |
G4-6 |
2 meters |
|
U10 (3 DB servers) |
PS0 |
G0-7 (PS2) |
G5-7 (PS3) |
1 meter |
|
U10 (3 DB servers) |
PS0 |
G5-7 |
G0-7 |
2 meters |
|
U8 |
PS0 |
G0-6 |
G5-0 |
2 meters |
|
U6 |
PS0 |
G0-4 |
G5-2 |
2 meters |
|
U4 |
PS0 |
G0-3 |
G5-3 |
2 meters |
|
U2 |
PS0 |
G0-1 |
G5-5 |
2 meters |
|
U1 |
PS2 |
G4-0 |
G1-6 |
3 meters |
Parent topic: Single Phase Power Distribution Unit Cabling Tables
14.5 Three-Phase Power Distribution Unit Cabling Tables
The following topics contains the tables for a three-phase power distribution unit (PDU) in Oracle Exadata X8M-2 and X8M-8.
- Three-Phase PDU Cabling for Oracle Exadata Database Machine X8M-2 Full Rack
Three-phase cabling for the Oracle Exadata Database Machine X8M-2 Full Rack routes from each power distribution unit (PDU) to the power supplies configured in each rack. - Three Phase PDU Cabling for Oracle Exadata Database Machine X8M-8 Full Rack
Three-phase cabling for the Oracle Exadata Database Machine X8M-8 Full Rack routes from each power distribution unit (PDU) to the power supplies configured in each rack.
Parent topic: Cabling Tables for Oracle Exadata X8M
14.5.1 Three-Phase PDU Cabling for Oracle Exadata Database Machine X8M-2 Full Rack
Three-phase cabling for the Oracle Exadata Database Machine X8M-2 Full Rack routes from each power distribution unit (PDU) to the power supplies configured in each rack.
The cables are terminated to PDU-A on the left (when looking at the rear of the rack), and routed to the right to enter the cable management arm (CMA). The cables are bundled in groups of four. The PDU connections list the group and outlet on the PDU. So, for example, G5-5 refers to group 5 outlet 5.
Table 14-7 Three Phase PDU Cabling for Oracle Exadata Database Machine X8M-2 Full Rack
| Rack Unit | PDU-A/PSU 0 | PDU-B/PSU 1 | Cable Length |
|---|---|---|---|
|
U42 |
G5-4 |
G2-2 |
2 meters |
|
U41 |
G5-2 |
G2-4 |
2 meters |
|
U40 |
G5-1 |
G2-5 |
2 meters |
|
U39 |
G5-6 |
G2-0 |
2 meters |
|
U37 |
G3-5 |
G0-1 |
2 meters |
|
U35 |
G3-0 |
G0-6 |
2 meters |
|
U33 |
G5-5 |
G2-1 |
2 meters |
|
U31 |
G5-3 |
G2-3 |
2 meters |
|
U29 |
G4-2 |
G1-4 |
2 meters |
|
U27 |
G3-2 |
G0-4 |
2 meters |
|
U26 |
G5-0 |
G2-6 |
2 meters |
|
U25 |
G4-5 |
G1-1 |
2 meters |
|
U24 |
G3-1 |
G0-5 |
2 meters |
|
U23 |
G4-1 |
G1-5 |
2 meters |
|
U22 |
G1-6 |
G4-0 |
2 meters |
|
U21 |
G2-6 |
G5-0 |
2 meters |
|
U20 |
G1-5 |
G4-1 |
2 meters |
|
U19 |
G1-1 |
G4-5 |
2 meters |
|
U18 |
G1-4 |
G4-2 |
2 meters |
|
U17 |
G2-1 |
G5-5 |
2 meters |
|
U16 |
G2-3 |
G5-3 |
2 meters |
|
U14 |
G0-5 |
G3-1 |
2 meters |
|
U12 |
G2-5 |
G5-1 |
2 meters |
|
U10 |
G0-3 |
G3-3 |
2 meters |
|
U8 |
G1-3 |
G4-3 |
2 meters |
|
U6 |
G2-4 |
G5-2 |
2 meters |
|
U4 |
G0-6 |
G3-0 |
2 meters |
|
U2 |
G0-0 |
G3-6 |
2 meters |
|
U1 |
G1-0 |
G4-6 |
3 meters |
Parent topic: Three-Phase Power Distribution Unit Cabling Tables
14.5.2 Three Phase PDU Cabling for Oracle Exadata Database Machine X8M-8 Full Rack
Three-phase cabling for the Oracle Exadata Database Machine X8M-8 Full Rack routes from each power distribution unit (PDU) to the power supplies configured in each rack.
The cables are terminated to PDU-A on the left (when looking at the rear of the rack), and routed to the right to enter the cable management arm (CMA). The cables are bundled in groups of four. The PDU connections list the group and outlet on the PDU. So, for example, G5-5 refers to group 5 outlet 5.
Table 14-8 Three Phase PDU Cabling for Oracle Exadata Database Machine X8M-8 Full Rack
| Rack Unit | PDU-A/PSU 0 | PDU-B/PSU 1 | Cable Length |
|---|---|---|---|
|
U41 |
G5-5 |
G2-1 |
2 meters |
|
U39 |
G5-4 |
G2-2 |
2 meters |
|
U37 |
G5-2 |
G2-4 |
2 meters |
|
U35 |
G5-1 |
G2-5 |
2 meters |
|
U33 |
G5-0 |
G2-6 |
2 meters |
|
U31 |
G4-6 |
G1-0 |
2 meters |
|
U29 |
G4-4 |
G1-2 |
2 meters |
|
U24 |
G3-7 (PS2) |
G0-7 (PS3) |
2 meters |
|
U24 |
G4-7 |
G1-7 |
2 meters |
|
U23 |
G3-1 |
G0-5 |
2 meters |
|
U22 |
G3-0 |
G0-6 |
2 meters |
|
U21 |
G2-5 |
G5-1 |
2 meters |
|
U16 |
G2-7 (PS2) |
G5-7 (PS3) |
2 meters |
|
U16 |
G1-7 |
G4-7 |
2 meters |
|
U14 (only 2 DB servers) |
G1-3 |
G4-3 |
2 meters |
|
U12 (only 2 DB servers) |
G1-0 |
G4-6 |
2 meters |
|
U10 (only 2 DB servers) |
G0-6 |
G3-0 |
2 meters |
|
U10 (3 DB servers) |
G5-7 (PS2) |
G2-7 (PS3) |
1 meter |
|
U10 (3 DB servers) |
G0-7 |
G3-7 |
1 meter |
|
U8 |
G0-5 |
G3-1 |
2 meters |
|
U6 |
G0-4 |
G3-2 |
2 meters |
|
U4 |
G0-2 |
G3-4 |
2 meters |
|
U2 |
G0-1 |
G3-5 |
2 meters |
|
U1 |
G0-0 |
G3-6 |
3 meters |
Parent topic: Three-Phase Power Distribution Unit Cabling Tables
14.6 RDMA Network Fabric Network Cabling Tables
This section contains the tables for RDMA Network Fabric network cabling for Oracle Exadata X8M-2 and X8M-8 racks.
- RDMA Network Fabric Network Cabling Tables for X8M-2 Racks
This topic contains the tables for RDMA Network Fabric network cabling for Oracle Exadata X8M-2 racks. - RDMA Network Fabric Network Cabling Tables for X8M-8 Racks
This topic contains the tables for RDMA Network Fabric network cabling for Oracle Exadata X8M-8 racks.
Parent topic: Cabling Tables for Oracle Exadata X8M
14.6.1 RDMA Network Fabric Network Cabling Tables for X8M-2 Racks
This topic contains the tables for RDMA Network Fabric network cabling for Oracle Exadata X8M-2 racks.
The RoCE Network Fabric switches are located in rack units 20 and 22 for Oracle Exadata X8M-2.
You can use the following tables for both flexible and fixed configurations. This first table contains RDMA Network Fabric cabling information for the database servers, each of which occupies 1RU. The second table covers the storage servers, each of which occupies 2RU. The last table contains the inter-switch cabling between the leaf switches.
Note:
Not all the slots shown in the tables below will be used in a single configuration. Match the rack component with the appropriate slot in the tables below to determine how to cable that particular component.In the following tables, Un denotes the slot in the rack, where n is the number, such as U20. Pn denotes the RDMA Network Fabric port n, where n is port number, such as P1. The cables used for the RDMA Network Fabric switch are black in color. The following tables are in this section:
- Table 14-9 RDMA Network Fabric Network Cabling for Oracle Exadata X8M-2 Database Servers
- Table 14-10 RDMA Network Fabric Network Cabling for Oracle Exadata X8M-2 Storage Servers
- Table 14-11 RDMA Network Fabric Inter-Switch Cabling for Oracle Exadata X8M-2
The following table lists the location, ports and cables for the RDMA Network Fabric connections for database servers in an Oracle Exadata X8M-2 rack.
Table 14-9 RDMA Network Fabric Network Cabling for Oracle Exadata Database Machine X8M-2 Database Servers
| From Rack Unit | Port | To RDMA Network Fabric Switch | Port | Description |
|---|---|---|---|---|
|
U39 |
PCIe 2, P2 |
U22 |
08 |
3 meters |
|
U39 |
PCIe 2, P1 |
U20 |
08 |
3 meters |
|
U37 |
PCIe 2, P2 |
U22 |
09 |
3 meters |
|
U37 |
PCIe 2, P1 |
U20 |
09 |
3 meters |
|
U35 |
PCIe 2, P2 |
U22 |
10 |
3 meters |
|
U35 |
PCIe 2, P1 |
U20 |
10 |
3 meters |
|
U33 |
PCIe 2, P2 |
U22 |
11 |
3 meters |
|
U33 |
PCIe 2, P1 |
U20 |
11 |
3 meters |
|
U31 |
PCIe 2, P2 |
U22 |
12 |
3 meters |
|
U31 |
PCIe 2, P1 |
U20 |
12 |
3 meters |
|
U29 |
PCIe 2, P2 |
U22 |
13 |
3 meters |
|
U29 |
PCIe 2, P1 |
U20 |
13 |
3 meters |
|
U27 |
PCIe 2, P2 |
U22 |
14 |
3 meters |
|
U27 |
PCIe 2, P1 |
U20 |
14 |
3 meters |
|
U26 |
PCIe 2, P2 |
U22 |
15 |
3 meters |
|
U26 |
PCIe 2, P1 |
U20 |
15 |
3 meters |
|
U25 |
PCIe 2, P2 |
U22 |
16 |
3 meters |
|
U25 |
PCIe 2, P1 |
U20 |
16 |
3 meters |
|
U24 |
PCIe 2, P2 |
U22 |
17 |
3 meters |
|
U24 |
PCIe 2, P1 |
U20 |
17 |
3 meters |
|
U23 |
PCIe 2, P2 |
U22 |
18 |
3 meters |
|
U23 |
PCIe 2, P1 |
U20 |
18 |
3 meters |
|
U19 |
PCIe 2, P2 |
U22 |
19 |
3 meters |
|
U19 |
PCIe 2, P1 |
U20 |
19 |
3 meters |
|
U18 |
PCIe 2, P2 |
U22 |
20 |
3 meters |
|
U18 |
PCIe 2, P1 |
U20 |
20 |
3 meters |
|
U17 |
PCIe 2, P2 |
U22 |
21 |
3 meters |
|
U17 |
PCIe 2, P1 |
U20 |
21 |
3 meters |
|
U16 |
PCIe 2, P2 |
U22 |
22 |
3 meters |
|
U16 |
PCIe 2, P1 |
U20 |
22 |
3 meters |
|
U14 |
PCIe 2, P2 |
U22 |
23 |
3 meters |
|
U14 |
PCIe 2, P1 |
U20 |
23 |
3 meters |
|
U12 |
PCIe 2, P2 |
U22 |
24 |
3 meters |
|
U12 |
PCIe 2, P1 |
U20 |
24 |
3 meters |
|
U10 |
PCIe 2, P2 |
U22 |
25 |
3 meters |
|
U10 |
PCIe 2, P1 |
U20 |
25 |
3 meters |
|
U08 |
PCIe 2, P2 |
U22 |
26 |
3 meters |
|
U08 |
PCIe 2, P1 |
U20 |
26 |
3 meters |
The following table lists the location, ports and cables for the RDMA Network Fabric connections for storage servers in an Oracle Exadata X8M-2 rack.
Table 14-10 RDMA Network Fabric Network Cabling for Oracle Exadata Database Machine X8M-2 Storage Servers
| From Rack Unit | Port | To RDMA Network Fabric Switch | Port | Description |
|---|---|---|---|---|
|
U41 |
PCIe 1, P2 |
U22 |
15 |
3 meters |
|
U41 |
PCIe 1, P1 |
U20 |
15 |
3 meters |
|
U39 |
PCIe 1, P2 |
U22 |
08 |
3 meters |
|
U39 |
PCIe 1, P1 |
U20 |
08 |
3 meters |
|
U37 |
PCIe 1, P2 |
U22 |
09 |
3 meters |
|
U37 |
PCIe 1, P1 |
U20 |
09 |
3 meters |
|
U35 |
PCIe 1, P2 |
U22 |
10 |
3 meters |
|
U35 |
PCIe 1, P1 |
U20 |
10 |
3 meters |
|
U33 |
PCIe 1, P2 |
U22 |
11 |
3 meters |
|
U33 |
PCIe 1, P1 |
U20 |
11 |
3 meters |
|
U31 |
PCIe 1, P2 |
U22 |
12 |
3 meters |
|
U31 |
PCIe 1, P1 |
U20 |
12 |
3 meters |
|
U29 |
PCIe 1, P2 |
U22 |
13 |
3 meters |
|
U29 |
PCIe 1, P1 |
U20 |
13 |
3 meters |
|
U27 |
PCIe 1, P2 |
U22 |
14 |
3 meters |
|
U27 |
PCIe 1, P1 |
U20 |
14 |
3 meters |
|
U25 |
PCIe 1, P2 |
U22 |
16 |
3 meters |
|
U25 |
PCIe 1, P1 |
U20 |
16 |
3 meters |
|
U23 |
PCIe 1, P2 |
U22 |
18 |
3 meters |
|
U23 |
PCIe 1, P1 |
U20 |
18 |
3 meters |
|
U18 |
PCIe 1, P2 |
U22 |
20 |
3 meters |
|
U18 |
PCIe 1, P1 |
U20 |
20 |
3 meters |
|
U14 |
PCIe 1, P2 |
U22 |
23 |
3 meters |
|
U14 |
PCIe 1, P1 |
U20 |
23 |
3 meters |
|
U12 |
PCIe 1, P2 |
U22 |
24 |
3 meters |
|
U12 |
PCIe 1, P1 |
U20 |
24 |
3 meters |
|
U10 |
PCIe 1, P2 |
U22 |
25 |
3 meters |
|
U10 |
PCIe 1, P1 |
U20 |
25 |
3 meters |
|
U08 |
PCIe 1, P2 |
U22 |
26 |
3 meters |
|
U08 |
PCIe 1, P1 |
U20 |
26 |
3 meters |
|
U06 |
PCIe 1, P2 |
U22 |
27 |
3 meters |
|
U06 |
PCIe 1, P1 |
U20 |
27 |
3 meters |
|
U04 |
PCIe 1, P2 |
U22 |
28 |
3 meters |
|
U04 |
PCIe 1, P1 |
U20 |
28 |
3 meters |
|
U02 |
PCIe 1, P2 |
U22 |
29 |
3 meters |
|
U02 |
PCIe 1, P1 |
U20 |
29 |
3 meters |
The following table lists the location, ports and cables for the RDMA Network Fabric connections for the leaf switches in an Oracle Exadata X8M-2 rack.
Table 14-11 RDMA Network Fabric Inter-Switch Cabling for Oracle Exadata Database Machine X8M-2
| From Rack Unit | Port | To RDMA Network Fabric Switch | Port | Description |
|---|---|---|---|---|
|
U20 |
04 |
U22 |
04 |
1 meter |
|
U20 |
05 |
U22 |
05 |
1 meter |
|
U20 |
06 |
U22 |
06 |
1 meter |
|
U20 |
07 |
U22 |
07 |
1 meter |
|
U20 |
30 |
U22 |
30 |
1 meter |
|
U20 |
31 |
U22 |
31 |
1 meter |
|
U20 |
32 |
U22 |
32 |
1 meter |
|
U20 |
33 |
U22 |
33 |
1 meter |
Parent topic: RDMA Network Fabric Network Cabling Tables
14.6.2 RDMA Network Fabric Network Cabling Tables for X8M-8 Racks
This topic contains the tables for RDMA Network Fabric network cabling for Oracle Exadata X8M-8 racks.
The RoCE Network Fabric switches are located in rack units 21 and 23 for Oracle Exadata X8M-8.
The following tables can be used for both flexible and fixed configurations. There are three sets of tables for each Exadata hardware model. One table is for storage servers, which have a 2-slot height (2RU). Another table is for the database servers, which require 5RU. The last table for each hardware model is for the inter-switch cabling, which provides the cabling information for the leaf switches.
Note:
Not all the slots shown in the tables below will be used in a single configuration. Match the rack component with the appropriate slot in the tables below to determine how to cable that particular component.In the following tables, Un denotes the slot in the rack, where n is the number, such as U23. Pn denotes the RDMA Network Fabric port n, where n is port number, such as P1. The cables used for the RDMA Network Fabric switch are black in color. The following tables are in this section:
- Table 14-12 RDMA Network Fabric Network Cabling for Oracle Exadata X8M-8 Database Servers
- Table 14-13 RDMA Network Fabric Network Cabling for Oracle Exadata X8M-8 Storage Servers
- Table 14-14 RDMA Network Fabric Inter-Switch Cabling for Oracle Exadata X8M-8
The following table lists the rack location, ports and cables for the RDMA Network Fabric connections for database servers in an Oracle Exadata X8M-8 rack.
Table 14-12 RDMA Network Fabric Network Cabling for Oracle Exadata Database Machine X8M-8 Database Servers
| From Rack Unit | Port | To RDMA Network Fabric Switch | Port | Description |
|---|---|---|---|---|
|
U24 |
PCIe 5, P2 |
U23 |
15 |
3 meters |
|
U24 |
PCIe 5, P1 |
U21 |
15 |
3 meters |
|
U24 |
PCIe 7, P2 |
U23 |
16 |
3 meters |
|
U24 |
PCIe 7, P1 |
U21 |
16 |
3 meters |
|
U24 |
PCIe 9, P2 |
U23 |
17 |
3 meters |
|
U24 |
PCIe 9, P1 |
U21 |
17 |
3 meters |
|
U24 |
PCIe 11, P2 |
U23 |
18 |
3 meters |
|
U24 |
PCIe 11, P1 |
U21 |
18 |
3 meters |
|
U16 |
PCIe 5, P2 |
U23 |
19 |
3 meters |
|
U16 |
PCIe 5, P1 |
U21 |
19 |
3 meters |
|
U16 |
PCIe 7, P2 |
U23 |
20 |
3 meters |
|
U16 |
PCIe 7, P1 |
U21 |
20 |
3 meters |
|
U16 |
PCIe 9, P2 |
U23 |
21 |
3 meters |
|
U16 |
PCIe 9, P1 |
U21 |
21 |
3 meters |
|
U16 |
PCIe 11, P2 |
U23 |
22 |
3 meters |
|
U16 |
PCIe 11, P1 |
U21 |
22 |
3 meters |
|
U10 |
PCIe 5, P2 |
U23 |
23 |
3 meters |
|
U10 |
PCIe 5, P1 |
U21 |
23 |
3 meters |
|
U10 |
PCIe 7, P2 |
U23 |
24 |
3 meters |
|
U10 |
PCIe 7, P1 |
U21 |
24 |
3 meters |
|
U10 |
PCIe 9, P2 |
U23 |
25 |
3 meters |
|
U10 |
PCIe 9, P1 |
U21 |
25 |
3 meters |
|
U10 |
PCIe 11, P2 |
U23 |
30 or 8 Note: Port 8 is the target only in a configuration with 3 database servers and 11 storage servers. Otherwise, port 30 is the target. |
3 meters |
|
U10 |
PCIe 11, P1 |
U21 |
30 or 8 Note: Port 8 is the target only in a configuration with 3 database servers and 11 storage servers. Otherwise, port 30 is the target. |
3 meters |
The following table lists the location, ports and cables for the RDMA Network Fabric connections for storage servers in an Oracle Exadata X8M-8 rack.
Table 14-13 RDMA Network Fabric Network Cabling for Oracle Exadata Database Machine X8M-8 Storage Servers
| From Rack Unit | Port | To RDMA Network Fabric Switch | Port | Description |
|---|---|---|---|---|
|
U41 |
PCIe 1, P2 |
U23 |
08 |
3 meters |
|
U41 |
PCIe 1, P1 |
U21 |
08 |
3 meters |
|
U39 |
PCIe 1, P2 |
U23 |
09 |
3 meters |
|
U39 |
PCIe 1, P1 |
U21 |
09 |
3 meters |
|
U37 |
PCIe 1, P2 |
U23 |
10 |
3 meters |
|
U37 |
PCIe 1, P1 |
U21 |
10 |
3 meters |
|
U35 |
PCIe 1, P2 |
U23 |
11 |
3 meters |
|
U35 |
PCIe 1, P1 |
U21 |
11 |
3 meters |
|
U33 |
PCIe 1, P2 |
U23 |
12 |
3 meters |
|
U33 |
PCIe 1, P1 |
U21 |
12 |
3 meters |
|
U31 |
PCIe 1, P2 |
U23 |
13 |
3 meters |
|
U31 |
PCIe 1, P1 |
U21 |
13 |
3 meters |
|
U29 |
PCIe 1, P2 |
U23 |
14 |
3 meters |
|
U29 |
PCIe 1, P1 |
U21 |
14 |
3 meters |
|
U14 |
PCIe 1, P2 |
U23 |
23 |
3 meters |
|
U14 |
PCIe 1, P1 |
U21 |
23 |
3 meters |
|
U12 |
PCIe 1, P2 |
U23 |
24 |
3 meters |
|
U12 |
PCIe 1, P1 |
U21 |
24 |
3 meters |
|
U10 |
PCIe 1, P2 |
U23 |
25 |
3 meters |
|
U10 |
PCIe 1, P1 |
U21 |
25 |
3 meters |
|
U08 |
PCIe 1, P2 |
U23 |
26 |
3 meters |
|
U08 |
PCIe 1, P1 |
U21 |
26 |
3 meters |
|
U06 |
PCIe 1, P2 |
U23 |
27 |
3 meters |
|
U06 |
PCIe 1, P1 |
U21 |
27 |
3 meters |
|
U04 |
PCIe 1, P2 |
U23 |
28 |
3 meters |
|
U04 |
PCIe 1, P1 |
U21 |
28 |
3 meters |
|
U02 |
PCIe 1, P2 |
U23 |
29 |
3 meters |
|
U02 |
PCIe 1, P1 |
U21 |
29 |
3 meters |
The following table lists the location, ports and cables for the RDMA Network Fabric connections for the leaf switches in an Oracle Exadata X8M-8 rack.
Table 14-14 RDMA Network Fabric Inter-Switch Cabling for Oracle Exadata Database Machine X8M-8
| From Rack Unit | Port | To RDMA Network Fabric Switch | Port | Description |
|---|---|---|---|---|
|
U21 |
04 |
U23 |
04 |
1 meter |
|
U21 |
05 |
U23 |
05 |
1 meter |
|
U21 |
06 |
U23 |
06 |
1 meter |
|
U21 |
07 |
U23 |
07 |
1 meter |
|
U21 |
30 or 34 Note: Port 34 is used only in a configuration with 3 database servers and 11 storage servers. Otherwise, port 30 is used. |
U23 |
30 or 34 Note: Port 34 is used only in a configuration with 3 database servers and 11 storage servers. Otherwise, port 30 is used. |
1 meter |
|
U21 |
31 |
U23 |
31 |
1 meter |
|
U21 |
32 |
U23 |
32 |
1 meter |
|
U21 |
33 |
U23 |
33 |
1 meter |
Parent topic: RDMA Network Fabric Network Cabling Tables