RDMA Network Fabric Switch-to-Server Cabling Connections
For InfiniBand Network Fabric, Table 20-8 lists the location, ports, and cables for the connections from the gateway leaf switches to the servers in a Recovery Appliance X8, X7, X6 or X5 full rack. The port numbers and cable lengths are the same in racks with fewer storage servers. The switches are located in rack units 20 and 22.
All cables are black quad data rate (QDR) cables.
Table 20-8 RDMA Network Fabric Switch-to-Server Cabling for the Recovery Appliance X8, X7, X6 or X5 Full Racks
| From InfiniBand Switch Rack Unit(1) | Port | To Rack Unit | Device | Port | Cable Length |
|---|---|---|---|---|---|
| U22 | 6B | U41 | Storage server | PCIe 7, P1 | 3 meters |
| U22 | 0A | U39 | Storage server | PCIe 7, P1 | 3 meters |
| U22 | 0B | U37 | Storage server | PCIe 7, P1 | 3 meters |
| U22 | 1A | U35 | Storage server | PCIe 7, P1 | 3 meters |
| U22 | 1B | U33 | Storage server | PCIe 7, P1 | 3 meters |
| U22 | 2A | U31 | Storage server | PCIe 7, P1 | 3 meters |
| U22 | 2B | U29 | Storage server | PCIe 7, P1 | 3 meters |
| U22 | 3B | U27 | Storage server | PCIe 7, P1 | 3 meters |
| U22 | 4A | U25 | Storage server | PCIe 7, P1 | 2 meters |
| U22 | 5A | U23 | Storage server | PCIe 7, P1 | 2 meters |
| U22 | 13A | U18 | Storage server | PCIe 7, P2 | 2 meters |
| U22 | 13B | U17 | Compute server | PCIe 7, P2 | 2 meters |
| U22 | 14B | U16 | Compute server | PCIe 7, P2 | 2 meters |
| U22 | 14A | U14 | Storage server | PCIe 7, P2 | 3 meters |
| U22 | 15A | U12 | Storage server | PCIe 7, P2 | 3 meters |
| U22 | 15B | U10 | Storage server | PCIe 7, P2 | 3 meters |
| U22 | 16A | U8 | Storage server | PCIe 7, P2 | 3 meters |
| U22 | 16B | U6 | Storage server | PCIe 7, P2 | 3 meters |
| U22 | 17A | U4 | Storage server | PCIe 7, P2 | 3 meters |
| U22 | 17B | U2 | Storage server | PCIe 7, P2 | 3 meters |
| U20 | 6B | U41 | Storage server | PCIe 7, P2 | 3 meters |
| U20 | 0A | U39 | Storage server | PCIe 7, P2 | 3 meters |
| U20 | 0B | U37 | Storage server | PCIe 7, P2 | 3 meters |
| U20 | 1A | U35 | Storage server | PCIe 7, P2 | 3 meters |
| U20 | 1B | U33 | Storage server | PCIe 7, P2 | 3 meters |
| U20 | 2A | U31 | Storage server | PCIe 7, P2 | 3 meters |
| U20 | 2B | U29 | Storage server | PCIe 7, P2 | 3 meters |
| U20 | 3B | U27 | Storage server | PCIe 7, P2 | 3 meters |
| U20 | 4A | U25 | Storage server | PCIe 7, P2 | 2 meters |
| U20 | 5A | U23 | Storage server | PCIe 7, P2 | 2 meters |
| U20 | 13A | U18 | Storage server | PCIe 7, P1 | 2 meters |
| U20 | 13B | U17 | Compute server | PCIe 2, P1 | 2 meters |
| U20 | 14B | U16 | Compute server | PCIe 2, P1 | 2 meters |
| U20 | 14A | U14 | Storage server | PCIe 7, P1 | 2 meters |
| U20 | 15A | U12 | Storage server | PCIe 7, P1 | 3 meters |
| U20 | 15B | U10 | Storage server | PCIe 7, P1 | 3 meters |
| U20 | 16A | U8 | Storage server | PCIe 7, P1 | 3 meters |
| U20 | 16B | U6 | Storage server | PCIe 7, P1 | 3 meters |
| U20 | 17A | U4 | Storage server | PCIe 7, P1 | 3 meters |
| U20 | 17B | U2 | Storage server | PCIe 7, P1 | 3 meters |
Footnote 1 Un is the unit location in the rack, where n is the number.