InfiniBand Private Network Physical Connections (ZFS Storage Appliance)

The ZFS storage appliance connects to the InfiniBand private network through one of the two ZFS storage controllers. The ZFS storage controller contains one Sun Dual Port 40Gb InfiniBand QDR HCA. The two ports in each InfiniBand HCA are bonded together to increase available bandwidth. When bonded, the two ports appear as a single port, with a single IP address assigned to the two bonded ports, resulting in one IP address for InfiniBand private network connections for the ZFS storage controller.

The two ports in the InfiniBand HCA connect to a different leaf switch to provide redundancy between the ZFS storage controller and the leaf switches. The following figures show how redundancy is achieved with the InfiniBand connections between the ZFS storage controller and the leaf switches in the Full Rack and Half Rack configurations.

Figure 12  InfiniBand Connections for ZFS Storage Controllers, Full Rack

Figure 13  InfiniBand Connections for ZFS Storage Controllers, Half Rack