InfiniBand Private Network Physical Connections (SPARC T4-4 Servers)

Each SPARC T4-4 server contains four dual-ported Sun QDR InfiniBand PCIe Low Profile host channel adapters (HCAs). The InfiniBand HCAs are installed in the following express module ports in every SPARC T4-4 server:

• Express module slot 1

• Express module slot 7

• Express module slot 9

• Express module slot 12

See Card and Port Locations (SPARC T4-4 Servers) for more information on the location of the InfiniBand HCAs.

The two ports in each InfiniBand HCA (ports 1 and 2) connect to a different leaf switch to provide redundancy between the SPARC T4-4 servers and the leaf switches. The following figure shows how redundancy is achieved with the InfiniBand connections between the SPARC T4-4 servers and the leaf switches in a half rack configuration.

Note that only the physical connections for the InfiniBand private network are described in this section. Once the logical domains are created for each SPARC T4-4 server, the InfiniBand private network will be configured differently depending on the type of domain created for the SPARC T4-4 servers. The number of IP addresses needed for the InfiniBand network will also vary, depending on the type of domains created on each SPARC T4-4 server. For more information, see Understanding the SPARC SuperCluster T4-4 Configurations.