I/O Interfaces

The ExpressModule includes the following interfaces:

Two 4x InfiniBand copper connectors

PCI ExpressModule to Server/Workstation connector

I/O panel LEDs

InfiniBand Interface

The Sun Dual Port 4x DDR IB Host Channel Adapter PCIe ExpressModule is compliant with the InfiniBand Architecture Specification, Release 1.2. It has two compliant 4x InfiniBand ports (Port 1 and Port 2); each having four Tx/Rx pairs of SerDes. The ExpressModule provides access to these ports by means of two 4x InfiniBand connectors for external InfiniBand copper cables also compliant with the IBTA specification 1.2. Connector 1 connects to Port 1 of the device, while connector 2 connects to Port 2.

Furthermore, the ExpressModule is embedded with a media detect circuit that supports external InfiniBand active copper and fiber solutions.

PCI ExpressModule Interface

The ExpressModule is compatible with the PCI ExpressModule Electromechanical Specification, Revision 1.1. The device can be either a master initiating the PCI Express bus operations, or a slave responding to PCI bus operations.

LED Assignment

The ExpressModule has four LEDs located on the InfiniBand ports panel, with two LEDs for each 4x port - see FIGURE 6-1.

The Physical Link (green) illuminates once VAPI (InfiniBand Verbs API) is started and a physical connection is made between two nodes.

The Data Activity Link (yellow) illuminates once the InfiniBand network is discovered over the physical link.

The Activity Link is a steady yellow when the network is discovered but no data is being passed. The activity link blinks when data is being passed.

If the LEDs are not active, either the physical or the logical (or both) connections have not been established.

FIGURE 6-1 InfiniBand Ports and LEDs

Figure shows ports and LEDs on the InfiniBand ports panel.

Figure Legend Ports and LEDs on the Infiniband Ports Panel
1	Port 1
2	Physical Link - Green
3	Data Activity - Yellow
4	Port2
5	Physical Link - Green
6	Data Activity - Yellow

Power

The ExpressModule receives power from the Server/Workstation slot connector. All other required power is generated by ExpressModule switch-mode regulators. For power consumption see Appendix A.

Memory

The ExpressModule supports multiple memory devices through the PCI Express, Flash, and I²C-compatible interfaces.

The ExpressModule utilizes the PCI Express interface to store and access IB fabric connection information on the system memory.