C H A P T E R 2 - Installing the Adapter

C H A P T E R 2

Installing the Adapter

This chapter describes how to install both the Sun IB-Host Channel Adapter PCI-ExpressModule hardware and verify that it has been installed correctly. It contains the following section:

Installing the Hardware

Verifying the Installation

Installing the Hardware

The following instructions describe the basic tasks required to install the adapter. Refer to your system installation or service manual for detailed ExpressModule adapter installation instructions

To Install the Adapter

1. Halt and power off your system.

2. Install the IB-EM card into the ExpressModule slot, pushing the card's edge connector into the connector on the chassis.

Ensure that the front plate on the IB-EM card mounts flush with the chassis panel opening.

3. Connect the 4x end of the InfiniBand I/O cable(s) to the IB-EM port connector(s).

Ensure that the connectors are properly engaged.

Caution - Avoid putting unnecessary stress on the connection. Do not bend or twist the cable near the connectors and avoid cable bends of more than 90 degrees.

4. If not already connected, connect the 12x end of the InfiniBand I/O cable(s) to the appropriate ports on the InfiniBand switch.

5. Turn power back on to the system and allow the server to reboot.

This completes the hardware installation. Proceed to the verification instructions in To Verify the Installation.

Verifying the Installation

Before you can verify the installation, you must install the adapter in the chassis, power the server, and cable it to an operational InfiniBand switch. The InfiniBand switch should automatically recognize InfiniBand servers when they are connected to the fabric.

To Verify the Installation

1. Ensure that the cables are connected to the adapter and switches.

2. Verify that the IB Subnet Manager is running on the IB switch.

3. Check that the green LED is illuminated for each port that is connected to the switch.

If the green LED is not on, check the cable connections at the adapter and at the switch.

4. Check that the amber LED is illuminated for each port that is connected to the switch.

If the amber LED is not on, refer to Appendix B, Diagnostic Software and Troubleshooting for more information.

5. Verify that the IB-EM ports are up and the driver is attached.

To do this, type the following command:

# dmesg | grep tavor

The output shows recently printed system diagnostic messages that have the string tavor in the message. Included in the output is a message that tells whether the port is up or down. See the information in bold italics in the following example:

Feb 17 20:30:42 hostname px_pci: [ID 370704 kern.info] PCI-device: pciex15b3,6278@0, tavor0

Feb 17 20:30:42 hostname genunix: [ID 936769 kern.info] tavor0 is /pci@7c0/pci@0/pci@8/pciex15b3,6278@0

Feb 17 20:30:42 hostname tavor: [ID 548581 kern.info] tavor0: FW ver: 0004.0007.0190, HW rev: a0

Feb 17 20:30:42 hostname tavor: [ID 827127 kern.info] tavor0: MT23108 Sun Microsystems InfiniBand HCA (0x0003ba0001001c18)

Feb 17 20:30:45 hostname genunix: [ID 979957 kern.info] NOTICE: tavor0: port 1 up

Feb 17 20:30:45 hostname genunix: [ID 611667 kern.info] NOTICE: tavor0: port 2 up

Feb 17 20:30:58 hostname genunix: [ID 408114 kern.info] /pci@7c0/pci@0/pci@8/pciex15b3,6278@0 (tavor0) online