Documentation, Support, and Training
Understanding the Installation
Fabric Card Handling Guidelines
Fabric Card and Line Card Fillers
Suggested Tools for Installation
Antistatic Precautions for Installation
Installing the InfiniBand Software Stack
Install the HPC Software Suite
Remove the Shipping Carton Contents
Unsecure the Chassis From the Pallet
Install the Rail Assemblies in the Rack
Install the Chassis in the Rack
Inspecting the Midplane for Installation
Identify the Midplane Fabric Card Connectors
Inspect the Pins on the Rear Side of the Midplane
Identify the Midplane Line Card Connectors
Inspect the Pins on the Front Side of the Midplane
Inspecting the Fabric Cards for Installation
Identify the Fabric Cards for Installation
Inspect the Fabric Card Chassis for Installation
Inspect the Fabric Card Retainer Bolts for Installation
Inspect the Fans for Installation
Inspect the Fabric Card XBOW Connectors for Installation
Inspecting the Line Cards for Installation
Identify the Line Cards for Installation
Inspect the Line Card Chassis for Installation
Inspect the Line Card Retainer Bolts for Installation
Inspect the Line Card XBOW Connectors for Installation
Inspect the Line Card CXP Connectors for Installation
Inspecting the InfiniBand Cables for Installation
Identify the InfiniBand Cable for Installation
Inspect the InfiniBand Cable Hardware for Installation
Inspect the InfiniBand Cable Connectors for Installation
Install the Midplane Stiffener
Install the Fabric Cards or Fabric Card Fillers
Install the Line Cards or Line Card Fillers
Check the Power Supply Status LEDs
Access the CMC From the Serial Management Port
Set the Initial UBoot Parameters
Access the CMC From the Network Management Port
Display the CMC FRU ID Information
Verify the Power Supply Status
Identify the Power Supply Addresses
Display the Power Supply FRU ID Information
Enable the Fabric Cards for Installation
Create the guid.txt File for Installation
Power On the Fabric Cards for Installation
Check the Fabric Card Status LEDs
Identify the Fabric Card Addresses
Display the Fabric Card FRU ID Information
Enable the Line Cards for Installation
Power On the Line Cards for Installation
Check the Line Card Status LEDs
Identify the Line Card Addresses
Display the Line Card FRU ID Information
Attach Cables to the CXP Connectors
Check the CXP Connector Status LEDs
Identify the CXP Connector Addresses
Display the InfiniBand Cable FRU ID Information
Verifying the InfiniBand Fabric
Perform Diagnostics on the InfiniBand Fabric
Validate the InfiniBand Fabric and Report Errors
Understanding ILOM on the Switch
The ibnetdiscover command enables you to see the InfiniBand fabric topology, and build a topology file which is used by the OpenSM Subnet Manager.
Identify the prerequisite and subsequent tasks you must perform in conjunction with this procedure, to install the switch.
See the table in Installation Sequence.
On the Linux InfiniBand host, type:
# ibnetdiscover # # Topology file: generated on Thu Oct 29 16:49:36 2009 # # Initiated from node 0003ba000100c708 port 0003ba000100c70a vendid=0x2c9 devid=0xbd36 sysimgguid=0x3ba2550282543 switchguid=0x21283a83ae11d2(21283a83ae11d2) Switch 36 "S-0021283a83ae11d2" # "Sun DCS 648 shmm1500 LC slot 1 switch 3" base port 0 lid 35 lmc 0 [1] "S-00bad0fc0100f8a2"[19] # "Sun DCS 648 shmm1500 FC slot 8 switch 0" lid 56 4xQDR [2] "S-00bad0fc0100f8b2"[36] # "Sun DCS 648 shmm1500 FC slot 8 switch 1" lid 57 4xQDR [3] "S-0021283a77bdf7a2"[19] # "Sun DCS 648 shmm1500 FC slot 7 switch 0" lid 54 4xQDR . . . vendid=0x2c9 devid=0x673c sysimgguid=0x3ba000100c70b caguid=0x3ba000100c708 Ca 2 "H-0003ba000100c708" # "nsn34-39 HCA-1" [2](3ba000100c70a) "S-00bad0cc010016a2"[22] # lid 58 lmc 0 "Sun DCS 648 shmm1500 LC slot 6 switch 0" lid 1 4xQDR #
Note - The output in the example is just a very small portion of the full output.
Perform InfiniBand fabric diagnostics.
Switch Command Reference, ibnetdiscover command