Documentation, Support, and Training
Understanding the Installation
Fabric Card Handling Guidelines
Fabric Card and Line Card Fillers
Suggested Tools for Installation
Antistatic Precautions for Installation
Installing the InfiniBand Software Stack
Install the HPC Software Suite
Remove the Shipping Carton Contents
Unsecure the Chassis From the Pallet
Install the Rail Assemblies in the Rack
Install the Chassis in the Rack
Inspecting the Midplane for Installation
Identify the Midplane Fabric Card Connectors
Inspect the Pins on the Rear Side of the Midplane
Identify the Midplane Line Card Connectors
Inspect the Pins on the Front Side of the Midplane
Inspecting the Fabric Cards for Installation
Identify the Fabric Cards for Installation
Inspect the Fabric Card Chassis for Installation
Inspect the Fabric Card Retainer Bolts for Installation
Inspect the Fans for Installation
Inspect the Fabric Card XBOW Connectors for Installation
Inspecting the Line Cards for Installation
Identify the Line Cards for Installation
Inspect the Line Card Chassis for Installation
Inspect the Line Card Retainer Bolts for Installation
Inspect the Line Card XBOW Connectors for Installation
Inspect the Line Card CXP Connectors for Installation
Inspecting the InfiniBand Cables for Installation
Identify the InfiniBand Cable for Installation
Inspect the InfiniBand Cable Hardware for Installation
Inspect the InfiniBand Cable Connectors for Installation
Install the Midplane Stiffener
Install the Fabric Cards or Fabric Card Fillers
Install the Line Cards or Line Card Fillers
Check the Power Supply Status LEDs
Access the CMC From the Serial Management Port
Set the Initial UBoot Parameters
Access the CMC From the Network Management Port
Display the CMC FRU ID Information
Verify the Power Supply Status
Identify the Power Supply Addresses
Display the Power Supply FRU ID Information
Enable the Fabric Cards for Installation
Create the guid.txt File for Installation
Power On the Fabric Cards for Installation
Check the Fabric Card Status LEDs
Identify the Fabric Card Addresses
Display the Fabric Card FRU ID Information
Enable the Line Cards for Installation
Power On the Line Cards for Installation
Check the Line Card Status LEDs
Identify the Line Card Addresses
Display the Line Card FRU ID Information
Attach Cables to the CXP Connectors
Check the CXP Connector Status LEDs
Identify the CXP Connector Addresses
Display the InfiniBand Cable FRU ID Information
Verifying the InfiniBand Fabric
Discover the InfiniBand Fabric Topology
Perform Diagnostics on the InfiniBand Fabric
Validate the InfiniBand Fabric and Report Errors
Understanding ILOM on the Switch
Identify the prerequisite and subsequent tasks you must perform in conjunction with this procedure, to install the switch.
See the table in Installation Sequence.
On the CMC, verify that the installed fabric cards are active:
# showpresent | grep FC
If an installed fabric card is shown to be INACTIVE, investigate why.
Check for fabric card power faults:
# checkpwrfault | grep FC
If an installed fabric card is shown to FAIL, investigate why.
Check fabric card internal voltages:
# checkvoltages
If an installed fabric card is shown to FAIL, investigate why.
Verify that the fans are operating:
# checkfans
If a fan’s speed is too low or the fan has STOPPED, investigate why.
Verify that the switch chips in the fabric cards are operational:
# checkswitches | grep FC
If an installed fabric card is shown as not boot correct, investigate why.
Note - Fabric card fillers do not have any switch chips. The checkswitches command does not display any information about fabric card fillers.
Retrieve each fabric card’s firmware versions:
# getfwversion fc slot
where slot is the slot number for the installed fabric cards. For example:
# getfwversion fc 0 FW versions for FC 0 H8 version : 0.1.1 FC FPGA version : 1.0.1 I4 FW image version : 7.2.00 #
Repeat Step 7 and record the information for each fabric card and compare to identify any discrepancies.
All fabric cards should have the same firmware versions.
Consider your next step:
Switch Command Reference, showpresent command
Switch Command Reference, checkpwrfault command
Switch Command Reference, checkvoltages command
Switch Command Reference, checkfans command
Switch Command Reference, checkswitches command
Switch Command Reference, getfwversion command