Documentation, Support, and Training
Understanding Administrative Commands
Understanding the Component Addressing Scheme
Line Card CXP Connector Addressing
Switch-Specific Command Overview
InfiniBand Software Command Overview
Display the General Health of the Switch
Display Power Supplies Present
Check the Status of a Power Supply
Display the Firmware Version of a Power Supply
Check Internal Power and Temperature of a CMC
Check the Status LEDs of a CMC
Display the Firmware Version of a CMC
Display the Firmware Version of the Switch Chassis Manager
Check Fabric Card Power Faults
Check the Internal Power and Temperature of a Fabric Card
Check Fabric Card Internal Temperatures
Check Fabric Card Internal Voltages
Display the Base GUIDs of a Fabric Card
Check Fabric Card Link Status (Simple)
Check Fabric Card Link Status (Detailed)
Check Fabric Card Switch Chip Health
Check the IPMB State of a Fabric Card
Check the Status LEDs of a Fabric Card
Display the Firmware Versions of a Fabric Card
Check the Internal Power and Temperature of a Line Card
Check Line Card Internal Temperatures
Check Line Card Internal Voltages
Display the Base GUIDs of a Line Card
Check Line Card Link Status (Simple)
Check Line Card Link Status (Detailed)
Check Line Card Switch Chip Health
Check the IPMB State of a Line Card
Check the Status LEDs of a Line Card
Display the Firmware Versions of a Line Card
Checking Other Switch Characteristics
Display the Network Management Configuration
Locate a Switch Chip or Connector From the GUID
Monitoring the InfiniBand Fabric
Display Information About the Local HCA
Identify All HCAs in the Fabric
Identify All Switches in the Fabric
Display the InfiniBand Fabric Topology
Display a Route Through the Fabric
Display the Link Status of a Node
Display Data Counters for a Node
Display Low-Level Detailed Information About a Node
Display Low-Level Detailed Information About a Port
Determine the GUID and LID for a Node Within the Switch
Display OFED Software Version Information
Reconfigure the Network Management Parameters
Reconfigure the CMCs for Identical Addresses
Restart a Fabric Card or Filler
Enable a Fabric Card or Filler
Disable a Fabric Card or Filler
Enable Standby Power for a Fabric Card or Filler
Disable Standby Power for a Fabric Card or Filler
Enable a Fabric Card Slot for Hot-Insertion
Activate a Fabric Card or Filler
Deactivate a Fabric Card or Filler
Turn On a Fabric Card or Filler Locator LED
Turn Off a Fabric Card or Filler Locator LED
Enable Downed Fabric Card Links
Enable a Fabric Card Switch Chip Port
Disable a Fabric Card Switch Chip Port
Reset a Fabric Card Switch Chip
Enable Standby Power for a Line Card
Disable Standby Power for a Line Card
Enable a Line Card Slot for Hot-Insertion
Turn On a Line Card Locator LED
Turn Off a Line Card Locator LED
Enable a Line Card Switch Chip Port
Disable a Line Card Switch Chip Port
Controlling the InfiniBand Fabric
Perform Comprehensive Diagnostics for the Entire Fabric
Perform Comprehensive Diagnostics for a Route
Determine Changes to the InfiniBand Fabric Topology
Find 1x or SDR or DDR Links in the Fabric
Determine Which Links Are Experiencing Significant Errors
Controlling the Subnet Manager
Start the Subnet Manager With Min Hop Routing
Start the Subnet Manager With Fat Tree Routing
Start the Subnet Manager With the opensmd Daemon
Stop the Subnet Manager With the opensmd Daemon
Understanding Signal Routing Through the Switch
Understanding Switch Startup and Component Addition
Understanding ILOM on the Switch
Switching Between the ILOM Shell and the Linux Shell
Controlling ILOM Targets (CLI)
Upgrading the Switch Firmware Through ILOM (CLI)
Administering ILOM (Web Interface)
Access ILOM From the Web Interface
Monitoring ILOM Targets (Web Interface)
Controlling ILOM Targets (Web Interface)
Upgrading the Switch Firmware Through ILOM (Web Interface)
Understanding InfiniBand Cabling
Understanding Switch Specifications
Understanding the Installation
Installing the InfiniBand Software Stack
Verifying the InfiniBand Fabric
Understanding Service Procedures
Servicing the Fabric Cards and Fabric Card Fillers
Servicing the InfiniBand Cables
Doing Supportive Software Tasks
Understanding Switch-Specific Commands
If your InfiniBand fabric uses the Fat-Tree routing algorithm, you must provide a modified listing of fabric card GUIDs, called the root node GUID file, for the Subnet Manager. The /etc/opensm/guid.txt file is such a file. This procedure describes how to create the guid.txt file.
Note - In this procedure, you issue commands to both the CMC and the Linux InfiniBand host.
# getbaseguid fc slot
where slot is the number of the fabric card (0–8). For example:
# getbaseguid fc 0 Base GUID = 0x00bad0fc0009f000 #
Once you have recorded each fabric card’s GUID, you will have a list similar to the following on your Linux InfiniBand host:
0x00bad0fc0009f000 0x00bad0fc0033f100 0x00bad00017fcf200 0x00bad00005fcf300 0x00bad00003fcf400 0x00bad00007fcf500 0x00bad0fc0011f600 0x00bad0b00002f700 0x00bad0b00001f800
Note - If you have fewer than 9 fabric cards, your list will be smaller.
0xa2
0xb2
Note - For GUIDs that end with two zeros (00), you are effectively replacing the zeros with a2 and b2.
For example, 0x00bad0fc0009f000 becomes:
0x00bad0fc0009f0a2
0x00bad0fc0009f0b2
For example:
0x00bad0fc0009f0a2 0x00bad0fc0009f0b2 0x00bad0fc0033f1a2 0x00bad0fc0033f1b2 0x00bad00017fcf2a2 0x00bad00017fcf2b2 0x00bad00005fcf3a2 0x00bad00005fcf3b2 0x00bad00003fcf4a2 0x00bad00003fcf4b2 0x00bad00007fcf5a2 0x00bad00007fcf5b2 0x00bad0fc0011f6a2 0x00bad0fc0011f6b2 0x00bad0b00002f7a2 0x00bad0b00002f7b2 0x00bad0b00001f8a2 0x00bad0b00001f8b2
# chmod 0644 /etc/opensm/guid.txt #
Switch Command Reference, getbaseguid command
Switch Command Reference, opensm command