Administration > Administering the Switch > Controlling the InfiniBand Fabric > Controlling the Subnet Manager |
Documentation, Support, and Training
Understanding Administrative Commands
Understanding the Component Addressing Scheme
Line Card CXP Connector Addressing
Switch-Specific Command Overview
InfiniBand Software Command Overview
Display the General Health of the Switch
Display Power Supplies Present
Check the Status of a Power Supply
Display the Firmware Version of a Power Supply
Check Internal Power and Temperature of a CMC
Check the Status LEDs of a CMC
Display the Firmware Version of a CMC
Display the Firmware Version of the Switch Chassis Manager
Check Fabric Card Power Faults
Check the Internal Power and Temperature of a Fabric Card
Check Fabric Card Internal Temperatures
Check Fabric Card Internal Voltages
Display the Base GUIDs of a Fabric Card
Check Fabric Card Link Status (Simple)
Check Fabric Card Link Status (Detailed)
Check Fabric Card Switch Chip Health
Check the IPMB State of a Fabric Card
Check the Status LEDs of a Fabric Card
Display the Firmware Versions of a Fabric Card
Check the Internal Power and Temperature of a Line Card
Check Line Card Internal Temperatures
Check Line Card Internal Voltages
Display the Base GUIDs of a Line Card
Check Line Card Link Status (Simple)
Check Line Card Link Status (Detailed)
Check Line Card Switch Chip Health
Check the IPMB State of a Line Card
Check the Status LEDs of a Line Card
Display the Firmware Versions of a Line Card
Checking Other Switch Characteristics
Display the Network Management Configuration
Locate a Switch Chip or Connector From the GUID
Monitoring the InfiniBand Fabric
Display Information About the Local HCA
Identify All HCAs in the Fabric
Identify All Switches in the Fabric
Display the InfiniBand Fabric Topology
Display a Route Through the Fabric
Display the Link Status of a Node
Display Data Counters for a Node
Display Low-Level Detailed Information About a Node
Display Low-Level Detailed Information About a Port
Determine the GUID and LID for a Node Within the Switch
Display OFED Software Version Information
Reconfigure the Network Management Parameters
Reconfigure the CMCs for Identical Addresses
Enable and Activate a Power Supply
Deactivate and Disable a Power Supply
Restart a Fabric Card or Filler
Enable a Fabric Card or Filler
Disable a Fabric Card or Filler
Enable Standby Power for a Fabric Card or Filler
Disable Standby Power for a Fabric Card or Filler
Enable a Fabric Card Slot for Hot-Insertion
Activate a Fabric Card or Filler
Deactivate a Fabric Card or Filler
Turn On a Fabric Card or Filler Locator LED
Turn Off a Fabric Card or Filler Locator LED
Enable Downed Fabric Card Links
Enable a Fabric Card Switch Chip Port
Disable a Fabric Card Switch Chip Port
Reset a Fabric Card Switch Chip
Enable Standby Power for a Line Card
Disable Standby Power for a Line Card
Enable a Line Card Slot for Hot-Insertion
Turn On a Line Card Locator LED
Turn Off a Line Card Locator LED
Enable a Line Card Switch Chip Port
Disable a Line Card Switch Chip Port
Controlling the InfiniBand Fabric
Perform Comprehensive Diagnostics for the Entire Fabric
Perform Comprehensive Diagnostics for a Route
Determine Changes to the InfiniBand Fabric Topology
Find 1x or SDR or DDR Links in the Fabric
Determine Which Links Are Experiencing Significant Errors
Controlling the Subnet Manager
Start the Subnet Manager With Min Hop Routing
Start the Subnet Manager With Fat Tree Routing
Start the Subnet Manager With the opensmd Daemon
Stop the Subnet Manager With the opensmd Daemon
Understanding ILOM on the Switch
If your InfiniBand fabric uses the Fat-Tree routing algorithm, you must provide a modified listing of fabric card GUIDs, called the root node GUID file, for the Subnet Manager. The /etc/opensm/guid.txt file is such a file. This procedure describes how to create the guid.txt file.
Note - In this procedure, you issue commands to both the CMC and the Linux InfiniBand host.
Type the following command on the CMC to retrieve the fabric card base GUID:
# getbaseguid fc slot
where slot is the number of the fabric card (0–8). For example:
# getbaseguid fc 0 Base GUID = 0x00bad0fc0009f000 #
Record the GUID to a text editor on your Linux InfiniBand host.
Repeat Step 1 and Step 2 for each fabric card.
Once you have recorded each fabric card’s GUID, you will have a list similar to the following on your Linux InfiniBand host:
0x00bad0fc0009f000 0x00bad0fc0033f100 0x00bad00017fcf200 0x00bad00005fcf300 0x00bad00003fcf400 0x00bad00007fcf500 0x00bad0fc0011f600 0x00bad0b00002f700 0x00bad0b00001f800
Note - If you have fewer than 9 fabric cards, your list will be smaller.
For each GUID, add the following values to make two new sums:
0xa2
0xb2
Note - For GUIDs that end with two zeros (00), you are effectively replacing the zeros with a2 and b2.
For example, 0x00bad0fc0009f000 becomes:
0x00bad0fc0009f0a2
0x00bad0fc0009f0b2
Repopulate your list with the modified GUIDs.
For example:
0x00bad0fc0009f0a2 0x00bad0fc0009f0b2 0x00bad0fc0033f1a2 0x00bad0fc0033f1b2 0x00bad00017fcf2a2 0x00bad00017fcf2b2 0x00bad00005fcf3a2 0x00bad00005fcf3b2 0x00bad00003fcf4a2 0x00bad00003fcf4b2 0x00bad00007fcf5a2 0x00bad00007fcf5b2 0x00bad0fc0011f6a2 0x00bad0fc0011f6b2 0x00bad0b00002f7a2 0x00bad0b00002f7b2 0x00bad0b00001f8a2 0x00bad0b00001f8b2
Save the list on the Linux InfiniBand host as the /etc/opensm/guid.txt file.
Set the permissions for the /etc/opensm/guid.txt file:
# chmod 0644 /etc/opensm/guid.txt #
Switch Command Reference, getbaseguid command
Switch Command Reference, opensm command