Documentation, Support, and Training
Understanding ILOM on the Switch
Administering ILOM (Web Interface)
Understanding Service Procedures
Inspect the Power Supply Hardware
Inspect the Power Supply Connectors
Servicing the Fabric Cards and Fabric Card Fillers
Inspect the Fabric Card Chassis
Inspect the Fabric Card Retainer Bolts
Inspect the Fabric Card XBOW Connectors
Remove a Fabric Card or Fabric Card Filler
Install a Fabric Card or Fabric Card Filler
Servicing the InfiniBand Cables
Inspecting the InfiniBand Cables
Inspect the InfiniBand Cable Hardware
Inspect the InfiniBand Cable Connectors
Inspect the Line Card Retainer Bolts
Inspect the Line Card XBOW Connectors
Inspect the Line Card CXP Connectors
Doing Supportive Software Tasks
In this procedure, you use issue commands to both the CMC and the Linux InfiniBand host.
Note - Use the table in Component Addressing to determine the slot number or IPMB address of your component.
Caution - Before beginning this procedure, have a replacement fabric card or replacement fabric card filler prepared and standing by for immediate installation. A quick exchange is necessary to maintain chassis thermal management. |
Identify the prerequisite and subsequent tasks you must perform in conjunction with this procedure, to achieve a goal.
See the table in Servicing the Fabric Cards and Fabric Card Fillers.
Power off the fabric card from the CMC, using the deactivate command.
For example, if you are removing fabric card 0:
# deactivate fc 0 Deactivating FC 0 Pigeon Point Shelf Manager Command Line Interpreter Command issued via IPMB, status = 0 (0x0) Command executed successfully #
Note - Once deactivated and disabled, the links provided by the fabric card are now lost. The Subnet Manager attempts to establish new routes for those links while you continue the procedure.
If you are permanently removing a fabric card from an InfiniBand fabric using the fat-tree routing algorithm, you must remove the respective GUIDs from the /etc/opensm/guid.txt file.
Otherwise, go to Step 4.
Type the following command on the CMC to retrieve the fabric card base GUID:
# getbaseguid fc slot
where slot is the number of the fabric card to be removed. For example:
# getbaseguid fc 0 Base GUID = 0x00bad0fc0009f000 #
For the GUID, add the following values to make two new sums:
0xa2
0xb2
Note - For a GUID that ends with two zeros (00), you are effectively replacing the zeros with a2 and b2.
For example, 0x00bad0fc0009f000 becomes:
0x00bad0fc0009f0a2
0x00bad0fc0009f0b2
On the Linux InfiniBand host, use a text editor to remove these two entries from the /etc/opensm/guid.txt file.
Restart the Subnet Manager on the Linux InfiniBand host:
# /etc/init.d/opensmd stop Stopping IB Subnet Manager..-. [ OK ] # /etc/init.d/opensmd start Starting IB Subnet Manager. [ OK ] #
Disable the fabric card from the CMC with the disableboard command.
For example, to disable fabric card 0:
# disableboard fc 0 fc 0 is M1 state, turning off stby STBY for fc 0 is off #
Remove the fabric card.
Switch Reference, deactivate command
Switch Reference, getbaseguid command
Switch Reference, opensm command
Switch Reference, disableboard command