Exit Print View

Sun Datacenter InfiniBand Switch 648 Topic Set

Get PDF Book Print View
 

Document Information

Using This Documentation

Related Documentation

Documentation, Support, and Training

Documentation Feedback

Installation

Preparing the Site

Installing the Switch

Administration

Administering the Switch

Diagnosing a Problem

Remote Management

Understanding ILOM on the Switch

Installing the ILOM Firmware

Administering ILOM (CLI)

Administering ILOM (Web Interface)

Administering ILOM (SNMP)

Administering Hardware (IPMI)

Understanding ILOM Commands

Service

Servicing the Switch

Understanding Service Procedures

Antistatic Precautions

Suggested Tools

Component Addressing

Connector Addressing

Replaceable Components

Servicing the Power Supplies

Inspecting the Power Supplies

Identify the Power Supply

Inspect the Power Supply Hardware

Inspect the Power Supply Connectors

Power Off a Power Supply

Remove a Power Supply

Install a Power Supply

Power On a Power Supply

Servicing the CMCs

Inspecting the CMCs

Identify the CMC

Inspect the CMC Hardware

Inspect the CMC Connectors

Power Off a CMC

Remove a CMC

Install a CMC

Power On a CMC

Servicing the Fans

Inspecting the Fans

Identify the Fan

Inspect the Fan Hardware

Inspect the Fan Connector

Remove a Fan

Install a Fan

Servicing the Fabric Cards and Fabric Card Fillers

Inspecting the Fabric Cards

Identify the Fabric Card

Inspect the Fabric Card Chassis

Inspect the Fabric Card Retainer Bolts

Inspect the Fabric Card Fans

Inspect the Fabric Card XBOW Connectors

Power Off a Fabric Card

Remove a Fabric Card or Fabric Card Filler

Install a Fabric Card or Fabric Card Filler

Power On a Fabric Card

Servicing the InfiniBand Cables

Inspecting the InfiniBand Cables

Identify the InfiniBand Cable

Inspect the InfiniBand Cable Hardware

Inspect the InfiniBand Cable Connectors

Remove an InfiniBand Cable

Install an InfiniBand Cable

Servicing the Line Cards

Inspecting the Line Cards

Identify the Line Card

Inspect the Line Card Chassis

Inspect the Line Card Retainer Bolts

Inspect the Line Card XBOW Connectors

Inspect the Line Card CXP Connectors

Power Off a Line Card

Remove a Line Card

Install a Line Card Filler

Remove a Line Card Filler

Install a Line Card

Power On a Line Card

Doing Supportive Software Tasks

Reperform Initial Setup

Configure CMCs for Identical Addresses

Upgrading the Firmware

Set Up a TFTP Server

Reference

Command Reference

Index

Power Off a Fabric Card

In this procedure, you use issue commands to both the CMC and the Linux InfiniBand host.


Note - Use the table in Component Addressing to determine the slot number or IPMB address of your component.



Caution

Caution - Before beginning this procedure, have a replacement fabric card or replacement fabric card filler prepared and standing by for immediate installation. A quick exchange is necessary to maintain chassis thermal management.


  1. Identify the prerequisite and subsequent tasks you must perform in conjunction with this procedure, to achieve a goal.

    See the table in Servicing the Fabric Cards and Fabric Card Fillers.

  2. Power off the fabric card from the CMC, using the deactivate command.

    For example, if you are removing fabric card 0:

    # deactivate fc 0
    Deactivating FC 0
    Pigeon Point Shelf Manager Command Line Interpreter
         Command issued via IPMB, status = 0 (0x0)
         Command executed successfully
    #

    Note - Once deactivated and disabled, the links provided by the fabric card are now lost. The Subnet Manager attempts to establish new routes for those links while you continue the procedure.


  3. If you are permanently removing a fabric card from an InfiniBand fabric using the fat-tree routing algorithm, you must remove the respective GUIDs from the /etc/opensm/guid.txt file.

    Otherwise, go to Step 4.

    1. Type the following command on the CMC to retrieve the fabric card base GUID:

      # getbaseguid fc slot

      where slot is the number of the fabric card to be removed. For example:

      # getbaseguid fc 0
      Base GUID = 0x00bad0fc0009f000
      #
    2. For the GUID, add the following values to make two new sums:

      • 0xa2

      • 0xb2


      Note - For a GUID that ends with two zeros (00), you are effectively replacing the zeros with a2 and b2.


      For example, 0x00bad0fc0009f000 becomes:

      • 0x00bad0fc0009f0a2

      • 0x00bad0fc0009f0b2

    3. On the Linux InfiniBand host, use a text editor to remove these two entries from the /etc/opensm/guid.txt file.

    4. Restart the Subnet Manager on the Linux InfiniBand host:

      # /etc/init.d/opensmd stop
      Stopping IB Subnet Manager..-.                             [  OK  ]
      # /etc/init.d/opensmd start
      Starting IB Subnet Manager.                                [  OK  ]
      #
  4. Disable the fabric card from the CMC with the disableboard command.

    For example, to disable fabric card 0:

    # disableboard fc 0
    fc 0 is M1 state, turning off stby
    STBY for fc 0 is off
    #
  5. Remove the fabric card.

    See Remove a Fabric Card or Fabric Card Filler.

Related Information