JavaScript is required to for searching.
Skip Navigation Links
Exit Print View
Sun Datacenter InfiniBand Switch 648 Topic Set
search filter icon
search icon

Document Information

Preface

Related Documentation

Documentation, Support, and Training

Third-Party Web Sites

Sun Welcomes Your Comments

Administration

Administering the Switch

Understanding Administrative Commands

Monitoring the Switch

Monitoring the InfiniBand Fabric

Controlling the Switch

Controlling the InfiniBand Fabric

Diagnosing a Problem

Identifying the Problem

Troubleshooting the Switch

Understanding Signal Routing Through the Switch

Understanding Switch Startup and Component Addition

Switch GUIDs Overview

Remote Management

Understanding ILOM on the Switch

ILOM Documentation

ILOM Overview

Supported Features

Understanding ILOM Targets

Installing the ILOM Firmware

Firmware Layout

rupgrade_tool Application

Download the ILOM Firmware

Install the ILOM Firmware

Administering ILOM (CLI)

CLI Overview

Access ILOM From the CLI

Switching Between the ILOM Shell and the Linux Shell

Monitoring ILOM Targets (CLI)

Controlling ILOM Targets (CLI)

Upgrading the Switch Firmware Through ILOM (CLI)

Administering ILOM (Web Interface)

Web Interface Overview

Access ILOM From the Web Interface

Monitoring ILOM Targets (Web Interface)

Controlling ILOM Targets (Web Interface)

Upgrading the Switch Firmware Through ILOM (Web Interface)

Understanding ILOM Commands

cd Command

create Command

delete Command

dump Command

exit Command

help Command

load Command

set Command

show Command

version Command

Installation

Preparing the Site

Routing Service Cables

Understanding InfiniBand Cabling

Understanding Switch Specifications

Installing the Switch

Understanding the Installation

Installing the InfiniBand Software Stack

Unpacking the Chassis

Preparing the Chassis

Inspecting the Components

Installing the Components

Powering On the CMCs

Powering On the Fabric Cards

Powering On the Line Cards

Connecting InfiniBand Cables

Verifying the InfiniBand Fabric

Service

Servicing the Switch

Understanding Service Procedures

Antistatic Precautions

Suggested Tools

Component Addressing

Connector Addressing

Replaceable Components

Servicing the Power Supplies

Inspecting the Power Supplies

Power Supply Identification

Inspect the Power Supply Hardware

Inspect the Power Supply Connectors

Power Off a Power Supply

Remove a Power Supply

Install a Power Supply

Power On a Power Supply

Servicing the CMCs

Inspecting the CMC

CMC Identification

Inspect the CMC Hardware

Inspect the CMC Connectors

Power Off a CMC

Remove a CMC

Install a CMC

Power On a CMC

Servicing the Fans

Inspecting the Fans

Fan Identification

Inspect the Fan Hardware

Inspect the Fan Connector

Remove a Fan

Install a Fan

Servicing the Fabric Cards and Fabric Card Fillers

Inspecting the Fabric Cards

Fabric Card Identification

Inspect the Fabric Card Chassis

Inspect the Fabric Card Retainer Bolts

Inspect the Fabric Card Fans

Inspect the Fabric Card XBOW Connectors

Power Off a Fabric Card

Remove a Fabric Card or Fabric Card Filler

Install a Fabric Card or Fabric Card Filler

Power On a Fabric Card

Servicing the InfiniBand Cables

Inspecting the InfiniBand Cables

InfiniBand Cable Identification

Inspect the InfiniBand Cable Hardware

Inspect the InfiniBand Cable Connectors

Remove an InfiniBand Cable

Install an InfiniBand Cable

Servicing the Line Cards

Inspecting the Line Cards

Line Card Identification

Inspect the Line Card Chassis

Inspect the Line Card Retainer Bolts

Inspect the Line Card XBOW Connectors

Inspect the Line Card CXP Connectors

Power Off a Line Card

Remove a Line Card

Install a Line Card Filler

Remove a Line Card Filler

Install a Line Card

Power On a Line Card

Doing Supportive Software Tasks

Reperform Initial Setup

Configure CMCs for Identical Addresses

Upgrading the Firmware

Set Up a TFTP Server

Reference

Command Reference

Understanding Switch-Specific Commands

Understanding CLIA Commands

Understanding InfiniBand Software Commands

Index

Power Off a Fabric Card

In this procedure, you use issue commands to both the CMC and the Linux InfiniBand host.


Note - Use the table in Component Addressing to determine the slot number or IPMB address of your component.



Caution

Caution - Before beginning this procedure, have a replacement fabric card or replacement fabric card filler prepared and standing by for immediate installation. A quick exchange is necessary to maintain chassis thermal management.


  1. Identify the prerequisite and subsequent tasks you must perform in conjunction with this procedure, to achieve a goal.

    See the table in Servicing the Fabric Cards and Fabric Card Fillers.

  2. Power off the fabric card from the CMC, using the deactivate command.

    For example, if you are removing fabric card 0:

    # deactivate fc 0
    Deactivating FC 0
    Pigeon Point Shelf Manager Command Line Interpreter
         Command issued via IPMB, status = 0 (0x0)
         Command executed successfully
    #

    Note - Once deactivated and disabled, the links provided by the fabric card are now lost. The Subnet Manager attempts to establish new routes for those links while you continue the procedure.


  3. If you are permanently removing a fabric card from an InfiniBand fabric using the fat-tree routing algorithm, you must remove the respective GUIDs from the /etc/opensm/guid.txt file.

    Otherwise, go to Step 4.

    1. Type the following command on the CMC to retrieve the fabric card base GUID:
      # getbaseguid fc slot

      where slot is the number of the fabric card to be removed. For example:

      # getbaseguid fc 0
      Base GUID = 0x00bad0fc0009f000
      #
    2. For the GUID, add the following values to make two new sums:
      • 0xa2

      • 0xb2


      Note - For a GUID that ends with two zeros (00), you are effectively replacing the zeros with a2 and b2.


      For example, 0x00bad0fc0009f000 becomes:

      • 0x00bad0fc0009f0a2

      • 0x00bad0fc0009f0b2

    3. On the Linux InfiniBand host, use a text editor to remove these two entries from the /etc/opensm/guid.txt file.
    4. Restart the Subnet Manager on the Linux InfiniBand host:
      # /etc/init.d/opensmd stop
      Stopping IB Subnet Manager..-.                             [  OK  ]
      # /etc/init.d/opensmd start
      Starting IB Subnet Manager.                                [  OK  ]
      #
  4. Disable the fabric card from the CMC with the disableboard command.

    For example, to disable fabric card 0:

    # disableboard fc 0
    fc 0 is M1 state, turning off stby
    STBY for fc 0 is off
    #
  5. Remove the fabric card.

    See Remove a Fabric Card or Fabric Card Filler.

Related Information