Exit Print View

Sun Datacenter InfiniBand Switch 648 Topic Set

Get PDF Book Print View
 

Document Information

Using This Documentation

Related Documentation

Documentation, Support, and Training

Documentation Feedback

Installation

Preparing the Site

Installing the Switch

Administration

Administering the Switch

Diagnosing a Problem

Remote Management

Understanding ILOM on the Switch

Installing the ILOM Firmware

Administering ILOM (CLI)

Administering ILOM (Web Interface)

Administering ILOM (SNMP)

Administering Hardware (IPMI)

Understanding ILOM Commands

Service

Servicing the Switch

Understanding Service Procedures

Antistatic Precautions

Suggested Tools

Component Addressing

Connector Addressing

Replaceable Components

Servicing the Power Supplies

Inspecting the Power Supplies

Identify the Power Supply

Inspect the Power Supply Hardware

Inspect the Power Supply Connectors

Power Off a Power Supply

Remove a Power Supply

Install a Power Supply

Power On a Power Supply

Servicing the CMCs

Inspecting the CMCs

Identify the CMC

Inspect the CMC Hardware

Inspect the CMC Connectors

Power Off a CMC

Remove a CMC

Install a CMC

Power On a CMC

Servicing the Fans

Inspecting the Fans

Identify the Fan

Inspect the Fan Hardware

Inspect the Fan Connector

Remove a Fan

Install a Fan

Servicing the Fabric Cards and Fabric Card Fillers

Inspecting the Fabric Cards

Identify the Fabric Card

Inspect the Fabric Card Chassis

Inspect the Fabric Card Retainer Bolts

Inspect the Fabric Card Fans

Inspect the Fabric Card XBOW Connectors

Power Off a Fabric Card

Remove a Fabric Card or Fabric Card Filler

Install a Fabric Card or Fabric Card Filler

Power On a Fabric Card

Servicing the InfiniBand Cables

Inspecting the InfiniBand Cables

Identify the InfiniBand Cable

Inspect the InfiniBand Cable Hardware

Inspect the InfiniBand Cable Connectors

Remove an InfiniBand Cable

Install an InfiniBand Cable

Servicing the Line Cards

Inspecting the Line Cards

Identify the Line Card

Inspect the Line Card Chassis

Inspect the Line Card Retainer Bolts

Inspect the Line Card XBOW Connectors

Inspect the Line Card CXP Connectors

Power Off a Line Card

Remove a Line Card

Install a Line Card Filler

Remove a Line Card Filler

Install a Line Card

Power On a Line Card

Doing Supportive Software Tasks

Reperform Initial Setup

Configure CMCs for Identical Addresses

Upgrading the Firmware

Set Up a TFTP Server

Reference

Command Reference

Index

Power On a Fabric Card

In this procedure, you issue commands to both the CMC and the Linux InfiniBand host.


Note - Use the table in Component Addressing to determine the slot number or IPMB address of your component.


  1. Identify the prerequisite and subsequent tasks you must perform in conjunction with this procedure, to achieve a goal.

    See the table in Servicing the Fabric Cards and Fabric Card Fillers.

  2. On the CMC, enable the fabric card using the enablestby command.

    For example, to enable fabric card 0:

    # enablestby fc 0
    fc 0 is now enabled
    #
  3. If your InfiniBand fabric uses the fat-tree algorithm, you must update the root GUID file with the new GUIDs.

    Otherwise, go to Step 4.

    1. Type the following command on the CMC to retrieve the fabric card base GUID:

      # getbaseguid fc slot

      where slot is the number of the fabric card you installed. For example:

      # getbaseguid fc 0
      Base GUID = 0x00bad0fc0009f000
      #
    2. For the GUID, add the following values to make two new sums:

      • 0xa2

      • 0xb2


      Note - For a GUID that ends with two zeros (00), you are effectively replacing the zeros with a2 and b2.


      For example, 0x00bad0fc0009f000 becomes:

      • 0x00bad0fc0009f0a2

      • 0x00bad0fc0009f0b2

    3. On the Linux InfiniBand host, use a text editor to add these two new entries to the /etc/opensm/guid.txt file.

    4. Restart the Subnet Manager on the Linux InfiniBand host:

      # /etc/init.d/opensmd stop
      Stopping IB Subnet Manager..-.                             [  OK  ]
      # /etc/init.d/opensmd start
      Starting IB Subnet Manager.                                [  OK  ]
      #
  4. On the CMC, power on the fabric card with the activate command.

    For example, to power on fabric card 0:

    # activate fc 0
    #
  5. If necessary, upgrade the firmware inside of the fabric card and fabric card filler:

    See Upgrading the Firmware.

  6. (Optional) Display and record the fabric card FRU ID information:

    # clia fruinfo IPMB_address 0

    where IPMB_address is from Component Addressing.

    The following example is the output for fabric card 0:

    # clia fruinfo 94 0 
    Pigeon Point Shelf Manager Command Line Interpreter
    94: FRU # 0, FRU Info
    Common Header:    Format Version = 1
    Board Info Area:
         Version     = 1
         Language Code            = 25
         Mfg Date/Time            = May  7 09:31:00 2009 (7020571 minutes since 1996)
         Board Manufacturer       = Sun Microsystems, Inc.
         Board Product Name       = Sun Datacenter Switch DCS 648 - Fabric Card
         Board Serial Number      = 0110SJC-0918FC0231
         Board Part Number        = 541-3811-04
         FRU Programmer File ID   = m9_fc_fru-info-0110SJC-0918FC0231.inf
    Product Info Area:
         Version     = 1
         Language Code            = 25
         Manufacturer Name        = Sun Microsystems, Inc.
         Product Name             = Sun Datacenter Switch DCS 648 - Fabric Card
         Product Part / Model#    = 541-3811-04
         Product Version          = Rev 1
         Product Serial Number    = 0110SJC-0918FC0231
         Asset Tag                = none
         FRU Programmer File ID   = m9_fc_fru-info-0110SJC-0918FC0231.inf
    #
Related Information