JavaScript is required to for searching.
Skip Navigation Links
Exit Print View
Sun Network QDR InfiniBand Gateway Switch HTML Document Collection for Firmware Version 2.0
search filter icon
search icon

Document Information

Using This Documentation

Product Notes

Related Documentation

Feedback

Support and Accessibility

Installation

Understanding the Gateway

Gateway Overview

Physical Specifications

Environmental Requirements

Acoustic Noise Emissions

Electrical Specifications

Network Management Connector and Pins

USB Management Connector and Pins

Data QSFP Connector and Pins

Understanding Cabling

Routing Service Cables

Understanding Data Cabling

Preparing to Install the Gateway

Installation Preparation

Suggested Tools for Installation

Antistatic Precautions for Installation

Installation Responsibilities

Installation Sequence

Verify Shipping Carton Contents

Assemble the Ethernet Splitter Data Cables

Route the Data Cables

Installing the Gateway

Install the Gateway in the Rack

Powering On the Gateway

Attach the Management Cables

Attach the Power Cords

Accessing the Management Controller

Access the Management Controller From the Network Management Port

Access the Management Controller From the USB Management Port

Verify the Gateway Status

Start the Subnet Manager

Connecting Data cables

Attach the Data Cables

Check Link Status

Verifying the InfiniBand Fabric

InfiniBand Node Description

Discover the InfiniBand Fabric Topology

Perform Diagnostics on the InfiniBand Fabric

Administration

Troubleshooting the Gateway

Gateway Hardware Problems

InfiniBand Fabric Problems

Identifying LEDs

Understanding Routing Through the Gateway

Switch GUIDs Overview

Understanding Administrative Commands

Configuration Overview

Hardware Command Overview

InfiniBand Command Overview

ILOM Command Overview

Administering the Chassis

Monitoring the Chassis

Controlling the Chassis

Administering the I4 Switch Chip

Monitoring the I4 Switch Chip

Controlling the I4 Switch Chip

Administering the Subnet Manager

Monitoring the Subnet Manager

Controlling the Subnet Manager

Administering the InfiniBand Fabric

Monitoring the InfiniBand Fabric

Controlling the InfiniBand Fabric

Configuring the Fabric Director Node List

Partitioning the InfiniBand Fabric

Administering Gateway Resources

Installing Gateway Supportive Software (Linux)

Creating VNICs Under Gateway Manual Mode (Linux)

Creating VNICs Under Host Manual Mode (Linux)

Creating Virtual IO Adapters (Oracle Solaris)

Monitoring Gateway Resources

Controlling LAGs

Controlling VLANs and VNICs

Controlling Gateway Ports and Parameters

Remote Management

Understanding Oracle ILOM on the Gateway

Oracle ILOM Overview

Supported Features

Understanding Oracle ILOM Targets

Administering Oracle ILOM (CLI)

CLI Overview

Accessing Oracle ILOM From the CLI

Switching Between the Oracle ILOM Shell and the Linux Shell

Monitoring Oracle ILOM Targets (CLI)

Controlling Oracle ILOM Targets (CLI)

Upgrading the Gateway Firmware Through Oracle ILOM (CLI)

Administering Oracle ILOM (Web)

Web Interface Overview

Access Oracle ILOM From the Web Interface

Monitoring Oracle ILOM Targets (Web)

Controlling Oracle ILOM Targets (Web)

Upgrade the Gateway Firmware (Web)

Using the Fabric Monitor

Access the Fabric Monitor

Fabric Monitor Features

Accessing the Rear Panel Diagram

Accessing Status Pane Information

Control Panel Function

Monitoring Parameters and Status

Administering Oracle ILOM (SNMP)

SNMP Overview

Understanding SNMP Commands

Monitoring Oracle ILOM Targets (SNMP)

Controlling Oracle ILOM Targets (SNMP)

Administering Hardware (IPMI)

ipmitool Overview

Display the Sensor States (IPMI)

Display the Sensor Information (IPMI)

Display the System Event Log (IPMI)

Display FRU ID Information (IPMI)

Display Gateway Status LED States (IPMI)

Enable the Locator LED (IPMI)

Disable the Locator LED (IPMI)

Understanding Oracle ILOM Commands

cd Command

create Command

delete Command

dump Command

exit Command (ILOM)

help Command (ILOM)

load Command

reset Command

set Command

show Command

version Command (ILOM)

Service

Understanding Service Procedures

Replaceable Components

Suggested Tools for Service

Antistatic Precautions for Service

Servicing Power Supplies

Inspecting a Power Supply

Power Off a Power Supply

Remove a Power Supply

Install a Power Supply

Power On a Power Supply

Servicing Fans

Inspecting a Fan

Remove a Fan

Install a Fan

Servicing Data Cables

Inspecting the Data Cables

Remove a Data Cable

Install a Data Cable

Servicing the Battery

Remove the Gateway From the Rack

Replace the Battery

Reference

Understanding Hardware Commands

Linux Shells for Hardware Commands

addlagport Command

allowhostconfig Command

checkboot Command

checkpower Command

checktopomax Command

checkvoltages Command

connector Command

createlag Command

createvlan Command

createvnic Command

dcsport Command

deletelag Command

deletevlan Command

deletevnic Command

dellagport Command

disablecablelog Command

disablegwport Command

disablelagmode Command

disablelinklog Command

disablesm Command

disableswitchport Command

disablevnic Command

disallowhostconfig Command

enablecablelog Command

enablegwport Command

enablelagmode Command

enablelinklog Command

enablesm Command

enableswitchport Command

enablevnic Command

env_test Command

exit Command (Hardware)

fdconfig Command

fwverify Command

generatetopology Command

getfanspeed Command

getmaster Command

getportcounters Command

getportstatus Command

help Command (Hardware)

listlinkup Command

matchtopology Command

setcontrolledhandover Command

setdefaultgwdiscpkey Command

setgwethport Command

setgwinstance Command

setgwsl Command

setgwsystemname Command

setmsmlocationmonitor Command

setsmmkey Command

setsmpriority Command

setsubnetprefix Command

showfruinfo Command

showgwconfig Command

showgwports Command

showlag Command

showpsufru Command

showsmlog Command

showtemps Command

showtopology Command

showunhealthy Command

showvlan Command

showvnics Command

smconfigtest Command

smnodes Command

smpartition Command

version Command (Hardware)

Understanding InfiniBand Commands

Linux Shells for InfiniBand Commands

ibdiagnet Command

ibhosts Command

ibnetdiscover Command

ibnetstatus Command

ibnodes Command

ibportstate Command

ibroute Command

ibrouters Command

ibstat Command

ibswitches Command

ibtracert Command

perfquery Command

saquery Command

smpquery Command

Understanding SNMP MIB OIDs

OID Tables Overview

Understanding the SUN-DCS-IB-MIB MIB OIDs

Understanding the SUN-FABRIC-MIB MIB OIDs

Understanding the SUN-HW-TRAP-MIB MIB OIDs

Understanding the SUN-ILOM-CONTROL-MIB MIB OIDs

Understanding the SUN-PLATFORM-MIB MIB OIDs

Understanding the ENTITY-MIB MIB OIDs

Index

Verify the Gateway Status

You can use these commands on the management controller to check the status of the gateway.

  1. Identify the prerequisite and subsequent installation tasks that you must perform in conjunction with this procedure.

    See Installation Sequence.

  2. Check the overall health of the gateway:
    FabMan@gateway_name-> showunhealthy 
    OK - No unhealthy sensors
    FabMan@gateway_name-> 

    An unfavorable output from the showunhealthy command means a hardware fault with that particular component.

  3. Check the status of the power supplies:
    FabMan@gateway_name-> checkpower
    PSU 0 present status: OK
    PSU 1 present status: OK
    FabMan@gateway_name->

    A power supply output that is not OK from the checkpower command means that there is a problem with that power supply. See Gateway Administration, checking power supply status LEDs, for assistance.

  4. Check the status of the fans:
    FabMan@gateway_name-> getfanspeed
    Fan 0 not present
    Fan 1 running at rpm 11212
    Fan 2 running at rpm 11313
    Fan 3 running at rpm 11521
    Fan 4 not present
    #
    • A stopped or low speed in the output of the getfanspeed command means there is a problem with that particular fan.

    • If not present is in the output of the getfanspeed command, yet a fan is installed at that particular slot, there is a problem with that fan.

    For either condition, check the fan. See Gateway Service, servicing fans.

  5. Check the status of the switch chip and BridgeX chips:
    FabMan@gateway_name-> checkboot
    Switch OK
    Bridge-0 OK
    Bridge-1 OK
    FabMan@gateway_name->

    If in the output of the checkboot command a component is not OK, there is a problem with that component. Try resetting the component. See Gateway Administration, resetting the switch chip and Gateway Administration, resetting the BridgeX chips.

  6. Alternatively, you can use the env_test command to perform the preceding checks and more:
    FabMan@gateway_name-> env_test
    Environment test started:
    Starting Voltage test:
    Voltage ECB OK
    Measured 3.3V Main = 3.28 V
    Measured 3.3V Standby = 3.37 V
    Measured 12V = 12.06 V
    Measured 5V = 5.03 V
    Measured VBAT = 3.25 V
    Measured 1.0V = 1.01 V
    Measured I4 1.2V = 1.22 V
    Measured 2.5V = 2.52 V
    Measured V1P2 DIG = 1.17 V
    Measured V1P2 AND = 1.16 V
    Measured 1.2V BridgeX = 1.21 V
    Measured 1.8V = 1.80 V
    Measured 1.2V Standby = 1.20 V
    Voltage test returned OK
    Starting PSU test:
    PSU 0 present
    PSU 1 present
    PSU test returned OK
    Starting Temperature test:
    Back temperature 23.00
    Front temperature 32.62
    SP temperature 26.12
    Switch temperature 45, maxtemperature 45
    Bridge-0 temperature 41, maxtemperature 42
    Bridge-1 temperature 43, maxtemperature 44
    Temperature test returned OK
    Starting FAN test:
    Fan 0 not present
    Fan 1 running at rpm 11212
    Fan 2 running at rpm 11313
    Fan 3 running at rpm 11521
    Fan 4 not present
    FAN test returned OK
    Starting Connector test:
    Connector test returned OK
    Starting onboard ibdevice test:
    Switch OK
    Bridge-0 OK
    Bridge-1 OK
    All Internal ibdevices OK
    Onboard ibdevice test returned OK
    Environment test PASSED
    FabMan@gateway_name->

    Note - If in the output of the env_test command a voltage deviates more than 10% from the provided specification, there is a problem with the respective component.


  7. (Optional) Set the gateway instance numbers.

    Note - If there is only one gateway in your InfiniBand fabric, you do not need to perform this step.


    If there is more than one gateway in your InfiniBand fabric, you must verify that each gateway’s instance number is unique.

    1. For each gateway, display its instance number:
      FabMan@gateway_name-> setgwinstance --list
      No BXM system name set, using 6 last bits of the ip-address, value: 34
      FabMan@gateway_name->

      The instance number for this example is 34.

    2. If the instance number is a duplicate, change it:
      FabMan@gateway_name-> setgwinstance number

      where number is the instance number, from 0 to 63. For example:

      FabMan@gateway_name-> setgwinstance 3
      Stopping Bridge Manager..                                  [  OK  ]
      Starting Bridge Manager.                                   [  OK  ]
      FabMan@gateway_name->
    3. Repeat from Step a for all remaining gateways in the InfiniBand subnet.
  8. Once the gateway has an operational status, you can start the Subnet Manager.

    See Start the Subnet Manager.

Related Information