JavaScript is required to for searching.
Skip Navigation Links
Exit Print View
Sun Network QDR InfiniBand Gateway Switch Topic Set
search filter icon
search icon

Document Information

Using This Documentation

Related Documentation

Documentation, Support, and Training

Installation

Understanding the Gateway

Gateway Overview

Physical Specifications

Environmental Requirements

Acoustic Noise Emissions

Electrical Specifications

Network Management Connector and Pins

USB Management Connector and Pins

Data QSFP Connector and Pins

Understanding Cabling

Routing Service Cables

Understanding Data Cabling

Preparing to Install the Gateway

Installation Preparation

Suggested Tools for Installation

Antistatic Precautions for Installation

Installation Responsibilities

Installation Sequence

Verify Shipping Carton Contents

Assemble the Ethernet Splitter Data Cables

Route the Data Cables

Installing the Gateway

Install the Gateway in the Rack

Powering On the Gateway

Connecting Data cables

Verifying the InfiniBand Fabric

Administration

Troubleshooting the Gateway

Gateway Hardware Problems

InfiniBand Fabric Problems

Identifying LEDs

Understanding Routing Through the Gateway

Switch GUIDs Overview

Understanding Administrative Commands

Hardware Command Overview

InfiniBand Command Overview

ILOM Command Overview

Administering the Chassis

Monitoring the Chassis

Controlling the Chassis

Administering the I4 Switch Chip

Monitoring the I4 Switch Chip

Controlling the I4 Switch Chip

Administering Gateway Resources

Installing Gateway Supportive Software

Creating VNICs Under Gateway Manual Mode

Creating VNICs Under Host Manual Mode

Monitoring Gateway Resources

Controlling VLANs and VNICs

Controlling Gateway Ports and Parameters

Administering the InfiniBand Fabric

Monitoring the InfiniBand Fabric

Controlling the InfiniBand Fabric

Administering the Subnet Manager

Monitoring the Subnet Manager

Controlling the Subnet Manager

Remote Management

Understanding Oracle ILOM on the Gateway

Oracle ILOM Overview

Supported Features

Understanding Oracle ILOM Targets

Administering Oracle ILOM (CLI)

CLI Overview

Accessing Oracle ILOM From the CLI

Access the Oracle ILOM Shell From the CLI (NET MGT Port)

Access the Oracle ILOM Shell From the CLI (USB Management Port)

Switching Between the Oracle ILOM Shell and the Linux Shell

/SYS/Switch_Diag, /SYS/Gateway_Mgmt, and /SYS/Fabric_Mgmt Linux Shells

Switch From the Oracle ILOM Shell to the Linux Shell

Switch From the Linux Shell to the Oracle ILOM Shell

Monitoring Oracle ILOM Targets (CLI)

Performing Daily Tasks (CLI)

Display the Date (CLI)

Display Gateway Status LEDs States (CLI)

Display the Aggregate Sensors State (CLI)

Aggregate Sensor States

Display Power Supply Status (CLI)

Display Board-Level Voltages (CLI)

Board Level Voltages

Display Internal Temperatures (CLI)

Internal Temperature Sensors

Display Fan Status (CLI)

Display the Oracle ILOM Sessions (CLI)

Display the Oracle ILOM Event Log (CLI)

Checking the Status of Services (CLI)

Display the HTTP Service Status (CLI)

Display the HTTPS Service Status (CLI)

Display the SSL Certificates (CLI)

Display the SNMP Service Status (CLI)

Display the SNMP User Accounts (CLI)

Display the SNMP Service Communities (CLI)

Display the IPMI Service Status (CLI)

Display the SMTP Client Status (CLI)

Display the NTP Servers (CLI)

Verifying Other Aspects With Oracle ILOM (CLI)

Get Help on an Oracle ILOM Command (CLI)

Get Help on an Oracle ILOM Target Property (CLI)

Display the Alert Properties (CLI)

Display the Oracle ILOM User Accounts (CLI)

Display the Remote Log Hosts (CLI)

Display the Network Management Configuration (CLI)

Display the CLI Session Timeout (CLI)

Display Gateway FRU ID (CLI)

Display Power Supply FRU ID (CLI)

Display the Firmware Version (CLI)

Display Identification Properties (CLI)

Controlling Oracle ILOM Targets (CLI)

Performing General Tasks on Oracle ILOM Targets (CLI)

Restart the Management Controller (CLI)

Set the Date and Time (CLI)

Enable the Locator LED (CLI)

Disable the Locator LED (CLI)

Clear the Oracle ILOM Event Log (CLI)

Set the Remote Log Hosts (CLI)

Configure the SMTP Client (CLI)

Back Up the Configuration (CLI)

Gateway Configuration Information Backed Up

Restore the Configuration (CLI)

Create a Snapshot of the Gateway State (CLI)

Snapshot Dataset Information (CLI)

Set the Network Management Parameters (CLI)

Set the Identification Properties (CLI)

Performing Oracle ILOM User Tasks (CLI)

Add an Oracle ILOM User Account (CLI)

Change an Oracle ILOM User's Password and or Role (CLI)

Delete an Oracle ILOM User Account (CLI)

Managing HTTP Services (CLI)

Enable the HTTP Service (CLI)

Disable the HTTP Service (CLI)

Managing HTTPS Services (CLI)

Enable the HTTPS Service (CLI)

Install a Custom SSL Certificate (CLI)

Remove the Custom SSL Certificate (CLI)

Disable the HTTPS Service (CLI)

Managing SNMP Services (CLI)

Enable the SNMP Service (CLI)

Configure the SNMP Service (CLI)

Add SNMP Service User Accounts (CLI)

Modify SNMP Service User Accounts (CLI)

Delete SNMP Service User Accounts (CLI)

Add SNMP Service Communities (CLI)

Modify SNMP Service Communities (CLI)

Delete SNMP Service Communities (CLI)

Back Up SNMP Service MIBs (CLI)

Disable the SNMP Service (CLI)

Managing Other Aspects With Oracle ILOM (CLI)

Enable Alerts to Send SNMP Traps (CLI)

Enable Alerts to Send PETs (CLI)

Enable Alerts to Send Email Alerts (CLI)

Disable Alerts (CLI)

Set the Oracle ILOM CLI Session Timeout (CLI)

Upgrading the Gateway Firmware Through Oracle ILOM (CLI)

Firmware Overview

Acquire the Gateway Firmware Package (CLI)

Upgrade the Gateway Firmware (CLI)

Administering Oracle ILOM (Web)

Web Interface Overview

Access Oracle ILOM From the Web Interface

Monitoring Oracle ILOM Targets (Web)

Controlling Oracle ILOM Targets (Web)

Upgrade the Gateway Firmware (Web)

Using the Fabric Monitor

Access the Fabric Monitor

Fabric Monitor Features

Accessing the Rear Panel Diagram

Accessing Status Pane Information

Control Panel Function

Monitoring Parameters and Status

Administering Oracle ILOM (SNMP)

SNMP Overview

Understanding SNMP Commands

Monitoring Oracle ILOM Targets (SNMP)

Controlling Oracle ILOM Targets (SNMP)

Administering Hardware (IPMI)

ipmitool Overview

Display the Sensor States (IPMI)

Display the Sensor Information (IPMI)

Display the System Event Log (IPMI)

Display FRU ID Information (IPMI)

Display Gateway Status LED States (IPMI)

Enable the Locator LED (IPMI)

Disable the Locator LED (IPMI)

Understanding Oracle ILOM Commands

cd Command

create Command

delete Command

dump Command

exit Command (ILOM)

help Command (ILOM)

load Command

reset Command

set Command

show Command

version Command (ILOM)

Service

Understanding Service Procedures

Replaceable Components

Suggested Tools for Service

Antistatic Precautions for Service

Servicing Power Supplies

Inspecting a Power Supply

Power Off a Power Supply

Remove a Power Supply

Install a Power Supply

Power On a Power Supply

Servicing Fans

Inspecting a Fan

Remove a Fan

Install a Fan

Servicing Data Cables

Inspecting the Data Cables

Remove a Data Cable

Install a Data Cable

Servicing the Battery

Remove the Gateway From the Rack

Replace the Battery

Reference

Understanding Hardware Commands

Linux Shells for Hardware Commands

checkboot Command

checkguidfilesftree Command

checkpower Command

checktopomax Command

checkvoltages Command

connector Command

createvlan Command

createvnic Command

dcsport Command

deletevlan Command

deletevnic Command

disablecablelog Command

disablegwport Command

disablelinklog Command

disablesm Command

disableswitchport Command

disablevnic Command

enablecablelog Command

enablegwport Command

enablelinklog Command

enablesm Command

enableswitchport Command

enablevnic Command

env_test Command

exit Command (Hardware)

generatetopology Command

getfanspeed Command

getmaster Command

getnm2type Command

getportcounters Command

getportstatus Command

help Command (Hardware)

ibdevreset Command

listlinkup Command

managementreset Command

matchtopology Command

setcontrolledhandover Command

setgwethport Command

setgwinstance Command

setgwsl Command

setgwsystemname Command

setloghost Command

setmsmlocationmonitor Command

setsmpriority Command

setsubnetprefix Command

showfruinfo Command

showgwconfig Command

showgwports Command

showioadapters Command

showpsufru Command

showsmlog Command

showtemps Command

showtopology Command

showunhealthy Command

showvlan Command

showvnics Command

smconfigtest Command

version Command (Hardware)

Understanding InfiniBand Commands

Linux Shells for InfiniBand Commands

ibaddr Command

ibcheckerrors Command

ibchecknet Command

ibchecknode Command

ibcheckport Command

ibcheckportstate Command

ibcheckportwidth Command

ibcheckstate Command

ibcheckwidth Command

ibclearcounters Command

ibclearerrors Command

ibdatacounters Command

ibdatacounts Command

ibdiagnet Command

ibdiagpath Command

ibhosts Command

ibnetdiscover Command

ibnetstatus Command

ibnodes Command

ibportstate Command

ibroute Command

ibrouters Command

ibstat Command

ibstatus Command

ibswitches Command

ibsysstat Command

ibtracert Command

perfquery Command

saquery Command

sminfo Command

smpdump Command

smpquery Command

Understanding SNMP MIB OIDs

OID Tables Overview

Understanding the SUN-DCS-MIB MIB OIDs

SUN-HW-TRAP-MIB MIB OIDs

Understanding the SUN-ILOM-CONTROL-MIB MIB OIDs

Understanding the SUN-PLATFORM-MIB MIB OIDs

Understanding the ENTITY-MIB MIB OIDs

Index

Upgrade the Gateway Firmware (CLI)

  1. Open an SSH session as user root and connect to the management controller by specifying the controller’s host name.

    For example:

    % ssh -l root nm2name
    root@nm2name’s password: password
    #

    where nm2name is the host name of the management controller. Initially, the password is changeme.

  2. If the Subnet Manager is running on the management controller, disable it with the disablesm command.
    # disablesm
    Stopping partitiond daemon.                                [  OK  ]
    Stopping IB Subnet Manager..                               [  OK  ]
    # 
  3. Verify that there is at least 150 MB available in the /tmp directory.
    # df -h /tmp
    Filesystem            Size  Used Avail Use% Mounted on
    tmpfs                 250M  240K 249M 1% /tmp
    #

    In this example, there are 249 MB available. If not enough space is available, you must delete files from the /tmp directory.

  4. Verify that there is at least 1 MB available in the /config directory.
    # df -h /config
    Filesystem            Size  Used Avail Use% Mounted on
    /dev/hda2              16M  3.6M   11M  25% /config
    #

    In this example, there are 11 MB available. If not enough space is available, you must delete files from the /config directory.

  5. Verify that there is at least 1 MB available in the /var/log directory.
    # df -h /var/log
    Filesystem            Size  Used Avail Use% Mounted on
    /dev/hda3              16M  3.6M   11M  25% /var/log
    #

    In this example, there are 11 MB available. If not enough space is available, you must delete files from the /var/log directory.

  6. Verify that there is at least 150 MB free memory available.
    # free -m
                     total       used       free     shared    buffers     cached
    Mem:           498        104        393          0         12         47
    -/+ buffers/cache:         45        453
    Swap:            0          0          0
    #

    In the Mem: row of the free column, there should be at least 150 MB free memory. In this example, there are 393 MB available. If not enough memory is available, you must exit non-essential applications that are running.

  7. Start the Oracle ILOM shell:
    # spsh
    Sun(TM) Integrated Lights Out Manager
    Version ILOM 3.0 r47111
    Copyright 2009 Sun Microsystems, Inc. All rights reserved.
    Use is subject to license terms.
    ->

    You are now in the Oracle ILOM shell.

    You can use the exit command to return to the Linux shell.

  8. Begin the upgrade process:
    -> load -source URI/pkgname

    where:

    • URI is the uniform resource indicator for the host where the gateway firmware package is located. The FTP and HTTP protocols are supported.

    • pkgname is the name of the firmware package in the transfer directory.

    For example, using the FTP protocol:

    -> load -source ftp://root:changeme@123.45.67.99//tmp/sundcs_gw_repository_1.3.2_1.pkg
    Downloading firmware image. This will take a few minutes.

    The firmware is downloaded. The upgrade begins. A caution is displayed and you are asked to commit to the upgrade.

    NOTE: Firmware upgrade will upgrade firmware on SUN DCS gw Kontron module, 
             I4, BridgeX and FPGA. Upgrade of Kontron module, I4 and BridgeX takes
             few minutes to complete. FPGA upgrade takes about 4 hours.
     
             ILOM will enter a special mode to load new firmware. No other tasks 
             should be performed in ILOM until the firmware upgrade is complete. 
     
    Are you sure you want to load the specified file (y/n)?
  9. Answer y to the prompt to commit to the upgrade.

    The upgrade begins.

    Setting up environment for firmware upgrade. This will take few minutes.
    Starting SUN DCS gw FW update
     
    ==========================
    Performing operation: I4 A
    ==========================
    I4 A: I4 is already at the given version.
     
    ==========================
    Performing operation: BX A
    ==========================
    BX fw upgrade from 8.3.3164(INI:4) to 8.3.3166(INI:4):
    Upgrade started...
    Upgrade completed.
    INFO: BX fw upgrade from 8.3.3164(INI:4) to 8.3.3166(INI:4) succeeded
     
    ==========================
    Performing operation: BX B
    ==========================
    BX fw upgrade from 8.3.3164(INI:4) to 8.3.3166(INI:4):
    Upgrade started...
    Upgrade completed.
    INFO: BX fw upgrade from 8.3.3164(INI:4) to 8.3.3166(INI:4) succeeded
     
    ===========================
    Summary of Firmware update 
    ===========================
    I4 status                :  FW UPDATE - SUCCESS
    I4 update succeeded on   :  none
    I4 already up-to-date on :  A
    I4 update failed on      :  none
    BX status                :  FW UPDATE - SUCCESS
    BX update succeeded on   :  A, B
    BX already up-to-date on :  none
    BX update failed on      :  none
     
    ==========================================
    Performing operation: FPGW firmware update
    ==========================================
    INFO: FPGA is already at the given version.
     
    =========================================
    Performing operation: SUN DCS gw firmware update
    =========================================
    SUN DCS gw Kontron module fw upgrade from 1.1.2-2 to 1.3.2-1:
    Please reboot the system to enable firmware update of Kontron module. The download of the Kontron firmware image 
    happens during reboot.
     
    After system reboot, Kontron FW update progress can be monitored in browser using URL [http://GWsystem] OR at OS 
    command line prompt by using command [telnet GWsystem 1234] where GWsystem is the hostname or IP address of SUN DCS 
    GW.
     
    Firmware update is complete.
    ->
  10. Exit the Oracle ILOM CLI shell:
    -> exit
    exit
    #
  11. Reboot the gateway to enable the new firmware.

    See Gateway Administration, restarting the entire switch.


    Note - The restart process takes between 4 to 5 minutes to complete. The Oracle ILOM stack requires at least 2 minutes to become operational after a reboot.


    The next time you login to the gateway, the following message is displayed:

    FW upgrade completed successfully on Thu May  5 19:17:10 IST 2011.
    For details see file /config/mon.autorun.out
    This message will be cleared on next reboot.
  12. If previously disabled, log in as the root user and enable the Subnet Manager.
    % ssh -l root nm2name
    root@nm2name’s password: password
    # enablesm
    Starting IB Subnet Manager.                                [  OK  ]
    Starting partitiond daemon.                                [  OK  ]
    # 
  13. Verify the firmware version:
    # version
    SUN DCS gw version: 1.3.2-1
    Build time: Feb 17 2011 10:02:40
    FPGA version: 0x33
    SP board info:
    Manufacturing Date: 2010.01.22
    Serial Number: "NCD4J0165"
    Hardware Revision: 0x0006
    Firmware Revision: 0x0102
    BIOS version: NOW1R112 
    BIOS date: 04/24/2009
    #

    In the first line of the output is SUN DCS gw version x.y.z-w, where x.y.z-w is the version of the firmware upgraded (or downgraded). For example, 1.3.2-1.

Related Information