JavaScript is required to for searching.
Skip Navigation Links
Exit Print View
Sun Network QDR InfiniBand Gateway Switch HTML Document Collection for Firmware Version 2.0
search filter icon
search icon

Document Information

Using This Documentation

Product Notes

Related Documentation


Support and Accessibility


Understanding the Gateway

Gateway Overview

Physical Specifications

Environmental Requirements

Acoustic Noise Emissions

Electrical Specifications

Network Management Connector and Pins

USB Management Connector and Pins

Data QSFP Connector and Pins

Understanding Cabling

Routing Service Cables

Understanding Data Cabling

Preparing to Install the Gateway

Installation Preparation

Suggested Tools for Installation

Antistatic Precautions for Installation

Installation Responsibilities

Installation Sequence

Verify Shipping Carton Contents

Assemble the Ethernet Splitter Data Cables

Route the Data Cables

Installing the Gateway

Install the Gateway in the Rack

Powering On the Gateway

Connecting Data cables

Verifying the InfiniBand Fabric


Troubleshooting the Gateway

Gateway Hardware Problems

InfiniBand Fabric Problems

Identifying LEDs

Understanding Routing Through the Gateway

Switch GUIDs Overview

Understanding Administrative Commands

Configuration Overview

Hardware Command Overview

InfiniBand Command Overview

ILOM Command Overview

Administering the Chassis

Monitoring the Chassis

Controlling the Chassis

Administering the I4 Switch Chip

Monitoring the I4 Switch Chip

Controlling the I4 Switch Chip

Administering the Subnet Manager

Monitoring the Subnet Manager

Controlling the Subnet Manager

Administering the InfiniBand Fabric

Monitoring the InfiniBand Fabric

Controlling the InfiniBand Fabric

Configuring the Fabric Director Node List

Partitioning the InfiniBand Fabric

Administering Gateway Resources

Installing Gateway Supportive Software (Linux)

Creating VNICs Under Gateway Manual Mode (Linux)

Creating VNICs Under Host Manual Mode (Linux)

Creating Virtual IO Adapters (Oracle Solaris)

Monitoring Gateway Resources

Controlling LAGs

Controlling VLANs and VNICs

Controlling Gateway Ports and Parameters

Remote Management

Understanding Oracle ILOM on the Gateway

Oracle ILOM Overview

Supported Features

Understanding Oracle ILOM Targets

Administering Oracle ILOM (CLI)

CLI Overview

Accessing Oracle ILOM From the CLI

Access the Oracle ILOM Shell From the CLI (NET MGT Port)

Access the Oracle ILOM Shell From the CLI (USB Management Port)

Switching Between the Oracle ILOM Shell and the Linux Shell

/SYS/Switch_Diag, /SYS/Gateway_Mgmt, and /SYS/Fabric_Mgmt Linux Shells

Switch From the Oracle ILOM Shell to the Linux Shell

Switch From the Linux Shell to the Oracle ILOM Shell

Monitoring Oracle ILOM Targets (CLI)

Performing Daily Tasks (CLI)

Display the Date (CLI)

Display Gateway Status LEDs States (CLI)

Display the Aggregate Sensors State (CLI)

Aggregate Sensor States

Display Power Supply Status (CLI)

Display Board-Level Voltages (CLI)

Board Level Voltages

Display Internal Temperatures (CLI)

Internal Temperature Sensors

Display Fan Status (CLI)

Display the Oracle ILOM Sessions (CLI)

Display the Oracle ILOM Event Log (CLI)

Checking the Status of Services (CLI)

Display the HTTP Service Status (CLI)

Display the HTTPS Service Status (CLI)

Display the SSL Certificates (CLI)

Display the SNMP Service Status (CLI)

Display the SNMP User Accounts (CLI)

Display the SNMP Service Communities (CLI)

Display the IPMI Service Status (CLI)

Display the DNS Client Status (CLI)

Display the SMTP Client Status (CLI)

Display the NTP Servers (CLI)

Verifying Other Aspects With Oracle ILOM (CLI)

Get Help on an Oracle ILOM Command (CLI)

Get Help on an Oracle ILOM Target Property (CLI)

Display the Alert Properties (CLI)

Display the Oracle ILOM User Accounts (CLI)

Display the Remote Log Hosts (CLI)

Display the Network Management Configuration (CLI)

Display the CLI Session Timeout (CLI)

Display Gateway FRU ID (CLI)

Display Power Supply FRU ID (CLI)

Display the Firmware Version (CLI)

Display System Identification Properties (CLI)

Controlling Oracle ILOM Targets (CLI)

Performing General Tasks on Oracle ILOM Targets (CLI)

Restart the Management Controller (CLI)

Set the Date and Time (CLI)

Enable the Locator LED (CLI)

Disable the Locator LED (CLI)

Clear the Oracle ILOM Event Log (CLI)

Set the Remote Log Hosts (CLI)

Configure the DNS Client (CLI)

Configure the SMTP Client (CLI)

Back Up the Configuration (CLI)

Gateway Configuration Information Backed Up

Restore the Configuration (CLI)

Create a Snapshot of the Gateway State (CLI)

Snapshot Dataset Information (CLI)

Set the Network Management Parameters (CLI)

Set the System Identification Properties (CLI)

Performing Oracle ILOM User Tasks (CLI)

Add an Oracle ILOM User Account (CLI)

Change an Oracle ILOM User’s Password and or Role (CLI)

Delete an Oracle ILOM User Account (CLI)

Managing HTTP Services (CLI)

Enable the HTTP Service (CLI)

Disable the HTTP Service (CLI)

Managing HTTPS Services (CLI)

Enable the HTTPS Service (CLI)

Install a Custom SSL Certificate (CLI)

Remove the Custom SSL Certificate (CLI)

Disable the HTTPS Service (CLI)

Managing SNMP Services (CLI)

Enable the SNMP Service (CLI)

Configure the SNMP Service (CLI)

Add SNMP Service User Accounts (CLI)

Modify SNMP Service User Accounts (CLI)

Delete SNMP Service User Accounts (CLI)

Add SNMP Service Communities (CLI)

Modify SNMP Service Communities (CLI)

Delete SNMP Service Communities (CLI)

Download SNMP Service MIBs (CLI)

Disable the SNMP Service (CLI)

Managing IPMI Services (CLI)

Enable the IPMI Service (CLI)

Disable the IPMI Service (CLI)

Managing Other Aspects With Oracle ILOM (CLI)

Enable Alerts to Send SNMP Traps (CLI)

Enable Alerts to Send PETs (CLI)

Enable Alerts to Send Email Alerts (CLI)

Disable Alerts (CLI)

Set the Oracle ILOM CLI Session Timeout (CLI)

Upgrading the Gateway Firmware Through Oracle ILOM (CLI)

Firmware Overview

Verify Firmware Integrity (CLI)

Acquire the Gateway Firmware Package (CLI)

Upgrade the Gateway Firmware (CLI)

Administering Oracle ILOM (Web)

Web Interface Overview

Access Oracle ILOM From the Web Interface

Monitoring Oracle ILOM Targets (Web)

Controlling Oracle ILOM Targets (Web)

Upgrade the Gateway Firmware (Web)

Using the Fabric Monitor

Access the Fabric Monitor

Fabric Monitor Features

Accessing the Rear Panel Diagram

Accessing Status Pane Information

Control Panel Function

Monitoring Parameters and Status

Administering Oracle ILOM (SNMP)

SNMP Overview

Understanding SNMP Commands

Monitoring Oracle ILOM Targets (SNMP)

Controlling Oracle ILOM Targets (SNMP)

Administering Hardware (IPMI)

ipmitool Overview

Display the Sensor States (IPMI)

Display the Sensor Information (IPMI)

Display the System Event Log (IPMI)

Display FRU ID Information (IPMI)

Display Gateway Status LED States (IPMI)

Enable the Locator LED (IPMI)

Disable the Locator LED (IPMI)

Understanding Oracle ILOM Commands

cd Command

create Command

delete Command

dump Command

exit Command (ILOM)

help Command (ILOM)

load Command

reset Command

set Command

show Command

version Command (ILOM)


Understanding Service Procedures

Replaceable Components

Suggested Tools for Service

Antistatic Precautions for Service

Servicing Power Supplies

Inspecting a Power Supply

Power Off a Power Supply

Remove a Power Supply

Install a Power Supply

Power On a Power Supply

Servicing Fans

Inspecting a Fan

Remove a Fan

Install a Fan

Servicing Data Cables

Inspecting the Data Cables

Remove a Data Cable

Install a Data Cable

Servicing the Battery

Remove the Gateway From the Rack

Replace the Battery


Understanding Hardware Commands

Linux Shells for Hardware Commands

addlagport Command

allowhostconfig Command

checkboot Command

checkpower Command

checktopomax Command

checkvoltages Command

connector Command

createlag Command

createvlan Command

createvnic Command

dcsport Command

deletelag Command

deletevlan Command

deletevnic Command

dellagport Command

disablecablelog Command

disablegwport Command

disablelagmode Command

disablelinklog Command

disablesm Command

disableswitchport Command

disablevnic Command

disallowhostconfig Command

enablecablelog Command

enablegwport Command

enablelagmode Command

enablelinklog Command

enablesm Command

enableswitchport Command

enablevnic Command

env_test Command

exit Command (Hardware)

fdconfig Command

fwverify Command

generatetopology Command

getfanspeed Command

getmaster Command

getportcounters Command

getportstatus Command

help Command (Hardware)

listlinkup Command

matchtopology Command

setcontrolledhandover Command

setdefaultgwdiscpkey Command

setgwethport Command

setgwinstance Command

setgwsl Command

setgwsystemname Command

setmsmlocationmonitor Command

setsmmkey Command

setsmpriority Command

setsubnetprefix Command

showfruinfo Command

showgwconfig Command

showgwports Command

showlag Command

showpsufru Command

showsmlog Command

showtemps Command

showtopology Command

showunhealthy Command

showvlan Command

showvnics Command

smconfigtest Command

smnodes Command

smpartition Command

version Command (Hardware)

Understanding InfiniBand Commands

Linux Shells for InfiniBand Commands

ibdiagnet Command

ibhosts Command

ibnetdiscover Command

ibnetstatus Command

ibnodes Command

ibportstate Command

ibroute Command

ibrouters Command

ibstat Command

ibswitches Command

ibtracert Command

perfquery Command

saquery Command

smpquery Command

Understanding SNMP MIB OIDs

OID Tables Overview

Understanding the SUN-DCS-IB-MIB MIB OIDs

Understanding the SUN-FABRIC-MIB MIB OIDs

Understanding the SUN-HW-TRAP-MIB MIB OIDs


Understanding the SUN-PLATFORM-MIB MIB OIDs

Understanding the ENTITY-MIB MIB OIDs


Upgrade the Gateway Firmware (CLI)

Note - If you are going to downgrade the firmware to a version earlier than 2.0, you must remove user partitions and depopulate the Subnet Manager nodes list. See Gateway Administration, removing partitions for firmware downgrade.

  1. Open an SSH session as user root and connect to the management controller by specifying the controller’s host name.

    For example:

    % ssh -l root gateway_name
    root@gateway_name’s password: password

    where gateway_name is the host name of the management controller. Initially, the password is changeme.

  2. If the Subnet Manager is running on the management controller, disable it with the disablesm command.
    # disablesm
    Stopping partitiond daemon.                                [  OK  ]
    Stopping IB Subnet Manager..                               [  OK  ]
  3. Verify that there is at least 150 MB available in the /tmp directory.
    # df -h /tmp
    Filesystem            Size  Used Avail Use% Mounted on
    tmpfs                 250M  240K 249M 1% /tmp

    In this example, there are 249 MB available. If not enough space is available, you must delete files from the /tmp directory.

  4. Verify that there is at least 1 MB available in the /config directory.
    # df -h /config
    Filesystem            Size  Used Avail Use% Mounted on
    /dev/hda2              16M  3.6M   11M  25% /config

    In this example, there are 11 MB available. If not enough space is available, you must delete files from the /config directory.

  5. Verify that there is at least 1 MB available in the /var/log directory.
    # df -h /var/log
    Filesystem            Size  Used Avail Use% Mounted on
    /dev/hda3              16M  3.6M   11M  25% /var/log

    In this example, there are 11 MB available. If not enough space is available, you must delete files from the /var/log directory.

  6. Verify that there is at least 150 MB free memory available.
    # free -m
                     total       used       free     shared    buffers     cached
    Mem:           498        104        393          0         12         47
    -/+ buffers/cache:         45        453
    Swap:            0          0          0

    In the -/+ buffers/cache: row of the free column, there should be at least 150 MB free memory. In this example, there are 453 MB available. If not enough memory is available, you must exit non-essential applications that are running.

  7. Start the Oracle ILOM shell.
    # spsh
    Oracle(R) Integrated Lights Out Manager
    Version ILOM 3.0 r47111
    Copyright (c) 2010, Oracle and/or its affiliates. All rights reserved.

    You are now in the Oracle ILOM shell.

    You can use the exit command to return to the Linux shell.

  8. Begin the upgrade process.
    -> load -source URI/pkgname


    • URI is the uniform resource indicator for the host where the gateway firmware package is located. The FTP and HTTP protocols are supported.

    • pkgname is the name of the firmware package in the transfer directory.

    For example, using the FTP protocol:

    -> load -source ftp://root:changeme@
    Downloading firmware image. This will take a few minutes.

    Note - If you are upgrading from firmware version 2.0.X, you can use the -force option to disable version number checking, and force the upgrade.

    The firmware is downloaded. The upgrade begins. A caution is displayed and you are asked to commit to the upgrade.

    NOTE: Firmware upgrade will upgrade firmware on SUN DCS gw Kontron module,
             I4 and BridgeX. Upgrade takes few minutes to complete.
             ILOM will enter a special mode to load new firmware. No other tasks 
             should be performed in ILOM until the firmware upgrade is complete. 
    Are you sure you want to load the specified file (y/n)?
  9. Answer y to the prompt to commit to the upgrade.

    The upgrade begins.

    Setting up environment for firmware upgrade. This will take few minutes.
    Starting SUN DCS gw FW update
    Performing operation: I4 A
    I4 A: I4 is already at the given version.
    Performing operation: BX A
    BX fw upgrade from 8.3.3166(INI:4) to 8.4.2740(INI:5):
    Upgrade started...
    Upgrade completed.
    INFO: BX fw upgrade from 8.3.3166(INI:4) to 8.4.2740(INI:5) succeeded
    Performing operation: BX B
    BX fw upgrade from 8.3.3166(INI:4) to 8.4.2740(INI:5):
    Upgrade started...
    Upgrade completed.
    INFO: BX fw upgrade from 8.3.3166(INI:4) to 8.4.2740(INI:5) succeeded
    Summary of Firmware update 
    I4 status :  FW UPDATE - SUCCESS
    I4 update succeeded on :  none
    I4 already up-to-date on :  A
    I4 update failed on :  none
    BX status :  FW UPDATE - SUCCESS
    BX update succeeded on :  A, B
    BX already up-to-date on :  none
    BX update failed on :  none
    Performing operation: SUN DCS gw firmware update
    SUN DCS gw Kontron module fw upgrade from 1.3.2-1 to 2.0.5-1:
    Please reboot the system to enable firmware update of Kontron module. The download of the Kontron firmware image happens during reboot.
    After system reboot, Kontron FW update progress can be monitored in browser using URL [http://GWsystem] OR at OS 
    command line prompt by using command [telnet GWsystem 1234] where GWsystem is the hostname or IP address of SUN DCS GW.
    Firmware update is complete.
  10. Exit the Oracle ILOM CLI shell.
    -> exit
  11. Reboot the gateway to enable the new firmware.

    See Gateway Administration, restarting the entire gateway.

    Note - The restart process takes between 4 to 5 minutes to complete.

    You can monitor the update progress through:

    • web browser – http://gateway_name

    • CLI – telnet gateway_name 1234

    where gateway_name is the host name or IP address of the management controller.

    Note - The Oracle ILOM stack requires at least 2 minutes to become operational after a reboot.

    The next time you login to the gateway, this message is displayed:

    FW upgrade completed successfully on Mon Oct 17 18:36:14 IST 2011.
    Please run the "fwverify" CLI command to verify the new image.
    This message will be cleared on next reboot.
  12. If the Subnet Manager was previously disabled, log in as the root user and enable the Subnet Manager.
    % ssh -l root gateway_name
    root@gateway_name’s password: password
    # enablesm
    Starting IB Subnet Manager.                                [  OK  ]
    Starting partitiond daemon.                                [  OK  ]
  13. Verify the firmware version.
    # version
    SUN DCS gw version: 2.0.5-1
    Build time: Nov 25 2011 12:56:05
    FPGA version: 0x33
    SP board info:
    Manufacturing Date: 2009.06.23
    Serial Number: "NCD3R0527"
    Hardware Revision: 0x0006
    Firmware Revision: 0x0102
    BIOS version: NOW1R112 
    BIOS date: 04/24/2009

    In the first line of the output is SUN DCS gw version x.y.z-w, where x.y.z-w is the version of the firmware upgraded (or downgraded). For example, 2.0.5-1.

  14. Verify the firmware integrity.

    See Verify Firmware Integrity (CLI).

Related Information