JavaScript is required to for searching.
Skip Navigation Links
Exit Print View
Sun Network QDR InfiniBand Gateway Switch HTML Document Collection for Firmware Version 2.1
search filter icon
search icon

Document Information

Using This Documentation

Product Notes

Related Documentation

Feedback

Access to Oracle Support

Installation

Understanding the Gateway

Gateway Overview

Physical Specifications

Environmental Requirements

Acoustic Noise Emissions

Electrical Specifications

NET MGT Connector and Pins

USB Management Connector and Pins

Data QSFP Connector and Pins

Understanding Cabling

Routing Service Cables

Understanding Data Cabling

Preparing to Install the Gateway

Installation Preparation

Suggested Tools for Installation

Antistatic Precautions for Installation

Installation Responsibilities

Installation Sequence

Verify Shipping Carton Contents

Assemble the Optical Fiber Data Cables

Route the Data Cables

Installing the Gateway

Install the Gateway in the Rack

Powering On the Gateway

Attach the Management Cables

Attach the Power Cords

Accessing the Management Controller

Access the Management Controller From the NET MGT Port

Access the Management Controller From the USB Management Port

Verify the Gateway Status

Start the Subnet Manager

Connecting Data cables

Attach the Data Cables

Check Link Status

Verifying the InfiniBand Fabric

InfiniBand Node Description

Discover the InfiniBand Fabric Topology

Perform Diagnostics on the InfiniBand Fabric

Administration

Troubleshooting the Gateway

Gateway Hardware Problems

InfiniBand Fabric Problems

Network Management Troubleshooting Guidelines

Understanding Routing Through the Gateway

Switch GUIDs Overview

Understanding Administrative Commands

Configuration Overview

Oracle ILOM Command Overview

Hardware Command Overview

InfiniBand Command Overview

Administering the Chassis

Monitoring the Chassis

Controlling the Chassis

Administering the I4 Switch Chip

Monitoring the I4 Switch Chip

Controlling the I4 Switch Chip

Administering the Subnet Manager

Monitoring the Subnet Manager

Controlling the Subnet Manager

Configuring Secure Fabric Management

Administering the InfiniBand Fabric

Monitoring the InfiniBand Fabric

Controlling the InfiniBand Fabric

Administering Gateway Resources

Installing Gateway Supportive Software (Linux)

Creating VNICs Under Gateway Manual Mode (Linux)

Creating VNICs Under Host Manual Mode (Linux)

Creating Virtual IO Adapters (Oracle Solaris)

Monitoring Gateway Resources

Controlling LAGs

Controlling VLANs and VNICs

Controlling Gateway Ports and Parameters

Remote Management

Understanding Oracle ILOM on the Gateway

Oracle ILOM Overview

Supported Features

Understanding Oracle ILOM Targets

Administering Oracle ILOM (CLI)

CLI Overview

Accessing Oracle ILOM From the CLI

Switching Between the Oracle ILOM Shell and the Linux Shell

Monitoring Oracle ILOM Targets (CLI)

Controlling Oracle ILOM Targets (CLI)

Upgrading the Gateway Firmware Through Oracle ILOM (CLI)

Administering Oracle ILOM (Web)

Web Interface Overview

Access Oracle ILOM From the Web Interface

Monitoring Oracle ILOM Targets (Web)

Controlling Oracle ILOM Targets (Web)

Upgrade the Gateway Firmware (Web)

Using the Fabric Monitor

Access the Fabric Monitor

Fabric Monitor Features

Accessing the Rear Panel Diagram

Accessing Status Pane Information

Control Panel Function

Monitoring Parameters and Status

Administering Oracle ILOM (SNMP)

SNMP Overview

Understanding SNMP Commands

Monitoring Oracle ILOM Targets (SNMP)

Controlling Oracle ILOM Targets (SNMP)

Administering Hardware (IPMI)

ipmitool Overview

Display the Sensor States (IPMI)

Display the Sensor Information (IPMI)

Display the System Event Log (IPMI)

Display FRU ID Information (IPMI)

Display Gateway Status LED States (IPMI)

Enable the Locator LED (IPMI)

Disable the Locator LED (IPMI)

Understanding Oracle ILOM Commands

cd Command

create Command

delete Command

dump Command

exit Command (Oracle ILOM)

help Command (Oracle ILOM)

load Command

reset Command

set Command

show Command

version Command (Oracle ILOM)

Service

Detecting and Managing Faults

Interpreting Status LEDs

Managing Faulty Components

Identify Faults in the Oracle ILOM Event Log

Determining the Alarm State of a Component or System

Evaluating Sensor Alarms

Accessing CLI Prompts

Understanding Service Procedures

Replaceable Components

Suggested Tools for Service

Antistatic Precautions for Service

Servicing Power Supplies

Determine If a Power Supply Is Faulty

Inspecting a Power Supply

Power Off a Power Supply

Remove a Power Supply

Install a Power Supply

Power On a Power Supply

Servicing Fans

Determine If a Fan Is Faulty

Inspecting a Fan

Remove a Fan

Install a Fan

Servicing Data Cables

Inspecting the Data Cables

Remove a Data Cable

Install a Data Cable

Servicing the Battery

Determine If the Battery Is Faulty

Remove the Gateway From the Rack

Replace the Battery

Reference

Understanding Hardware Commands

Linux Shells for Hardware Commands

addlagport Command

allowhostconfig Command

autodisable Command

checkboot Command

checkpower Command

checktopomax Command

checkvoltages Command

connector Command

create_ipoib Command

createfabric Command

createlag Command

createvlan Command

createvnic Command

dcsport Command

delete_ipoib Command

deletelag Command

deletevlan Command

deletevnic Command

dellagport Command

disablecablelog Command

disablegwport Command

disablelagmode Command

disablelinklog Command

disablesm Command

disableswitchport Command

disablevnic Command

disallowhostconfig Command

enablecablelog Command

enablegwport Command

enablelagmode Command

enablelinklog Command

enablesm Command

enableswitchport Command

enablevnic Command

env_test Command

exit Command (Hardware)

fdconfig Command

fwverify Command

generatetopology Command

getfanspeed Command

getmaster Command

getportcounters Command

getportstatus Command

help Command (Hardware)

listlinkup Command

localmkeypersistence Command

matchtopology Command

modifyvnic Command

setcontrolledhandover Command

setdefaultgwdiscpkey Command

setgwethport Command

setgwinstance Command

setgwsl Command

setgwsystemname Command

sethostvniclimit Command

setmsmlocationmonitor Command

setsmmkey Command

setsmpriority Command

setsmrouting Command

setsubnetprefix Command

showdisk Command

showfree Command

showfruinfo Command

showgwconfig Command

showgwports Command

showioadapters Command

showlag Command

showpsufru Command

showsmlog Command

showtemps Command

showtopology Command

showunhealthy Command

showvlan Command

showvnics Command

smconfigtest Command

smnodes Command

smpartition Command

smsubnetprotection Command

version Command (Hardware)

Understanding InfiniBand Commands

Linux Shells for InfiniBand Commands

ibdiagnet Command

ibhosts Command

ibnetdiscover Command

ibnetstatus Command

ibnodes Command

ibportstate Command

ibroute Command

ibrouters Command

ibstat Command

ibswitches Command

ibtracert Command

perfquery Command

saquery Command

smpquery Command

Understanding SNMP MIB OIDs

OID Tables Overview

Understanding the SUN-DCS-IB-MIB MIB OIDs

Understanding the SUN-FABRIC-MIB MIB OIDs

Understanding the SUN-HW-TRAP-MIB MIB OIDs

Understanding the SUN-ILOM-CONTROL-MIB MIB OIDs

Understanding the SUN-PLATFORM-MIB MIB OIDs

Understanding the ENTITY-MIB MIB OIDs

Index

Attach the Data Cables


Caution

Caution - Data cables must never turn tighter than a 5-inch (127 mm) radius. A tighter radius damages the wires and fibers inside the cable.



Note - When you install the data cables, connect cables to the lower connectors first, then connect cables to the upper connectors.



Note - Though the illustrations in this procedure picture only InfiniBand cables, the process is identical for both InfiniBand cables and Ethernet cables.


  1. Identify the prerequisite and subsequent installation tasks that you must perform in conjunction with this procedure.

    See Installation Sequence.

  2. Loosen the two captive thumbscrews that secure the cover to the cable management bracket.
    image:Illustration shows the thumbscrew being loosened.
  3. Lift the cover off.
    image:Illustration shows the cable management bracket cover being removed.
  4. Remove the protective cap from the connector or transceiver and visually inspect the cable connector.

    The shell should not be bent and should be parallel to the inner boards. If the connector is bent or damaged, use a different cable.

  5. Ensure that the retraction strap is folded back against the cable.
  6. Orient the cable connector to the QSFP receptacle squarely and horizontally.

    Ensure that the L groove is up for the top row of receptacles, or that the L groove is down for the bottom row of receptacles.


    image:Illustration shows the InfiniBand cable being attached.

    Note - On some QSFP cable connectors, there is a retraction strap. Both the retraction strap and L groove indicate the reference surface for the connector. When installing QSFP cables in the top row of receptacles (0A, 1A, 2A, and so on), ensure that the L groove and retraction strap are up. When installing QSFP cables in the bottom row of receptacles (0B, 1B, 2B, and so on) ensure that the L groove and retraction strap are down. Refer to Gateway Service, identifying the data cable.


  7. Slowly move the connector in.

    As you slide the connector in, the shell should be in the center of the QSFP receptacle.


    image:Illustration shows the alignment of the InfiniBand cables.
    • If the connector stops or binds after about 1/4 in. (5 mm) travel, back out and repeat from Step 6.

    • If the connector stops or binds with about 1/8 in. (2 mm) still to go, back out and repeat Step 7.

  8. Continue to push the connector in until you feel a detent.
  9. Place the cable into the open slot on the cable management bracket.
    image:Illustration shows the InfiniBand cables being laid into the cable management bracket.
  10. Repeat Step 4 through Step 9 for all cables to be installed, including the Ethernet cables at connectors 0A and 1A on the right side of the rear panel.
  11. Replace the cover for the cable management bracket and tighten the thumbscrews.
    image:Illustration shows the cover being put on the cable management bracket.
  12. Route the data cables so that they do not interfere with other cables, or with servicing the gateway or other systems.

    Use hook and loop fastener straps to bundle and secure the cables.


    Note - Do not use cable zip ties to bundle or secure the cables, because the ties damage the fibers inside the cables.


  13. Check that the Link LEDs for cabled links are lit green.

    If the Link LED is unlit, the link is down. If the Link LED flashes, there are symbol errors. Refer to Gateway Service, checking the link status LEDs.

  14. If possible, close the rack doors to maintain EMI compliance.
  15. Check the link status.

    See Check Link Status.

Related Information