JavaScript is required to for searching.
Skip Navigation Links
Exit Print View
Oracle Dual Port QDR InfiniBand Adapter M3

User's Guide

search filter icon
search icon

Document Information

Using This Documentation

Product Notes

Related Documentation

Feedback

Access to Oracle Support

Installing the Adapter

Hardware and Software Requirements

Install the Adapter

Adapter Features

Adapter Specifications

InfiniBand Interface

PCIe Interface

LEDs and Ports

I2C Compatible Interface

Node GUID

Installing InfiniBand on Oracle Solaris OS

InfiniBand for Oracle Solaris OS

Verify the Installation (Oracle Solaris)

Update the Firmware (Oracle Solaris)

InfiniBand Devices (Oracle Solaris)

Installing InfiniBand on Oracle Linux OS

InfiniBand for Oracle Linux OS

Enable Ethernet Over Oracle IB Gateway

Verify the Installation (Oracle Linux)

Replacing a Short Bracket With a Tall Bracket

Remove the Short Bracket From the Adapter

Assemble and Install a Tall Bracket

Glossary

Index

Verify the Installation (Oracle Solaris)

  1. Install the adapter in the chassis.

    See Install the Adapter.

  2. Power on the server and cable the server to an operational InfiniBand switch.

    Refer to the documentation for your server.

  3. Ensure that the cables are connected to the adapter and switches.
  4. Verify that the IB Subnet Manager is in operation on the network.

    Refer to the documentation for your network hardware for more information.

  5. Check that the green LED is illuminated for each port that is connected to the switch.

    If the green LED is not on, check the cable connections at the adapter and the switch.

  6. Check that the yellow LED is illuminated for each port that is connected to the switch.
  7. Verify that the IB-HCA ports are up and the driver is attached.
    1. Obtain the state of the device installed.
      # cfgadm -als "cols=ap_id:condition" hca
      Ap_Id                          Condition
      hca:2C90109763F70              ok

      If more than one IB-HCA device is installed in the server, a row is displayed for each. Look for the row displaying hca:GUID where GUID is the 64-bit number from the physical label on the adapter. See Node GUID.

      The Condition column must display ok to indicate that the driver has discovered the hardware and is bound to it. Refer to the cfgadm_ib(1m) man pages for details about the IB specific extensions.

    2. Obtain port GUIDs for each port on the adapter.
      # cfgadm -als "cols=ap_id:info" hca
      Ap_Id                          Information
      hca:2C90109763F70              VID: 0x15b3, PID: 0x5a44, 
      #ports: 0x2, port1 GUID: 0x2C90109763F71, port2 GUID: 0x2C90109763F72

      If more than one IB-HCA device is installed in the server, a row is displayed for each device. Look for the row displaying hca:GUID, where GUID is the 64-bit number from the physical label on the adapter. See Node GUID.

      Use the port number and GUID displayed by this command for your IB-HCA device in the following step.

    3. Verify that the IB ports and partitions are configured by the Subnet Manager.
      # dladm show-ib
      LINK HCAGUID         PORTGUID        PORT STATE  PKEYS
      net6 2C90300A38360   2C90300A38361 1 up     17,18,33,34,800A,800B,8033,8034,FFFF
      net7 2C90300A38360   2C90300A38362   2    up     800A,8033,8034,FFFF

      The command displays the AP_ID column: where each row has the format of ib:Port GUID, P_Key, ipib. Match the Port GUIDs from the previous command with these port GUIDs. There must be one row corresponding to the port and P_Key setup by the Subnet Manager. If an entry is missing, check the Subnet Manager configuration.

      # dladm show-part
      LINK         PKEY  OVER         STATE    FLAGS
      ibd1         FFFF  net9         up       ----
      ibd2         FFFF  net10        up       ----
Related Information