Skip Navigation Links | |
Exit Print View | |
Sun Network QDR InfiniBand Gateway Switch HTML Document Collection for Firmware Version 2.1 |
USB Management Connector and Pins
Preparing to Install the Gateway
Suggested Tools for Installation
Antistatic Precautions for Installation
Verify Shipping Carton Contents
Assemble the Optical Fiber Data Cables
Install the Gateway in the Rack
Verifying the InfiniBand Fabric
Network Management Troubleshooting Guidelines
Understanding Routing Through the Gateway
Understanding Administrative Commands
Administering the I4 Switch Chip
Controlling the I4 Switch Chip
Administering the Subnet Manager
Controlling the Subnet Manager
Configuring Secure Fabric Management
Administering the InfiniBand Fabric
Monitoring the InfiniBand Fabric
Controlling the InfiniBand Fabric
Administering Gateway Resources
Installing Gateway Supportive Software (Linux)
Acquire the BXOFED Software (Linux)
Install the BXOFED Software (Linux)
Acquire the ConnectX-2 Firmware
Creating VNICs Under Gateway Manual Mode (Linux)
Gateway Manual Mode Overview (Linux)
Determine VNIC Configuration Parameters For Gateway Manual Mode (Linux)
Determine VLAN Associations for Gateway Manual Mode (Linux)
Configure and Create VNICs for Gateway Manual Mode (Linux)
VNIC Configuration on Linux Hosts in Gateway Manual Mode
Creating VNICs Under Host Manual Mode (Linux)
Host Manual Mode Overview (Linux)
Central Configuration File (Linux)
VNIC-Specific Configuration File (Linux)
Determine VNIC Configuration Parameters for Host Manual Mode (Linux)
Create the Central Configuration File (Linux)
Create the VNIC-Specific Configuration Files (Linux)
mlx4_vnic_confd Daemon (Linux)
Configure and Create VNICs for Host Manual Mode (Linux)
Creating Virtual IO Adapters (Oracle Solaris)
Verify That the Ethernet Over InfiniBand Driver Is Installed (Oracle Solaris)
Install the Ethernet Over InfiniBand Driver (Oracle Solaris)
Configure IP Addresses on the Data Link (Oracle Solaris)
Create Oracle Solaris VNICs With VLAN Tagging (Oracle Solaris)
Display Gateway Ethernet Port Information
Display Gateway Port Information
Display the Gateway Instance Number
Display Information About the Gateway
Add or Delete Connectors From a LAG
VNIC Allocation on the Gateway
Controlling Gateway Ports and Parameters
Enable a Gateway Ethernet Port
Disable a Gateway Ethernet Port
Set the Gateway Ethernet Port Parameters
Set the Gateway Instance Number
Understanding Oracle ILOM on the Gateway
Understanding Oracle ILOM Targets
Administering Oracle ILOM (CLI)
Accessing Oracle ILOM From the CLI
Switching Between the Oracle ILOM Shell and the Linux Shell
Monitoring Oracle ILOM Targets (CLI)
Controlling Oracle ILOM Targets (CLI)
Upgrading the Gateway Firmware Through Oracle ILOM (CLI)
Administering Oracle ILOM (Web)
Access Oracle ILOM From the Web Interface
Monitoring Oracle ILOM Targets (Web)
Controlling Oracle ILOM Targets (Web)
Upgrade the Gateway Firmware (Web)
Accessing the Rear Panel Diagram
Accessing Status Pane Information
Monitoring Parameters and Status
Administering Oracle ILOM (SNMP)
Monitoring Oracle ILOM Targets (SNMP)
Controlling Oracle ILOM Targets (SNMP)
Display the Sensor States (IPMI)
Display the Sensor Information (IPMI)
Display the System Event Log (IPMI)
Display FRU ID Information (IPMI)
Display Gateway Status LED States (IPMI)
Disable the Locator LED (IPMI)
Understanding Oracle ILOM Commands
Identify Faults in the Oracle ILOM Event Log
Determining the Alarm State of a Component or System
Understanding Service Procedures
Antistatic Precautions for Service
Determine If a Power Supply Is Faulty
Determine If the Battery Is Faulty
Remove the Gateway From the Rack
Understanding Hardware Commands
Linux Shells for Hardware Commands
Understanding InfiniBand Commands
Linux Shells for InfiniBand Commands
Understanding the SUN-DCS-IB-MIB MIB OIDs
Understanding the SUN-FABRIC-MIB MIB OIDs
Understanding the SUN-HW-TRAP-MIB MIB OIDs
Understanding the SUN-ILOM-CONTROL-MIB MIB OIDs
Understanding the SUN-PLATFORM-MIB MIB OIDs
The Ethernet over InfiniBand driver is available in current releases of the Oracle Solaris 11 image. This driver supports the Data Link Provider Interface over all InfiniBand ports of an Oracle Solaris 11 host connected to the gateway. The driver uses the IBA unreliable datagram mode to enable initialization, gateway handshake, heartbeat management, frame transmit and receive functions, multicast support, and statistical reporting. The driver is delivered through an IPS-based package with the file name of ethernet-over-ib.
Network interfaces in the Oracle Solaris 11 operating system correspond to instances of network hardware devices, and the interfaces are configured over data links. The Ethernet over InfiniBand driver supports virtual network hardware on HCAs and enables interfaces to be assigned to that virtual hardware.
Administrators create IP interfaces on top of data links. A data link represents a link object in the second layer of the OSI model. The respective physical link is directly associated with a device (physical or virtual) and device instance name. The device instance name is comprised of the device driver name augmented with the instance number, which has a value of 0 to n instances of network devices (physical or virtual) using that driver. For each virtual device and interface created on the gateway, there is a corresponding data link named eoibX created on the Oracle Solaris 11 host.
Associating the InfiniBand port of an HCA to a gateway Ethernet port, and assigning one or more MAC addresses to the pair creates a virtual IO adapter (VIOA). The createvnic command of the gateway is used to fulfill this objective. Oracle Solaris discovers the VIOA, binds an eoibX datalink instance to the VIOA, and then manages the VIOA as if it were a physical network interface card (NIC). Like a physical NIC, the VIOA represents the access path to an Ethernet port. Because more than one MAC address can be assigned to a VIOA, the VNIC management commands of the gateway are actually managing the MAC addresses within the gateway itself.