Skip Navigation Links | |
Exit Print View | |
Sun Network QDR InfiniBand Gateway Switch HTML Document Collection for Firmware Version 2.1 |
USB Management Connector and Pins
Preparing to Install the Gateway
Suggested Tools for Installation
Antistatic Precautions for Installation
Verify Shipping Carton Contents
Assemble the Optical Fiber Data Cables
Install the Gateway in the Rack
Verifying the InfiniBand Fabric
Network Management Troubleshooting Guidelines
Understanding Routing Through the Gateway
Understanding Administrative Commands
Administering the I4 Switch Chip
Controlling the I4 Switch Chip
Administering the Subnet Manager
Controlling the Subnet Manager
Configuring Secure Fabric Management
Administering the InfiniBand Fabric
Monitoring the InfiniBand Fabric
Controlling the InfiniBand Fabric
Administering Gateway Resources
Installing Gateway Supportive Software (Linux)
Acquire the BXOFED Software (Linux)
Install the BXOFED Software (Linux)
Acquire the ConnectX-2 Firmware
Creating VNICs Under Gateway Manual Mode (Linux)
Gateway Manual Mode Overview (Linux)
Determine VNIC Configuration Parameters For Gateway Manual Mode (Linux)
Determine VLAN Associations for Gateway Manual Mode (Linux)
Configure and Create VNICs for Gateway Manual Mode (Linux)
VNIC Configuration on Linux Hosts in Gateway Manual Mode
Creating VNICs Under Host Manual Mode (Linux)
Host Manual Mode Overview (Linux)
Central Configuration File (Linux)
VNIC-Specific Configuration File (Linux)
Create the Central Configuration File (Linux)
Create the VNIC-Specific Configuration Files (Linux)
mlx4_vnic_confd Daemon (Linux)
Configure and Create VNICs for Host Manual Mode (Linux)
Creating Virtual IO Adapters (Oracle Solaris)
Ethernet Over InfiniBand Overview (Oracle Solaris)
Verify That the Ethernet Over InfiniBand Driver Is Installed (Oracle Solaris)
Install the Ethernet Over InfiniBand Driver (Oracle Solaris)
Configure IP Addresses on the Data Link (Oracle Solaris)
Create Oracle Solaris VNICs With VLAN Tagging (Oracle Solaris)
Display Gateway Ethernet Port Information
Display Gateway Port Information
Display the Gateway Instance Number
Display Information About the Gateway
Add or Delete Connectors From a LAG
VNIC Allocation on the Gateway
Controlling Gateway Ports and Parameters
Enable a Gateway Ethernet Port
Disable a Gateway Ethernet Port
Set the Gateway Ethernet Port Parameters
Set the Gateway Instance Number
Understanding Oracle ILOM on the Gateway
Understanding Oracle ILOM Targets
Administering Oracle ILOM (CLI)
Accessing Oracle ILOM From the CLI
Switching Between the Oracle ILOM Shell and the Linux Shell
Monitoring Oracle ILOM Targets (CLI)
Controlling Oracle ILOM Targets (CLI)
Upgrading the Gateway Firmware Through Oracle ILOM (CLI)
Administering Oracle ILOM (Web)
Access Oracle ILOM From the Web Interface
Monitoring Oracle ILOM Targets (Web)
Controlling Oracle ILOM Targets (Web)
Upgrade the Gateway Firmware (Web)
Accessing the Rear Panel Diagram
Accessing Status Pane Information
Monitoring Parameters and Status
Administering Oracle ILOM (SNMP)
Monitoring Oracle ILOM Targets (SNMP)
Controlling Oracle ILOM Targets (SNMP)
Display the Sensor States (IPMI)
Display the Sensor Information (IPMI)
Display the System Event Log (IPMI)
Display FRU ID Information (IPMI)
Display Gateway Status LED States (IPMI)
Disable the Locator LED (IPMI)
Understanding Oracle ILOM Commands
Identify Faults in the Oracle ILOM Event Log
Determining the Alarm State of a Component or System
Understanding Service Procedures
Antistatic Precautions for Service
Determine If a Power Supply Is Faulty
Determine If the Battery Is Faulty
Remove the Gateway From the Rack
Understanding Hardware Commands
Linux Shells for Hardware Commands
Understanding InfiniBand Commands
Linux Shells for InfiniBand Commands
Understanding the SUN-DCS-IB-MIB MIB OIDs
Understanding the SUN-FABRIC-MIB MIB OIDs
Understanding the SUN-HW-TRAP-MIB MIB OIDs
Understanding the SUN-ILOM-CONTROL-MIB MIB OIDs
Understanding the SUN-PLATFORM-MIB MIB OIDs
MAC addresses, GUIDs, and other parameters are assigned to VNICs. You can create a repository of this information to assist in creating VNICs.
Note - This procedure creates a host MAC address list, used to create VNICs in host manual mode.
You must associate a VNIC with a VLAN, even if that VLAN identifier is NO. You also must partition the InfiniBand fabric and provide a partition key for each VLAN. If the VLAN identifier NO is to be associated with the P_Key default, you need not create the default partition, for it already exists.
Note - The association of VLAN identifier NO to partition key default survives firmware upgrades.
Note - Each MAC address must be unique and not 00:00:00:00:00:00.
Note - Only even numbers are supported for the most significant byte of the MAC address (unicast).
For example:
# ibv_devinfo hca_id: mlx4_0 fw_ver: 2.5.9266 node_guid: 0003:ba00:0100:c708 sys_image_guid: 0003:ba00:0100:c70b . . . #
In the example, the hca_id value is mlx4_0, and the HCA port GUID (sys_image_guid) is 003ba000100c70b.
Note - Do not use VLAN identifiers 0, 1, or 4095. According to the IEEE 802.1Q specification, VLAN ID 0 is used for priority tag, and VLAN ID 1 is usually reserved for a switch or bridge management VLAN.
Note - Due to hardware limitations for MultiCast groups, there is a maximum of 1000 VLANs.
Note - Given a connector and vlan_id combination, there is only one p_key permitted.
An example entry in the host MAC address list might look like this:
1 00:30:48:7d:de:e4 cupcake mlx4_0 1 0003ba000100c70b 3 0A-ETH-1
For this example:
1 is the entry number. This will become the VNIC number and eth number.
00:30:48:7d:de:e4 is the MAC address.
cupcake is the host name and is used to identify the location of the VNIC.
mlx4_0 is the value of the hca_id field and is called the device name.
1 is the port of the HCA.
0003ba000100c70b is the HCA port GUID.
3 is the VLAN identifier.
0A-ETH-1 is the connector.