Skip Navigation Links | |
Exit Print View | |
Sun Network QDR InfiniBand Gateway Switch HTML Document Collection for Firmware Version 2.1 |
USB Management Connector and Pins
Preparing to Install the Gateway
Suggested Tools for Installation
Antistatic Precautions for Installation
Verify Shipping Carton Contents
Assemble the Optical Fiber Data Cables
Install the Gateway in the Rack
Verifying the InfiniBand Fabric
Network Management Troubleshooting Guidelines
Understanding Routing Through the Gateway
Understanding Administrative Commands
Administering the I4 Switch Chip
Controlling the I4 Switch Chip
Administering the Subnet Manager
Controlling the Subnet Manager
Configuring Secure Fabric Management
Administering the InfiniBand Fabric
Monitoring the InfiniBand Fabric
Controlling the InfiniBand Fabric
Administering Gateway Resources
Installing Gateway Supportive Software (Linux)
Acquire the BXOFED Software (Linux)
Install the BXOFED Software (Linux)
Acquire the ConnectX-2 Firmware
Creating VNICs Under Gateway Manual Mode (Linux)
Gateway Manual Mode Overview (Linux)
Determine VNIC Configuration Parameters For Gateway Manual Mode (Linux)
Determine VLAN Associations for Gateway Manual Mode (Linux)
Configure and Create VNICs for Gateway Manual Mode (Linux)
VNIC Configuration on Linux Hosts in Gateway Manual Mode
Creating VNICs Under Host Manual Mode (Linux)
Host Manual Mode Overview (Linux)
Central Configuration File (Linux)
VNIC-Specific Configuration File (Linux)
Determine VNIC Configuration Parameters for Host Manual Mode (Linux)
Create the Central Configuration File (Linux)
Create the VNIC-Specific Configuration Files (Linux)
mlx4_vnic_confd Daemon (Linux)
Configure and Create VNICs for Host Manual Mode (Linux)
Creating Virtual IO Adapters (Oracle Solaris)
Ethernet Over InfiniBand Overview (Oracle Solaris)
Verify That the Ethernet Over InfiniBand Driver Is Installed (Oracle Solaris)
Install the Ethernet Over InfiniBand Driver (Oracle Solaris)
Configure IP Addresses on the Data Link (Oracle Solaris)
Display Gateway Ethernet Port Information
Display Gateway Port Information
Display the Gateway Instance Number
Display Information About the Gateway
Add or Delete Connectors From a LAG
VNIC Allocation on the Gateway
Controlling Gateway Ports and Parameters
Enable a Gateway Ethernet Port
Disable a Gateway Ethernet Port
Set the Gateway Ethernet Port Parameters
Set the Gateway Instance Number
Understanding Oracle ILOM on the Gateway
Understanding Oracle ILOM Targets
Administering Oracle ILOM (CLI)
Accessing Oracle ILOM From the CLI
Switching Between the Oracle ILOM Shell and the Linux Shell
Monitoring Oracle ILOM Targets (CLI)
Controlling Oracle ILOM Targets (CLI)
Upgrading the Gateway Firmware Through Oracle ILOM (CLI)
Administering Oracle ILOM (Web)
Access Oracle ILOM From the Web Interface
Monitoring Oracle ILOM Targets (Web)
Controlling Oracle ILOM Targets (Web)
Upgrade the Gateway Firmware (Web)
Accessing the Rear Panel Diagram
Accessing Status Pane Information
Monitoring Parameters and Status
Administering Oracle ILOM (SNMP)
Monitoring Oracle ILOM Targets (SNMP)
Controlling Oracle ILOM Targets (SNMP)
Display the Sensor States (IPMI)
Display the Sensor Information (IPMI)
Display the System Event Log (IPMI)
Display FRU ID Information (IPMI)
Display Gateway Status LED States (IPMI)
Disable the Locator LED (IPMI)
Understanding Oracle ILOM Commands
Identify Faults in the Oracle ILOM Event Log
Determining the Alarm State of a Component or System
Understanding Service Procedures
Antistatic Precautions for Service
Determine If a Power Supply Is Faulty
Determine If the Battery Is Faulty
Remove the Gateway From the Rack
Understanding Hardware Commands
Linux Shells for Hardware Commands
Understanding InfiniBand Commands
Linux Shells for InfiniBand Commands
Understanding the SUN-DCS-IB-MIB MIB OIDs
Understanding the SUN-FABRIC-MIB MIB OIDs
Understanding the SUN-HW-TRAP-MIB MIB OIDs
Understanding the SUN-ILOM-CONTROL-MIB MIB OIDs
Understanding the SUN-PLATFORM-MIB MIB OIDs
Note - Follow this procedure to configure Ethernet over InfiniBand with VLAN tagging in Oracle Solaris. This procedure is independent of and unrelated to Host Manual Mode or Gateway Manual Mode. To create VIOAs on the gateway, see Set Up VIOAs (Oracle Solaris).
FabMan@gateway_name->createvlan connector -vlan vlan_ID -pkey p_key
where:
connector is the name of the connector (0A-ETH-1 to 0A-ETH-4, 0A-ETH, 1A-ETH-1 to 1A-ETH-4, and 1A-ETH).
vlan_ID is the VLAN identifier (NO or 2 to 4094).
Note - Do not use VLAN identifiers 0, 1, or 4095. According to the IEEE 802.1Q specification, VLAN ID 0 is used for priority tag, and VLAN ID 1 is usually reserved for a switch or bridge management VLAN.
p_key is the partition identifier (1 to 7fff or default).
For example, to associate connector 1A-ETH-3 with VLAN 3 and default partition key:
FabMan@gateway_name->createvlan 1A-ETH-3 -vlan 3 -pkey default FabMan@gateway_name->
FabMan@gateway_name->sethostvniclimit connector -host hostname -port port -limit number -vlanlist vlan_ID1 ... vlan_IDn
where:
connector is the name of the connector (0A-ETH-1 to 0A-ETH-4 and 1A-ETH-1 to 1A-ETH-4).
hostname is the host name of the management controller or system name recognized by the BridgeX manager.
port is the port of the host.
number is the maximum number of VNICs for the IOA.
vlan_ID is the VLAN identifier (NO or 2 to 4094).
Note - Do not use VLAN identifiers 0, 1, or 4095. According to the IEEE 802.1Q specification, VLAN ID 0 is used for priority tag, and VLAN ID 1 is usually reserved for a switch or bridge management VLAN.
For example, to limit the host cupcake to 4 VNICs:
FabMan@gateway_name->sethostvniclimit 0A-ETH-1 -host cupcake -port 1 -limit 4 -vlanlist 3 FabMan@gateway_name->
# dladm create-vnic -l IP_interface -m mac_address -v vlan_ID name
where:
IP_interface is the interface corresponding to the data link and VIOA.
mac_address is the MAC address to be assigned to the VIOA.
vlan_ID is the VLAN identifier (NO or 2 to 4094).
Note - Do not use VLAN identifiers 0, 1, or 4095. According to the IEEE 802.1Q specification, VLAN ID 0 is used for priority tag, and VLAN ID 1 is usually reserved for a switch or bridge management VLAN.
name is the name of the VNIC. For ease of identification, the VNIC name can be formatted as eX_vnicY, where:
X is the instance number of the Ethernet over InfiniBand IP interface.
Y is the instance of the VNIC, independent of the interface instance.
For example:
# dladm create-vnic -l net6 -m 2:8:20:7c:5d:d3 -v 3 e0_vnic0 #
# dladm show-vnic LINK OVER SPEED MACADDRESS MACADDRTYPE VID e0_vnic0 net6 10000 2:8:20:7c:5d:d3 random 3 #
# dladm show-link LINK CLASS MTU STATE OVER net6 phys 1500 up -- e0_vnic0 vnic 1500 up net6
See Configure IP Addresses on the Data Link (Oracle Solaris).
FabMan@gateway_name->showvnics ID STATE FLG IOA_GUID NODE IID MAC VLN PKEY GW --- ----- --- ----------------- ---------- ---- ----------------- --- ------ -------- 0 UP N 0021280001CF37AC solaris01 00c0 02:42:42:42:12:03 NO 0xffff 0A-ETH-1 1 UP H 0021280001CF37AC solaris01 80c1 02:08:20:7C:5D:D3 3 0xffff 0A-ETH-1 FabMan@gateway_name->