Skip Navigation Links | |
Exit Print View | |
Sun Blade 6000 Virtualized 40 GbE Network Express Module User's Guide |
RJ-45 Ethernet Connector Port LEDs
Performing Hot-plug Insertion and Removal
Prepare the PCIe Interface for Hot-plug Removal
Performing SAS Interface Hot-plug
Prepare SAS Interfaces for Hot-plug Removal
Restoring SAS Configurations After NEM Installation
Saving the Zoning Configuration to a Backup File
Recovering Zoning Configurations
Determine the CMM Part Number Using ILOM 3.0x Web Interface
Determine the CMM Part Number Using ILOM 3.1x Web Interface
Determine the CMM Part Number Using ipmitool
Find the CMM Part Number on the CMM Label
Verify Installation (CMM ILOM Web)
Verify Installation (CMM ILOM CLI)
Installing and Removing SFP+ Optical Transceiver Modules
Install an SFP+ Optical Transceiver Module
Remove an Optical Transceiver SFP+ Module
SFP+ Connector Cabling Options
Configuring Jumbo Frames (Solaris)
Jumbo Frames Configurations and Driver Statistics
Configuring Jumbo Frames (Linux)
Temporarily Configure Jumbo Frames (Linux)
Permanently Enable Jumbo Frames (Linux)
Configuring Jumbo Frames (VMware ESX)
Create a Jumbo Frames-Enabled vSwitch (VMWare)
Create a Jumbo Frames-Enabled VMkernel Interface (VMWare
Configuring Static Link Aggregation
Example (Oracle Solaris 11 OS)
Example (Oracle Solaris 10 OS)
Booting an x86 Server Over the Network
Booting the NEM on an x86 Blade Server Over the Network
Set Up the BIOS for Booting From the NEM
Use the F12 Key to Initiate the Network Boot
Use the F8 Key to Boot Off the PXE Server
Boot a SPARC Blade Over the Network
Installing Drivers on Oracle Solaris OS SPARC or x86 Platform
Configure the Network Host Files
Configure the sxge Device Driver Parameters
Installing Drivers on a Linux Platform
Downloading, Installing, and Removing Drivers
Configuring the Network Interface
Temporary Network Interface Configuration
Permanent Network Interface Configuration
Bring the Interface Online Manually
Configure the Network Interface File Automatically for Red Hat Linux
Configure the Network Interface Automatically for SUSE Linux
Configure the Syslog Parameter
Installing Drivers on a Windows Platform
Installing Drivers on a Windows Platform
Installing and Uninstalling the Network Controller
Installing and Uninstalling the Sun Blade 6000 40 GbE VLAN Driver (Optional)
Install the Enclosure Device on a Windows Server 2008 System
Installing Drivers on a VMware ESX Server Platform
Install a NEM Driver for a New ESX4.0 Installation
Install a NEM Driver on an Existing ESX 4.0 Server
Install a NEM Driver on an ESX/ESXi Server
Configure the NEM Network Adapters
Configuring Blade and Port Parameters and Managing the NEM
Configuring and Viewing Parameters
Saving User Configurations or Resetting to Defaults
Viewing Parameter Settings, Firmware Versions, and Configuration File
Configuring NEM for Oracle VM Para-Virtualization
Configure Para-Virtualization Without Live Migration
Configure Para-Virtualization With Live Migration
Managing the NEM Using CMM ILOM
ILOM Documentation and Updates
Start NEM CLI from CMM ILOM CLI
Verify and Enable Hot Plug (Oracle Solaris OS)
Verify and Enable Hot Plug (Linux OS)
Obtain and Apply the Newest Firmware
The following instructions apply to both drivers, sxge and sxgevf. When downloading and installing, specify which driver you want.
To use the sxgevf driver, you need to have the sxge driver already installed.
host #> ifconfig -a | grep eth eth0 Link encap:Ethernet HWaddr 00:14:4F:CA:15:68 eth1 Link encap:Ethernet HWaddr 00:14:4F:CA:15:69
After you have installed the NEM and installed and loaded a driver, a new eth device is displayed. This is the eth device for the NEM.
For Oracle Enterprise Linux, use the corresponding Red Hat Enterprise Linux driver.
The drivers are located in the following directories:
/linux/drivers/rhel5.4
/linux/drivers/sles10sp3
/linux/drivers/sles11
Note - Linux source files are available at /linux/drivers/src.
An account is required to download software. You must register if you do not have an account.
In the following example, the download directory is tge10:
host #>mkdir tge10 host #>cp xxx/p12918641_100_Generic.zip host #>cd tge10 host #>unzip p12918641_100_Generic.zip host #>ls readme.html Sun_Blade_6000_Virtualized_40GbE_NEM_1_0_4.xml Sun_Blade_6000_Virtualized_40GbE_NEM_1_0_4.zip host #>unzip Sun_Blade_6000_Virtualized_40GbE_NEM_1_0_4.zip host #>ls host #>firmware fpga license linux solaris windows release_note
In the following example, RHEL6.0 Linux driver is selected for REHL version 6.0.
host #> cd linux/RHL6.0 host #>ls kmod-sxge-1.0-0.x86_64.rpm sxge-debuginfo-1.0-0.x86_64.rpm kmod-sxgevf-1.0-0.x86_64.rpm sxgevf-debuginfo-1.0-0.x86_64.rpm
In the following example, the file kmod-sxgevf-1.0-0.x86_64.rpm is the package that will be installed.
If you are not sure which release your system is running, use the lsb_release command to show information about your host's operating system.
host #> lsb_release -a LSB Version: core-4.0-intel64:core-4.0-noarch:graphics-4.0-intel64:graphics- 4.0-noarch:printing-4.0-intel64:printing-4.0-noarch Distributor ID: RedHatEnterpriseServer Description: Red Hat Enterprise Linux Server release 6.0 (Santiago) Release: 6.0 Codename: Santiago host #> rpm -q kmod-sxgevf-1.0-0.x86_64 package kmod-sxgevf-1.0-0.x86_64 is not installed
Note - If the driver is already installed, uninstall the driver to avoid complications. See Remove the Drivers for instructions. The update command (rpm -u) is not supported for updating the drivers.
host #> rpm -ivh --nodeps kmod-sxge-1.0-0.x86_64.rpm Preparing... ########################################### [100%] 1:kmod-sxge ########################################### [100%] post Install Done
host #> rpm -ivh --nodeps kmod-sxgevf-1.0-0.x86_64.rpm Preparing... ########################################### [100%] 1:kmod-sxgevf ######################################### [100%] post Install Done
Note - To load and use the sxgevf driver, you must have the sxge driver already installed.
The following command sample has been edited for brevity. Lines marked [....] denote output that has been removed.
host #> lspci [...] 13:00.0 PCI bridge: Oracle Corporation Unknown Device 2070 14:02.0 PCI bridge: Oracle Corporation Unknown Device 2070 14:03.0 PCI bridge: Oracle Corporation Unknown Device 2070 15:00.0 Ethernet controller: Sun Microsystems Computer Corp. Unknown device 207a (rev 01) 15:00.2 Ethernet controller: Sun Microsystems Computer Corp. Unknown device 207b (rev 01) 15:00.3 Ethernet controller: Sun Microsystems Computer Corp. Unknown device 207b (rev 01) 16:00.0 Ethernet controller: Sun Microsystems Computer Corp. Unknown device 207a (rev 01) 16:00.1 Ethernet controller: Sun Microsystems Compute Corp. Unknown device 207b (rev 01) 16:00.2 Ethernet controller: Sun Microsystems Computer Corp. Unknown device 207b (rev 01) 16:00.3 Ethernet controller: Sun Microsystems Computer Corp. Unknown device 207b (rev 01) [...]
host #> lspci [...] 19:00.0 PCI bridge: Sun Microsystems Computer Corp. Unknown device 2070 (rev 01) 1a:02.0 PCI bridge: Sun Microsystems Computer Corp. Unknown device 2070 (rev 01) 1a:03.0 PCI bridge: Sun Microsystems Computer Corp. Unknown device 2070 (rev 01) 1b:00.0 Ethernet controller: Sun Microsystems Computer Corp. Unknown device 2078 (rev 01) 1c:00.0 Ethernet controller: Sun Microsystems Computer Corp. Unknown device 2078 (rev 01) [...]
Device code 0x2078 is the NEM device when used as a regular PCI device.
Device code 0x207a is the PF (using sxge driver) NEM device when SR-IOV is enabled.
Device code 0x207b is the VF (using sxgevf driver) NEM device when SR-IOV is enabled.
Presence of this line indicates the NEM is visible and available to the system.
host #> modprobe sxge or sxgevf
host #> lsmod | grep sxge sxge 71304 0 host#> modinfo sxge filename: /lib/modules/2.6.18-238.el5/extra/sxge/sxge.ko version: 0.06032011 license: GPL description: SXGE ethernet driver author: srcversion: 73779771D7EA5154342838B alias: pci:v0000108Ed0000207Asv*sd*bc*sc*i* alias: pci:v0000108Ed00002078sv*sd*bc*sc*i* depends: vermagic: 2.6.18-238.el5 SMP mod_unload gcc-4.1 parm: debug:SXGE debug level (int) [etc.]
host #> lsmod | grep sxgevf sxge (or sxgevf) 71304 0 host#> modinfo sxgevf filename: /lib/modules/2.6.18-238.el5/extra/sxgevf/sxgevf.ko version: 0.06032011 license: GPL description: SXGEVF ethernet driver author: srcversion: 73779771D7EA5154342838B alias: pci:v0000108Ed0000207Asv*sd*bc*sc*i* alias: pci:v0000108Ed00002078sv*sd*bc*sc*i* depends: vermagic: 2.6.18-238.el5 SMP mod_unload gcc-4.1 parm: debug:SXGEVF debug level (int) [etc.]
host #> modprobe sxge or sxgevf FATAL: Module sxge not found. FATAL: Module sxgevf not found.
This output indicates that you probably installed the wrong driver version. Uninstall the driver, then install the correct package for your Linux release.
If you are running a custom or patched kernel, you might have to build a custom driver to match your custom kernel.
After the NEM has been correctly installed, and the driver has been successfully installed and loaded, the new NEM eth device will be visible.
host #> ifconfig -a | grep eth eth0 Link encap:Ethernet HWaddr 00:14:4F:CA:15:68 eth1 Link encap:Ethernet HWaddr 00:14:4F:CA:15:69 eth2 Link encap:Ethernet HWaddr 00:14:4F:29:00:1D
In this example, eth0 and eth1 were previously present. The eth2 device is for a new NEM. You can identify each eth device (NEM0 or NEM1) by matching the Ethernet MAC address with the one you recorded and saved when you physically installed the NEM into the chassis in Install a NEM.
host #> ethtool -i eth2 driver: sxge version: 0.06032011 firmware-version: bus-info: 0000:1b:00.0 driver: sxgevf version: 0.01202011 firmware-version: bus-info: 0000:1c:00.0
host #> ifconfig eth2 Link encap:Ethernet HWaddr FA:CE:00:00:FC:0F BROADCAST MULTICAST MTU:1500 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:0 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:0 (0.0 b) TX bytes:0 (0.0 b) Interrupt:194
The eth2 device is active and available to the system, but has yet to be configured (assigned an IP address). See Configuring the Network Interface for details on configuring the NEM for the Linux OS.
Refer to the Oracle VM Server for x86 XEN documentation.