C H A P T E R  2

Installing and Setting Up the nxge Driver

This chapter explains how to download and install the nxge driver. This chapter contains the following sections:


nxge Driver Overview

The nxge Gigabit Ethernet driver (nxge[7D]) is a multithreaded, loadable, clonable, GLD-based STREAMS driver. The nxge driver is managed by the dladm(1M) command-line utility, which allows VLANs to be defined on top of nxge instances and for nxge instances to be aggregated. See the dladm(1M) man page for more details on configuring the data-link interfaces and link aggregations.


nxge Driver for Solaris Platforms

If your system uses the Solaris 10 8/07 Operating System, the nxge device driver is bundled with the operating system. However, you must download and install patches for Sun Dual 10GbE Fabric Expansion Module support.

Required Patches

This section lists the latest required patches.



Note - Always check for the latest revision of the patch, -01, -02, and so on.




Patch ID Description
119255-53 Prerequisite patch for Kernel Patch 127128-11
126424-03 Prerequisite patch for Kernel Patch 127128-11
127756-01 Prerequisite patch for Kernel Patch 127128-11
127128-11 Kernel patch for Solaris 10 8/07 OS
138049-02 x86 hot swap support for the Sun Blade 6000 10GbE Multi-fabric Network Express Module


Downloading and Installing the Driver on a Linux Platform

procedure icon  To Download the Driver on a Linux Platform

  1. Log in to your system.

  2. Download the driver RPM for your operating system:

    https://cds.sun.com/is-bin/INTERSHOP.enfinity/WFS/CDS-CDS_SMI-Site/en_US/-/USD/ViewProductDetail-Start?ProductRef=Sunx8Exp-EAD-1.0-G-F@CDS-CDS_SMI

    For example, the file will look similar to the following:


    sun_10_Gigabit_Ethernet_driver_update_xx.zip
    

    After unzipping this file, go to the Linux directory.

  3. Discover the network interfaces before adding the package by using the ifconfig -a command:


    # ifconfig -a | grep eth
    eth0      Link encap:Ethernet  HWaddr 00:14:4F:20:F1:DC
    eth1      Link encap:Ethernet  HWaddr 00:14:4F:20:F1:DD
    eth2      Link encap:Ethernet  HWaddr 00:14:4F:20:F1:DE
    eth3      Link encap:Ethernet  HWaddr 00:14:4F:20:F1:DF
    

  4. Use the rpm tool to install the driver on SuSe and RedHat Linux.


    # rpm -ivh nxge-2.6.9-55.ELsmp-2.1-1.x86_64.rpm
    Preparing...                ###########################################
    [100%] 
     1:nxge-2.6.9-55.ELsmp    ###########################################
    [100%] 
    

  5. Ensure that the driver is loaded after the RPM installation, enter the following:


    # lsmod | grep nxge
    

  6. Verify the new network interface instances corresponding to the Sun Dual 10GbE Fabric Expansion Module:


    # ifconfig -a | grep eth
    eth0      Link encap:Ethernet  HWaddr 00:14:4F:20:F1:DC
    eth1      Link encap:Ethernet  HWaddr 00:14:4F:20:F1:DD
    eth2      Link encap:Ethernet  HWaddr 00:14:4F:20:F1:DE
    eth3      Link encap:Ethernet  HWaddr 00:14:4F:20:F1:DF
    eth4      Link encap:Ethernet  HWaddr 00:14:4F:6C:78:E8 
    eth5      Link encap:Ethernet  HWaddr 00:14:4F:6C:78:E9 
    

    The Sun Dual 10GbE Fabric Expansion Module instances, eth2 and eth3, appear in the third and fourth lines of the output.

  7. Use the ethtool command to check the parameter configurations that apply to the nxge driver:


    (For 10G)
    # ethtool -i eth2
    driver: nxge
    version: 2.1.1
    firmware-version: RFEM PXE1.49 FCode 3.16
    bus-info: 0000:0d:00.0
    

procedure icon  To Remove the Driver From a Linux Platform


Downloading and Installing the Windows OS Drivers

The Sun Dual 10GbE Fabric Expansion Module supports the Windows Server 2008 Enterprise Edition 32/64-bit miniport driver. For additional Windows driver release information, refer to the Sun Multithreaded 10GbE and QGC Networking Cards Specification for Windows xxx Drivers document.



Note - Installing the Windows OS driver changes the hot-swapping procedure for the Sun Blade 6000 10 GbE Multi-Fabric Network Expansion Module. See .



The Sun Dual 10GbE Fabric Expansion Module must be installed before you install the Windows Server 2008 Enterprise Edition miniport driver. Without the Sun Dual 10GbE Fabric Expansion Module installed, the Windows OS driver will not install correctly.

To download the Windows OS driver and documentation, go to: https://cds.sun.com/is-bin/INTERSHOP.enfinity/WFS/CDS-CDS_SMI-Site/en_US/-/USD/ViewProductDetail-Start?ProductRef=Sunx8Exp-EAD-1.0-G-F@CDS-CDS_SMI

The zip file looks similar to the following:


sun_10_Gigabit_Ethernet_driver_update_xx.zip

After unzipping this file, go to Windows directory, which contains the documents and driver:


Readme.txt                              User Manual.pdf
Release Notes.txt                       windows_2008_Releasepackage.zip
Sun MulitThreaded 10GbE and QGC Installer.msi



Note - Multiple VLANs are not currently supported with the Windows OS driver.



Hot-Swapping a Sun Blade 6000 10GbE Multi-Fabric NEM With Windows OS Driver Installed

This section explains how to remove an existing 10GbE Multi-Fabric NEM and install another in its place.



caution icon

Caution - Damage to the NEM can occur as the result of careless handling or electrostatic discharge (ESD). Always handle the NEM with care to avoid damage to ESD-sensitive components. To minimize the risk of electrostatic damage, Sun strongly recommends that you use both a workstation antistatic mat and an antistatic wrist strap.



Replacing a 10GbE Multi-Fabric NEM

If an Multi-Fabric NEM fails, you will need to replace it.



hot surface icon

Caution - The NEM should be replaced immediately after it fails.



The Multi-Fabric NEM is a Customer Replaceable Unit (CRU). You replace the entire module. There are no subcomponents that you can replace.

You can remove and replace a 10GbE Multi-Fabric NEM from a powered-on chassis using a hot-swap operation, as well as from a powered-off chassis.



hot surface icon

Caution - Before you remove the NEM from the chassis, you should pause or shut down any active I/O that passes through the NEM.





Note - The blue Ready to Remove LED on the NEM is not operational. To help identify a NEM that you plan to remove, you can illuminate the white Locate LED using the proxy CLI. For more information, refer to the Sun Blade 6000 10GbE Multi-Fabric Network Express Module User’s Guide.



procedure icon  To Replace a 10GbE Multi-Fabric NEM



hot surface icon

Caution - If you are replacing the NEM while power is applied to the chassis, be sure to have a NEM filler panel ready for use before you remove the NEM. The NEM slot must not be left uncovered for more than a minute while power is active in the chassis.



  1. Double-click the Safely Remove Hardware icon located at the bottom right of the GUI.

  2. Select the device Sun Muiltithreaded 10GbE & QGE Networking Cards #.

  3. Click STOP.

  4. Confirm it is the correct device click OK.

  5. When the GUI reports that it is safe to remove the hardware, click OK.

  6. Label all the cables so you can reconnect them in the same location.

  7. Disconnect all cables from the NEM.

  8. Press together and hold the ejector buttons on both the right and left ejector levers.

  9. Open the ejector levers by extending them outward until they stop.

  10. Hold the opened ejector levers and pull the NEM out.

  11. Insert the new Multi-Fabric NEM into the chassis.

  12. Reconnect all the cables in their original locations.