JavaScript is required to for searching.
Skip Navigation Links
Exit Print View
Sun Blade 6000 Virtualized 40 GbE Network Express Module

User's Guide

search filter icon
search icon

Document Information

Using This Documentation

Related Documentation

Feedback

Support and Accessibility

Understanding the NEM

Task Overview

Product Features

Understanding the Components

SAS Connections

Ethernet Connections

10GbE NIC Virtualization

Fabric Express Modules

Processor

Identifying Ports and LEDs

Connector Locations

External NEM Ports

RJ-45 Ethernet Connector Port LEDs

NEM Front Panel and LEDs

Performing Hot-plug Insertion and Removal

Performing PCIe Hot-plug

Understanding PCIe Hot-plug

Prepare the PCIe Interface for Hot-plug Removal

Performing SAS Interface Hot-plug

Prepare SAS Interfaces for Hot-plug Removal

Restoring SAS Configurations After NEM Installation

Saving the Zoning Configuration to a Backup File

Recovering Zoning Configurations

Installing or Replacing a NEM

Before Installing a NEM

Determine the CMM Part Number Using ILOM 3.0x Web Interface

Determine the CMM Part Number Using ILOM 3.1x Web Interface

Determine the CMM Part Number Using ipmitool

Find the CMM Part Number on the CMM Label

Install a NEM

Verifying NEM Installation

Verify Installation (CMM ILOM Web)

Verify Installation (CMM ILOM CLI)

Remove a NEM

Replace a NEM

Installing and Removing SFP+ Optical Transceiver Modules

Install an SFP+ Optical Transceiver Module

Remove an Optical Transceiver SFP+ Module

SFP+ Connector Cabling Options

Enabling Jumbo Frames

Configuring Jumbo Frames (Solaris)

Jumbo Frames Overview

Jumbo Frames Configurations and Driver Statistics

Enable Jumbo Frames (Solaris)

Check Layer 2 Configuration

Check Layer 3 Configuration

Configuring Jumbo Frames (Linux)

Temporarily Configure Jumbo Frames (Linux)

Permanently Enable Jumbo Frames (Linux)

Enable Jumbo Frames (Windows)

Configuring Jumbo Frames (VMware ESX)

Create a Jumbo Frames-Enabled vSwitch (VMWare)

Create a Jumbo Frames-Enabled VMkernel Interface (VMWare

Configuring Static Link Aggregation

Example (Oracle Solaris 11 OS)

Example (Oracle Solaris 10 OS)

Example (Linux OS)

Booting an x86 Server Over the Network

Booting the NEM on an x86 Blade Server Over the Network

Set Up the BIOS for Booting From the NEM

Use the F12 Key to Initiate the Network Boot

Use the F8 Key to Boot Off the PXE Server

Boot a SPARC Blade Over the Network

Installing Drivers on Oracle Solaris OS SPARC or x86 Platform

Download the sxge Driver

Configure the Network Host Files

Configure the sxge Device Driver Parameters

Installing Drivers on a Linux Platform

Downloading, Installing, and Removing Drivers

Download and Install the Drivers

Remove the Drivers

Configuring the Network Interface

Temporary Network Interface Configuration

Permanent Network Interface Configuration

Bring the Interface Online Manually

Configure the Network Interface File Automatically for Red Hat Linux

Configure the Network Interface Automatically for SUSE Linux

Device Checking and Testing

Configure the Syslog Parameter

Installing Drivers on a Windows Platform

Installing Drivers on a Windows Platform

Installing and Uninstalling the Network Controller

Installing and Uninstalling the Sun Blade 6000 40 GbE VLAN Driver (Optional)

Adding and Removing VLANs

Install the Enclosure Device on a Windows Server 2008 System

Dynamic and NIC Teaming

Installing Drivers on a VMware ESX Server Platform

Installing ESX Server Drivers

Install a NEM Driver for a New ESX4.0 Installation

Install a NEM Driver on an Existing ESX 4.0 Server

Install a NEM Driver on an ESX/ESXi Server

Configure the NEM Network Adapters

Uninstalling the Drivers

Configuring Blade and Port Parameters and Managing the NEM

Configuring and Viewing Parameters

Defaults and Options

Setting Blade Parameters

Setting Port Parameters

Saving User Configurations or Resetting to Defaults

Viewing Parameter Settings, Firmware Versions, and Configuration File

Configuring NEM for Oracle VM Para-Virtualization

Configure Para-Virtualization Without Live Migration

Configure Para-Virtualization With Live Migration

Managing the NEM Using CMM ILOM

ILOM Documentation and Updates

Start NEM CLI from CMM ILOM CLI

Updating the NEM Firmware

Configuring Hot Plug Service

Verify and Enable Hot Plug (Oracle Solaris OS)

Verify and Enable Hot Plug (Linux OS)

Disabling Interfaces

Updating Firmware (Web)

Obtain and Apply the Newest Firmware

Reset the NEM (Web)

Updating the Firmware (CLI)

Update NEM ILOM Firmware (CLI)

Reset the NEM (CLI)

Glossary

Index

Replace a NEM

The server modules must be informed if you are replacing a non-redundant NEM.


Caution

Caution - If the chassis is powered on and you are not replacing the NEM within 60 seconds, install an NEM filler panel to ensure proper system operation.



Caution

Caution - If you are replacing a functional SAS2 NEM (for example replacing a NEM with a NEM) and another SAS2 NEM is installed in the chassis, make sure that multipathing at the OS level is enabled on all active server blades in the chassis before you remove the existing NEM. This ensures that the primary path to disks is not lost, which can cause an OS panic. For servers running Windows 2003, which does not support multipathing, shut down I/O to all disks on the disk module that is not in hardware RAID volumes.


If you are removing a NEM from a powered on chassis, read the hot-plug guidelines Performing Hot-plug Insertion and Removal and follow the instructions in Prepare the PCIe Interface for Hot-plug Removal.


Caution

Caution - Before replacing a NEM, make sure that you have backed up the SAS assignment configuration, as described in Saving the Zoning Configuration to a Backup File.


  1. In the rear of the chassis, locate the NEM that you want to remove.
  2. Do one of the following:
    • If you are replacing a NEM in a powered-off chassis, go to Step 6.
    • If you are replacing a NEM in a powered-on chassis, continue with Step 3.

    Note - Hot-plug service has to be enabled on all blades in the chassis for a hot-plug removal to properly initiate. If the Ready-to-Remove LED does not light, check the configuration of the blades, or power off all of them.


  3. Push the ATTN button once.

    Note - Pushing the ATTN button twice within five seconds will cause the Power/OK LED to return to solid green. This action will cancel the request for a NEM removal.


  4. View the behavior of the Power/OK LED and Ready-to-Remove LED or the ILOM interface to determine if the Ready-to-Remove action is successful.

    If the action is successful:

    • The NEM green Power/OK begins to slowly blink.

    • The OK- to-Remove blue LED illuminates and the Power LED turns off.

    • In the ILOM System Information —> Components screen: The Return-to-Service option is available in the Actions drop-down list for the NEM and the Ready-to-Remove status column for the NEM is Ready.

    • In the ILOM CLI show /CH/NEMx command output, the following status is listed in the Properties section: prepare_to_remove_status = Ready

    • /CH/NEMx/OK reads Off in either the ILOM web interface or CLI.

    If the action is unsuccessful:

    • The NEM green Power/OK LED begins to slowly blink, then returns to solid green, and the Ready-to-Remove LED does not go on.

    • In the ILOM System Information —> Components screen, the Return-to-Service option does not become available in the Actions drop-down list and the Ready-to-Remove status column for the NEM still reads Not Ready.

    • In the ILOM CLI show /CH/NEMx command output, the following status is listed in the Properties section: prepare_to_remove_status = NotReady

    • /CH/NEMx/OK reads On in either the ILOM web interface or CLI.

  5. Do one of the following:
    • If the Ready-to-Remove action is successful, proceed with Step 6.
    • If the Ready-to-Remove action is not successful, do not remove the NEM. Follow the instructions in Forcing NEM Graceful Removal to remove the NEM.
  6. Label the cables so that you can install them in the same location, then remove all cables from the NEM.
  7. Press together and hold the buttons on both the right and left ejector levers.
  8. To unlatch the NEM from the chassis, open the ejector levers by extending them outward.
  9. Holding the open ejector levers, pull the NEM toward you until you can pull the rest of the module out by hand.

    Support the weight of the NEM, with one hand at the bottom of the NEM.


    image:Figure showing NEM removal

    Note - Wait at least 10 seconds before installing the new NEM.


  10. Insert the new NEM into the chassis.
  11. Do one of the following:
    • If you have replaced a NEM in a powered-off chassis, go to Step 16.
    • If you have replaced a NEM in a powered-on chassis, continue with Step 12.
  12. After the NEM has been inserted into a chassis slot, wait until the Power/OK LED goes to standby blink.

    Standby blink indicates that the NEM is in standby mode.

  13. Press the ATTN button once.

    It can take up to three minutes for the NEM to come online.


    Note - If you push the ATTN button twice within five seconds, the green Power/OK LED remains in standby blinking mode, and the request for bringing the NEM online is cancelled.


  14. View the behavior of the Power/OK LED or the ILOM interface.

    The NEM is online and the PCIe interfaces are available to the blades when the following occurs:

    • The NEM green Power/OK LED illuminates solid.

    • In the ILOM web interface System Information —> Components screen, the Prepare-to-Remove option is available in the Actions drop-down list for the NEM.

    • In the ILOM CLI show /CH/NEMx output, the following status shows in the Properties section: prepare_to_remove_status = NotReady.

  15. See Restoring SAS Configurations After NEM Installation to see if any additional actions need to be taken for the SAS interfaces.
  16. Reconnect all the cables in their original locations.
Related Information