JavaScript is required to for searching.
Skip Navigation Links
Exit Print View
Sun Blade 6000 Virtualized Multi-Fabric 10GE M2 Network Express Module Documentation     Sun Blade 6000 Virtualized Multi-Fabric 10GbE M2 Network Express Module Documentation Library
search filter icon
search icon

Document Information

Using This Documentation

Related Books

About This Documentation (PDF and HTML)

We Welcome Your Comments

Change History

User's Guide

Overview of Sun Blade 6000 Virtualized Multi-Fabric 10GbE M2 NEM User's Guide

Features of the Sun Blade 6000 Virtualized Multi-Fabric 10GbE M2 NEM

Terminology

Features Overview

Components Overview

NEM Ports and LEDs

Performing Hot Plug Insertion and Removal

PCIe Hot Plug

PCIe Hot Plug Guidelines

Attention Button

Surprise Removal

Forcing NEM Graceful Removal

Configuring PCIe Device Hot Plug in Linux

How to Prepare the PCIe Interface for Hot Removal

SAS Interface Hot Plug

How to Prepare SAS Interfaces for Hot Plug Removal

Restoring SAS Configurations After NEM Installation

Saving the Zoning Configuration to a Backup File Using the CMM ILOM

How to Save the Zoning Configuration to a Backup File Using the CMM CLI

How to Save the Zoning Configuration to a Backup File Using the CMM Web Interface

Recovering Zoning Configurations

How to Recover Zoning Configurations Using the Web Interface

How to Recover Zoning Configurations Using the CLI

Installing or Replacing the Virtualized M2 NEM

Installing a NEM

Verifying NEM Installation

Removing a NEM

Replacing a NEM

Installing and Removing SFP+ Optical Transceiver Modules

Cabling the SPF+ Connectors

Booting Over the Virtualized M2 NEM 10-Gigabit Ethernet Port

Booting over the Network With an x86 Blade Server

Booting over the Network With a SPARC Blade Server

Installing and Configuring the hxge Driver on a Solaris SPARC or x86 Platform

How to Configure the Network Host Files

Configuring the hxge Device Driver Parameters

Configuring the Jumbo Frames Feature

Installing and Configuring the hxge Driver on a Linux Platform

Installing and Removing the Driver on a Linux Platform

Configuring the Network Interface

Checking and Testing the hxge Device

Changing the hxge Driver Configuration

Troubleshooting the Driver

Configuring Jumbo Frames

Installing and Configuring Drivers on a Windows Platform

Installing Drivers on a Windows Platform

Enabling Jumbo Frames

Installing and Configuring Drivers on a VMware ESX Server Platform

Installing the ESX Server Drivers on an Existing ESX Server

Installing the ESX Server Drivers With a New ESX Installation

Configuring the Virtual NEM M2 Network Adapters

Configuring Jumbo Frames

ILOM Supplement

Accessing ILOM Documentation and Updates

Connecting to ILOM

Updating the NEM Firmware

Sun Blade Zone Manager

NEM Sensors

Enabling Private and Failover Mode

Using Hot Plug Commands

Fixing Problems with Oracle ILOM Using the Preboot Menu

Product Notes

Overview of the Sun Blade 6000 Virtualized Multi-Fabric 10GbE M2 NEM Product Notes

Product Information

Supported Software and Firmware

Supported Hardware

Hardware and Networking Issues

Packet Drop at 1Gb with 100m Cable (6879222)

Special Instructions for Network PXE Booting for the Sun Blade X3-2B Server (7183913)

ILOM Issues

ILOM Failover and Private Mode Cannot Be Enabled Simultaneously (6911661)

Cannot Set NEM SP IP Address When NEM Is Powered Off (6938660)

ipmitool Command Fails (6940791)

FMA Not Supported (6938667)

Prepare-to-Remove and Return-to-Service Does Not Work on NEM ILOM (6948103)

Green Rear SAS Link LEDs All Turn On When Setting Prepare-to-Remove (6950981)

NEM SAS Firmware Updates Must be Performed from the CMM and Not the NEM SP (7020854)

Operating System Issues

Oracle Linux: Server Module Might Hang When NEM Replaced Repeatedly (6935520)

Oracle Solaris: Hotplugd(1M) Daemon Must Be Started Before Initiating Hot Plug Actions In Oracle Solaris 10 OS 09/10 (7005233)

Oracle Solaris: Virtualized M2 NEM hxge 10 GbE Driver Can Hang Under High Stress (6932684)

Linux: Configuring PCIe Hot Plug in Linux (7075694)

Windows: Incorrect Driver Version Displayed When Driver File Properties is Viewed (7069358)

Index

Restoring SAS Configurations After NEM Installation

After installing a NEM using hot-plug, you might need to perform some additional tasks to restore the chassis SAS configurations.

In the following table, find the Action that corresponds with your hot plug scenario and follow the User Intervention instructions.

Action
Outcome
User Intervention
Insert a second Virtualized M2 NEM into an empty chassis slot.
The NEM is automatically registered with the CMM. The second NEM will obtain zoning configurations from the first NEM. Any future saved configurations remain unchanged if the NEM is removed and reinserted the same slot. The external port configuration is not copied over from the existing NEM to the new NEM, but the NEM external SAS ports are not currently supported.
  • None. When using a SAS-2 REM configured for RAID, dual path support to storage will automatically be enabled.
  • When using a SAS-2 REM not configured for RAID, dual path support might need to be configured at the OS level. Check your OS documentation for information on enabling SAS multipath support.

Remove and insert the same Virtualized M2 NEM into the same chassis slot.
Since the NEM is already registered with the CMM, the NEM zoning configurations will remain unchanged.
The host REM might identify the storage module virtual drives as a foreign configuration (MegaRAID), or inactive (Fusion-MPT IR). A foreign or inactive configuration can be recovered using the REM management software. For MegaRAID, use the import feature described in the LSI MegaRAID SAS Software User's Guide. For Fusion-MPT IR, use the activate feature described in the LSI SAS2 Integrated RAID User's Guide.
Remove and insert a Virtualized M2 NEM into a different slot in the same chassis..
Upon insertion into the chassis, the SAS zoning configurations on the NEM expanders are deleted.

The NEM is automatically registered with the CMM. Any future saved configurations remain unchanged if the SAS-2 NEM is removed and reinserted in the same slot.

  • Restore zoning configurations from a backup of CMM configurations. See Recovering Zoning Configurations

    —Or—

  • Use the CMM zoning utility to re-assign storage module resources to SAS-2 server blades.

Replace a failed Virtualized M2 NEM.
  • If there are two Virtualized M2 NEMs, upon insertion in the chassis, the replacement NEM is automatically registered with the CMM. The replacement NEM obtains configurations from the first NEM, except for external port configurations. Any future saved configurations remain unchanged if the NEM is removed and inserted in the same slot.
  • If there was only one Virtualized M2 NEM, upon insertion into the chassis, the SAS zoning configurations of the replacement NEM expanders are deleted. The NEM is automatically registered with the CMM. Any future saved configurations remain unchanged if the NEM is removed and inserted into the same slot.

  • If there were two Virtualized M2 NEM, no further action is needed..
  • If there was only one Virtualized M2 NEM, restore zoning configurations from a backup of CMM configurations. See Recovering Zoning Configurations

    —Or—

  • If there was only one Virtualized M2 NEM use the CMM zoning utility to re-assign storage module resources to SAS-2 server blades.

  • If there was only one Virtualized M2 NEM, the host REM might identify the storage module virtual drives as a foreign configuration (MegaRAID), or inactive (Fusion-MPT IR). A foreign or inactive configuration can be recovered using the REM management software. For MegaRAID, use the import feature described in the LSI MegaRAID SAS Software User's Guide. For Fusion-MPT IR, use the activate feature described in the LSI SAS2 Integrated RAID User's Guide.

Connect a SAS-2 JBOD to the SAS-NEM external SAS ports.
Not currently supported.
Do not connect external SAS storage to the NEM external SAS ports.