Sun Blade 6000 Virtualized Multi-Fabric 10GbE Network Express Module User’s Guide

Sun Blade 6000 Virtualized Multi-Fabric 10GbE Network Express Module User’s Guide

820-6561-13

Contents

Preface

Features of the Virtualized Multi-Fabric 10GbE NEM

Terminology

Features Overview

Overview of the Virtualized Multi-Fabric 10GbE NEM Components

SAS Connections

Ethernet Connections

10 GbE NIC Virtualization

Virtualized NEM ASIC

Enabling or Disabling the IAL

Fabric Express Modules

Service Processor

Physical Appearance of the Virtualized Multi-Fabric 10GbE NEM

External Virtualized NEM Ports

External SAS x4 Ports

Gigabit Ethernet Ports

SFP+ Ports

NEM Front Panel and LEDs

RJ45 Ethernet Connector Port LEDs

Installing or Replacing the Sun Blade 6000 Virtualized Multi-Fabric 10GbE Network Express Module

Installing a NEM

To Install a NEM

Verifying NEM Installation

To Verify Installation With the CMM ILOM Web Interface

To Verify Installation With the CMM ILOM CLI

Removing a NEM

To Remove a NEM

Replacing a NEM

To Replace a NEM

Installing SFP+ Optical Transceiver Modules

To Install an SFP+ Optical Transceiver Module

To Remove an Optical Transceiver SFP+ Module

Cabling the SPF+ Connectors

Installing and Configuring the Virtualized Multi-Fabric 10GbE NEM Drivers

Booting Over the NEM 10-Gigabit Ethernet Port

Booting over the Network With an x86 Blade Server

Important Considerations for Booting Over the Network With an x86 Blade Server Over the Virtualized NEM

To Set Up the BIOS for Booting From the Virtualized NEM

To Use the F12 Key to Initiate the Network Boot

To Use the F8 Key to Boot Off the PXE Server

Booting over the Network With a SPARC Blade Server

To Boot Over the Network Using the OpenBoot on a SPARC System

Installing and Configuring the hxge Driver on a Solaris SPARC or x86 Platform

Installing and Removing the Driver on a Solaris Platform

To Download and Install the Driver on a Solaris Platform

To Remove the Driver From a Solaris Platform

Configuring the Network Host Files

To Configure the Network Host Files

Configuring the hxge Device Driver Parameters

To Set Parameters Using the hxge.conf File

To Specify Parameter Values Using the ndd Utility

Configuring the Jumbo Frames Feature

Jumbo Frames Overview

Checking Jumbo Frames Configurations

Enabling Jumbo Frames in a Solaris Environment

Installing and Configuring the hxge Driver on a Linux Platform

Installing and Removing the Driver on a Linux Platform

To Download and Install the Driver on a Linux Platform

To Remove the Driver From a Linux Platform

Configuring the Network Interface

Temporary hxge Network Interface Configuration

Permanent hxge Network Interface Configuration

Checking and Testing the hxge Device

Changing the hxge Driver Configuration

Troubleshooting the Driver

Debug Messaging Parameter Overview

Setting the Debug Messaging Parameter

Configuring Jumbo Frames

To Temporarily Configure Jumbo Frames Support

To Permanently Enable Jumbo Frame Support

Installing and Configuring Drivers on a Windows Platform

Installing Drivers on a Windows Platform

Installing and Uninstalling the Sun Blade 6000 10GbE Network Controller

Installing and Uninstalling the Sun Blade 6000 10GbE VLAN Driver (Optional)

Adding and Removing VLANs

Installing the Virtualized Multi-Fabric 10GbE NEM Enclosure Device

Enabling Jumbo Frames

To Enable Jumbo Frames

Installing and Configuring Drivers on a VMware ESX Server Platform

Installing the ESX Server Drivers on an Existing ESX Server

To Install a Virtualized NEM Driver on an Existing ESX 3.5 Server

To Install a Virtualized NEM Driver on an Existing ESX/ESXi 4.0 Server Using vihostupdate

To Install a Virtualized NEM Driver on an Existing ESX 4.0 Server Using esxupdate

Installing the ESX Server Drivers on With a New ESX Installation

To Install a Virtualized NEM Driver With a New ESX3.5 Installation

To Install a Virtualized NEM Driver With a New ESX4.0 Installation

Configuring the Virtual NEM Network Adapters

To Configure the Virtual NEM Network Adapters

Configuring Jumbo Frames

Jumbo Frames Guidelines

To Create a Jumbo Frames-enabled vSwitch

To Create a Jumbo Frames-enabled VMkernel Interface

The Common Array Manager

About Enclosure Management

CAM

CAM Agent

Problem Resolution

Obtaining CAM Software

Using CAM With Disk Blades and Virtualized Multi-Fabric 10GbE NEM

Monitoring Component Health

Upgrading Expander Firmware

To Upgrade Expander Firmware

Using the lsiutil Utility to Save and Restore HBA Persistence Mappings

Where to Obtain the lsiutil Software

Installing lsiutil

Using the Interactive lsiutil Menus to Clear Your LSI Host Bus Adapter Non-Present Persistence Mapping

To Clear Your Non-Present Persistence Mappings

Saving a Snapshot of Your Host Bus Adapter Persistence Mappings

To Save a Snapshot of Your Host Bus Adapter Persistence Mappings

ILOM Supplement

Documentation and Updates

Product Updates

Connecting to ILOM

Option 1 - Ethernet

To Find the ILOM’s IP Address

To Connect to the CLI

To Connect to the WebGUI

Option 2 - Chassis Serial Connector

To Connect to ILOM Through the Chassis Serial Connector

Option 3 - NEM Serial Connector

To Connect to the ILOM Using the NEM Serial Connector

Temperature, Voltage, and Fan Sensors

Board Sensor List

Sensor Details

slotid

nem/cmm/prsnt

nem/ok

nem/ok2rm

nem/service

nem/locate

Mainboard Temperature Sensors

mb.t_amb[0..2]

NEM Voltage Sensors

mb.v_+12v

mb.v_+5v

mb.v_+3v3

mb.v_+1v2

ILOM Proxy

Starting the ILOM Proxy CLI Program

To Start the ILOM Proxy CLI Program

Enable or Disable IAL Dynamic Mode

To Enable or Disable IAL Dynamic Mode Using the Web Interface

To Enable or Disable Dynamic Mode Using the CLI

Sun Blade 6000 Virtualized Multi-Fabric 10GbE Network Express Module User’s Guide

820-6561-13

Copyright © 2009, Sun Microsystems, Inc. All rights reserved.