This chapter describes how to replace a Sun Blade 6000 Virtualized Multi-Fabric 10GbE Network Express Module (Virtualized NEM) in a powered-on Sun Blade 6000 Series Chassis. This chapter also includes instructions to verify that the replacement Virtualized NEM has been installed correctly.

This chapter contains the following sections:

Installing a NEM
Verifying NEM Installation
Removing a NEM
Replacing a NEM
Installing SFP+ Optical Transceiver Modules

Caution - Damage to the NEM can occur as the result of careless handling or electrostatic discharge (ESD). Always handle the NEM with care to avoid damage to electrostatic-sensitive components. To minimize the possibility of ESD-related damage, Sun strongly recommends using both a workstation antistatic mat and an ESD wrist strap. You can get an ESD wrist strap from any reputable electronics store or from Sun as part number 250-1007.

Installing a NEM

You can insert either one or two Virtualized Multi-Fabric 10GbE NEMs in the Sun Blade 6000 chassis. If you insert only one, it should go in the lower slot (NEM 0).

Before installing your NEM, remove the NEM filler panel in the slot you plan to use.

Note - The Virtualized NEM can be paired with a pass-through Gigabit Ethernet NEM or another Virtualized NEM only. Mixing of Multi-Fabric NEM types is not supported.

To Install a NEM

This procedure is for installing a NEM into an empty slot. If you are replacing a NEM, see Replacing a NEM.

Power off the chassis.

Refer to the chassis documentation for information.

Align the NEM with the vacant NEM slot.

Ensure that:
- The RJ-45 port connectors of the NEM are facing you.
- The NEM ejector levers are fully opened.
- The NEM ejector levers are on the top of the module.

Slide the NEM into the vacant NEM chassis slot until you feel it stop.

Support the weight of the NEM with one hand at the bottom of the NEM.

Complete the installation by closing the ejector levers to secure the NEM in the chassis.

FIGURE 2-1 shows how to install the NEM.

FIGURE 2-1 Installing a Virtualized Multi-Fabric 10GbE NEM

Power on the chassis.

Refer to the chassis documentation for information on powering on the chassis.

Execute the procedure Saving a Snapshot of Your Host Bus Adapter Persistence Mappings on all server blades in the chassis that meet all three of these requirements:
- The server blade is running CAM or a CAM agent.
- The server blade uses an LSI host bus adapter.
- The server blade is running the Solaris OS.

Connect cables, as needed. See Cabling the SPF+ Connectors.

Verifying NEM Installation

The following topics are covered in this section:

To Verify Installation With the CMM ILOM Web Interface

From the CMM ILOM left navigation bar, select CMM.

In a web browser, type the IP address of the CMM in the location bar.

Select Components from the second row of tabs (FIGURE 2-2).

Select /CH/NEM0 (FIGURE 2-3).

If the NEM does not appear in ILOM, verify that the NEM is properly seated in the chassis.

FIGURE 2-2 CMM ILOM Screen for Viewing NEM Information

FIGURE 2-3 FRU Information for NEM0 in the Web Browser

To Verify Installation With the CMM ILOM CLI

The NEM is automatically detected when the chassis is powered on.

You can connect to the ILOM CLI by either of two methods:

Connect a terminal or PC running a terminal emulator directly to the CMM serial port on your chassis.

or
Connect to the chassis Ethernet network management port using a secure shell (SSH).

Instructions for setting up and using ILOM are documented in Appendix B.

Note - The examples in this section refer to NEM0. If you are installing NEM1, replace the “0” in these examples with “1”.

Access the CMM ILOM.

The NEM and the NEM Field Replaceable Unit (FRU) information appears in the CLI.

-> show /CH/NEM0
 Targets:
SEEPROM
SP
 
Properties:
type = Network Express Module
fru_name = SUN BLADE 6000 10GBE Hydra NEM
fru_part_number = 501-7935-02
fru_serial_number = 0000000-7001C003K
 
Commands:
cd
show

If the NEM does not appear in ILOM, verify that the NEM is properly seated in the chassis and verify that you have installed the latest CMM ILOM firmware.

For more information about using CMM ILOM, see the your ILOM documentation, at: (http://docs.sun.com/app/docs/prod/blade.6000mod#hic)

Removing a NEM

This procedure is for removing a NEM if you do not plan to replace it. If you plan to replace a NEM, see Replacing a NEM.

To Remove a NEM

Power off the chassis.

Refer to the chassis documentation for information.

In the rear of the chassis, locate the NEM that you want to remove.

Remove all cables from the NEM.

Press together and hold the buttons on both the right and left ejector levers.

To unlatch the NEM from the chassis, open the ejector levers by extending them outward.

Holding the open ejector levers, pull the NEM toward you until you can pull the rest of the module out by hand.

Support the weight of the NEM with one hand at the bottom of the NEM.

FIGURE 2-4 shows how to remove a NEM.

FIGURE 2-4 Removing a NEM

Power on the chassis.

Refer to the chassis documentation for information.

Replacing a NEM

If a NEM fails, you need to replace it. You must power off the chassis before you remove the NEM. The server modules must be informed if you are replacing a non-redundant NEM.

Caution - If the chassis is powered on and you are not replacing the NEM within 60 seconds, install an NEM filler panel to ensure proper system operation.

Caution - If you are replacing a functional SAS-NEM (for example replacing a Multi-Fabric NEM with a 10GbE Virtualized Multi-Fabric NEM), make sure that multipathing at the OS level is enabled on all active server blades in the chassis before you remove the existing NEM. This ensures that the primary path to disks is not lost, which can cause an OS panic. For servers running Windows 2003, which does not support multipathing, shut down IO to all disks on the disk module that are not in hardware RAID volumes.

To Replace a NEM

Power off the chassis.

Refer to the chassis documentation for information.

In the rear of the chassis, locate the NEM that you want to remove.

Label the cables so that you can install them in the same location, then remove all cables from the NEM.

Press together and hold the buttons on both the right and left ejector levers.

To unlatch the NEM from the chassis, open the ejector levers by extending them outward.

Holding the open ejector levers, pull the NEM toward you until you can pull the rest of the module out by hand.

Support the weight of the NEM with one hand at the bottom of the NEM.

FIGURE 2-4 shows how to remove a NEM.

Determine if the following are present in the chassis:
- A server blade that is running CAM or a CAM agent.
- A server blade that uses an LSI host bus adapter.
If both of the above conditions are true, continue with Step 10. If either one of the above conditions is not true, continue to Step 13.

Power on the chassis.

Refer to the chassis documentation for information.

Follow the procedure Using the Interactive lsiutil Menus to Clear Your LSI Host Bus Adapter Non-Present Persistence Mapping on all server blades in the chassis that meet both of these requirements listed in Step 7.

Power off the chassis.

Insert the new NEM into the chassis.

Reconnect all the cables in their original locations.

Power on the chassis.

Execute the procedure Saving a Snapshot of Your Host Bus Adapter Persistence Mappings on all server blades in the chassis that meet all three of these requirements:
- The server blade is running CAM or a CAM agent.
- The server blade uses an LSI host bus adapter.
- The server blade is running the Solaris OS.

Installing SFP+ Optical Transceiver Modules

The NEM requires an SFP+ transceiver in at least one port to create a 10GbE connection. Before installing or removing an SFP+ module, refer to Connectivity Mode.

To Install an SFP+ Optical Transceiver Module

Pull the locking handle into the full horizontal position until you feel the handle click into position.

Holding the optical transceiver (SFP+ module) by the edges, align the SFP+ module with the slot in the NEM and slide it into the opening.

Applying even pressure at both corners of the SFP+ module, push the module until it is firmly seated in the slot.

Push the handle closed to lock the SFP+ module in place.

Note - If you pull the locking handle down when the SFP+ module is installed, you should remove the SFP+ module entirely and reinstall it. The handle operates an internal lock. Pulling the handle down can disconnect the SFP+ module, even though it might appear to be connected.

FIGURE 2-5 Installing an Optical Transceiver SFP+ Module

Graphic showing SFP+ module installation.

To Remove an Optical Transceiver SFP+ Module

Press the optical cable connector latch down and gently pull out the optical cable (FIGURE 2-6).

Pull down the SFP+ module latch into the open position.

Slide out the SFP+ module.

Replace the protective end caps if you plan to store the module.

FIGURE 2-6 Removing an Optical Module from the NEM

Cabling the SPF+ Connectors

The following table shows the optical module (OM) multimode fiber (MMF) and single-mode fiber (SMF) cabling options available for the Virtualized Multi-Fabric 10GbE NEM SPF+ connectors.

**TABLE 2-1 Cabling Guidelines for SPF+ Connectors**
SPF+ Connector Type	Cable type	Reach
Short range (SR)	OM 1 MMF	33 meters
	OM 2 MMF	50 meters
	OM 3 MMF	300 meters

Note - The optical transceiver for the Virtualized Multi-Fabric 10GbE NEM uses a long connector (LC). The connection on the other side of the cable might use a different connector type.

Caution - Avoid putting unnecessary stress on the connection. Do not bend or twist the cable near the connectors, and avoid sharp cable bends of more than 90 degrees.