If a Network Express Module (NEM) fails or if you choose to change the I/O configuration, you will need to replace a NEM. You can remove and replace a NEM from a powered-on system using a hot-plug operation, as well as from a powered-off system. When you remove a NEM, you must replace the module within two minutes to prevent adjacent modules from overheating. If you are removing but not replacing the NEM, you also must install a NEM filler panel to meet FCC limits for electromagnetic interference (EMI) and to ensure proper airflow and cooling. If you encounter a problem with the NEM replacement, see NEM Hot-Remove Operation Fails.
The NEMs are customer-replaceable units (CRUs).
Some operating systems, and some PCIe ExpressModules (EMs) and Network Express Modules (NEMs) do not support a hot-plug operation. Check your operating system documentation, the I/O documentation, and the Sun Blade 8000 Series Product Notes to verify the hot-plug support.
Identify which NEM to replace.
If the amber Service Action Required LED is lit, this indicates a problem with the NEM. Otherwise, if you want to change the I/O configuration, you can choose any NEM to replace.
Prepare the NEM for a hot-plug procedure. Use either of these methods:
Press the Attention button on the NEM to initiate the hot-plug removal.
Use the ILOM web interface or the command-line interface (CLI) to initiate the hot-plug removal. See Prepare Components for Hot-Remove Operation.
If the NEM fails the hot-plug preparation and its Ready-to-Remove indicator does not light, see NEM Hot-Remove Operation Fails .
When the blue Ready-to-Remove LED is lit on the NEM, physically remove the NEM.
Remove all cables from the NEM.
Press the latch on both ejector levers inward at the same time.
Swing out the ejector levers to their fully open position.
Slide the NEM out of its slot.
Support the weight of the NEM with one hand at the bottom of the NEM.
Before you install a new GbE NEM, locate its MAC address that is printed on the rear of the NEM board.
Record the MAC address and the number of the slot into which you are about to install the NEM. Keep the data for future reference.
Align the NEM with the vacant NEM slot.
Ensure that the NEM's RJ-45 port connectors are facing toward you and that the NEM ejector levers are fully open.
Align the NEM with the chassis guidance system and slide the NEM into its slot.
Ensure that the NEM engages with the chassis guidance system. Failure to align the NEM correctly can result in damage to the NEM's internal connections to the chassis midplane.
Push the ejector levers toward each other and close the levers to secure the NEM in its slot.
After you physically install the NEM in its slot, the CMM will automatically detect the presence of the NEM. Press the Attention button to notify the blades (host operating systems) of the presence of the NEM.
Verify that the NEM is working properly.
Because the NEMs are shared resources, all Server Modules (blades) must respond favorably to the PCI hot-remove request. A blade may not relinquish the link to a NEM if, for instance, there are busy NFS mounted volumes, file transfers, and so forth. In addition, if the blade is in a "transition" state, for example, at the system halted prompt or in the BIOS menu, the blade will always remain connected to the NEM when a hot-remove operation is attempted. You must either power off the blade or boot the blade into the OS for the hot-remove operation to succeed.
To determine the state of the NEM-to-blade connections, you can use the ILOM web interface or the command-line interface. There are three states that show the connection status of the NEM to the blade:
Connected – Indicates that the NEM is connected to the blade.
Attention_on – Indicates that there is a problem training the PCIe link between the blade and the NEM. This state could indicate a fault with either the NEM or the blade.
Not_connected – Indicates that the blade is not connected to the NEM.
Any blade reporting a Not_connected status needs intervention from the host operating system on that blade. This intervention from the host OS depends entirely on the OS that is active on the blade. Each supported OS has a different method for managing attached devices.
To verify the NEM-to-blade connections using the ILOM web interface:
Log in to the ILOM web interface.
In the left navigation pane, select Chassis Monitoring Module.
The ILOM Version Information page appears.
Select the System Information tab, and then the Components tab.
The Component Management page appears.
Click on the NEM component name.
A dialog appears that contains "bladeX_link_status" entries for each blade (where X is the blade module number).
If the NEM link status is Connected, perform the appropriate host OS procedure for releasing the NEM from the blade.
Re-execute the steps in Prepare Components for Hot-Remove Operation.
To verify NEM-to-blade connections using the ILOM CLI:
Log in to the ILOM CLI.
Type the following command, where X is the number of the NEM in question:
show /CH/NEMx
The system responds with a "bladeX_link_status" entries for each blade (where X is the blade module number).
Perform the appropriate host OS procedure for releasing the NEM from the blade.
Re-execute the steps in Prepare Components for Hot-Remove Operation.