4.9 Servicing FB-DIMMs

This section describes how to diagnose and replace faulty FB-DIMMs. If you are upgrading the system with additional FB-DIMMs, see Install Additional FB-DIMMs. For FB-DIMM configuration guidelines, see 4.7 FB-DIMM Configuration Reference.

Caution - This procedure requires that you handle components that are sensitive to static discharge. This sensitivity can cause the component to fail. To avoid this problem, ensure that you follow antistatic practices as described in Perform Antistatic Measures.

Caution - Ensure that all power is removed from the server before removing or installing FB-DIMMs. You must disconnect the power cables before performing this procedure.

Caution - DIMM filler cards are required in all empty slots in the memory mezzanine tray. DIMM filler cards are not required on the motherboard.

Locating a Faulty FB-DIMM

The system Service Required LED lights if the system detects a FB-DIMM fault.

Use the showfaults command to identify faulty FB-DIMMs. See Detecting Faults.

Use the FB-DIMM fault locator button on the motherboard to identify faulty FB‐DIMMs.

Prepare the server for FB-DIMM removal. See:
- Power Off the Server
- Disconnect Cables From the Server
- Remove the Server From the Rack
- Perform Antistatic Measures
- Remove the Top Cover
- Remove the Memory Air Duct
Disconnect all power cables from the server (Identifying an FB-DIMM).
Press the Fault Locator button on the motherboard to activate the FB-DIMM status LEDs (Identifying an FB-DIMM).
Any faulty FB-DIMMs will be indicated with a corresponding amber fault LED on the motherboard.

Figure 4-20 Identifying an FB-DIMM

Tip - Make a note of the faulty FB-DIMM location so that you can install the replacement FB-DIMM in the same location.

Note - For memory configuration information see 4.7 FB-DIMM Configuration Reference.
Document the location of faulty FB-DIMMs.
Faulty FB-DIMMs are identified with a corresponding amber LED on the motherboard.

Note - The FB-DIMM fault LEDs remain lit only for a few minutes.
Ensure that all FB-DIMMs are seated correctly in their slots.

Remove FB-DIMMs

Prepare the server for FB-DIMM removal. See:
- Power Off the Server
- Disconnect Cables From the Server
- Remove the Server From the Rack
- Perform Antistatic Measures
- Remove the Top Cover
- Remove the Memory Air Duct
If you are replacing a faulty FB-DIMM, locate the FB-DIMMs that you want to replace. See Locating a Faulty FB-DIMM .
If you are removing a FB-DIMM on the motherboard, you must first remove the memory mezzanine, see Remove the Memory Mezzanine Assembly.
Push down on the ejector tabs on each side of the FB-DIMM until the FB‐DIMM is released (Removing FB-DIMMs).

Caution - FB-DIMMs may be hot. Use caution when servicing FB-DIMMs.
Grasp the top corners of the faulty FB-DIMM and remove it from the server.
Figure 4-21 Removing FB-DIMMs
Place the FB-DIMM on an antistatic mat.
Repeat Step 4 through Step 6 to remove any additional FB-DIMMs.
Install filler panels in the empty FB-DIMM slots, if you are not replacing the FB-DIMMs right away.

Install FB-DIMMs

Caution - Ensure that all power is removed from the server before removing or installing FB-DIMMs or damage to the FB-DIMMs might occur. You must disconnect the power cables from the system before performing this procedure.

Unpackage the replacement FB-DIMMs and place them on an antistatic mat.
Tip - See 4.7 FB-DIMM Configuration Reference for information about configuring the FB-DIMMs.
Ensure that the ejector tabs are in the open position.
Line up the replacement FB-DIMM with the connector (Inserting the FB-DIMM Into the Slot).
Align the FB-DIMM notch with the key in the connector. This ensures that the FB-DIMM is oriented correctly.
Push the FB-DIMM into the connector until the ejector tabs lock the FB-DIMM in place.
If the FB-DIMM does not easily seat into the connector, verify that the orientation of the FB-DIMM is as shown in Inserting the FB-DIMM Into the Slot. If the orientation is reversed, damage to the FB-DIMM might occur.

Figure 4-22 Inserting the FB-DIMM Into the Slot
Repeat Step 2 through Step 4 until all replacement FB-DIMMs are installed.
Consider your next step:
- If you installed FB-DIMMs as part of another procedure, return to that procedure.
- If you are to only install FB-DIMMs go to Step 7.
  
  Note - If you removed the memory mezzanine, you must reinstall it. See ***
See Chapter 6, Returning the Server to Operation to bring the server back online.

Verifying Successful Replacement of a Faulty FB‐DIMM

Access the ILOM -> prompt.
Refer to the Integrated Lights Out Manager 2.0 (ILOM 2.0) Supplement for the Sun Netra T5440 Server for instructions.

Run the show faulty command to determine how to clear the fault.

The method you use to clear a fault depends on how the fault is identified by the showfaults command.

Examples:

If the fault is a host-detected fault (displays a UUID), continue to Step 3. For example:

-> show faulty
Target              | Property               | Value
--------------------+------------------------+--------------------------------
/SP/faultmgmt/0     | fru                    | /SYS/MB/CMP0/BR0/CH1/D0
/SP/faultmgmt/0     | timestamp              | Dec 14 22:43:59
/SP/faultmgmt/0/    | sunw-msg-id            | SUN4V-8000-DX
faults/0            |                        |
/SP/faultmgmt/0/    | uuid                   | 3aa7c854-9667-e176-efe5-e487e520
faults/0            |                        | 7a8a
/SP/faultmgmt/0/    | timestamp              | Dec 14 22:43:59
faults/0            |                        |

If the fault was detected by POST and resulted in the FB-DIMM being disabled, such as the following,

-> show faulty
Target              | Property               | Value
--------------------+------------------------+--------------------------------
/SP/faultmgmt/0     | fru                    | /SYS/MB/CMP0/BR1/CH0/D0
/SP/faultmgmt/0     | timestamp              | Dec 21 16:40:56
/SP/faultmgmt/0/    | timestamp              | Dec 21 16:40:56 faults/0
/SP/faultmgmt/0/    | sp_detected_fault      | /SYS/MB/CMP0/BR1/CH0/D0
faults/0            |                        | Forced fail(POST)

In most cases, the replacement of the faulty FB-DIMM(s) is detected when the service processor is power cycled. In this case, the fault is automatically cleared from the system. If the fauilt is still displayed by the show faulty command, then run the set command to enable the FB-DIMM and clear the fault. For example:
```
-> set /SYS/MB/CMP0/BR0/CH0/D0 component_state=Enabled
```

Perform the following steps to verify the repair:
1. Set the virtual keyswitch to diag so that POST will run in Service mode.
```
-> set /SYS/keyswitch_state=Diag
Set ‘keyswitch_state’ to ‘Diag’
```
2. Powercycle the system.
```
-> stop /SYS
Are you sure you want to stop /SYS (y/n)? y
Stopping /SYS
-> start /SYS
Are you sure you want to start /SYS (y/n)? y
Starting /SYS 
```
  Note - The server takes about one minute to power off. Use the show /HOST command to determine when the host has been powered off. The console will display status=Powered Off.
3. Switch to the system console to view POST output.
```
-> start /SYS/console
```
  Watch the POST output for possible fault messages. The following output is a sign that POST did not detect any faults:
```
.
.
.
0:0:0>INFO:
0:0:0>    POST Passed all devices.
0:0:0>POST:    Return to VBSC.
0:0:0>Master set ACK for vbsc runpost command and spin...
```
  Note - Depending on the configuration of ILOM POST variables and whether POST detected faults or not, the system might boot, or the system might remain at the ok prompt. If the system is at the ok prompt, type boot.
4. Return the virtual keyswitch to normal mode.
```
-> set /SYS keyswitch_state=Normal
Set ‘ketswitch_state’ to ‘Normal’
```
5. Switch to the system console and issue the Solaris OS fmadm faulty command.
```
# fmadm faulty
```
  No memory faults should be displayed.
  If faults are reported, refer to the diagnostics flowchart in Diagnostic Flowchart for an approach to diagnose the fault.
Switch to the ILOM -> command shell.

Run the show faulty command.

If the fault was detected by the host and the fault information persists, the output will be similar to the following example:

-> show faulty
Target              | Property               | Value 
--------------------+------------------------+-------------------------------
/SP/faultmgmt/0     | fru                    | /SYS/MB/CMP0/BR0/CH1/D0
/SP/faultmgmt/0     | timestamp              | Dec 14 22:43:59
/SP/faultmgmt/0/    | sunw-msg-id            | SUN4V-8000-DX
faults/0            |                        |
/SP/faultmgmt/0/    | uuid                   | 3aa7c854-9667-e176-efe5-e487e520
faults/0            |                        | 7a8a
/SP/faultmgmt/0/    | timestamp              | Dec 14 22:43:59 
faults/0            |                        |

If the showfaults command does not report a fault with a UUID, then you do not need to proceed with the following steps because the fault is cleared.

Run the set command.

-> set /SYS/MB/CMP0/BR0/CH1/D0 clear_fault_action=True
Are you sure you want to clear /SYS/MB/CMP0/BR0/CH1/D0 (y/n)? y
Set ’clear_fault_action’ to ’true

Switch to the system console and issue the fmadm repair command with the UUID.
Use the same UUID that was displayed from the output of the ILOM show faulty command.
```
# fmadm repair 3aa7c854-9667-e176-efe5-e487e520
```

Install Additional FB-DIMMs

Before You Begin

Before you begin, see 4.7 FB-DIMM Configuration Reference to familiarize yourself with FB-DIMM configuration guidelines.

Caution - Ensure that all power is removed from the server before installing FB‐DIMMs or damage to the FB-DIMMs might occur.

Caution - You must disconnect the power cables from the system before performing this procedure.

Prepare the server for installing FB-DIMMs. See:
- Power Off the Server
- Disconnect Cables From the Server
- Remove the Server From the Rack
- Perform Antistatic Measures
- Remove the Top Cover
Unpackage the replacement FB-DIMMs and place them on an antistatic mat.
Remove any filler panels from the FB-DIMM slots, if necessary.
Place the ejector tabs are in the open position.
Line up the FB-DIMM with the connector (Removing FB-DIMMs).
Align the FB-DIMM notch with the key in the connector. This alignment ensures that the FB-DIMM is oriented correctly.
Push the FB-DIMM into the connector until the ejector tabs lock the FB-DIMM in place.
If the FB-DIMM does not easily seat into the connector, verify that the orientation of the FB-DIMM is as shown in Removing FB-DIMMs. If the orientation is reversed, damage to the FB-DIMM might occur.
Repeat Step 4 through Step 6 until all FB-DIMMs are installed.
See Chapter 6, Returning the Server to Operation to bring the server back online:
Perform the following steps to verify that there are no faults:
1. Set the virtual keyswitch to diag so that POST will run in Service mode.
```
-> set /SYS/keyswitch_state=Diag
Set ‘keyswitch_state’ to ‘Diag’
```
2. Power cycle the system.
```
-> stop /SYS
Are you sure you want to stop /SYS (y/n)? y
Stopping /SYS
-> start /SYS
Are you sure you want to start /SYS (y/n)? y
Starting /SYS 
```
  Note - The server takes about one minute to power off. The ILOM console does not indicate when the system is actually powered off.
3. Switch to the system console to view POST output.
```
-> start /SYS/console
```
  Watch the POST output for possible fault messages. The following output is a sign that POST did not detect any faults:
```
.
.
.
0:0:0>INFO:
0:0:0>    POST Passed all devices.
0:0:0>POST:    Return to VBSC.
0:0:0>Master set ACK for vbsc runpost command and spin...
```
  Note - Depending on the configuration of ILOM POST variables and whether POST detected faults or not, the system might boot, or the system might remain at the ok prompt. If the system is at the ok prompt, type boot.
4. Return the virtual keyswitch to Normal mode.
```
-> set /SYS keyswitch_state=Normal
Set ‘ketswitch_state’ to ‘Normal’
```

Skip Navigation Links
Exit Print View
	Sun Netra T5440 Server Service Manual

Service Manual