JavaScript is required to for searching.
Skip Navigation Links
Exit Print View
Sun Netra T5440 Server

Service Manual

search filter icon
search icon

Document Information

Using This Documentation

1.  Server Diagnostics

1.1 Fault on Initial Power Up

1.2 Server Diagnostics Overview

1.2.1 Memory Configuration and Fault Handling

1.3 Using LEDs to Identify the State of Devices

1.3.1 Front and Rear Panel LEDs

1.3.2 Hard Drive LEDs

1.3.3 Power Supply LEDs

1.3.4 Ethernet Port LEDs

1.4 Using the Service Processor Firmware for Diagnosis and Repair Verification

1.4.1 Interacting With the Service Processor

1.4.2 Running Service-Related Commands

1.4.3 Clearing Faults

Displaying FRU Information

1.5 Running POST

1.5.1 Controlling How POST Runs

Changing POST Parameters

1.5.2 Reasons to Run POST

1.6 Using the Solaris Predictive Self-Healing Feature

1.6.1 Identifying PSH Detected Faults

1.7 Collecting Information From Solaris OS Files and Commands

Checking the Message Buffer

Viewing System Message Log Files

1.8 Managing Components With Automatic System Recovery Commands

Displaying System Components

Disabling Components

Enabling Disabled Components

1.9 Exercising the System With SunVTS Software

Checking Whether SunVTS Software Is Installed

1.9.1 Exercising the System Using SunVTS Software

1.10 Obtaining the Chassis Serial Number

1.11 Additional Service Related Information

2.  Preparing for Service

2.1 Safety Information

2.1.1 Safety Symbols

2.1.2 Electrostatic Discharge Safety

2.2 Required Tools

2.3 Prerequisite Tasks for Component Replacement

Power Off the Server

Disconnect Cables From the Server

Remove the Server From the Rack

Perform Antistatic Measures

Remove the Top Cover

3.  Replacing Storage Components

3.1 Replacing a Hard Drive

Remove a Hard Drive

Install a Hard Drive

3.2 Replacing the Optical Media Drive

Remove the Optical Media Drive

Install the Optical Media Drive

4.  Replacing Motherboard Assembly Components

4.1 PCIe, PCI-X, and XAUI Card Configuration Reference

4.1.1 PCI Cards on the PCI Auxilliary Board

4.1.2 PCI Cards on the PCI Mezzanine Assembly

4.1.3 High Bandwidth PCIe Card Installation

4.2 Replacing PCI-X 0-1 and PCIe 2-3 Cards

Remove PCI-X 0-1 and PCIe 2-3 Cards

Install PCI-X 0-1 and PCIe 2-3 Cards

4.3 Replacing PCIe/XAUI Cards 4-6 and PCIe Cards 7-9

Remove PCIe/XAUI Cards 4-6 and PCIe Cards 7-9

Install PCIe/XAUI Cards 4-6 and PCIe Cards 7-9

4.4 Cabling the Sun Storage 6 Gb SAS PCIe RAID HBA, Internal

Cable the Sun Storage 6 Gb SAS PCIe RAID HBA, Internal

4.5 Replacing Memory Air Duct

Remove the Memory Air Duct

Install the Memory Air Duct

4.6 Replacing the PCI Mezzanine Assembly

Remove the PCI Mezzanine Assembly

Install the PCI Mezzanine Assembly

4.7 FB-DIMM Configuration Reference

4.8 Replacing the Memory Mezzanine Assembly

Remove the Memory Mezzanine Filler Tray

Install the Memory Mezzanine Assembly

Remove the Memory Mezzanine Assembly

4.9 Servicing FB-DIMMs

Locating a Faulty FB-DIMM

Remove FB-DIMMs

Install FB-DIMMs

Verifying Successful Replacement of a Faulty FB‐DIMM

Install Additional FB-DIMMs

4.10 Replacing the Battery

Remove the Battery

Install the Battery

4.11 Replacing the SCC Module

Remove the SCC Module

Install the SCC Module

4.12 Replacing the Motherboard Assembly

Remove the Motherboard Assembly

Install the Motherboard Assembly

4.13 Replacing the Disk Backplane Assembly

Remove the Disk Backplane Assembly

Install the Disk Backplane Assembly

4.14 Replacing the SAS Expander Assembly

Remove the SAS Expander Assembly

Install the SAS Expander Assembly

4.15 Replacing the Auxillary Board Assembly

Remove the Auxillary Board Assembly

Install the Auxillary Board Assembly

5.  Replacing Chassis Components

5.1 Replacing the Air Filter

Remove the Air Filter

Install the Air Filter

5.2 Replacing a Power Supply

Remove a Power Supply

Install a Power Supply

5.3 Replacing the System Fan Assembly (Fan Tray 0)

Remove the System Fan Assembly (Fan Tray 0)

Install the System Fan Assembly (Fan Tray 0)

5.4 Replacing the Hard Drive Fan Assembly (Fan Tray 1)

Remove the Hard Drive Fan Assembly (Fan Tray 1)

Install the Hard Drive Fan Assembly (Fan Tray 1)

5.5 Replacing the FB-DIMM Fan Assembly (Fan Tray 2)

Remove the FB-DIMM Fan Assembly (Fan Tray 2)

Install the FB-DIMM Fan Assembly (Fan Tray 2)

5.6 Replacing the Power Board

Remove the Power Board

Install the Power Board

6.  Returning the Server to Operation

6.1 Tasks for Finishing Up

Return the Server to Operation

A.  Signal Pinouts

A.1 Gigabit Ethernet Ports

A.2 Network Management Port

A.3 Serial Ports

A.3.1 Serial Management Port

A.3.2 Serial Port TTYA

A.4 Alarm Port

A.5 USB Ports

Index

4.9 Servicing FB-DIMMs

This section describes how to diagnose and replace faulty FB-DIMMs. If you are upgrading the system with additional FB-DIMMs, see Install Additional FB-DIMMs. For FB-DIMM configuration guidelines, see 4.7 FB-DIMM Configuration Reference.


Electrical

Caution - This procedure requires that you handle components that are sensitive to static discharge. This sensitivity can cause the component to fail. To avoid this problem, ensure that you follow antistatic practices as described in Perform Antistatic Measures.



Electrical

Caution - Ensure that all power is removed from the server before removing or installing FB-DIMMs. You must disconnect the power cables before performing this procedure.



Hot

Caution - DIMM filler cards are required in all empty slots in the memory mezzanine tray. DIMM filler cards are not required on the motherboard.


Locating a Faulty FB-DIMM

The system Service Required LED lights if the system detects a FB-DIMM fault.

Use the showfaults command to identify faulty FB-DIMMs. See Detecting Faults.

Use the FB-DIMM fault locator button on the motherboard to identify faulty FB‐DIMMs.

  1. Prepare the server for FB-DIMM removal. See:
  2. Disconnect all power cables from the server (Identifying an FB-DIMM).
  3. Press the Fault Locator button on the motherboard to activate the FB-DIMM status LEDs (Identifying an FB-DIMM).

    Any faulty FB-DIMMs will be indicated with a corresponding amber fault LED on the motherboard.


    Figure 4-20 Identifying an FB-DIMM

    image:Figure showing disconnecting power cables and pressing the fault locator button on motherboard.

    Tip - Make a note of the faulty FB-DIMM location so that you can install the replacement FB-DIMM in the same location.



    Note - For memory configuration information see 4.7 FB-DIMM Configuration Reference.


  4. Document the location of faulty FB-DIMMs.

    Faulty FB-DIMMs are identified with a corresponding amber LED on the motherboard.


    Note - The FB-DIMM fault LEDs remain lit only for a few minutes.


  5. Ensure that all FB-DIMMs are seated correctly in their slots.

Remove FB-DIMMs

  1. Prepare the server for FB-DIMM removal. See:
  2. If you are replacing a faulty FB-DIMM, locate the FB-DIMMs that you want to replace. See Locating a Faulty FB-DIMM .
  3. If you are removing a FB-DIMM on the motherboard, you must first remove the memory mezzanine, see Remove the Memory Mezzanine Assembly.
  4. Push down on the ejector tabs on each side of the FB-DIMM until the FB‐DIMM is released (Removing FB-DIMMs).

    Hot

    Caution - FB-DIMMs may be hot. Use caution when servicing FB-DIMMs.


  5. Grasp the top corners of the faulty FB-DIMM and remove it from the server.

    Figure 4-21 Removing FB-DIMMs

    image:Figure showing how to remove a FB-DIMM
  6. Place the FB-DIMM on an antistatic mat.
  7. Repeat Step 4 through Step 6 to remove any additional FB-DIMMs.
  8. Install filler panels in the empty FB-DIMM slots, if you are not replacing the FB-DIMMs right away.

Install FB-DIMMs


Electrical

Caution - Ensure that all power is removed from the server before removing or installing FB-DIMMs or damage to the FB-DIMMs might occur. You must disconnect the power cables from the system before performing this procedure.


  1. Unpackage the replacement FB-DIMMs and place them on an antistatic mat.

    Tip - See 4.7 FB-DIMM Configuration Reference for information about configuring the FB-DIMMs.


  2. Ensure that the ejector tabs are in the open position.
  3. Line up the replacement FB-DIMM with the connector (Inserting the FB-DIMM Into the Slot).

    Align the FB-DIMM notch with the key in the connector. This ensures that the FB-DIMM is oriented correctly.

  4. Push the FB-DIMM into the connector until the ejector tabs lock the FB-DIMM in place.

    If the FB-DIMM does not easily seat into the connector, verify that the orientation of the FB-DIMM is as shown in Inserting the FB-DIMM Into the Slot. If the orientation is reversed, damage to the FB-DIMM might occur.


    Figure 4-22 Inserting the FB-DIMM Into the Slot

    image:Figure showing how to insert the FB-DIMM into the slot on the motherboard assembly
  5. Repeat Step 2 through Step 4 until all replacement FB-DIMMs are installed.
  6. Consider your next step:
    • If you installed FB-DIMMs as part of another procedure, return to that procedure.

    • If you are to only install FB-DIMMs go to Step 7.


      Note - If you removed the memory mezzanine, you must reinstall it. See ***


  7. See Chapter 6, Returning the Server to Operation to bring the server back online.

Verifying Successful Replacement of a Faulty FB‐DIMM

  1. Access the ILOM -> prompt.

    Refer to the Integrated Lights Out Manager 2.0 (ILOM 2.0) Supplement for the Sun Netra T5440 Server for instructions.

  2. Run the show faulty command to determine how to clear the fault.

    The method you use to clear a fault depends on how the fault is identified by the showfaults command.

    Examples:

    • If the fault is a host-detected fault (displays a UUID), continue to Step 3. For example:
      -> show faulty
      Target              | Property               | Value
      --------------------+------------------------+--------------------------------
      /SP/faultmgmt/0     | fru                    | /SYS/MB/CMP0/BR0/CH1/D0
      /SP/faultmgmt/0     | timestamp              | Dec 14 22:43:59
      /SP/faultmgmt/0/    | sunw-msg-id            | SUN4V-8000-DX
      faults/0            |                        |
      /SP/faultmgmt/0/    | uuid                   | 3aa7c854-9667-e176-efe5-e487e520
      faults/0            |                        | 7a8a
      /SP/faultmgmt/0/    | timestamp              | Dec 14 22:43:59
      faults/0            |                        | 
    • If the fault was detected by POST and resulted in the FB-DIMM being disabled, such as the following,
      -> show faulty
      Target              | Property               | Value
      --------------------+------------------------+--------------------------------
      /SP/faultmgmt/0     | fru                    | /SYS/MB/CMP0/BR1/CH0/D0
      /SP/faultmgmt/0     | timestamp              | Dec 21 16:40:56
      /SP/faultmgmt/0/    | timestamp              | Dec 21 16:40:56 faults/0
      /SP/faultmgmt/0/    | sp_detected_fault      | /SYS/MB/CMP0/BR1/CH0/D0
      faults/0            |                        | Forced fail(POST)
    • In most cases, the replacement of the faulty FB-DIMM(s) is detected when the service processor is power cycled. In this case, the fault is automatically cleared from the system. If the fauilt is still displayed by the show faulty command, then run the set command to enable the FB-DIMM and clear the fault. For example:
      -> set /SYS/MB/CMP0/BR0/CH0/D0 component_state=Enabled
  3. Perform the following steps to verify the repair:
    1. Set the virtual keyswitch to diag so that POST will run in Service mode.
      -> set /SYS/keyswitch_state=Diag
      Set ‘keyswitch_state’ to ‘Diag’
    2. Powercycle the system.
      -> stop /SYS
      Are you sure you want to stop /SYS (y/n)? y
      Stopping /SYS
      -> start /SYS
      Are you sure you want to start /SYS (y/n)? y
      Starting /SYS 

      Note - The server takes about one minute to power off. Use the show /HOST command to determine when the host has been powered off. The console will display status=Powered Off.


    3. Switch to the system console to view POST output.
      -> start /SYS/console

      Watch the POST output for possible fault messages. The following output is a sign that POST did not detect any faults:

      .
      .
      .
      0:0:0>INFO:
      0:0:0>    POST Passed all devices.
      0:0:0>POST:    Return to VBSC.
      0:0:0>Master set ACK for vbsc runpost command and spin...

      Note - Depending on the configuration of ILOM POST variables and whether POST detected faults or not, the system might boot, or the system might remain at the ok prompt. If the system is at the ok prompt, type boot.


    4. Return the virtual keyswitch to normal mode.
      -> set /SYS keyswitch_state=Normal
      Set ‘ketswitch_state’ to ‘Normal’
    5. Switch to the system console and issue the Solaris OS fmadm faulty command.
      # fmadm faulty

      No memory faults should be displayed.

      If faults are reported, refer to the diagnostics flowchart in Diagnostic Flowchart for an approach to diagnose the fault.

  4. Switch to the ILOM -> command shell.
  5. Run the show faulty command.
    • If the fault was detected by the host and the fault information persists, the output will be similar to the following example:
      -> show faulty
      Target              | Property               | Value 
      --------------------+------------------------+-------------------------------
      /SP/faultmgmt/0     | fru                    | /SYS/MB/CMP0/BR0/CH1/D0
      /SP/faultmgmt/0     | timestamp              | Dec 14 22:43:59
      /SP/faultmgmt/0/    | sunw-msg-id            | SUN4V-8000-DX
      faults/0            |                        |
      /SP/faultmgmt/0/    | uuid                   | 3aa7c854-9667-e176-efe5-e487e520
      faults/0            |                        | 7a8a
      /SP/faultmgmt/0/    | timestamp              | Dec 14 22:43:59 
      faults/0            |                        |
    • If the showfaults command does not report a fault with a UUID, then you do not need to proceed with the following steps because the fault is cleared.
  6. Run the set command.
    -> set /SYS/MB/CMP0/BR0/CH1/D0 clear_fault_action=True
    Are you sure you want to clear /SYS/MB/CMP0/BR0/CH1/D0 (y/n)? y
    Set ’clear_fault_action’ to ’true
  7. Switch to the system console and issue the fmadm repair command with the UUID.

    Use the same UUID that was displayed from the output of the ILOM show faulty command.

    # fmadm repair 3aa7c854-9667-e176-efe5-e487e520

Install Additional FB-DIMMs

Before You Begin

Before you begin, see 4.7 FB-DIMM Configuration Reference to familiarize yourself with FB-DIMM configuration guidelines.


Electrical

Caution - Ensure that all power is removed from the server before installing FB‐DIMMs or damage to the FB-DIMMs might occur.



Electrical

Caution - You must disconnect the power cables from the system before performing this procedure.


  1. Prepare the server for installing FB-DIMMs. See:
  2. Unpackage the replacement FB-DIMMs and place them on an antistatic mat.
  3. Remove any filler panels from the FB-DIMM slots, if necessary.
  4. Place the ejector tabs are in the open position.
  5. Line up the FB-DIMM with the connector (Removing FB-DIMMs).

    Align the FB-DIMM notch with the key in the connector. This alignment ensures that the FB-DIMM is oriented correctly.

  6. Push the FB-DIMM into the connector until the ejector tabs lock the FB-DIMM in place.

    If the FB-DIMM does not easily seat into the connector, verify that the orientation of the FB-DIMM is as shown in Removing FB-DIMMs. If the orientation is reversed, damage to the FB-DIMM might occur.

  7. Repeat Step 4 through Step 6 until all FB-DIMMs are installed.
  8. See Chapter 6, Returning the Server to Operation to bring the server back online:
  9. Perform the following steps to verify that there are no faults:
    1. Set the virtual keyswitch to diag so that POST will run in Service mode.
      -> set /SYS/keyswitch_state=Diag
      Set ‘keyswitch_state’ to ‘Diag’
    2. Power cycle the system.
      -> stop /SYS
      Are you sure you want to stop /SYS (y/n)? y
      Stopping /SYS
      -> start /SYS
      Are you sure you want to start /SYS (y/n)? y
      Starting /SYS 

      Note - The server takes about one minute to power off. The ILOM console does not indicate when the system is actually powered off.


    3. Switch to the system console to view POST output.
      -> start /SYS/console

      Watch the POST output for possible fault messages. The following output is a sign that POST did not detect any faults:

      .
      .
      .
      0:0:0>INFO:
      0:0:0>    POST Passed all devices.
      0:0:0>POST:    Return to VBSC.
      0:0:0>Master set ACK for vbsc runpost command and spin...

      Note - Depending on the configuration of ILOM POST variables and whether POST detected faults or not, the system might boot, or the system might remain at the ok prompt. If the system is at the ok prompt, type boot.


    4. Return the virtual keyswitch to Normal mode.
      -> set /SYS keyswitch_state=Normal
      Set ‘ketswitch_state’ to ‘Normal’