C H A P T E R  4

Feedback Replacing Motherboard Assembly Components

This chapter describes how to remove components from the motherboard assembly and how to remove the motherboard assembly itself. Topics include:


4.1 Powering Off and Powering On the Server

To prepare the server for servicing parts in this chapter, power off the server by performing the following procedures:

To bring the server back online, perform the following procedures:


4.2 Replacing PCI-X, PCIe/XAUI Cards

4.2.1 PCI Card Retainers

The PCI mezzanine secures the PCIe cards into place with green PCI card retainers and captive (nonremovable) screws. The following figure shows the four PCI card retainers that ship with the server.

FIGURE 4-1 PCI Card Retainers


Figure showing the four PCI card retainers


Figure Legend

1

Long retainer; mfg part number: 340747400038, 60mm long

2

Short, straight retainer; mfg part number: 340747400037, 18mm long
(Note: This retainer fits the same cards as the short, curved retainer [4].)

3

Low-profile retainer; mfg part number: 340764100068, 48mm long

4

Short, curved retainer; mfg part number: 340747400039, 24mm long
(Note: This retainer fits the same cards as the short, straight retainer [2].)


The following figure shows examples of how to use these retainers with differently sized PCI cards.



Note - The short, straight retainers and the short, curved retainers can be used interchangeably to secure the same cards. The short, curved retainer provides more support.


FIGURE 4-2 PCI Card Retainer Examples


Figure showing PCI retainers and corresponding PCI cards.


Figure Legend

1

Half-length, standard-height card secured with two short retainers

2

Low-profile card secured with one long retainer

3

Low-profile card secured with one low-profile retainer

4

Full-length, standard-height card secured with two short retainers and the retainer on the air duct


4.2.2 Replacing PCI-X 4 and PCIe 5 Cards



Note - The maximum power of any one PCI card is 25 watts. Only PCI-X slot 4 and PCIe slot 5 accept long cards.



procedure icon  To Remove the PCI-X 4 and PCIe 5 Cards

1. Prepare the server for PCI card removal. See Powering Off and Powering On the Server.

2. With the PCI mezzanine installed and cabled, identify which card is to be removed.

3. Loosen the appropriate PCI card retainers and securing screws (FIGURE 4-3).

The screws are captive and cannot be completely removed from the PCI mezzanine.

FIGURE 4-3 Upper PCI Card Retainers and Securing Screws


Figure showing the PCI mezzanine, indicating PCI retainers and securing screws

4. Slide the card to the left and lift it out of the PCI mezzanine (FIGURE 4-4).

FIGURE 4-4 Removing PCI-X 4 and PCIe 5 Cards From the PCI Mezzanine


Figure showing PCI-X 4 and PCIe 5 cards being removed from a PCI mezzanine slot

Set the card aside on an antistatic mat.

5. Consider your next step:

6. Tighten the card securing screws.

7. Bring the server back online. See Powering Off and Powering On the Server.


procedure icon  To Install PCI-X 4 and PCIe 5 Cards

1. Prepare the server for PCI card installation. See Powering Off and Powering On the Server.

2. With the PCI mezzanine installed and cabled, determine which slot to install the card and loosen the appropriate card securing screws (FIGURE 4-3).

3. Remove the replacement card from its packaging and place it onto an antistatic mat.

4. If a filler panel is installed, remove it by pulling the tab.

5. Lower the card into position on the PCI mezzanine, then slide it to the right to seat it into the connector (FIGURE 4-5).

You must secure the right side of the PCI card faceplate into the small slot on the right side of the PCI card slot (facing the rear of the server) before installing the PCI card.

FIGURE 4-5 Installing PCI-X 4 and PCIe 5 Cards in the PCI Mezzanine


Figure showing PCI-X 4 and PCIe 5 cards being installed into a PCI mezzanine slot

6. Tighten the card securing screws and appropriate PCI retainers (FIGURE 4-3).

7. Bring the server back online. See Powering Off and Powering On the Server.

4.2.3 Replacing the PCI-X 3 Card



Note - The maximum power of any one PCI card is 25 watts. Only PCI-X slot 4 and PCIe slot 5 accept long cards.



procedure icon  To Remove the PCI-X 3 Card

1. Prepare the server for PCI card removal. See Powering Off and Powering On the Server.

2. With the PCI mezzanine installed and cabled, identify which card is to be removed.

3. Loosen the appropriate PCI card retainers and securing screws (FIGURE 4-3).

The screws are captive and cannot be completely removed from the PCI mezzanine.

4. Slide the card to the left and lift it out of the PCI mezzanine (FIGURE 4-4).

FIGURE 4-6 Removing the PCI-X 3 Card From the PCI Mezzanine


Figure showing the PCI-X 3 card being removed from a PCI mezzanine slot

Set the card aside on an antistatic mat.

5. Consider your next step:

6. Tighten the card securing screws.

7. Bring the server back online. See Powering Off and Powering On the Server.


procedure icon  To Install the PCI-X 3 Card

1. Prepare the server for PCI card installation. See Powering Off and Powering On the Server.

2. With the PCI mezzanine installed and cabled, loosen the appropriate card securing screws (FIGURE 4-3).

3. Remove the replacement card from its packaging and place it onto an antistatic mat.

4. If a filler panel is installed, remove it by pulling the tab (FIGURE 4-7).

5. Lower the card into position on the PCI mezzanine, then slide it to the right to seat it into the connector (FIGURE 4-7).

6. Tighten the appropriate card securing screws and PCI retainers (FIGURE 4-7).

FIGURE 4-7 Installing the PCI-X 3 Card in the PCI Mezzanine


Figure showing the PCI-X 3 card being installed into a PCI mezzanine slot

7. Bring the server back online. See Powering Off and Powering On the Server.

4.2.4 Replacing the Lower PCIe/XAUI Cards



Note - The maximum power of any one PCI card is 25 watts. PCIe/XAUI slots 0 and 1 are the only slots that support XAUI cards.



procedure icon  To Remove the Lower PCIe/XAUI Cards

1. Prepare the server for card removal. See Powering Off and Powering On the Server.

2. Remove the PCI mezzanine and place it on an anti-static mat.

3. Loosen the appropriate card securing screws (FIGURE 4-8).

4. Lift the PCI riser assembly (with PCI card attached) from the PCI mezzanine (FIGURE 4-8).

5. If installed, remove the card securing screw on the right side of the PCI card faceplate (FIGURE 4-8).

6. Remove the PCI card from the PCI riser assembly (FIGURE 4-8).

FIGURE 4-8 Removing Lower PCIe/XAUI Cards From the PCI Mezzanine


Figure showing the reomoval of lower PCIe/XAUI cards from the PCI mezzanine

7. Set the card aside on an antistatic mat.

8. Consider your next step:

9. Bring the server back online. See Powering Off and Powering On the Server.

4.2.5 Installing the Lower PCIe/XAUI Cards

1. Prepare the server for PCI card installation. See Powering Off and Powering On the Server.

2. Remove the PCI mezzanine and place it on an anti-static mat.

3. Remove the replacement card from its packaging and place it onto an antistatic mat.

4. Loosen the appropriate PCI riser assembly securing screws (FIGURE 4-9).

5. Lift the PCI riser assembly from the PCI mezzanine and place it on an antistatic mat.

6. If a filler panel is installed, remove it by pulling the tab (FIGURE 4-9).



caution icon Caution - Verify the PCI card you are installing matches the slot. The PCIe 0 and 1 slots are different than the PCIe 2 slot (FIGURE 4-10). The Sun Storage 6 Gb SAS PCIe RAID HBA, Internal card must be installed in PCIe slot 0 only.


7. Slide the PCI card into the PCI riser assembly connector until fully seated.

8. Install the card securing screw on the right side of the PCI card faceplate (FIGURE 4-9).

9. Seat the PCI riser assembly into the PCI mezzanine (FIGURE 4-9).

10. Tighten the appropriate PCI riser assembly securing screws (FIGURE 4-9).



Note - If you are installing the Sun Storage 6 Gb SAS PCIe RAID HBA, Internal (slot 0 only), see Cabling the Sun Storage 6 Gb SAS PCIe RAID HBA, Internal for important cabling instructions.


FIGURE 4-9 Installing Lower PCIe/XAUI Cards in the PCI Mezzanine


Figure showing the installation of lower PCIe/XAUI cards in the PCI mezzanine

11. Bring the server back online. See Powering Off and Powering On the Server.

12. See Chapter 6 to return the server to operation.


4.3 Cabling the Sun Storage 6 Gb SAS PCIe RAID HBA, Internal

Refer to the Sun Storage 6 Gb SAS PCIe RAID HBA, Internal Installation Guide (E22410) for additional details.

This HBA requires a separate SAS cable (530-4088-01) that ships with the card, or can be ordered separately.


procedure icon  Cable the Sun Storage 6 Gb SAS PCIe RAID HBA, Internal

1. Remove the existing SAS cable connected to the SAS BackPlane (BP) connector and the motherboard near slot 0.

2. Install the card in PCIe slot 0, see Installing the Lower PCIe/XAUI Cards.

3. Connect the SAS cable (530-4088-01) to port SAS0 on the card and the SAS BP connector.

Route the SAS cable as shown in the following figure.

 

FIGURE 4-10 Cable Connections for the Sun Storage 6 Gb PCIe SAS RAID HBA


Figure showing the Sun Storage 6 Gb PCIe SAS RAID HBA cabling instructions.


Figure Callout

Instruction

1

Unulug existing SAS cable from the SAS BackPlane (BP) connector and from the motherboard near slot 0

2

Plug the new SAS cable into port SAS0 of the HBA and into the SAS BP connector.


Table listing the cabling instructions called out in the figure.

4. Bring the server back online. See Powering Off and Powering On the Server.

5. See Chapter 6 to return the server to operation.


4.4 Replacing the Air Duct

4.4.1 Removing the Air Duct

1. Prepare the server for air duct removal. See Powering Off and Powering On the Server.

2. Facing the server, release the tab on the right of the air duct and pull upward (FIGURE 4-11).

3. Lift the duct out of the chassis, releasing it from the pins on the left side of the chassis, and set it aside on an antistatic mat (FIGURE 4-11).

FIGURE 4-11 Removing the Air Duct


Figure showing air duct tab being pressed and lifted for removal

4. Consider your next step:

4.4.2 Installing the Air Duct

1. Remove the replacement air duct from its packaging.

2. With the duct at a 45 degree angle, position the pin holes in the duct to align with the pins of the chassis (FIGURE 4-12).

3. Lower the duct to the horizontal position until the tab secures in place (FIGURE 4-12).

FIGURE 4-12 Installing the Air Duct


Figure showing air duct being installed

4. Consider your next step:

5. See Chapter 6 to return the server to operation.


4.5 FB-DIMM Layout

Use these FB-DIMM configuration rules, FIGURE 4-13, and TABLE 4-1 to help you plan the memory configuration of your server.



Note - On each branch, populate CH0/D0 first. Populate CH1/D0 second.



FIGURE 4-13 FB-DIMM Layout

 [ D ]


FIGURE 4-14 FB-DIMM Upgrade Path

 [ D ]



Note - FB-DIMM names in ILOM messages are displayed with the full FRU name, such as /SYS/MB/CMP0/BR0/CH0/D0.



4.6 Replacing FB-DIMMs

This section describes how to diagnose and replace faulty FB-DIMMs. For FB-DIMM configuration guidelines, see FB-DIMM Layout.



caution icon Caution - Ensure that all power is removed from the server before removing or installing FB-DIMMs. You must disconnect the power cables before performing this procedure.




caution icon Caution - Always perform antistatic measures by using a wrist strap and an antistatic mat for handling and storing removable components.




Note - To remove and install some of the FB-DIMMs, you might need to remove and reinstall the media bay assembly and cables. If this is necessary, see Replacing the Media Bay Assembly.


4.6.1 Locating a Faulty FB-DIMM

The system Service Required LED lights if the system detects a FB-DIMM fault.

Use the showfaults command to identify faulty FB-DIMMs. See Displaying System Faults.

Use the FB-DIMM fault locator button on the motherboard to identify faulty FB-DIMMs.

1. Prepare the server for FB-DIMM removal. See Powering Off and Powering On the Server.

2. Remove the FB-DIMM/CPU duct.

See Removing the Air Duct.

3. Press the FB-DIMM fault locator button on the motherboard.

The button is located on the left edge of the motherboard, next to /SYS/MB/CMP0/BR3/CH1/D1 (J1701).

4. Note the location of faulty FB-DIMMs.

Faulty FB-DIMMs are identified with a corresponding amber LED on the motherboard.



Note - The FB-DIMM fault LEDs remain lit only for a few minutes.


5. Ensure that all FB-DIMMs are seated correctly in their slots.

4.6.2 Removing FB-DIMMs

1. Prepare the server for FB-DIMM removal. See Powering Off and Powering On the Server.

2. Remove the FB-DIMM/CPU duct.

See Removing the Air Duct.

3. If you are replacing a faulty FB-DIMM, locate the FB-DIMMs that you want to replace.

Press the DBDIMM DIAG button on the motherboard to activate the DB-DIMM status LEDs. Any faulty FB-DIMMs will be indicated with a corresponding amber fault LED on the motherboard.



Tip - Make a note of the faulty FB-DIMM location so that you can install the replacement FB-DIMM in the same location.




Note - For memory configuration information see FB-DIMM Layout.


4. Push down on the ejector tabs on each side of the FB-DIMM until the FB-DIMM is released (FIGURE 4-15).

5. Grasp the top corners of the faulty FB-DIMM and remove it from the server.

FIGURE 4-15 Removing FB-DIMMs


Figure showing how to remove a FB-DIMM

6. Place the FB-DIMM on an antistatic mat.

7. Repeat Step 4 through Step 6 to remove any additional FB-DIMMs.

4.6.3 Installing FB-DIMMs



caution icon Caution - Ensure that all power is removed from the server before removing or installing FB-DIMMs or damage to the FB-DIMMs might occur. You must disconnect the power cables from the system before performing this procedure.


1. Unpackage the replacement FB-DIMMs and place them on an antistatic mat.



Tip - See FB-DIMM Layout for information about configuring the FB-DIMMs.


2. Ensure that the ejector tabs are in the open position.

3. Line up the replacement FB-DIMM with the connector (FIGURE 4-16).

Align the FB-DIMM notch with the key in the connector. This ensures that the FB-DIMM is oriented correctly.

4. Push the FB-DIMM into the connector until the ejector tabs lock the FB-DIMM in place.

If the FB-DIMM does not easily seat into the connector, verify that the orientation of the FB-DIMM is as shown in FIGURE 4-16. If the orientation is reversed, damage to the FB-DIMM might occur.

FIGURE 4-16 Inserting the FB-DIMM Into the Slot


Figure showing how to insert the FB-DIMM into the slot on the motherboard assembly

5. Repeat Step 2 through Step 4 until all replacement FB-DIMMs are installed.

6. Consider your next step:

a. Install the air duct.

See Installing the Air Duct.

b. Bring the server back online. See Powering Off and Powering On the Server

4.6.4 Verifying Successful Replacement of a Faulty FB-DIMM

1. Access the ALOM CMT sc> prompt.

Refer to the Sun Integrated Lights Out Management 2.0 Supplement for the Sun Netra T5220 Server for instructions.

2. Run the showfaults -v command to determine how to clear the fault.

The method you use to clear a fault depends on how the fault is identified by the showfaults command.

Examples:

In most cases, the replacement of the faulty FB-DIMM(s) is detected when the service processor is power cycled. In this case, the fault is automatically cleared from the system. If the fauilt is still displayed by the showfaults command, then run the enablecomponent command to enable the FB-DIMM and clear the fault.


sc> enablecomponent /SYS/MB/CMP0/BR3/CH1/D1

3. Perform the following steps to verify the repair:

a. Set the virtual keyswitch to diag so that POST will run in Service mode.


sc> setkeyswitch diag

b. Issue the poweron command.


sc> poweron

c. Switch to the system console to view POST output.


sc> console

Watch the POST output for possible fault messages. The following output is a sign that POST did not detect any faults:


.
.
.
0:0:0>INFO:
0:0:0>    POST Passed all devices.
0:0:0>POST:    Return to VBSC.
0:0:0>Master set ACK for vbsc runpost command and spin...



Note - Depending on the configuration of ILOM POST variables and whether POST detected faults or not, the system might boot, or the system might remain at the ok prompt. If the system is at the ok prompt, type boot.


d. Return the virtual keyswitch to normal mode.


sc> setkeyswitch normal

e. Issue the Solaris OS fmadm faulty command.


# fmadm faulty

No memory faults should be displayed.

If faults are reported, refer to the diagnostics flowchart in FIGURE 1-1 for an approach to diagnose the fault.

4. Gain access to the ALOM CMT sc> prompt.

5. Run the showfaults command.

6. Run the clearfault command.


sc> clearfault 7ee0e46b-ea64-6565-e684-e996963f7b86

7. Switch to the system console.


sc> console

8. Issue the fmadm repair command with the UUID.

Use the same UUID that you used with the clearfault command.


# fmadm repair 7ee0e46b-ea64-6565-e684-e996963f7b86


4.7 Replacing the Battery

4.7.1 Removing the Battery

1. Prepare the server for battery removal. See Powering Off and Powering On the Server.

2. Pry the battery out of the service processor board using a small flat-blade screwdriver (FIGURE 4-17).

FIGURE 4-17 Prying the Battery From the Motherboard


Figure showing how to pry the battery from the service motherboard

3. Set the battery aside on an antistatic mat.

4. Continue to Installing the Battery.

4.7.2 Installing the Battery



Note - The Sun Netra T5220 server uses one of three lithium CR2032 batteries (part number 371-2210-01: Panasonic, Maxell or Renata).


1. Remove the replacement battery from its packaging.

2. Press the new battery in with the “+” side facing up (FIGURE 4-18).

FIGURE 4-18 Inserting the Battery Into the Service Processor Board


Figure showing how to insert the battery into the motherboard

3. Bring the server back online. See Powering Off and Powering On the Server.

4. See Chapter 6 to return the server to operation.


4.8 Replacing the NVRAM

4.8.1 Removing the NVRAM

1. Prepare the server for NVRAM removal. See Powering Off and Powering On the Server.

2. Carefully pull the NVRAM from the service processor board (FIGURE 4-19).

FIGURE 4-19 Pulling the NVRAM From the Service Processor Board


Figure showing how to pull the NVRAM from the service processor board.

3. Set the NVRAM aside on an antistatic mat.

4. Consider your next step:

4.8.2 Installing the NVRAM



Note - The NVRAM contains the identifiers of the server, such as its MAC address, FRUID, and so on. If you install a new NVRAM, you must reconfigure your applications and services to recognize the new MAC address, FRUID, and so on.


1. Remove the replacement NVRAM from its packaging and place it on an antistatic mat.

2. Align the notch in the NVRAM socket with the key on the underside of the NVRAM, and press it into place (FIGURE 4-20).

FIGURE 4-20 Pressing the NVRAM Into the Socket


Figure showing how to press the NVRAM into its socket

3. Consider your next step:

4. See Chapter 6 to return the server to operation.


4.9 Replacing the SCC Module



Note - The SCC module is also known as the IDPROM chip.




Note - The SCC module contains system host ID, MAC addresses, and configuration variable settings for ILOM. If you are replacing a motherboard, you must move the SCC module from the old motherboard to the new one.




Note - If you are replacing a faulty SCC module, you must obtain the host ID, MAC addresses, and ILOM configuration settings stored in the SCC module you are replacing. Configure these settings into the new SCC module.


4.9.1 Removing the SCC Module

1. Prepare the server for SCC module removal.

See Powering Off and Powering On the Server.

2. Remove the air duct.

See Removing the Air Duct.

3. Remove the PCI mezzanine.

See Removing the PCI Mezzanine.

4. Locate the SCC module.

5. Carefully pull the SCC module straight up from its connector.

4.9.2 Installing the SCC Module

1. Align the SCC module with its connector on the motherboard.



Note - The SCC module and its connector are keyed.


2. Press the SCC module down until it seats.

3. Install the air duct.

See Installing the Air Duct.

4. Install the PCI mezzanine.

See Installing the PCI Mezzanine.

5. Bring the server back online.

See Powering Off and Powering On the Server.

6. If the previous SCC module had modified ILOM configuration variables and you recorded them, configure the new SCC module with those values.

7. Return the server to operation.

See Chapter 6.

 


4.10 Replacing the Motherboard Assembly



caution icon Caution - The SCC module contains system host ID, MAC addresses, and configuration variable settings for ILOM. If you are replacing a motherboard, you must move the SCC module from the old motherboard to the new one. You must also backup OpenBoot PROM variables for restoring after motherboard replacement.


4.10.1 Removing the Motherboard Assembly

1. Back up OpenBoot PROM variables with one of the following procedures:

2. Prepare the server for motherboard assembly removal. See Powering Off and Powering On the Server.

3. Remove the following components:

4. Disconnect the cables connected to the motherboard (FIGURE 4-21).

a. Disconnect the cable connected to the PDB.

b. Disconnect the two cables connected to the media bay assembly.

FIGURE 4-21 Removing the Cables Connected to the Motherboard


Figure showing motherboard cables being removed

5. Loosen or remove the screws that secure the motherboard assembly to the chassis (FIGURE 4-22).

FIGURE 4-22 Removing the Motherboard Assembly Screws


Figure showing loosening or removal of the screws that secure the motherboard assembly

6. Loosen the two captive screws at the center of the motherboard assembly (FIGURE 4-22).

7. Lift slighty and slide the motherboard assembly forward approximately one inch (25.4 mm) (FIGURE 4-23).

8. Lift up on the right edge to approximately a 45 degree angle (FIGURE 4-23).

9. Remove the motherboard assembly from the chassis (FIGURE 4-23).

FIGURE 4-23 Removing the Motherboard Assembly From the Chassis


Figure showing how to remove the motherboard assembly from the chassis

10. Set the motherboard assembly aside on an antistatic mat.

11. Continue to Installing the Motherboard Assembly.

4.10.2 Installing the Motherboard Assembly

1. Remove the replacement motherboard assembly from its packaging and place it on an antistatic mat.

2. Lower the left edge of the motherboard assembly into the chassis, then the entire board, and while slightly elevated, slide the motherboard assembly to the back of the chassis (FIGURE 4-24).

FIGURE 4-24 Installing the Motherboard Assembly Into the Chassis


Figure showing how to install the motherboard assembly into the chassis

3. Align the motherboard assembly screw holes over the chassis standoffs.

4. Tighten the two captive screws at the center of the motherboard assembly (FIGURE 4-25).

FIGURE 4-25 Installing the Motherboard Assembly Screws


Figure showing installation of the screws that secure the motherboard assembly

5. Install the two power screws and four other screws that secure the motherboard assembly to the chassis (FIGURE 4-25).

6. Reconnect the cables to the following connectors on the motherboard assembly (FIGURE 4-26):

FIGURE 4-26 Reconnecting the Cables to the Motherboard Assembly


Figure showing how to connect the cables to the motherboard assembly

7. Install the following components:

8. Bring the server back online.

See Powering Off and Powering On the Server.

9. Restore OpenBoot PROM variables with one of the following procedures:

10. Return the server to operation.

See Chapter 6.


1 (TableFootnote) Upgrade path: DIMMs should be added with each group populated in the order shown.
2 (TableFootnote) Fault replacement path: Each pair is addressed as a unit, and each pair must be identical.
Feedback