Sun Blade T6320 Server Module Service Manual

This chapter describes how to remove and replace field-replaceable units (FRUs) that must be cold-swapped.

The following topics are covered:

• Section 4.1, Safety Information
• Section 4.2, Common Procedures for Parts Replacement
• Section 4.3, Removing and Replacing DIMMs
• Section 4.4, Removing and Replacing the Service Processor
• Section 4.5, Removing and Replacing the Battery on the Service Processor
• Section 4.6, Replacing or Installing the Sun Blade RAID 5 Expansion Module
• Section 4.7, Removing and Replacing the Sun Blade G2 RAID 0/1 Expansion Module
• Section 4.8, Finishing Component Replacement

---

4.1 Safety Information

This section describes important safety information you need to know prior to removing or installing parts in the Sun Blade T6320 server module.

For your protection, observe the following safety precautions when setting up your equipment:

• Follow all Sun standard cautions, warnings, and instructions marked on the equipment and described in Important Safety Information for Sun Hardware Systems, 816-7190 or 821-1590.
• Ensure that the voltage and frequency of your power source match the voltage and frequency inscribed on the equipment s electrical rating label.
• Follow the electrostatic discharge safety practices as described in this section.

4.1.1 Safety Symbols

The following symbols might appear in this manual, note their meanings:

Caution - There is a risk of personal injury and equipment damage. To avoid personal injury and equipment damage, follow the instructions.

Caution - Hot surface. Avoid contact. Surfaces are hot and might cause personal injury if touched.

Caution - Hazardous voltages are present. To reduce the risk of electric shock and danger to personal health, follow the instructions.

4.1.2 Electrostatic Discharge Safety

Electrostatic discharge (ESD) sensitive devices, such as the motherboard, hard drives, and memory cards require special handling.

Caution - The boards and hard drives contain electronic components that are extremely sensitive to static electricity. Ordinary amounts of static electricity from clothing or the work environment can destroy components. Do not touch the components along their connector edges.

4.1.2.1 Using an Antistatic Wrist Strap

Wear an antistatic wrist strap and use an antistatic mat when handling components such as drive assemblies, boards, or cards. When servicing or removing server module components, attach an antistatic strap to your wrist and then to a metal area on the chassis. Do this after you disconnect the power cords from the server module. Following this practice equalizes the electrical potentials between you and the server module.

4.1.2.2 Using an Antistatic Mat

Place ESD-sensitive components such as the motherboard, memory, and other PCB cards on an antistatic mat.

---

4.2 Common Procedures for Parts Replacement

Before you can remove and replace internal components, you must perform the procedures in this section.

4.2.1 Required Tools

You can service the Sun Blade T6320 server module with the following tools:

• Antistatic wrist strap
• Antistatic mat

4.2.2 Shutting Down the System

Performing a graceful shutdown ensures that all of your data is saved and that the system is ready for restart. This section describes procedures for using the ILOM CLI and the ILOM web interface to shut down the system.

1. Log in as superuser or equivalent.

Depending on the nature of the problem, you might want to view the system status, the log files, or run diagnostics before you shut down the system. For more information, refer to:

• Sun Integrated Lights Out Manager 2.0 Supplement for Sun Blade T6320 Server Modules, 820-2546. And the Oracle Integrated Lights Out Manager (ILOM) 3.0 Supplement for Sun Blade T6320 Server Modules, 820-7145. These documents describe ILOM information specific to the Sun Blade T6320 server module. It also provides command comparisons of the ALOM CMT and ILOM CLI command sets.
• Appendix D of this service manual also provides some information about ILOM.

2. Notify affected users.

Refer to your Solaris system administration documentation for additional information.

3. Save any open files and quit all running programs.

Refer to your application documentation for specific information on these processes.

4. Shut down the Solaris OS using the shutdown (1M)command.

5. Use either the ILOM web interface, or the ILOM CLI, to finish the shut down sequence as described in the following sections.

You can also press the power button on the front of the server module to initiate a graceful shutdown.

4.2.3 Using the ILOM Web Interface to Shut Down the Server Module

1. From the ILOM web interface, select the tabs: Remote Control, Remote Power Control (FIGURE 4-1).

In the Select Action menu, choose a shutdown option.

FIGURE 4-1 Powering Off the Server Module with the ILOM Web Interface

4.2.4 Using the ILOM CLI to Shut Down the Server Module

1. Switch from the system (host) console to the ILOM -> prompt by typing the #. (Hash-Period) key sequence.

2. At the ILOM -> prompt, type the set /SYS/PS0 prepare_to_remove_action=true command and type y to confirm.

ILOM CLI, ILOM web interface, and ALOM-CMT command equivalents are shown in TABLE 4-1.

-> set /SYS/ prepare_to_remove_action=true
Are you sure you want to stop /SYS (y/n)? y
Stopping /SYS

The blue blade ok2 remove LED is illuminated.

The top white LED is the Locator LED. You can also set the white locator LED to blink:

-> set /SYS/LOCATE value=fast_blink

Once you have located the server module, you can press the Locator LED to turn it off.

3. If a cable is connected to the front of the server module, disconnect it.

FIGURE 4-2 Disconnecting the Cable Dongle

[ D ]

Caution - The cable dongle is for temporary connections only. The cable dongle has not been evaluated for electromagnetic compatibility (EMC). The cable dongle or server module connectors could be damaged by rack doors or other impacts. Remove the cable dongle during normal system operation.

4. Open the ejector levers (FIGURE 4-3).

FIGURE 4-3 Removing the Sun Blade T6320 Server Module From the Chassis

5. While pinching the release latches, slowly pull the server module forward until the slide rails latch.

Caution - Hold the server module firmly so that you do not drop it. The server module weighs approximately 16 pounds (7.3 kg).

Caution - Do not stack server modules higher than five units tall. They might fall and cause damage or injury.

FIGURE 4-4 Stack Five Server Modules or Fewer

6. Set the server module on an antistatic mat.

7. Attach an antistatic wrist strap.

When servicing or removing server module components, attach an antistatic strap to your wrist and then to a metal area on the chassis.

FIGURE 4-5 Antistatic Mat and Wrist Strap

[ D ]

8. While pressing the top cover release button, slide the cover toward the rear of the server module about an inch (2.5 mm).

9. Lift the cover off the chassis.

---

4.3 Removing and Replacing DIMMs

This section describes how to remove and replace DIMMs.

4.3.1 Removing the DIMMs

LEDs indicate if a DIMM requires replacement.

• If the system is still powered on and installed in the chassis, see Section 2.2, Memory Configuration and Fault Handling to determine if a DIMM requires replacement.
• If the server module is powered off, you can remove the server module from the chassis. Pressing the DIMM Locate button illuminates and LED next to the faulty DIMMs (FIGURE 4-6).

Caution - Ensure that you follow antistatic practices as described in Section 4.1.2, Electrostatic Discharge Safety.

1. Perform the procedures described in Section 4.2, Common Procedures for Parts Replacement.

2. Locate the DIMMs that you want to replace (FIGURE 4-7).

The server module has a DIMM locate button on the motherboard. Press the DIMM locate button to illuminate the LEDs of the bad DIMMs.

FIGURE 4-6 DIMM Locate Button and DIMM LEDs

You can also use FIGURE 4-7 and TABLE 4-2 to identify the DIMMs that you want to remove.

FIGURE 4-7 DIMM Installation Rules

3. Note the DIMM locations so that you can install the replacement DIMMs in the same sockets.

4. Push down on the ejector levers on each side of the DIMM connector until the DIMM is released.

FIGURE 4-8 Removing DIMMs

5. Grasp the top corners of the faulty DIMM and remove it from the system.

6. Place DIMMs on an antistatic mat.

4.3.2 Replacing the DIMMs

See Section 2.2.1, FB-DIMM Configuration Guidelines for complete memory configuration and installation rules.

Caution - The DIMM rules must be followed. The server module might not operate correctly if the DIMM rules are not followed. Always use DIMMs that have been qualified by Sun.

1. Place the replacement DIMMs on an antistatic mat.

2. Ensure that the connector ejector tabs are in the open position.

3. Line up a replacement DIMM with the connector.

Align the DIMM notch with the key in the connector.

a. Push each DIMM into a connector until the ejector tabs lock the DIMM in place.

b. Perform the procedures described in Section 4.8, Finishing Component Replacement.

4.3.2.1 Verifying DIMM Installation

Clear the previous faults and enable the DIMMs. See Section 2.6.4, Clearing POST Detected Faults.

---

4.4 Removing and Replacing the Service Processor

The service processor controls the host power and monitors host system events (power and environmental). The service processor holds a battery and a socketed EEPROM for storing the system configuration, all Ethernet MAC addresses, and the host ID.

Caution - Handle the components carefully to avoid damage.

4.4.1 Removing the Service Processor

Caution - The service processor card can be hot. To avoid injury, handle it carefully.

1. Perform the procedures described in Section 4.2, Common Procedures for Parts Replacement.

2. Pull back the plastic retaining tab and lift up on handle of the service processor card to release it from the bracket (FIGURE 4-10).

FIGURE 4-9 Removing the Service Processor

3. Grasp the top corners of the service processor and pull it out of the bracket.

4. Place the service processor card on an antistatic mat.

5. Remove the system configuration PROM (NVRAM) (FIGURE 4-10) from the service processor card and place the PROM on an antistatic mat.

The service processor contains the persistent storage for the system host ID and Ethernet MAC addresses. The service processor also contains the ILOM configuration including the IP addresses and ILOM user accounts, if configured. This information will be lost unless the system configuration PROM (NVRAM) is removed and installed in the replacement service processor. The PROM does not hold the fault data, and the fault data will no longer be accessible when the service processor is replaced.

FIGURE 4-10 Removing the System Configuration PROM (NVRAM)

4.4.2 Replacing the Service Processor

1. Remove the replacement service processor from the package and place it on an antistatic mat.

2. Install the system configuration PROM (NVRAM) that you removed from the faulty service processor.

The PROM is keyed to ensure proper orientation.

3. Insert the service processor edge into the bracket and carefully align the service processor so that each of its contacts is centered on a socket pin.

4. Push firmly and evenly between the handle edges, until the service processor is firmly seated in the connector socket.

5. Perform the procedures described in Section 4.8, Finishing Component Replacement.

---

4.5 Removing and Replacing the Battery on the Service Processor

Caution - Handle the components carefully to avoid damage.

1. Perform the procedures described in Section 4.2, Common Procedures for Parts Replacement.

2. To remove the service processor from the chassis, pull back the plastic tab and lift the handle (Section 4.4, Removing and Replacing the Service Processor).

3. Place the service processor on an antistatic mat.

4. Carefully remove the battery (FIGURE 4-11) from the service processor.

FIGURE 4-11 Removing the Battery From the Service Processor

4.5.1 Replacing the Battery on the Service Processor

1. Remove the replacement battery from the package.

2. Press the new battery into the service processor (FIGURE 4-11) with the positive side (+) facing upward (away from the card).

3. Place the edge of the service processor in between the tabs on the plastic bracket and carefully align the connectors.

4. Press between the handle edges until the service processor is seated in the connector.

5. Perform the procedures described in Section 4.8, Finishing Component Replacement.

6. Before you poweron the host system, type the ILOM set /SP/clock datetime command to set the day and time.

For details about this command, refer to the Sun Integrated Lights out Manager 2.0 User’s Guide, 820-1188.

->set /SP/clock datetime=10
Set ‘datetime’ to ‘102421532007.30’
-> show
/SP/clock
	Targets
	Properties:
		datetime = Wed Oct 24, 21:53:38 2007
		usentpserver = disabled
...

---

4.6 Replacing or Installing the Sun Blade RAID 5 Expansion Module

If you have a previously installed REM, save the configuration before removing it. Refer to the Sun Blade 6000 Disk Module Service Manual, 820-1703 and the Sun Blade 6000 Disk Module Administration Guide 820-4922
http://docs.sun.com/app/docs/prod/blade.6000disk~blade6000dskmod

Also refer to the Sun Adaptec RAID User’s Guide, 820-4708 for instructions on using the Java GUI to save the configuration of the existing REM.

1. Place your fingers under the RAID expansion module (REM), with each finger close top the connector (FIGURE 4-12).

2. Lift the card free from the connector.

3. Lift the REM free from the gray plastic standoff.

FIGURE 4-12 Removing the RAID Expansion Module

4.6.1 Installing the RAID 5 Expansion Module

1. Place the card under the tabs of the gray plastic standoff (FIGURE 4-13).

2. Press on the rubber button on the top of the card until the connector engages with the connector on the motherboard (FIGURE 4-13).

FIGURE 4-13 Replacing the RAID 5 Expansion Module

1. Power-up the computer and storage systems.

a. Ensure that all hard disk drives are securely installed.

b. Connect all power cords securely and plug them into the proper power sources.

c. Power-on the disk drive enclosure, and verify that all available HDD status indicators are normal for the storage enclosure(s) that they are in.

d. Power-on the computer system.

2. Enter the Open Boot Prompt (OBP) and use the show-disks command to list the current devices.

In the following example, the HBA is the first device that is listed.

{0} ok show-disks
a) /pci@500/pci@0/pci@9/scsi@0/disk
b) /pci@500/pci@0/pci@2/pci@0/usb@0,2/storage@5/disk
c) /pci@500/pci@0/pci@2/pci@0/usb@0,2/storage@1/disk

3. Use the select command to select the device node for the HBA, and follow the on-screen instructions by pressing Enter when prompted.

{0} ok select /pci@500/pci@0/pci@9/scsi@0
Waiting for AAC Controller to start: . . Started

4. To display additional configuration information, list the device properties by using the .properties command.

{0} ok .properties
firmware-version         15825
assigned-addresses       82e70010 00000000 50000000 00000000 00200000
                        82e70030 00000000 50200000 00000000 00080000
compatible               pciex9005,285.108e.7aac.9
                        pciex9005,285.108e.7aac
                        pciex9005,285.9
                        pciex9005,285
                        pciexclass,010400
                        pciexclass,0104
model                    AAC,285
reg                      00e70000 00000000 00000000 00000000 00000000
                        03e70010 00000000 00000000 00000000 00200000
version                  0.00.01
wide                     00000010
device_type              scsi-2
name                     scsi
fcode-rom-offset         00011800
interrupts               00000001
cache-line-size          00000010
class-code               00010400
subsystem-id             00007aac
subsystem-vendor-id      0000108e

5. Return to the root node by using the unselect-dev command.

{0} ok unselect-dev

If no errors or issues are discovered, continue to Creating a Bootable Array With the RAID 5 Expansion Module to complete the installation process. If any issues are discovered, correct them and retest the HBA before continuing.

4.6.2 Configuring the RAID 5 Expansion Module

For details, see Appendix B and Appendix C.

4.6.3 Creating a Bootable Array With the RAID 5 Expansion Module

If you are installing an operating system onto a bootable array, see Appendix B.

4.6.4 Additional Information

For more information, refer to the following documents at: http://docs.sun.com/app/docs/coll/dsk-cntrl

• Uniform Command-Line Interface User’s Guide, 820-2145
• Sun StorageTek RAID Manager Software User’s Guide, 820-1177
• Sun StorageTek RAID Manager Software Release Notes, 820-2755

For Sun RAID controller drivers, firmware, and utilities including Sun StorageTek RAID Manager for SPARC (8/4/2008) Version 5.50, go to: http://support.intel.com/support/motherboards/server/sunraid/

---

4.7 Removing and Replacing the Sun Blade G2 RAID 0/1 Expansion Module

Caution - Avoid excess strain on the REM edges. Lift as close to the connector as possible.

1. Place your fingers under the RAID expansion module (REM), with each finger close top the connector (FIGURE 4-14).

2. Lift the card free from the connector.

3. Lift the REM free from the gray plastic standoff.

FIGURE 4-14 Removing the RAID Expansion Module

4.7.1 Replacing the RAID 0/1 Expansion Module

1. Place the card under the tabs of the gray plastic standoff (FIGURE 4-15).

2. Press on the rubber button on the top of the card until the connector engages with the connector on the motherboard (FIGURE 4-15).

FIGURE 4-15 Replacing the RAID 0/1 Expansion Module

4.7.2 Verifying the RAID 0/1 Expansion Module Installation

Refer to the Sun Blade G2 RAID 0/1 Expansion Module Installation Guide (820-5448) for details.

---

4.8 Finishing Component Replacement

4.8.1 Replacing the Cover

1. Place the cover on the chassis.

Set the cover down so that it hangs over the rear of the server module by about an inch (2.5 mm).

2. Slide the cover forward until it latches into place (FIGURE 4-16).

FIGURE 4-16 Replacing the Cover

4.8.2 Reinstalling the Server Module in the Chassis

Caution - Hold the server module firmly so that you do not drop it. The server module weighs approximately 17 pounds (7.7 kg).

1. Turn the server module over so that the ejector levers are on the right side (FIGURE 4-17).

2. Push the server module into the chassis.

3. Close the latches.

• The server module powers on with 3.3v standby power.
• The ILOM software boots.

You can either press the Power button to fully power on the server module, type the ILOM command start /SYS, command, or use the ALOM-CMT poweron command.

FIGURE 4-17 Inserting the Server Module in the Chassis

^{1 (TableFootnote) Upgrade path: DIMMs should be added with each group populated in the order shown.}

^{2 (TableFootnote) Fault replacement path: Each pair is addressed as a unit, and each pair must be identical.}

Sun Blade T6320 Server Module Service Manual

820-2386-12

Copyright © 2010, Oracle and/or its affiliates. All rights reserved.