2 Preparing Oracle Database Appliance for Service

How to prepare the Oracle Database Appliance for servicing.

Servicing System Components

These sections describe the serviceable components of the server.

Illustrated Parts Breakdown

Identify major components of Oracle Database Appliance X10 server.

The following figure identifies Oracle Dababase Appliance X10 server major components.

Description of mm-10168_oda-x10-illustrated-parts.png follows
Description of the illustration mm-10168_oda-x10-illustrated-parts.png
Callout Description

1

2.5-inch NVMe SSD (up to two supported with the Oracle Database Appliance X10-S, or up to four with the Oracle Database Appliance X10-L)

2

Storage drive bay cage

3

4-Drive backplane

4

System chassis

5

Front LED indicator module

6

Six fan modules (FM0-5)

7

Fan tray

8

Motherboard assembly

9

Processors (P0, P1) and heatsinks (Single-processor systems contain only a single processor in socket P0; socket P1 contains a cap to protect processor socket pins.)

10

24 DIMMs (Twelve DIMMs are supported in single-processor systems and the DIMMs must be installed in P0 DIMM sockets.)

11

Internal M.2 SSD memory with two internal M.2 Risers

12

Top cover

13

Air baffle

14

System RTC battery

15

Two power supplies (PS0, PS1)

16

(Optional) Nine half-height half-length PCIe cards

PCIe slots 1 through 4 are nonfunctional in single-processor systems.

Customer-Replaceable Units

The following table lists the customer-replaceable units (CRUs) in the server, describes whether they can be serviced hot (with appliance power on) or cold (with appliance power off) and directs you to the replacement instructions.

CRU (Service Level) Description Replacement Instructions

Server battery (Cold service)

Lithium coin-cell battery that powers the CMOS BIOS and real-time clock.

Servicing the Battery

Server DIMMs (Cold service)

Add or replace memory modules in the system.

Servicing the DIMMs

Server storage drives (Hot service)

Storage drive configurations can be comprised of both hard disk drives (HDDs), solid state disk drives (SSDs), or NVMe drives.

Servicing Server Storage Drives

Server internal M.2 flash SSDs (Cold service)

Supports up to two internal M.2 flash SSDs.

Servicing the Internal M.2 Flash SSDs

Server fan modules (Hot service)

Four fan modules for cooling the server components.

Servicing Fan Modules

Server PCIe cards (Cold service)

Optional add-on cards that can expand the functionality of the server.

Servicing PCIe Cards

Server power supply units (Hot service)

Two fully redundant AC-powered power supplies.

Servicing Power Supplies

Storage Shelf components (Hot service)

Storage shelf SSDs, power supplies and IO modules.

Oracle Database Appliance X10-HA Storage Shelf Hot Pluggable Components

Field-Replaceable Units

The following table lists the field-replaceable units (FRUs) in the server and directs you to the replacement instructions.

Note:

Only authorized Oracle Service personnel can service FRU components.

FRU (Service Level) Description Replacement Instructions

Processor and heatsink (Cold service)

Processor that carries out the instructions of the system.

Servicing Processors

Fan tray (Cold service)

Houses the fan modules.

Servicing the Fan Tray

Disk backplane (Cold service)

Provides power and communications connectors for storage drives.

Servicing the Disk Backplane

Front LED indicator module (Cold service)

Contains the push-button circuitry and LEDs that are displayed on the front panel.

Servicing the Front LED Indicator Module

PCIe slot Flyover cable (Cold service)

Supports PCIe slots 6 and 7 in the system.

Servicing the PCIe Slot Flyover Cable (FRU)

Motherboard assembly (Cold service)

Provides connectors for the DIMMs, processors, PCIe risers, and other components.

Servicing the Motherboard Assembly

Safety Precautions

For your protection, observe the following safety precautions when setting up your equipment:

  • Follow all standard cautions, warnings, and instructions marked on the equipment and described in the Oracle Server Safety and Compliance Guide and Important Safety Information for Oracle's Hardware Systems.

  • Ensure that the voltage and frequency of your power source match the voltage and frequency that appear on the equipment electrical rating label.

  • Follow the electrostatic discharge safety practices as described in Electrostatic Discharge Safety.

  • Disconnect both power supply cords (if necessary) before servicing components.

    Note:

    Power cords must be disconnected when servicing components that require cold service.

Safety Symbols

The following symbols might appear in this document. Note their meanings.

Caution:

Risk of personal injury or equipment damage. To avoid personal injury or equipment damage, follow the instructions.

Caution:

Hot surface. Avoid contact. Surfaces are hot and might cause personal injury if touched.

Caution:

Hazardous voltages are present. To reduce the risk of electric shock and danger to personal health, follow the instructions.

Electrostatic Discharge Safety

Devices that are sensitive to electrostatic discharge (ESD), such as the motherboard, PCIe cards, drives, processors, and memory DIMMs require special handling.

Caution:

The boards and drives contain electronic components that are extremely sensitive to static electricity. Ordinary amounts of static electricity from clothing or the work environment can destroy components. Do not touch the components along their connector edges.

Do the following when handling ESD-sensitive components:

  • Use an antistatic wrist strap.

    Wear an antistatic wrist strap when handling components such as drive assemblies, boards, or cards. When servicing or removing server components, disconnect the power cords from the server. Attach an antistatic strap to your wrist and to a metal area on the chassis. Following this practice equalizes the electrical potentials between you and the server.

    Note:

    An antistatic wrist strap is not included in the Accessory Kit for the server. However, antistatic wrist straps are included with optional components.
  • Use an antistatic mat.

    Place ESD-sensitive components such as the motherboard, DIMMS (memory modules), and other printed circuit board (PCB) cards on an antistatic mat. The following items can be used as an antistatic mat:

    • Antistatic bag used to wrap an Oracle replacement part

    • Oracle ESD mat (orderable item)

    • Disposable ESD mat (shipped with some replacement parts or optional system components)

FRU Key Identity Properties (KIP) Automated Update

Oracle ILOM includes a key identity properties (KIP) auto-update feature that ensures product information that is used for service entitlement and warranty coverage is accurately maintained by the server at all times, including during hardware replacement activities.

The KIP includes the server product name, product part number (PPN), and product serial number (PSN). The KIP is stored in the FRUID (field-replaceable unit identifiers) container of the three server FRUs that are designated quorum members.

The quorum members include:

  • Disk backplane (DBP), designated as a primary quorum member.

  • Motherboard (MB), designated as a backup quorum member.

  • Power supply (PS), designated as a backup quorum member.

When a server FRU that contains the KIP is removed and a replacement component is installed, the KIP of the replacement component is programmed by Oracle ILOM to contain the same KIP as the other two components.

Note:

Only one of the quorum members can be replaced at a time. Automated updates can be completed only when two of the three quorum members contain matching key identity properties.

Required Service Tools

The server can be serviced with the following tools:

  • Antistatic wrist strap

  • Antistatic mat(s)

  • No. 2 Phillips screwdriver

  • Torx (6 lobe) T10, T15, T20, and T25 drivers

  • Torque driver 12 in-lbf with T20 Torx bit (processor and heatsink installation)

  • Small flat blade screwdriver (motherboard light pipe removal)

Preparing the Server for Component Replacement

Note:

When you are replace the storage drives or power supplies, not all of the procedures in this section are necessary. For more information, see the replacement procedures for those components.

Before you can remove and install components that are inside the server, you must perform the procedures in some or all of the following sections.

Powering Down the Server

Gracefully shut down the server host to prevent data from being corrupted. Performing a graceful shutdown ensures that the system is ready for restart. If the server is not responding, or you must shut down the server quickly, perform an immediate shutdown.

Note:

Some server components, such as storage drives, power supplies, fan modules, and M.2 flash SSDs are hot-pluggable. Components that are hot-pluggable do not require the server to be powered down when performing service procedures.

Determine how you want to power down the server by reviewing the following options.

Power Down the Server Gracefully Using Oracle ILOM CLI

Performing a graceful shutdown ensures that all of your data is saved and the system is ready for restart.

  1. Log in to the server as superuser or equivalent.

    Depending on the nature of the problem, you might want to view the system status or the log files or run diagnostics before you shut down the system. Refer to Oracle ILOM Documentation.

  2. Notify affected users that the server will be powered down.
  3. Save any open files, and quit all running applications.

    Refer to your application documentation for specific information about these processes.

  4. Log in to the Oracle ILOM command-line interface (CLI) using an Administrator account.
  5. At the Oracle ILOM prompt, shut down the operating system: stop command

    -> stop /System

    Note:

    The stop /System command does not guarantee a system shutdown. This command is only a request to the host operating system (OS) to perform a system shutdown. To ensure a system shutdown, see Power Down the Server for Immediate Shutdown Using Oracle ILOM CLI.

    The host server performs an orderly power shutdown to Standby power mode, and the System OK LED on the front panel begins blinking.

  6. Disconnect the power and cables from the server.

    See Disconnect Cables From the Server.

    Caution:

    When you power down the server using Oracle ILOM, the server enters Standby power mode. Power is still directed to the service processor remote management subsystem and power supply fans. To completely power off the server, you must disconnect the power cords from the power supplies.
Power Down the Server Gracefully Using Oracle ILOM Web Interface

Performing a graceful shutdown ensures that all of your data is saved and the system is ready for restart.

  1. Log in to the server as superuser or equivalent.

    Depending on the nature of the problem, you might want to view the system status or the log files or run diagnostics before you shut down the system. Refer to Oracle ILOM Documentation.

  2. Notify affected users that the server will be powered down.
  3. Save any open files, and quit all running applications.

    Refer to your application documentation for specific information about these processes.

  4. Log in to the Oracle ILOM web interface using an Administrator account.
  5. In the left pane, click Host Management → Power Control, and click Graceful Shutdown and Power Off from the Select Action list.
  6. Click Save, and then click OK.

    The host server performs an orderly power shutdown to Standby power mode, and the System OK LED on the front panel begins blinking.

  7. Disconnect the power cords and data cables from the server.

    See Disconnect Cables From the Server.

    Caution:

    When you power down the server using Oracle ILOM, the server enters Standby power mode. Power is still directed to the service processor and power supply fans. To completely power off the server, you must disconnect the power cords from the power supplies.
Power Down the Server Gracefully Using the On/Standby Button

Power down the server using the On/Standby button. Performing a graceful shutdown ensures that all of your data is saved and the system is ready for restart.

  1. Press and quickly release the On/Standby button on the front panel.

    This action causes ACPI-enabled operating systems to perform an orderly shutdown of the operating system. Servers not running ACPI-enabled operating systems shut down to Standby power mode immediately.

    When main power is off, the System OK LED on the front panel begins blinking, indicating that the server is in Standby power mode.

  2. Disconnect the power cords and data cables from the server.

    See Disconnect Cables From the Server.

    Caution:

    When you power down the server using the On/Standby button, the server enters Standby power mode. Power is still directed to the service processor and power supply fans. To completely power off the server, you must disconnect the power cords from the power supplies.
Power Down the Server for Immediate Shutdown Using Oracle ILOM CLI

Caution:

An immediate power-off might corrupt system data, therefore, use this procedure to power down the server only after attempting the graceful power down procedure.
  1. Log in to the Oracle ILOM command-line interface (CLI) using an Administrator account.

    Refer to Oracle ILOM Documentation.

    Oracle ILOM displays the default command prompt (->), indicating that you have successfully logged in to Oracle ILOM.

  2. At the CLI prompt, type the following command:

    -> stop -f /System

    The server powers down immediately to Standby power mode.

  3. Disconnect the power and data cables from the server.

    See Disconnect Cables From the Server.

    Caution:

    When you power down the server using Oracle ILOM, the server enters Standby power mode. Power is still directed to the service processor and power supply fans. To completely power off the server, you must disconnect the power cords from the power supplies.
Power Down the Server for Immediate Shutdown Using Oracle ILOM Web Interface

Caution:

An immediate power-off might corrupt system data, therefore, use this procedure to power down the server only after attempting the graceful power down procedure.
  1. Log in to the Oracle ILOM web interface using an Administrator account.
  2. In the left pane, click Host Management → Power Control, and click Immediate Power Off in the Select Action list.
  3. Click Save, and then click OK.

    The server powers down immediately to Standby power mode.

  4. Disconnect the power and data cables from the server.

    See Disconnect Cables From the Server.

    Caution:

    When you power down the server using Oracle ILOM, the server enters Standby power mode. Power is still directed to the service processor and power supply fans. To completely power off the server, you must disconnect the power cords from the power supplies.
Power Down the Server for Immediate Shutdown Using the On/Standby Button

Caution:

An immediate power-off might corrupt system data, therefore, use this procedure to power down the server only after attempting the graceful power down procedure.
  1. Press and hold the On/Standby button for four seconds to force the Main power off and to enter Standby power mode.

    When the Main power is off, the System OK LED on the front panel begins blinking, indicating that the server is in Standby power mode.

  2. Disconnect the power cords and data cables from the server.

    See Disconnect Cables From the Server.

    Caution:

    When you power down the server using the On/Standby button, the server enters Standby power mode. Power is still directed to the service processor and power supply fans. To completely power off the server, you must disconnect the power cords from the power supplies.

Disconnect Cables From the Server

Caution:

The system supplies Standby power to the circuit boards even when the system is powered off.
  1. Label all cables connected to the server.
  2. Power down the server.
  3. Disconnect the power cords from the rear of the server.
  4. Disconnect all data cables from the rear of the server.
  5. If your rackmount kit includes a cable management device, remove the cables from it.
  6. Depending on the components that you are servicing, either extend the server to the maintenance position, or remove the server from the rack.

Stabilize the Rack

Caution:

To reduce the risk of personal injury, stabilize the rack cabinet, and extend the anti-tilt bar before you install the server.

Refer to your rack documentation for detailed instructions for the following steps.

  1. Open and remove the front and back doors from the rack cabinet, only if they impinge on the mounting bay.
  2. To prevent the rack cabinet from tipping during the installation, fully extend the rack cabinet anti-tilt bar, which is located at the bottom front of the rack cabinet.
  3. If the rack includes leveling feet beneath the rack cabinet to prevent the rack from rolling, extend these leveling feet fully downward and lock to the floor.

    Caution:

    When moving the rack cabinet to a new location, verify that the leveling feet are up before moving the rack.

Extend the Server to the Maintenance Position

The following components can be serviced with the server in the maintenance position:

  • Fan modules

  • Storage drives

  • DDR5 DIMMs

  • Processors

  • M.2 Flash drives and risers

  • System battery

  • Motherboard

  • PCIe cards and cables

  • Disk backplane

  • Front indicator module

If the server is installed in a rack with extendable slide-rails, use this procedure to extend the server to the maintenance position.

  1. To prevent the rack from tipping forward when the server is extended, extend all rack anti-tilt mechanisms.
  2. Verify that no cables will be damaged or will interfere when the server is extended.

    Although the cable management arm (CMA) that is supplied with the server is hinged to accommodate extending the server, ensure that all cables and cords are capable of extending.

  3. From the front of the server, open and hold the left and right release latch covers in the open position.

    When in an open position, the release latch covers engage the slide-rail release latches [1].

    Caution:

    Deploy any rack anti-tilt mechanism before releasing the slide-rail release latches.
    Description of aog-251_server-maint-position.png follows
    Description of the illustration aog-251_server-maint-position.png
  4. While the release latch covers are in the open position, slowly pull the server forward until the slide-rails latch into a locked position [2].

    The server is now in the extended maintenance position.

Remove the Cable Management Arm

Follow this procedure to remove the cable management arm (CMA). You might need to remove the CMA to service power supplies or cables connected to the back of the system.

Before you begin this procedure, refer to the illustration provided in the procedure Install the Cable Management Arm (Optional) to identify CMA connectors A, B, C, and D. Disconnect the CMA connectors in the reverse order in which you installed them, that is, disconnect connector D first, followed by C, B, and A.

Throughout this procedure, after you disconnect any of the CMA four connectors, do not allow the CMA to hang under its own weight.

Note:

References to “left” or “right” in this procedure assume that you are facing the back of the equipment rack.

  1. To prevent the rack from tipping forward when the server is extended, ensure that the rack anti-tilt bar is extended.

    Caution:

    To reduce the risk of personal injury, stabilize the rack cabinet and extend the anti-tilt bar before extending the server from the rack.

    For instructions to stabilize the rack, see Stabilize the Rack.

  2. To make it easier to remove the CMA, extend the server approximately 13 cm (5 inches) out of the front of the rack.
  3. To remove the cables from the CMA:
    1. Disconnect all cables from the back of the server.
    2. If applicable, remove any additional Velcro straps that were installed to bundle the cables.
    3. Unwrap the six Velcro straps that are securing the cables.
    4. Open the three cable covers to the fully opened position.
    5. Remove the cables from the CMA and set them aside.
  4. To disconnect connector D:
    1. Press the green release tab (callout 1) on the slide-rail latching bracket toward the left and slide the connector D out of the left slide-rail [1 and 2].

      When you slide connector D out of the left slide-rail, the slide-rail latching bracket portion of the connector remains in place. You disconnect connector D in the next step.

      Note:

      After you disconnect connector D, do not allow the CMA to hang under its own weight. Throughout the remainder of this procedure, the CMA must be supported until all the remaining connectors are disconnected and the CMA can be placed on a flat surface.

      Description of mm-10242_2u-connd.png follows
      Description of the illustration mm-10242_2u-connd.png
      Call Out Description

      1

      Connector D release tab (green)

      2

      Slide-rail latching bracket release tab (labeled PUSH)

    2. Use your right hand to support the CMA and use your left thumb to push in (toward the left) on the slide-rail latching bracket release tab labeled PUSH (callout 2), and pull the latching bracket out of the left slide-rail and put it aside [3 and 4].
  5. To disconnect connector C:
    1. Place your left arm under the CMA to support it.
    2. Use your right thumb to push in (toward the right) on the connector C release tab labeled PUSH (callout 1), and pull connector C out of the right slide-rail [1 and 2].
      Description of mm-10243_2u-connc.png follows
      Description of the illustration mm-10243_2u-connc.png
      Call Out Description

      1

      Connector C release tab (labeled PUSH)

  6. To disconnect connector B:
    1. Place your right arm under the CMA to support it and grasp the back end of connector B with your right hand.
    2. Use your left thumb to pull the connector B release lever to the left, away from the right slide-rail (callout 1), and use your right hand to pull the connector out of the slide-rail [1 and 2].
      Description of mm-10244_2u-connb.png follows
      Description of the illustration mm-10244_2u-connb.png
      Call Out Description

      1

      Connector B release lever

  7. To disconnect connector A:
    1. Place your left arm under the CMA to support it and grasp the back end of connector A with your left hand.
    2. Use your right thumb to pull the connector A release lever to the right, away from the left slide-rail (callout 1), and use your left hand to pull the connector out of the slide-rail [1 and 2].
      Description of mm-10245_2u-conna.png follows
      Description of the illustration mm-10245_2u-conna.png
      Call Out Description

      1

      Connector A release lever

  8. Remove the CMA from the rack and place it on a flat surface.
  9. Go to the front of the server and push it back into the rack.

Remove the Server From the Rack

This section describes how to remove the server from the rack. For most service actions you won't need to do this.

Caution:

The server weighs approximately 76 lbs (34 kg). A mechanical lift or two people are required to remove the server from the rack and carry the chassis.

Always load equipment into a rack from the bottom up so that the rack does not become top-heavy and tip over. Extend the rack anti-tilt bar to prevent the rack from tipping during equipment installation.

  1. Disconnect all the cables and power cords from the server.
  2. Remove the cable management arm (CMA).
  3. Extend the server to the maintenance position.
  4. From the front of the server on both sides, pull the gray slide-rail release tabs toward the front of the server, and pull the server out of the rack until it is free of the rack rails [1 and 2].

    Use a mechanical lift or two people to remove the chassis from the rack and transport it.

    A slide-rail release tab is located on each slide-rail.

    Note:

    To pull the gray slide-rail release tab, place your finger in the center of the tab, not on the end, and apply pressure as you pull the tab toward the front of the server.

    Description of aog-249_removing-server.png follows
    Description of the illustration aog-249_removing-server.png
  5. Set the server on a sturdy, ESD safe work surface.

Take Antistatic Measures

  1. Prepare an antistatic surface on which to set parts during removal and installation.

    Place electrostatic discharge ESD-sensitive components such as the printed circuit boards on an antistatic mat. You can use the following items as an antistatic mat:

    • Antistatic bag used to wrap a replacement part

    • Oracle ESD mat (orderable item)

    • Disposable ESD mat (shipped with some replacement parts or optional system components)

  2. Attach an antistatic wrist strap.

    When servicing or removing server components, attach an antistatic strap to your wrist and then to a metal area on the chassis. Then perform procedures for servicing the server.

    Note:

    An antistatic wrist strap is not included in the Accessory Kit for the server. However, antistatic wrist straps might be included with options and components.

Remove the Server Top Cover

Remove the top cover to service components inside the server.

  1. To service non-hot pluggable components, ensure that AC power cords are disconnected from the server power supplies.

    Note:

    Fan modules and M.2 flash SSDs are hot-pluggable and do not require AC power cables to be disconnected from the server power supplies.
  2. If the release button latch is in the locked position, use a Torx T15 screwdriver to turn the release button latch clockwise to the unlocked position.
  3. Unlatch the top cover [1].

    Lift up on the release button on top of the server cover. Lifting the release button slides the server cover toward the rear of the chassis for easy removal.

    Description of aog-252_4-drive-remove-cover.png follows
    Description of the illustration aog-252_4-drive-remove-cover.png
  4. Lift up and remove the top cover [2].

Remove the Air Baffle

  1. Prepare the server for service.
    1. Power off the server.
    2. Disconnect the power cords from the power supplies.
    3. Extend the server into the maintenance position.
    4. Attach an antistatic wrist strap to your wrist and then to a metal area on the chassis.
    5. Remove the server top cover.
  2. Remove the air baffle by lifting the baffle up and out of the server.

    Lift up the air baffle in the rear at a 50 degree angle, and slide slightly rearward to clear the air baffle tabs that prevent the front of the baffle from lifting up.

    Description of aog-53_remove-air-baffle.png follows
    Description of the illustration aog-53_remove-air-baffle.png
  3. Set aside the air baffle.
  4. Consider your next step:
    • If you removed the air baffle as part of another procedure, return to that procedure.

    • Otherwise, continue to Install the Air Baffle.