JavaScript is required to for searching.
Skip Navigation Links
Exit Print View
Oracle® ZFS Storage Appliance Customer Service Manual

For ZS3-x, 7x20 Controllers, and DE2-24, Sun Disk Shelves

Oracle Technology Network
Library
PDF
Print View
Feedback
search filter icon
search icon

Document Information

Using This Documentation

Chapter 1 Introduction

Chapter 2 Hardware Maintenance

Maintenance

Introduction

ZS3-2

ZS3-2 Hardware Overview

Controller Overview

Front Panel

Rear Panel

4x4 SAS-2 HBA

Serial Management Connector

Network Management Connector

Ethernet Ports

Cluster I/O Ports

Disconnecting the RJ-45 Cable from the Cluster Serial Port

Physical Specifications

Electrical Specifications

Acoustic Noise Emissions

Internal Components

Storage, Power, and Fan Components

Internal Cables

Motherboard, Memory, and PCIe Cards

CPU and Memory

NIC/HBA Options

PCIe Riser Configuration

PCIe Options

PCIe Slot Order

Optional Cable Management Arm

Attached Storage

ZS3-4

ZS3-4 Hardware Overview

Controller Overview

Chassis Dimensions

Front Panel

System Drives

Rear Panel

4x4 SAS-2 HBA

Electrical Specifications

Internal Boards

Components

CPU and Memory

Fan Modules

NIC/HBA Options

Connectors

PCIe Options

PCIe Slot Order

Attached Storage

ZS3-2

ZS3-2 CRU Maintenance Procedures

Prerequisites

Safety Information

Required Tools and Information

Chassis Serial Number

Prepare the Controller for Servicing Internal Components

ZS3-2 Prepare the Controller for Servicing Internal Components

Remove Power

Extend the Storage Controller From the Rack

Remove the Top Cover

Controller Replacement Tasks

ZS3-2 Controller Replacement Tasks

SSDs and HDDs

Replacing the ZS3-2 Controller SSDs and HDDs

Power Supplies

Replacing the ZS3-2 Controller Power Supplies

Fan Modules

Replacing the ZS3-2 Controller Fan Modules

Memory

Replacing the ZS3-2 Controller Memory

PCIe Cards and Risers

Replacing the ZS3-2 Controller PCIe Cards and Risers

USB Flash Drive

Replacing the ZS3-2 Controller USB Flash Drive

Battery

Replacing the ZS3-2 Controller Battery

Oracle DE2 and Sun Disk Shelf Interoperability

ZS3-4

ZS3-4 CRU Maintenance Procedures

Prerequisites

Safety Information

Required Tools and Information

Chassis Serial Number

Controller Replacement Tasks

ZS3-4 Controller Replacement Tasks

HDD or SSD

Replacing the ZS3-4 Controller HDD or SSD

Fan Module

Replacing the ZS3-4 Controller Fan Module

Power Supply

Replacing the ZS3-4 Controller Power Supply

Memory

Replacing the ZS3-4 Controller Memory

PCIe Cards and Risers

Replacing the ZS3-4 Controller PCIe Cards and Risers

Battery

Replacing the ZS3-4 Controller Battery

Oracle DE2 and Sun Disk Shelf Interoperability

7120

7120 Hardware Overview

Chassis Overview

Front Panel

Rear Panel

Electrical Specifications

Internal Components

I/O Components

Cables

CPU and Memory

Power Distribution, Fan Module and Disk Components

Standalone Controller Configurations

NIC/HBA Options

PCIe Options

Attached Storage

7320

7320 Hardware Overview

Chassis Overview

Boards

Cables

7320 I/O Components

7320 CPU and Memory Components

7320 Power Distribution and Fan Module Components

Electrical Specifications

7320 Front Panel

7320 Replaceable Components

7320 PCIe Cards and Risers

7320 Rear Panel

7320 Single and Cluster Controller Configurations

7320 Cluster Configurations

7320 Connector Pinouts

Attached Storage

See Also

7420

7420 Hardware Overview

Appliance Overview

Chassis

Front Panel

System Drives

Rear Panel

Connectors

Electrical Specifications

Internal Boards

Components

CPU and Memory

Fan Modules

NIC/HBA Options

PCIe Options

PCIe Slot Order

Attached Storage

7x20

7x20 CRU Maintenance Procedures

Prerequisites

Safety Information

Required Tools and Information

Chassis Serial Number

Controller Replacement Tasks

7x20 Controller Replacement Tasks

HDD or SSD

Replacing the 7x20 Controller HDD or SSD

Fan Module

Replacing the 7x20 Controller Fan Module

Power Supply

Replacing the 7x20 Controller Power Supply

Memory

Replacing the 7x20 Controller Memory

PCIe Cards and Risers

Replacing the 7x20 Controller PCIe Cards and Risers

Battery

Replacing the 7x20 Controller Battery

Oracle DE2 and Sun Disk Shelf Interoperability

Shelf

Disk Shelf Overview

SAS-2

Front Panel

Drive Locations

Front Panel Indicators

Back Panel

I/O Module Indicators

SIM Board Indicators

Power Supply Indicators

Disk Shelf Configurations

Oracle Storage Drive Enclosure DE2-24P

Oracle Storage Drive Enclosure DE2-24C

Sun Disk Shelf (DS2)

Shelf

Disk Shelf Maintenance Procedures

Prerequisites

Safety Information

Electrostatic Discharge Precautions

Shelf Electrostatic Discharge Precautions

Removing Power from the Disk Shelf

Remove Power from the Disk Shelf

Tasks

Disk Shelf Replacement Tasks

Drives

Replacing a Drive

Power Supply

Replacing a Power Supply

I/O Module

Replacing an I/O Module

SIM Board

Replacing a SIM Board

Faults

Hardware Faults

Connect to ILOM

Management Port Configuration

Observing and Clearing CPU faults from ILOM

See Also

Cabling

Connecting to Attached Storage

Maximum Number of Disk Shelves per Controller Configuration

Next Steps

Chapter 3 System Maintenance

Controller Replacement Tasks

7x20 Controller Replacement Tasks

Use the following procedures to replace the 7x20 controller:

HDD or SSD

If you have more than one failed drive, replace only one drive at a time. Removing more than one drive in quick succession will cause a hardware/pool fault.

Replacing the 7x20 Controller HDD or SSD

  1. Identify the failed HDD or SSD by going to the Maintenance > Hardware section of the BUI and clicking the drive information icon image: . If you are physically at the system, the amber Service Required indicator on the HDD or SSD should be illuminated.
  2. If you are not physically at the system, turn on the locator indicator by clicking the locator icon image: .
  3. Push the release button on the HDD or SSD to open the latch.
  4. Grasp the latch (2), and pull the drive out of the drive slot.
    image:graphic showing how to remove a 7x20 controller disk drive
  5. After 15 seconds, navigate to the Hardware > Maintenance screen, and click the right-arrow icon image: on the system controller to verify that the software has detected that the drive is not present.
  6. Slide the replacement drive into the slot until it is fully seated.
    image:graphic showing how to install a 7x20 controller disk drive
  7. Close the latch to lock the drive in place.

    The Sun ZFS Storage system software automatically detects and configures the new drive. The device appears in the BUI Maintenance > Hardware screen when you view details for the controller or drive shelf.

Fan Module

Fan modules are hot-swappable and can be removed and installed while the storage controller is running without affecting other hardware capabilities.

7120 or 7320: The fan modules and status indicators are hidden under a fan door in the 7120 and 7320 storage controllers. Components may differ slightly between the 7120 and 7320, however service procedures for each are identical. The illustration shows the 7320 controller.

image:graphic showing the 7120 and 7320 controller fan modules and status indicators

Leaving the door open for more than 60 seconds while the storage controller is running might cause it to overheat and shut down.

7420: The following illustration shows the fan modules in the 7420 storage controller.

image:graphic showing the 7420 controller fan modules and status indicators

Replacing the 7x20 Controller Fan Module


Caution

Caution  -  Operating a controller for an extended period of time with fans removed reduces the effectiveness of the cooling system. For this reason, the replacement fan should be unpacked in advance and ready to insert into the controller chassis as soon as the faulted fan is removed.


  1. To locate the chassis you want to service, click the associated locator icon image: on the Maintenance > Hardware screen of the BUI or issue the set /SYS/LOCATE status=on command at the service processor (SP) prompt. The locate LED will flash on the controller chassis.
  2. Verify that no cables will be damaged or will interfere when the storage controller is extended from the rack.
  3. From the front of the storage controller, release the two slide release latches.
  4. While squeezing the slide release latches, slowly pull the storage controller forward until the slide rails latch.
  5. 7120 or 7320: To replace the fan module:

    Open the fan module door while unlatching the release tabs on the door.

    Identify the faulted fan module by locating the corresponding Service Required status indicator or by clicking the locator icon image: on the Maintenance > Hardware screen of the BUI for the fan you want to replace.

    Using thumb and forefinger, pull the fan module up and out.


    image:graphic showing how to remove a 7120 or 7130 controller fan module

    Install the replacement fan module into the storage controller fan slot.


    Caution

    Caution  -  The fan must be replaced within one minute to avoid controller shutdown.



    image:graphic showing how to install a 7120 or 7130 controller fan module

    Apply firm pressure to fully seat the fan module.

    Verify that the Fan OK status indicator is lit, and that the fault status indicator on the replaced fan module is dim.

    Close the top cover door immediately after replacing the fan to maintain airflow in the storage controller.

  6. 7420: To replace the fan module:

    Identify the faulted fan module by locating the corresponding Service Required status indicator or by clicking the locator icon image: on the Maintenance > Hardware screen of the BUI for the fan you want to replace.

    Lift the latch at the top of the fan module to unlock the fan module, and pull the fan module out.


    image:graphic showing how to remove and install a 7420 controller fan module

    Unlock and insert the 7420 fan module.

    Apply firm pressure to fully seat the fan module.

    Verify that the Fan OK status indicator is lit and that the fault status indicator on the replaced fan module is dim.

  7. Verify that the Top Fan status indicator, the Service Required status indicators, and the Locator status indicator/Locator button are dim.
  8. Push the release tabs on the side of each rail and slowly slide the storage controller into the rack.
Power Supply

Storage controllers are equipped with redundant hot-swappable power supplies. If a power supply fails and you do not have a replacement, leave the failed power supply installed to ensure proper air flow. A faulted power supply is indicated by an amber-colored status LED.

Replacing the 7x20 Controller Power Supply

  1. Gain access to the rear of the storage controller where the faulted power supply is located.
  2. If a cable management arm (CMA) is installed, press and hold the CMA release tab and rotate the arm out of the way.
    image:graphic showing how to release the 7x20 controller cable management arm
  3. Disconnect the power cord from the faulted power supply.
  4. Remove the power supply.

    7120 or 7320: Release the latch, then remove the power supply. Components may differ slightly between the 7120 and 7320, however service procedures for each are identical. The illustration shows the 7320 controller.


    image:graphic showing how to remove a 7120 or 7320 controller power supply

    7420: Grasp the power supply handle and press the release latch to remove the power supply.


    image:graphic showing how to remove a 7420 controller power supply
  5. Align the replacement power supply with the empty power supply chassis bay.
  6. Slide the power supply into the bay until it is fully seated. The following figure shows the 7420 power supply.
    image:graphic showing how to install a 7x20 controller power supply
  7. Connect the power cord to the power supply.
  8. Verify that the green AC Present status indicator is lit.
  9. Close the CMA, inserting the CMA into the rear left rail bracket.
  10. Go to the Maintenance > Hardware screen of the BUI. Click the right-arrow icon image: for the controller and then click power supply to verify that the online icon image: is green for the newly installed power supply.
Memory

To identify a specific memory module that has faulted, you must open the storage controller and use the amber status LEDs on the motherboard. To identify a general memory fault, go to the Maintenance > Hardware screen of the BUI, and click on the right-arrow icon image: on the controller. Then click DIMMs to locate the faulted component, indicated by the warning icon image: .

You must shut down the appliance before beginning this task. Note that there will be a loss of access to the storage unless the system is in a clustered configuration. Shut down the appliance using one of the following methods:

Replacing the 7x20 Controller Memory


Caution

Caution  -  This procedure requires that you handle components that are sensitive to static discharge, which can cause the component to fail. To avoid damage, wear an antistatic wrist strap and use an antistatic mat when handling components.


  1. Disconnect the AC power cords from the rear panel of the storage controller.
  2. Verify that no cables will be damaged or will interfere when the storage controller is extended from the rack.
  3. From the front of the storage controller, release the two slide release latches.
  4. While squeezing the slide release latches, slowly pull the storage controller forward until the slide rails latch.
  5. 7120 or 7320: Components may differ slightly between the 7120 and 7320, however service procedures for each are identical. The illustration shows the 7320 controller. To remove the top cover:

    Unlatch the fan module door, pull the two release tabs back, rotate the fan door to the open position and hold it there.

    Press the top cover release button and slide the top cover to the rear about a half-inch (1.3 cm).

    Lift up and remove the top cover.

    Also remove the air baffle by pressing the air baffle connectors outward and lifting the air baffle up and out of the server.


    image:graphic showing how to remove a 7120 or 7320 controller top cover and air baffle
  6. 7420: To remove the top cover:

    Simultaneously lift both cover latches in an upward motion.


    image:graphic showing how to remove a 7420 controller top cover

    Lift up and remove the top cover.

  7. To locate the DIMM you want to service, press the Fault Remind Button on the storage controller.

    The following illustration shows the Fault remind button on the 7120 controller.


    image:graphic showing the 7120 or 7320 controller Fault remind button

    The following illustration shows the Fault remind button on the 7420 controller.


    image:graphic showing the 7420 controller Fault remind button
  8. 7420: Identify the memory riser that hosts the faulted DIMM by the Service Required status indicator. Lift the memory riser straight up to remove it from the motherboard, and place it on an antistatic mat.
    image:graphic showing how to remove a 7420 controller memory riser
  9. Rotate both DIMM slot ejectors outward as far as they will go and carefully lift the faulted DIMM straight up to remove it from the socket.
    image:graphic showing how to remove a 7420 controller DIMM
  10. Line up the replacement DIMM with the connector, aligning the notch with the key to ensure that the component is oriented correctly.
    image:graphic showing how to install a 7420 controller DIMM
  11. Push the DIMM into the connector until the ejector tabs lock the component in place.
  12. 7120 or 7320: Components may differ slightly between the 7120 and 7320, however service procedures for each are identical. The illustration shows the 7320. To replace the cover:

    Place the top cover on the chassis so that it hangs over the rear of the storage controller by about an inch (2.5 cm).

    Slide the top cover forward until it seats.

    Close the fan cover and engage the fan cover latches. The cover must be completely closed for the storage controller to power on.


    image:graphic showing how to close the 7120 or 7320 controller fan cover
  13. 7420: To replace the cover:

    Push the memory riser module into the associated CPU memory riser slot until the riser module locks in place.


    image:graphic showing how to replace a 7420 controller riser module

    Place the top cover on the chassis so that it is forward of the rear of the storage controller by about an inch (2.5 cm).

    Slide the top cover toward the rear of the chassis until it seats and press down on the cover with both hands until both latches engage.


    image:graphic showing how to close the 7420 controller top cover
  14. Push the release tabs on the side of each rail and slowly push the storage controller into the rack.
    image:graphic showing how to push the release tabs on the rails

    The following image shows the 7420 chassis.


    image:graphic showing how to install a 7x20 controller into the rack
  15. Connect the power cords to the power supplies.
  16. Verify that standby power is on, indicated by the Power/OK status indicator flashing on the front panel about two minutes after the power cords are plugged in.
  17. Use a pen or other pointed object to press and release the recessed Power button on the storage controller front panel.

    The Power/OK status indicator next to the Power button lights and remains lit. The Maintenance > Hardware screen of the BUI provides status of the replacement on the Details page for DIMMs.

PCIe Cards and Risers

Go to the Maintenance > Hardware screen of the BUI and click the right-arrow icon image: on the controller, and then click Slots to locate the faulted component.

Note that the 7120 Sun Flash Accelerator F20 card is a FRU and must be replaced by an Oracle service representative.

All HBAs must be of the same type. Ensure that you upgrade your system software before installing a newly released HBA.

You must shut down the controller before beginning this task. Note that there will be a loss of access to the storage unless the system is in a clustered configuration. Shut down the appliance using one of the following methods:

Replacing the 7x20 Controller PCIe Cards and Risers


Caution

Caution  -  This procedure requires that you handle components that are sensitive to static discharge, which can cause the component to fail. To avoid damage, wear an antistatic wrist strap and use an antistatic mat when handling components.


  1. Disconnect the AC power cords from the rear panel of the storage controller.
  2. Verify that no cables will be damaged or will interfere when the storage controller is extended from the rack.
  3. From the front of the storage controller, release the two slide release latches.
  4. While squeezing the slide release latches, slowly pull the storage controller forward until the slide rails latch.
  5. 7120 or 7320: To remove the top cover:

    Unlatch the fan module door, pull the two release tabs back, rotate the fan door to the open position and hold it there.

    Press the top cover release button and slide the top cover to the rear about a half-inch (1.3 cm).

    Lift up and remove the top cover.

  6. 7420: To remove the top cover:

    Simultaneously lift both cover latches in an upward motion.


    image:graphic showing how to remove a 7420 controller top cover

    Lift up and remove the top cover.

  7. Locate the PCIe card position in the storage controller, see 7320 Single and Cluster Controller Configurations for the 7320, the PCIe Options for the 7120, or PCIe Options for the 7420.
  8. 7120 or 7320: To replace the PCIe card:

    Disconnect any data cables connected to the cards on the PCIe riser you want to replace. Label the cables for proper connection later.

    Loosen the two captive Phillips screws on the end of the rear panel crossbar and lift the crossbar up and back to remove it.


    image:graphic showing how to remove a 7120 or 7320 controller PCIe card slot crossbar

    Loosen the captive retaining screw holding the front end of the riser and the Phillips screw on the end of the riser.

    Lift the riser up to remove it from the storage controller.


    image:graphic showing how to remove a 7120 or 7320 controller PCIe card riser

    Carefully remove the PCIe card from the riser board connector and clean the slot with filtered, compressed air if necessary.


    image:graphic showing how to remove a 7120 or 7320 controller PCIe card

    Seat the replacement PCIe card in the slot of the riser and connect the cables.


    image:graphic showing how to install a 7120 or 7320 controller PCIe card

    Align the riser, together with any attached PCIe cards, with the intended location on the motherboard, and carefully insert it into its slot.


    image:graphic showing how to intall a 7120 or 7320 controller PCIe card riser

    Slide the back of the riser into the motherboard rear panel stiffener.

    Tighten the screw that secures the riser to the motherboard.

    Replace the rear panel PCI crossbar by sliding it down over the PCIe risers, ensuring the crossbar is secured with two captive Phillips screws.


    image:graphic showing how to replace a 7120 or 7320 controller PCIe card slot crossbar
  9. 7420: To replace the PCIe card:

    Disengage the PCIe card slot crossbar from its locked position and rotate the crossbar into an upright position.


    image:graphic showing how to disengage the 7420 controller PCIe card slot crossbar

    Remove the retaining screw that holds the PCIe card to the chassis.

    Carefully remove the PCIe card from the connector and clean the slot with filtered, compressed air if necessary.

    Install the replacement PCIe card into the PCIe card slot.

    Install the retaining screw to hold the PCIe card to the chassis.

    Return the crossbar to its closed and locked position.


    image:graphic showing how to close the 7420 controller PCIe card slot crossbar
  10. 7120 or 7320: Components may differ slightly between the 7120 and 7320, however service procedures for each are identical. The illustration shows the 7320 controller. To install the top cover:

    Place the top cover on the chassis so that it hangs over the rear of the storage controller by about an inch (2.5 cm), then slide the top cover forward until it seats.

    Close the fan cover and engage the fan cover latches. The cover must be completely closed for the storage controller to power on.


    image:graphic showing how to close the 7120 or 7320 controller fan cover
  11. 7420: To install the top cover:

    Place the top cover on the chassis (1) so that it is forward of the rear of the storage controller by about an inch (2.5 cm).

    Slide the top cover toward the rear of the chassis (2) until it seats.

    Press down on the cover with both hands until both latches engage.


    image:graphic showing how to close the 7420 controller top cover
  12. Push the release tabs on the side of each rail and slowly push the storage controller into the rack, making sure no cables obstruct the path of the controller.
  13. Connect the power cords to the power supplies.
  14. Verify that standby power is on, indicated by the Power/OK status indicator flashing on the front panel about two minutes after the power cords are plugged in.
  15. Use a pen or other pointed object to press and release the recessed Power button on the storage controller front panel. The Power/OK status indicator next to the Power button lights and remains lit.
  16. Connect data cables to the PCIe card, routing them through the cable management arm.
  17. Go to the Maintenance > Hardware screen of the BUI, and click the right-arrow icon image: on the controller. Then, click Slots to verify the status of the new component. The online icon image: should be green.
  18. Install the disk shelf as described in Installation in Oracle ZFS Storage Appliance Installation Guide and connect the expansion storage as described in Connecting to Attached Storage.
Battery

You might need to replace the battery if the storage controller fails to maintain the proper time when powered off and disconnected from the network. You will need a small (No.1 flat-blade) non-metallic screwdriver or equivalent.

You must shut down the appliance before beginning this task. Note that there will be a loss of access to the storage unless the system is in a clustered configuration. Shut down the appliance using one of the following methods:

Replacing the 7x20 Controller Battery

  1. Disconnect the AC power cords from the rear panel of the storage controller.
  2. Verify that no cables will be damaged or will interfere when the storage controller is extended from the rack.
  3. From the front of the storage controller, release the two slide release latches.
  4. While squeezing the slide release latches, slowly pull the storage controller forward until the slide rails latch.
  5. 7120 or 7320: To remove the top cover:

    Unlatch the fan module door, pull the two release tabs back, rotate the fan door to the open position and hold it there.

    Press the top cover release button and slide the top cover to the rear about a half-inch (1.3 cm).

    Lift up and remove the top cover.

  6. 7420: To remove the top cover:

    Simultaneously lift both cover latches in an upward motion.


    image:graphic showing how to remove the 7420 controller top cover
  7. Lift up and remove the top cover.
  8. Using a small, non-metallic screwdriver, press the latch and remove the battery from the motherboard. The 7420 battery is shown here.
    image:graphic showing how to remove the 7320 or 7420 controller battery

    The following figure shows the 7120 battery.


    image:graphic showing how to remove the 7120 controller battery
  9. Press the replacement battery into the motherboard with the positive side (+) facing upward.
  10. 7120 or 7320: Components may differ slightly between the 7120 and 7320, however, service procedures for each are identical. The illustration shows the 7320. To install the top cover:

    Place the top cover on the chassis so that it hangs over the rear of the storage controller by about an inch (2.5 cm), then slide the top cover forward until it seats.

    Close the fan cover and engage the fan cover latches. The cover must be completely closed for the storage controller to power on.


    image:graphic showing how to remove the 7120 or 7320 controller fan cover
  11. 7420: To install the top cover:

    Place the top cover on the chassis (1) so that it is forward of the rear of the storage controller by about an inch (2.5 cm).

    Slide the top cover toward the rear of the chassis (2) until it seats.

    Press down on the cover with both hands until both latches engage.


    image:graphic showing how to close the 7420 controller top cover
  12. Push the release tabs on the side of each rail and slowly push the storage controller into the rack, making sure no cables obstruct the path of the controller.
  13. Connect the power cords to the power supplies.
  14. Verify that standby power is on, indicated by the Power/OK status indicator flashing on the front panel about two minutes after the power cords are plugged in.
  15. Use a pen, or other pointed object, to press and release the recessed Power button on the storage controller front panel. The Power/OK status indicator next to the Power button lights and remains lit.
  16. Connect data cables to the PCIe card, routing them through the cable management arm.
  17. When the system has finished booting, log in and set the time using the steps in the task NTP BUI Clock in Oracle ZFS Storage Appliance Administration Guide .