C H A P T E R  1

Overview

This chapter provides an overview of the Sun StorageTek 6540 Array. It contains the following sections:


Sun StorageTek 6540 Array

The Sun StorageTek 6540 Array is a high-performance, enterprise-class, full 4-Gigabit per second (Gb/s) Fibre Channel (FC) solution that combines outstanding performance with the highest reliability, availability, flexibility, and manageability.

The Sun StorageTek 6540 Array is mounted in a Sun Rack 1000-38 cabinet, which is fully prepared to be fitted with up to 11 expansion trays. The 6540 Array is scalable from a base configuration of one dual RAID controller tray and one expansion tray to a maximum configuration of one dual RAID controller tray and 11 expansion trays in one cabinet (see FIGURE 1-6) or up to 14 expansion trays across two cabinets.

The 6540 Array can be shipped as independent components or in a fully-racked and cabled environment. This section contains an overview of the Sun StorageTek 6540 Array hardware and software.


FIGURE 1-1 Sun StorageTek 6540 Array Product Overview


Hardware Overview

Each expansion tray can contain 5 to 16 disk drives, allowing the array to support up to 224 Fibre Channel (FC) or Serial Advanced Technology Attachment (SATA) disk drives.

This section describes the main components of the Sun StorageTek 6540 Array controller and expansion trays.

Sun Rack 1000-38 Cabinet

The Sun Rack 1000-38 cabinet is 39.4 inches (1000 mm) deep, 23.5 inches (59.7 cm) wide, and 74 inches (188 cm) tall. The cabinet has an empty weight of 360 pounds (163.3 kilograms) and a fully loaded weight of 1625 pounds (737 kilograms). The cabinet includes the Sun Power Distribution System (PDS), which provides a high-current, sequenced power system. The cabinet front and rear doors give you immediate access to hardware, cabling, and LEDs. The vertical cable management bracket and the cable management arms keep the cables organized for easy tracing and mobility.

The Sun PDS resides in the cabinet frame but does not occupy space that otherwise would be used for expansion trays. The PDS consists of two independently powered sequencers and two power outlet strips, each with 24 outlets. Therefore, it provides 48 outlets, in ten separate switched and two unswitched zones. Four 20-amp circuits are required to power the four power cords to the rack. Each circuit must provide 180 to 264 VAC at 47 to 63 Hz.

Controller Tray Components

The 6540 controller tray contains two redundant array of independent disks (RAID) controllers, which operate independently and provide failover capability for the data and management paths. The controller tray is configured for FC connections to disk drives and trays, and provides RAID functionality and caching.

The controller tray has two power supply and fan compartments, and a battery backup compartment in which batteries are housed to retain cache memory in the event of a power failure. The backup batteries are accessed from a removable panel in the interconnection module.

TABLE 1-1 summarizes the controller tray configuration.


TABLE 1-1 Sun StorageTek 6540 Array
Controller Tray

Description

Quantity

FC RAID controllers

2

Ethernet ports for management host connections

4 (2 per controller)

4/2/1 Gbps FC host ports with SFPs

8 (4 per controller)

4/2/1 Gbps FC expansion ports

4 (2 per controller)

Power supply/fan assemblies

2

Battery backup compartments

2


Fibre Channel RAID Controllers

The SCSI RAID controllers communicate using the FC protocol to provide RAID and caching functionality. Each controller is hot-swappable. A battery that is housed in the controller tray interconnection module enables the controller to retain cache memory in the event of a power failure.

Power Supply Units

The power supplies provide hot-swappable, redundant power and cooling to the controller tray. Each power supply gets its power from an AC cord that is plugged into a RAID controller. The fans within the power supply are powered from the controller tray interconnection module. This regulates the environment so that the loss of AC or DC power from a single power supply does not affect the power to either set of fans.

Interconnection Module

The interconnection module is a hot-swappable unit that provides redundant connections between the two RAID controllers. If a power supply were to fail, the redundant connection through the interconnection module would continue to supply power to both controllers from the remaining power supply.

Although hot-swappable, the interconnection module itself is not redundant. If it is removed, the system will not go off line, but system performance will be impacted.

Write cache mirroring and access to redundant loops on the back end are accomplished through the interconnection module. If the interconnection module is removed, the system switches cache to write-through mode and fails over all volumes to one controller. That controller continues to have access to all disk drives and continues to service I/O using half of the backend loops.

The system remains in this mode until the interconnection module is replaced, at which time the system automatically reverts back to normal operations.

Battery Backup

Battery backups supply power to the cache of both RAID controllers. A single controller tray battery pack is capable of supplying enough power to maintain data in cache for up to seven days.

Every system is shipped with redundant battery packs, which can support and maintain up to 4 Gbytes of cache memory per controller (8 Gbytes per system) for up to seven days, or up to 8 Gbytes of cache per controller (16 Gbytes per system) for up to three days. A single battery pack is capable of supporting and maintaining up to 2 Gbytes of cache per controller (4 Gbytes per system) for up to seven days.

Controller Tray LEDs

FIGURE 1-2 shows the LEDs and components at the front of the controller tray with the bezel on.


FIGURE 1-2 Controller Tray (Front View)




FIGURE 1-3 shows the location of the power cooling units and the battery compartments at the front of the controller tray with the bezel off.



Note - A tray LED icon may not be visible unless the LED is illuminated.



FIGURE 1-3 Power Cooling Units and Battery



TABLE 1-2 describes the LEDs on the power cooling units and the battery interconnection unit.


TABLE 1-2 Controller Tray LEDs (Front)

LED/Indicator

Description


Service Action Allowed

Steady blue indicates that service action can be taken on the power supply without adverse consequences. Off indicates that the power supply is engaged and service should not be implemented.


Service Action Required

Steady amber indicates that the power supply requires service. Off indicates that the battery does not require service.


Battery Status

Power Cooling Units:

Steady green indicates that the battery is fully charged. A slow blink indicates that the battery is charging. Off indicates that the battery is discharged or off.

Battery Interconnect Unit:

Amber indicates that the battery is missing or has failed. Off indicates status is normal.


OK/Power

Steady green indicates that power is applied to the tray and the tray is functioning normally. Off indicates that power is not applied to the tray. Flash indicates that normal activity is in progress.


Alarm Cancel button

Reserved for canceling audio alarm. This function is not currently supported. Use the management software to review alarms and events.


DC

On indicates that the correct DC power is being supplied from the controller power supply.


AC

On indicates that AC power is being supplied to the controller power supply.



FIGURE 1-4 shows the ports at the back of the controller tray.

FIGURE 1-4 Controller Tray Ports (Back)


TABLE 1-3 describes the controller tray ports. All Controller A ports are inverted from the Controller B ports.


TABLE 1-3 Controller Tray Ports (Back)

Ports

Description

Host ports
(Ch1 - Ch4)

Four 4-, 2-, or 1-Gbit/second FC ports with Small Form-factor Pluggable (SFP) transceivers. Host port Ch4 is reserved for remote replication if you are licensed for remote replication and it is activated; otherwise, host port Ch4 is available for use.

Ethernet ports
(1 and 2)

RJ-45 Ethernet ports. Ethernet port 1 is used for out-of-band management of the RAID controller. An internal Ethernet device provides 10 Mbit/second and 100 Mbit/second full-duplex connectivity. Ethernet port 2 has limited functionality and is reserved for future use.

Drive ports
(P1, P2, P3, P4)

Four connections to the two 4-, 2-, or 1-Gbit FC ports that are used to connect to the expansion tray drives.

Serial port

Port that allows terminal access for display or configuration of the controller IP addresses. Also, allows you to clear the local array password.



FIGURE 1-5 shows the controller tray LEDs and
indicators.

FIGURE 1-5 Controller Tray LEDs and Indicators (Back
View)



TABLE 1-4 describes the LEDs and indicators at the back of the controller tray. All Controller A LEDS are inverted from the Controller B LEDs.


TABLE 1-4 Controller Tray LEDs and
Indicators (Back)

LED/Indicator

Description


DC

On indicates that the correct DC power is being supplied from the controller power supply.


Service Action Required

Steady amber indicates that the power supply requires service. Off indicates that the power supply does not require service.


AC

On indicates that AC power is being supplied to the controller power supply.

ID/Diag display

Seven-segment readouts indicate the ID of the tray. Also provides diagnostic information, such as the number 85, which indicates all is well. Contact Sun Customer Service for additional information.

Cache Active



Steady green indicates that data is in the cache. Off indicates that all data has been written to disk and the cache is empty.


Service Action Allowed

Steady blue indicates that service action can be taken on the controller without adverse consequences. Off indicates that the controller is engaged and service action should not be implemented.

Controller Indicators


Host Port Rate

The combined display indicates the host port link rate for the tray:

  • LED 1 On, LED 2 On - 4 Gbits/second
  • LED 1 Off, LED 2 On - 2 Gbits/second
  • LED 1 On, LED 2 Off - 1 Gbits/second

Expansion Port Rate

The combined display indicates the expansion port link rate for the tray:

  • LED 4 On, LED 2 Off - 4 Gbits/second
  • LED 4 Off, LED 2 On - 2 Gbits/second

The LEDs display as follows:

W X Y Z

Each pair of drive ports (ports 1 and 2 are one pair, and ports 3 and 4 are the other pair) W and Z LEDs indicate whether or not the port is by-passed (amber); the X and Y LEDs indicate the speed of this pair of drive ports. If the Y LED is the only one lit, it represents 2Gb/sec. If both X and Y are lit, it represents 4Gb/sec.


Expansion Port Bypass

Steady amber indicates that no valid device is detected and that the drive port is bypassed. Off indicates that there is no SFP transceiver installed or that the port is enabled.

Ethernet Link Activity

Steady green indicates that there is an active connection. Off indicates that there is not an active connection.

Ethernet Link Speed

Steady green indicates that there is a 100BaseTX connection to the port. Off (when the Ethernet Status LED is on) indicates that there is a 10BaseT connection to the Ethernet port.


Controller LED Status Codes

The following is a list of the status codes and descriptions that may display on the numerical LEDs on the controller.

FF - ESM/IOM Boot Diagnostic executing

88 - This ESM/IOM is being held in Reset by the other ESM/IOM

AA - ESM/IOM-A application is booting up

bb - ESM/IOM-B application is booting up

L0 - Mismatched ESM/IOM types

L2 - Persistent memory errors

L3 - Persistent hardware errors

L9 - Over Temperature

H1 - SFP Speed Mismatch (2 Gb/s SFP installed when operating at 4 Gb/s)

H2 - Invalid/Incomplete Configuration

H3 - Maximum Reboot Attempts Exceeded

H4 - Cannot Communicate with Other ESM/IOM

H5 - Midplane Harness Failure

H6 - Firmware Failure

H7 - Current Enclosure Fibre Channel Rate Different than Rate Switch

H8 - SFP(s) Present in Currently Unsupported slot (2A or 2B)

Controller FRU Handle Can Be Hazardous


caution icon Caution - Be careful using the FRU handle on the controller tray. It can snap shut when pushed hard during reinsertion, pinning fingers between the tray and handle edges.


Sharp Edges on Chassis


caution icon Caution - On both the controller and expansion trays, the rear of the chassis has very sharp edges.


Expansion Tray

An expansion tray (Common Storage Module 200 also known as CSM2) is directly attached by an FC loop to a controller tray and cannot operate independently. The expansion trays are connected to the RAID controllers in a controller tray using the drive port connections.

Should you need multiple expansion trays in a configuration, you can connect them together using FC cables. You can add up to 14 expansion trays (four sets of three or four expansion trays per set) to each controller tray.

Expansion trays are built from a 3 RU chassis and include power supplies and disk drives. Each expansion tray has two Fibre Channel Arbitrated Loop (FCAL) switch cards, one for each back-end loop.

In addition, each expansion tray is connected to the tray above and the tray below it by two FC cables. The FCAL switch performs trunking operations, which increases performance by opening multiple threads through the switch at one time.

Refer to Installing and Cabling Trays for details on expansion tray cabling.

TABLE 1-5 describes the expansion tray configuration.


TABLE 1-5 Sun StorageTek 6540 Array
Expansion Tray

Description

Quantity

FC or SATA II disk drives

FC hard disk drives: 73G10K, 73G15K, 146G10K, 146G15K, 300G10K

5-16 4-, 2-, or 1-Gbit/second drives.

 

SATA II hard disk drives: 500G7.2K

5-16 3-Gbit/second drives with circuitry to support operation in either a 4-, 2-, or 1-Gbit/second environment.

Drive expansion ports

One pair per controller. Ports 2A and 2B are disabled, reserved for future use.

Power supply/fan assemblies

2


FIGURE 1-6 shows the ports and components at the back of the expansion tray.


FIGURE 1-6 Expansion Tray Ports and Components (Back)

TABLE 1-6 describes the ports and components at the back of the expansion tray.


TABLE 1-6 Expansion Tray Ports and
Components (Back)

Ports/Components

Description

Expansion ports
1A (In), 1B (Out)

Two 4-, 2-, or 1-Gbit/second FC ports used to connect to a controller tray and additional expansion trays.

Power supplies

For each expansion tray, two power supplies that provide redundant power to the tray. If one power supply fails, the tray is powered by the remaining power supply.

Reserved expansion ports

Reserved for future use.


FIGURE 1-7 shows the LEDs at the back of the expansion tray.


FIGURE 1-7 Expansion Tray LEDs and Indicators (Back)


TABLE 1-7 describes the LEDs and indicators at the back of the expansion tray.


TABLE 1-7 Expansion Tray LEDs and
Indicators (Back)

LED/Indicator

Description

Power Supply LEDs


DC

On indicates that the correct DC power is being supplied from the controller power supply.


Service Action Required

Steady amber indicates that the power supply requires service. Off indicates that the power supply does not require service.


Service Action Allowed

Steady blue indicates that service action can be taken on the power supply without adverse consequences. Off indicates that the power supply is engaged and service action should not be implemented.


AC

On indicates that AC power is being supplied to the controller power supply.

Expansion Tray LEDs

ID/Diag display

Seven-segment readouts indicate the ID of the tray. Also provides diagnostic information, such as the number 85, which indicates all is well. Contact Sun Customer Service for additional information.


Locate

Steady white indicates that the controller has been identified.


Service Action Required

Steady amber indicates that the controller requires service. Off indicates that the controller does not require service.


Service Action Allowed

Steady blue indicates that service action can be taken on the controller without adverse consequences. Off indicates that the controller is engaged and service action should not be implemented.

Expansion Tray Indicators


Expansion Port Rate

The combined display indicates the expansion port link rate for the tray:

  • LED 4 On, LED 2 Off - 4 Gbits/second
  • LED 4 Off, LED 2 On - 2 Gbits/second

The LEDs display as follows:

W X Y Z

For each pair of drive ports (ports 1 and 2 are one pair, and ports 3 and 4 are the other pair) W and Z LEDs indicate whether or not the port is by-passed (amber); the X and Y LEDs indicate the speed of this pair of drive ports. If the Y LED is the only one lit, it represents 2Gb/sec. If both X and Y are lit, it represents 4Gb/sec.


Expansion Port Bypass

Steady amber indicates that no valid device is detected and that the drive port is bypassed. Off indicates that there is no SFP installed or that the port is enabled.


Software Overview

The Sun StorageTek 6540 Array is managed by the Sun StorageTek Common Array Manager software. This software delivered on CD and consists of the tools described in the following topics:

You specify the functionality you require, and the CD installs the necessary software.

Management Software

The web-based management software is the primary interface for configuring, managing, monitoring, and diagnosing the array. The management software consists of a suite of tools that you install on an external management host. The management host can be a Sun system running the Solaris 8, 9, or 10 Operating System (OS), or an x86 or x64 system running Solaris, or Windows 2000, 2003, or XP.

The management software enables the storage administrator to manage the array from any system with a web browser that is on the same network as the management host. For a list of supported browsers, see the release notes.

The management software enables monitoring and diagnostic tasks on the array. You can configure the software to monitor on a 24-hour basis, collecting information that enhances the reliability, availability, and serviceability (RAS) of the array.

The management software records alerts and notifications, which you can monitor by displaying the log file. It also automates the transmission of alerts, which can be sent to an email address, to a pager, or to diagnostic software running on a management host on the network.

Finally, the management software enables you to run diagnostic tests to troubleshoot problems and access Service Advisor for instruction on replacing field-replaceable units (FRUs).

Service Advisor and Field-Replaceable Units

Field-replaceable units (FRUs) can be replaced by Sun field engineers or by Sun-trained customer administrators. To see a list of the hardware components that can be replaced at the customer site refer to Service Advisor in the Sun StorageTek Common Array Manager software.

The Service Advisor also provides information and procedures for replacing array components.

Remote CLI Client

You can also manage and configure storage for the array using the remote command-line interface (CLI) client. The CLI provides the same control and monitoring capability as the web browser, and it is also scriptable for running frequently performed tasks.

The remote CLI client is available for Solaris operating system (OS) and several other operating systems. See the release notes for a list of supported operating system platforms. For more information about the CLI commands, see the sscs man page.

Remote management software is installed on the management host automatically.

Data Host Software

The array data host software controls the data path between the data host and the array. The data host software consists of the following tools:

Data host software enables Solaris 8, Solaris 9, and Solaris 10 workstations and Windows XP and NT operating systems to communicate with the array.

You can obtain the data host software from Sun’s Download Center. Refer to the Sun StorageTek 6540 Array Release Notes (part number 819-6521-nn) for additional data host software information.

Sun StorageTek 6540 Shipping Kit

Following is a list of the current 6540 shipping kit. In case of any changes, refer to the Sun StorageTek 6450 Array Release Notes (819-6521-nn) for the latest list.

Sun StorageTek Common Array Manager CD

Sun StorageTek 6450 Array Hardware Installation Guide (819-6461-nn)

Sun StorageTek Common Array Manager Software Installation Guide (819-7035-nn)

Sun StorageTek 6130, 6140, and 6540 Arrays sscs(1M) CLI Quick Reference (819-7038-nn)

Important Safety Information for Sun Hardware Systems (816-7190-nn)

Software License Agreement (819-0764-nn)

Next Generation Rail Shipping Kit

Following is a list of the current Next Generation Rail shipping kit for the Sun Rack 1000-38. In case of any changes, refer to the Sun StorageTek 6450 Array Release Notes (819-6521-nn) for the latest list.

Wrench for the pallet tie down brackets

3 mm, 5 mm, and 6 mm allen wrenches

Deep-head socket wrench, double-ended

#3 Phillips screwdriver bit, 1/4-inch, 50 mm

M6x12mm screws

10-32x1/2-inch screws

4-40x3/16-inch Phillips screws

M5 Plastic cage nuts

#10 washers

10-32 lock nuts

Door hinge pin

Velcro tie wrap

Sun Rack Service Manual (816-6387-nn)

Sun Rack Safety and Regulatory Compliance Information (816-7885-nn)


Overview of the Installation Process

Before you install the 6540 Array, you must do the following:

The following checklist (TABLE 1-8) outlines all of the tasks required for installing the Sun StorageTek 6540 Array and tells you where you can find detailed procedures. To ensure a successful installation, perform the tasks in the order in which they are presented, according to your situation, either individual components or a fully-racked environment.


TABLE 1-8 Sun StorageTek 6540 Array
Installation Checklist

Step

Installation Task

Where to Find Procedure

  1.  

Unpack the cabinet and move it into position.

Unpacking guide attached to the outside of the shipping carton

  1.  

Attach the power cables to the power source.

Connecting the Power Cables

  1.  

Connect the Ethernet port to your network.

Refer to Connecting the Management Host

  1.  

Connect the management host.

Connecting the Management Host

  1.  

Attach the host interface cables.

Connecting Data Hosts

  1.  

Verify the link rate for each tray.

Verifying the Link Rate and Powering On the Array

  1.  

Turn on the power.

Powering On the Array

  1.  

Configure IP addresses for both array controllers using the serial console port, as necessary.

Configuring Static IP Addressing

  1.  

Install the management host software on host systems.

Sun StorageTek Common Array Manager Software Installation Guide



Next Steps

Now you are ready to install rails in a rack, install trays in the rack, and cable the trays, as described in Chapter 2.