Sun StorageTek 5320 NAS Appliance and Gateway System Getting Started Guide

This chapter provides comprehensive instructions for connecting the Sun StorageTek 5320 NAS Cluster Appliance, the Sun StorEdge 5300 RAID Controller Enclosures (CUs), and the optional Sun StorEdge 5300 Expansion Enclosures (EUs). It also provides initial configuration instructions for the system.

This chapter contains the following sections:

• Before You Begin
• Connecting the Sun StorageTek 5320 NAS Cluster Appliance to Back-End Storage
• Connecting the Server Health-Monitoring and Network Cables
• Powering On the Sun StorageTek 5320 NAS Cluster Appliance, Controller Enclosures, and Expansion Enclosures
• Initial Sun StorageTek 5320 NAS Cluster Appliance Configuration

---

Before You Begin

Before connecting the system, you must install the units in the rack. Refer to Installing Servers and Back-End Storage for rackmount instructions.

---

Connecting the Sun StorageTek 5320 NAS Cluster Appliance to Back-End Storage

This section describes how to cable the Sun StorageTek 5320 NAS Cluster Appliance to the controller enclosures and the controller enclosure to the optional expansion enclosures for several different configurations.

This section includes the following tasks:

• Connecting the Sun StorageTek 5320 NAS Cluster Appliance to Controller Enclosures
• Connecting the Controller Enclosures to Expansion Enclosures

Connecting the Sun StorageTek 5320 NAS Cluster Appliance to Controller Enclosures

The Sun StorageTek 5320 NAS Cluster Appliance and the controller enclosures (CUs) each connect with a pair of optical fiber cables. Optical SFP transceivers have been installed in the controller enclosures' host ports to interface with the optical fiber cable's LC connectors. Refer to FIGURE 4-1 for port locations.

FIGURE 4-1 Sun StorageTek 5320 NAS Cluster Appliance HBA Cards and Controller Enclosure Ports

This section contains details on the following:

• To Connect One Controller Enclosure
• To Connect Two Controller Enclosures

Use the instructions in this section if you are connecting one controller enclosure to the Sun StorageTek 5320 NAS Cluster Appliance.

1. Connect the HBA port 1 of the first HBA card on the Sun StorageTek 5320 NAS Cluster Appliance server H1 to the Controller A host 1 port.

2. Connect the HBA port 1 of the second HBA card on the Sun StorageTek 5320 NAS Cluster Appliance server H1 to the Controller B host 1 port.

3. Connect the HBA port 1 of the first HBA card on the Sun StorageTek 5320 NAS Cluster Appliance server H2 to the Controller A host 2 port.

4. Connect the HBA port 1 of the second HBA card on the Sun StorageTek 5320 NAS Cluster Appliance server H2 to the Controller B host 2 port.

FIGURE 4-2 Connecting Pairs of HBA Cards to One Controller Enclosure

Use the instructions in this section and refer to FIGURE 4-3 and FIGURE 4-4 if you are connecting two controller enclosures to the Sun StorageTek 5320 NAS Cluster Appliance.

Caution - One array can contain Fibre Channel disk drives in the controller enclosure and expansion enclosures and the other array can contain SATA disk drives in the expansion enclosures only. However, you cannot mix EU F (Fibre Channel) and EU S (SATA) expansion enclosures attached to a controller enclosure.

1. Connect the HBA port 2 of the first HBA card on the Sun StorageTek 5320 NAS Cluster Appliance server H1 to the Controller A host 1 port on the first controller enclosure.

2. Connect the HBA port 1 of the first HBA card on the Sun StorageTek 5320 NAS Cluster Appliance server H1 to the Controller B host 1 port on the second controller enclosure.

3. Connect the HBA port 2 of the second HBA card on the Sun StorageTek 5320 NAS Cluster Appliance server H1 to the Controller B host 1 port on the first controller enclosure.

4. Connect the HBA port 1 of the second HBA card on the Sun StorageTek 5320 NAS Cluster Appliance server H1 to the Controller A host 1 port on the second controller enclosure.

FIGURE 4-3 Connecting the Sun StorageTek 5320 NAS Cluster Appliance to Two Controller Enclosures

5. Connect the HBA port 2 of the first HBA card on the Sun StorageTek 5320 NAS Cluster Appliance server H2 to the Controller A host 2 port on the first controller enclosure.

6. Connect the HBA port 1 of the first HBA card on the Sun StorageTek 5320 NAS Cluster Appliance server H2 to the Controller B host 2 port on the second controller enclosure.

7. Connect the HBA port 2 of the second HBA card on the Sun StorageTek 5320 NAS Cluster Appliance server H2 to the Controller B host 2 port on the first controller enclosure.

8. Connect the HBA port 1 of the second HBA card on the Sun StorageTek 5320 NAS Cluster Appliance server H2 to the Controller A host 2 port on the second controller enclosure.

Connecting the Controller Enclosures to Expansion Enclosures

Each controller enclosure uses Controller A and Controller B expansion ports to connect to FC-AL ports at the back of an expansion enclosure (FIGURE 4-4).

FIGURE 4-4 Controller Enclosure and Expansion Enclosure Ports

[ D ]

The controller enclosures and the expansion enclosures connect with a pair of Active Copper cables. These copper cables have transceiver electronics built into their connector ends. They plug directly into the SFP ports of the controllers and expansion enclosures.

Caution - One array can contain Fibre Channel disk drives in the controller enclosure and expansion enclosures and the other array can contain SATA disk drives in the expansion enclosures only. However, you cannot mix EU F (Fibre Channel) and EU S (SATA) expansion enclosures attached to a controller enclosure.

The cabling differs depending on the number of expansion enclosures you are connecting:

• For one expansion enclosure, refer to To Cable a Controller Enclosure to One Expansion Enclosure.
• For two expansion enclosures, refer to To Cable a Controller Enclosure to Two Expansion Enclosures.
• For three expansion enclosures, refer to To Cable a Controller Enclosure to Three Expansion Enclosures.
• For four to seven expansion enclosures, refer to To Cable a Controller Enclosure to Seven Expansion Enclosures.

To connect a controller enclosure and one expansion enclosure, two 2-meter Active Copper cables are required. Refer to FIGURE 4-5.

FIGURE 4-5 Controller Enclosure and One Expansion Enclosure Cable Interconnection

1. Connect one Active Copper cable between the A side expansion port of the controller enclosure and the A side port 1 of the expansion enclosure.

2. Connect one Active Copper cable between the B side expansion port of the controller enclosure and the B side port 2 of the expansion enclosure.

To connect a controller enclosure and two expansion enclosures, four 2-meter Active Copper cables are required. Refer to FIGURE 4-6.

FIGURE 4-6 Controller Enclosure and Two Expansion Enclosures Cable Interconnection

Caution - Do not mix EU F (Fibre Channel) and EU S (SATA) expansion enclosures attached to a controller enclosure.

1. Connect one Active Copper cable between the A side expansion port of the controller enclosure and the A side port 1 of expansion enclosure 1.

2. Connect one Active Copper cable between the A side port 2 of expansion enclosure 1 and the A side port 1 of expansion enclosure 2.

3. Connect one Active Copper cable between the B side expansion port of the controller enclosure and the B side port 2 of expansion enclosure 2.

4. Connect one Active Copper cable between the B side port 1 of expansion enclosure 2 and the B side port 2 of expansion enclosure 1.

To connect a controller enclosure and three expansion enclosures, six 2-meter Active Copper cables are required. Refer to FIGURE 4-7.

FIGURE 4-7 Controller Enclosure and Three Expansion Enclosures Cable Interconnection

Caution - Do not mix EU F (Fibre Channel) and EU S (SATA) expansion enclosures attached to a controller enclosure.

1. Connect one Active Copper cable between the A side expansion port of the controller enclosure and the A side port 1 of expansion enclosure 1.

2. Connect one Active Copper cable between the A side port 2 of expansion enclosure 1 and the A side port 1 of expansion enclosure 2.

3. Connect one Active Copper cable between the A side port 2 of expansion enclosure 2 and the A side port 1 of expansion enclosure 3.

4. Connect one Active Copper cable between the B side expansion port of the controller enclosure and B side port 2 of expansion enclosure 3.

5. Connect one Active Copper cable between the B side port 1 of expansion enclosure 3 and the B side port 2 of expansion enclosure 2.

6. Connect one Active Copper cable between the B side port 1 of expansion enclosure 2 and the B side port 2 of expansion enclosure 1.

To connect a controller enclosure and seven expansion enclosures, fourteen 2-meter Active Copper cables are required. Refer to FIGURE 4-8.

FIGURE 4-8 Controller Enclosure and Seven Expansion Enclosures Cable Interconnection

Caution - Do not mix EU F (Fibre Channel) and EU S (SATA) expansion enclosures attached to a controller enclosure.

1. Connect one Active Copper cable between the A side expansion port of the controller enclosure and the A side port 1 of expansion enclosure 1.

2. Connect one Active Copper cable between the A side port 2 of expansion enclosure 1 and the A side port 1 of expansion enclosure 2.

3. Continue to connect one Active Copper cable between the A side port 2 of each expansion enclosure and the A side port 1 of the expansion enclosure directly below it, until the A sides of all expansion enclosures are interconnected with Active Copper cables.

4. Connect one Active Copper cable between the B side expansion port of the controller enclosure and the B side port 2 of expansion enclosure 7.

5. Connect one Active Copper cable between the B side port 1 of expansion enclosure 7 and the B side port 2 of expansion enclosure 6.

6. Continue to connect one Active Copper cable between the B side port 1 of each expansion enclosure and the B side port 2 of the expansion enclosure directly above it, until the B sides of all expansion enclosures are interconnected with Active Copper cables.

---

Connecting the Server Health-Monitoring and Network Cables

Each server in a Sun StorageTek 5320 NAS Cluster Appliance uses a dedicated Ethernet connection to communicate with its partner and perform periodic "health checks." The port used for the health check connection is referred to as the heartbeat port. The NET0 Gigabit Ethernet port is used for the heartbeat.

The Sun StorageTek 5320 NAS Cluster Appliance is commonly configured with two Gigabit Ethernet cards (FIGURE 4-9).

FIGURE 4-9 Connecting to an Optical Gigabit Ethernet Network

Use a Cat5 Ethernet cable to connect the two servers' NET0 heartbeat ports.

You must have a second optical Gigabit Ethernet card installed.

Connect an FC cable from the network to the top (LINK A) and connect another FC cable from the network to the bottom (LINK B) optical Gigabit Ethernet connector on the back of each of the Sun StorageTek 5320 NAS Cluster Appliance servers.

Later, when you configure the system (see Initial Sun StorageTek 5320 NAS Cluster Appliance Configuration), the ports will be identified on the LCD as shown in TABLE 4-1.

If your system is configured for Fast Ethernet or Gigabit Ethernet networking, refer to FIGURE 4-9 for NIC port locations.

To connect the Sun StorageTek 5320 NAS Cluster Appliance to a Fast Ethernet or Gigabit Ethernet network, connect an RJ-45 unshielded twisted-pair cable from your local area network (LAN) to the NET1 port on the back of each of the Sun StorageTek 5320 NAS Cluster Appliance servers. For additional LAN connections, continue to connect in order: NET2 and NET3.

---

Powering On the Sun StorageTek 5320 NAS Cluster Appliance, Controller Enclosures, and Expansion Enclosures

Caution - Always power on the units in the following order: 1. Sun StorEdge 5300 Expansion Enclosures 2. Sun StorEdge 5300 RAID Controller Enclosures 3. Sun StorageTek 5320 NAS Cluster Appliance server H1 (Server H2 will power up during the configuration process.)

Power on the expansion enclosures first, followed by controller enclosures, and then the Sun StorageTek 5320 NAS Cluster Appliance. The redundant power supplies and separate power cords provide fault tolerance if properly connected.

Caution - The expansion enclosures and controller enclosures must always be powered on and properly connected to each other and the Sun StorageTek 5320 NAS Cluster Appliance before the Sun StorageTek 5320 NAS Cluster Appliance. The expansion enclosures must be powered on first, before the controller enclosures and Sun StorageTek 5320 NAS Cluster Appliance. If these instructions are not followed, the system could start slowly.

Caution - When you power off the controller enclosures and expansion enclosures, wait five seconds before you power them back on. If you power the units off and on too quickly, unexpected results can occur.

1. Verify that all cables between the Sun StorageTek 5320 NAS Cluster Appliance, controller enclosures, and expansion enclosures are properly secured according to the instructions in Connecting the Sun StorageTek 5320 NAS Cluster Appliance to Controller Enclosures and Connecting the Controller Enclosures to Expansion Enclosures.

2. Verify that the Cat5 Ethernet cable is connected between the heartbeat ports according to the instructions in Connecting the Server Health-Monitoring and Network Cables.

3. Power on each expansion enclosure by setting the two power supply switches to the On position.

4. Check that all LEDs on the expansion enclosure front panels turn solid green to indicate good operation.

5. Power on each controller enclosure by setting the two power supply switches to the On position.

6. Check that all LEDs on the controller enclosure front panels turn solid green to indicate good operation.

7. Verify that the Sun StorageTek 5320 NAS Cluster Appliance is connected to the network.

8. Power on the server H1 (software serial number ending in "-H1") by using a pen tip or similar implement to press the recessed Power button (FIGURE 4-10).

FIGURE 4-10 Power Button and Front Panel Detail

Caution - Do not power up server H2 until directed in the instructions that follow.

9. Verify server H1 has completed booting up: the LCD should display "QUIET."

10. To complete the power-on sequence, continue with the next section, Initial Sun StorageTek 5320 NAS Cluster Appliance Configuration.

---

Initial Sun StorageTek 5320 NAS Cluster Appliance Configuration

To complete the initial Sun StorageTek 5320 NAS Cluster Appliance configuration, you must specify the following:

• IP addresses
• Basic configuration information
• Failover configuration information
• LUN ownership
• LUN paths

You assign a static IP address using the server H1's LCD panel:

1. Select Menu.

2. Select A. Network Config.

3. Select A. Set Gateway and enter the gateway address.

4. Select C. Set Port-emc2 and enter the IP address, subnet mask, and broadcast address as prompted.

This IP address information is assigned to the first regular (non-heartbeat) LAN port, emc2, on your system.

Caution - Do not change the private IP address on the network port that is used for the HB Port (heartbeat port).

5. Select Escape twice to return to the main menu.

You can edit the port information and assign addresses to other ports in the same way.

6. From server H1's LCD menu, select C. Take All LUNs and press the ENTER button.

7. When prompted to "take all LUNs," press the up arrow button to select "Yes," and press the ENTER or right arrow button to start taking LUNs.

The LCD displays "Taking LUNs" followed by a message "Took n LUNs." After a few seconds, the display returns to the Network Config menu.

8. Select Escape to return to the main menu.

Server H1 is now in the ALONE state.

9. Power on the server H2 (software serial number ending in "-H2") by pressing the recessed Power button.

10. Wait until server H2's LCD display status is QUIET.

11. Use the instructions in Step 1 through Step 5 to assign server H2's IP address and gateway address.

To configure the system using the Web Admin application, follow these instructions:

1. From a client on the same network, open a Java platform-enabled web browser with Java Plug-in and enter the IP address for server H1.

2. Accept the "Applet Security Certificate" and wait until the Web Admin applet is loaded on this system.

3. On the Web Admin login screen, click Apply.

The password can be set later. Refer to the Sun StorageTek 5320 NAS Appliance and Gateway System Administration Guide.

4. On the Set Time and Date panel, select the date, the time, and the time zone, and click Apply. Then click Yes to confirm.

This sets the secure clock to the same time and date. Make sure you set the time and date accurately as you can set the secure clock only once.

5. Read the license agreement in the Configuration wizard dialog box, and click Accept.

6. Click Next in the Welcome dialog box, and proceed with the following steps:

a. From the Select Environment screen, configure Windows, UNIX, or both environments, and click Next to continue.

b. From the Set Server Name screen, type the server name and populate the other fields accordingly, and then click Next.

c. From the Enable Failover screen, select Automatic Failover and Enable Link Failover.

A default value of 60 seconds is assigned in both the Down Timeout and Restore Timeout fields.

d. Type the Partner Configuration Name and the Gateway IP address for server H2 (Partner Name factory default is "head2"), and click Apply.

The information you enter here is used to start server H2. The Partner Name is the host name you want to assign to server H2. Any network information server H2 obtained manually through the LCD panel is displayed here and can be corrected, if necessary.

The field for Private IP should already be populated and should not be changed.

e. Click Next.

f. On the Configure Network Adapters screen, verify that the information is correct.

You can configure additional network interfaces at this time. However, if you change the configuration of the port to which the browser is attached, the browser session is disconnected.

g. Click Next to continue.

h. On the Set Gateway Address screen, verify that the address is correct, and, if not, enter the gateway address. Click Next to continue.

7. For all the other wizard configuration steps, refer to the Sun StorageTek 5320 NAS Appliance and Gateway System Administration Guide for more information.

8. On the Confirmation screen, review the configuration information you have added.

9. Click Finish on the wizard Confirmation screen.

The system configures the settings and indicates that in the Save Configuration screen. It also displays a message that both servers must reboot for the failover changes to be applied.

10. Click Close on the Save Configuration screen.

To finish the configuration process, you must assign LUN ownership for both servers.

1. Launch a new browser window and type server H1's IP address.

2. On the Web Admin login screen, click Apply. A password is not required.

The password can be set later. Refer to the Sun StorageTek 5320 NAS Appliance and Gateway System Administration Guide.

3. From the navigation panel, select High Availability > Recover.

Check the status of the recover process in the logging window (bottom pane).

4. In the Restore RAID Configuration window, assign some of the LUNs to server H2.

5. Click Apply.

6. Click Recover, and the LUNs are distributed between both the servers.

At this point, both servers change to the NORMAL state.

You should assign LUN paths on each server to balance multipath access from each server to each storage controller. You can automatically assign LUN paths using the CLI Auto-assign LUN paths option on the LUN Paths screen, or you can use the Web Admin, as follows:

1. In the Web Admin navigation panel, select High Availability > Set LUN Path.

2. Select a LUN and click Edit.

3. Select the desired controller from the Primary Path drop-down menu.

Evenly divide the assignment of LUNs to the two available paths. For example, the first and third LUN to 1/0 and the second and fourth LUN to 1/1.

4. Click Apply.

Refer to the Sun StorageTek 5320 NAS Appliance and Gateway System Administration Guide for additional information about LUNs and other detailed software setup and use.

For server H2, repeat all steps in To Configure the System with the following exceptions:

• In Step 6 d. in To Configure the System, enter the information for the partner H1 server.
• As you complete the configuration process, there is no message to reboot the servers, since you do not need to reboot the servers

Sun StorageTek 5320 NAS Appliance and Gateway System Getting Started Guide

819-6387-10

Copyright © 2006, Sun Microsystems, Inc. All Rights Reserved.