Chapter 2 Maintaining Sun StorEdge 3310 and 3320 SCSI RAID Arrays

This chapter describes the procedures about how to maintain Sun^TM StorEdge^TM 3310 and 3320 SCSI RAID arrays in a Sun^TM Cluster environment.

Read the entire procedure before you perform any steps within a procedure in this chapter. If you are not reading an online version of this document, ensure that you have the books listed in Preface available.

This chapter contains the following procedures.

• How to Remove a RAID Storage Array

• How to Replace a Controller

• How to Replace an I/O Module

• How to Replace a Terminator Module

• How to Replace a Host Adapter

Maintaining RAID Storage Arrays

This section contains the procedures about how to maintain a RAID storage array in a Sun Cluster environment. Maintenance tasks in Table 2–1 contain cluster-specific tasks. Tasks that are not cluster-specific are referenced in a list following the table.

When you upgrade firmware on a storage device or on an enclosure, redefine the stripe size of a LUN, or perform other LUN operations, a device ID might change unexpectedly. When you perform a check of the device ID configuration by running the scdidadm -c command, the following error message appears on your console if the device ID changed unexpectedly.

device id for nodename:/dev/rdsk/cXtYdZsN does not match physical 
device's id for ddecimalnumber, device may have been replaced.

To fix device IDs that report this error, run the scdidadm -R command for each affected device.

Sun StorEdge 3310 and 3320 RAID Array FRUs

The following is a list of administrative tasks that require no cluster-specific procedures. See the Sun StorEdge 3000 Family FRU Installation Guide for instructions on replacing the following FRUs.

• Replace a disk drive

• Replace an AC or DC power supply and fan module

• Replace a battery

• Replace an LED and reset switch module

• Replace an EMU module

How to Remove a RAID Storage Array

Use this procedure to remove a RAID storage array from a running cluster.

This procedure removes all data that is on the RAID storage array that you remove.

Before You Begin

This procedure assumes that your nodes are not configured with dynamic reconfiguration functionality. If your nodes are configured for dynamic reconfiguration, see your Sun Cluster Hardware Administration Manual for Solaris OS.

Steps

1. Is one of the disks in the RAID storage array a quorum device? This RAID storage array is the storage array that you are removing.

   # scstat -q

   • If no, proceed to Step 2.

   • If yes, relocate that quorum device to another suitable RAID storage array.

     For procedures about how to add and remove quorum devices, see your Sun Cluster system administration documentation.

2. If necessary, back up the metadevice or volume.

   For more information, see your Solstice DiskSuite/Solaris Volume Manager or VERITAS Volume Manager documentation.

3. Perform volume management administration to remove the RAID storage array from the configuration.

   If a volume manager does manage the LUN, run the appropriate Solstice DiskSuite/Solaris Volume Manager commands or VERITAS Volume Manager commands to remove the LUN from any diskset or disk group. For more information, see your Solstice DiskSuite/Solaris Volume Manager or VERITAS Volume Manager documentation. See the following paragraph for additional VERITAS Volume Manager commands that are required.

   ---

   Note –

   LUNs that were managed by VERITAS Volume Manager must be completely removed from VERITAS Volume Manager control before you can delete the LUNs from the Sun Cluster environment. After you delete the LUN from any disk group, use the following commands on both nodes to remove the LUN from VERITAS Volume Manager control.

   ---

   # vxdisk offline cNtXdY # vxdisk rm cNtXdY

4. Identify the LUNs that you need to remove.

   # cfgadm -al

5. On all nodes, remove references to the LUNs in the RAID storage array that you removed.

   # cfgadm -c unconfigure cN::dsk/cNtXdY

6. Disconnect the SCSI cables from the RAID storage array.

7. On both nodes, remove the paths to the LUN that you are deleting.

   # devfsadm -C

8. On both nodes, remove all obsolete device IDs (DIDs).

   # scdidadm -C

9. If no other LUN is assigned to the target and LUN ID, remove the LUN entries from /kernel/drv/sd.conf file.

   Perform this step on both nodes to prevent extended boot time caused by unassigned LUN entries.

   ---

   Note –

   Do not remove default t0d0 entries.

   ---

10. Power off the RAID storage array. Disconnect the RAID storage array from the AC power source.

    For the procedure about how to power off a storage array, see the Sun StorEdge 3000 Family Installation, Operation, and Service Manual.

11. Remove the RAID storage array.

    For the procedure about how to remove a storage array, see the Sun StorEdge 3000 Family Installation, Operation, and Service Manual.

12. If necessary, remove any unused host adapters from the nodes.

    For the procedure about how to remove a host adapter, see your Sun Cluster system administration documentation and the documentation that shipped with your host adapter and node.

13. From any node, verify that the configuration is correct.

    # scdidadm -L

How to Replace a Controller

If the RAID storage array is configured with dual controllers, see the Sun StorEdge 3000 Family FRU Installation Guidey for controller replacement procedures. If the RAID storage array is configured with a single controller, perform the procedure below to ensure high availability.

Steps

1. Detach the submirrors on the RAID storage array that are connected to the controller. This controller is the controller that you are replacing. Detach the submirrors to stop all I/O activity to the RAID storage array.

   For more information, see your Solstice DiskSuite/Solaris Volume Manager or VERITAS Volume Manager documentation.

2. Replace the controller.

   For the procedure about how to replace a controller, see the Sun StorEdge 3000 Family Installation, Operation, and Service Manual.

3. Reattach the submirrors to resynchronize the submirrors.

   For more information, see your Solstice DiskSuite/Solaris Volume Manager or VERITAS Volume Manager documentation.

How to Replace an I/O Module

Use this procedure to replace a RAID storage array I/O module.

If your configuration is running in RAID level 0, take appropriate action to prepare the volume manager for the impacted disk to be inaccessible.

Steps

1. Detach the submirrors on the RAID storage array that are connected to the I/O module that you are replacing. Detach the submirrors to stop all I/O activity to the RAID storage array.

   For more information, see your Solstice DiskSuite/Solaris Volume Manager or VERITAS Volume Manager documentation.

2. Disconnect the SCSI cables from the hosts.

3. Disconnect the SCSI cables from the I/O module.

4. Replace the I/O module.

   For the procedure about how to replace the I/O module, see the Sun StorEdge 3000 Family FRU Installation Guide.

5. Reconnect the SCSI cables to the I/O module.

6. Reconnect the SCSI cables to the host.

7. Reattach the submirrors to resynchronize submirrors.

   For more information, see your Solstice DiskSuite/Solaris Volume Manager or VERITAS Volume Manager documentation.

How to Replace a Terminator Module

Use this procedure to replace a RAID storage array terminator module.

If your configuration is running in RAID level 0, take appropriate action to prepare the volume manager for the impacted disk to be inaccessible.

Steps

1. Detach the submirrors on the RAID storage array that are connected to the terminator module that you are replacing. Detach the submirrors to stop all I/O activity to the RAID storage array.

   For more information, see your Solstice DiskSuite/Solaris Volume Manager or VERITAS Volume Manager documentation.

2. Replace the terminator module.

   For the procedure about how to replace the terminator module, see the Sun StorEdge 3000 Family FRU Installation Guide.

3. Reattach the submirrors to resynchronize submirrors.

   For more information, see your Solstice DiskSuite/Solaris Volume Manager or VERITAS Volume Manager documentation.

How to Replace a Host Adapter

Use this procedure to replace a failed host adapter in a running cluster. This procedure defines Node A as the node with the failed host adapter that you are replacing.

Before You Begin

This procedure relies on the following prerequisites and assumptions.

• Except for the failed host adapter, your cluster is operational and all nodes are powered on.

• Your nodes are not configured with dynamic reconfiguration functionality.

  If your nodes are configured for dynamic reconfiguration and you are using two entirely separate hardware paths to your shared data, see the Sun Cluster Hardware Administration Manual for Solaris OS and skip steps that instruct you to shut down the cluster.

  If you are using a single, dual-port HBA to provide the connections to your shared data, you cannot use dynamic reconfiguration for this procedure. Follow all steps in the procedure. For the details on the risks and limitations of this configuration, see Configuring Cluster Nodes With a Single, Dual-Port HBA in Sun Cluster 3.0-3.1 Hardware Administration Manual for Solaris OS.

Steps

1. Determine the resource groups and device groups that are running on Node A.

   Record this information because you use this information in Step 11 of this procedure to return resource groups and device groups to Node A.

   # scstat

2. Record the details of any metadevices that are affected by the failed host adapter.

   Record this information because you use it in Step 10 of this procedure to repair any affected metadevices.

3. Move all resource groups and device groups off Node A.

   # scswitch -S -h nodename

4. Shut down Node A.

   For the full procedure about how to shut down and power off a node, see your Sun Cluster system administration documentation.

5. Power off Node A.

6. Replace the failed host adapter.

   For the procedure about how to remove and add host adapters, see the documentation that shipped with your nodes.

7. Do you need to upgrade the node's host adapter firmware?

   • If yes, boot Node A into noncluster mode. Proceed to Step 8.

     For more information about how to boot nodes, see your Sun Cluster system administration documentation.

   • If no, proceed to Step 9.

8. Upgrade the host adapter firmware on Node A.

   PatchPro is a patch-management tool that eases the selection and download of patches required for installation or maintenance of Sun Cluster software. PatchPro provides an Interactive Mode tool especially for Sun Cluster. The Interactive Tool makes the installation of patches easier. PatchPro's Expert Mode tool helps you to maintain your configuration with the latest set of patches. Expert Mode is especially useful for obtaining all of the latest patches, not just the high availability and security patches.

   To access the PatchPro tool for Sun Cluster software, go to http://www.sun.com/PatchPro/, click Sun Cluster, then choose either Interactive Mode or Expert Mode. Follow the instructions in the PatchPro tool to describe your cluster configuration and download the patches.

   For third-party firmware patches, see the SunSolve^SM Online site at http://sunsolve.ebay.sun.com.

9. Boot Node A into cluster mode.

   For more information about how to boot nodes, see your Sun Cluster system administration documentation.

10. Perform any volume management procedures that are necessary to fix any metadevices affected by this procedure, as you identified in Step 2.

    For more information, see your volume manager software documentation.

11. Return the resource groups and device groups you identified in Step 1 to Node A.

    # scswitch -z -g resource-group -h nodename # scswitch -z -D device-group-name -h nodename

    For more information, see your Sun Cluster system administration documentation.