Sun Cluster 2.2 System Administration Guide

14.3 Administering Sun StorEdge A5000 Disks

This section describes how to add and replace Sun StorEdge A5000 disks in a Sun Cluster configuration.

14.3.1 Adding or Replacing Sun StorEdge A5000 Disks

When adding or replacing Sun StorEdge A5000 disks, be sure to refer to the documentation that came with your system for more information.

Note -

When replacing a failed A5000 disk under SSVM or CVM control, you cannot simply pull out the disk and replace it with a new one. This is because each disk has a unique World Wide Name (WWN). See "11.5 Replacing a SPARCstorage Array Controller and Changing the World Wide Name", for more information about the WWN.

14.3.2 How to Add a Sun StorEdge A5000 Disk (Solstice DiskSuite)

Use the luxadm command to insert the new disk.

Physically install the new disk or disks when prompted. Repeat for each node that is physically connected to the array.
# luxadm insert enclosure.slot

Insert the new disk drive and enter Return.

Use format to create a disk label and repartition, if needed.

Use scdidadm(1M) to discover the new disk and create a DID instance for it.

This should be run from node1 only. See the scdidadm(1M) man page for details.
# scdidadm -r -H node2,node3...
This completes the disk addition procedure.

14.3.3 How to Add a Sun StorEdge A5000 Disk (SSVM or CVM)

Use the luxadm command to prepare the loop for a new device.

Physically install the new disk or disks when prompted.
# luxadm insert

Notify SSVM of the new disk.
# vxdctl enable

Use the vxdiskadm command to bring the new disk(s) into SSVM control.

Enter 1 (Add or initialize one or more disks).

This completes the disk addition procedure.

14.3.4 How to Replace a Sun StorEdge A5000 Disk (Solstice DiskSuite)

Identify all metadevices or applications using the failing disk.

If the metadevices are mirrored or RAID5, the disk can be replaced without stopping the metadevices. Otherwise all I/O to the disk must be stopped using the appropriate commands. For example, use the umount(1M) command to unmount a file system on a stripe or concatenation.

Preserve the disk label, if needed.

For example:

# prvtoc /dev/rdsk/c1t3d0s2 > /tmp/c1t3d0.vtoc

(optional) Use metareplace to replace the disk slices if the disk has not been hot-spared.

For example:
# metareplace d1 c1t3d0s2 c1t2d0s2 d1: device c1t3d0s2 is replaced with c1t2d0s2

Use luxadm -F to remove the disk. The -F is required since Solstice DiskSuite does not offline disks.

Repeat for all hosts, if multihosted. For example:

# luxadm remove -F /dev/rdsk/c1t3d0s2
WARNING!!! Please ensure that no filesystems are mounted on these
 device(s).  All data on these devices should have been backed
 up.The list of devices which will be removed is: 
 1: Box Name "macs1" rear slot 1
 Please enter `q' to Quit or <Return> to Continue: stopping:  Drive
 in "macs1" rear  slot 1....Done
 offlining: Drive in "macs1" rear  slot 1....Done
 Hit <Return> after removing the device(s).

Note -

The FPM icon for the disk drive to be removed should be blinking. In addition, the amber LED under the disk drive should also be blinking.

Remove the disk drive and enter Return.

The output should look similar to the following:

Hit <Return> after removing the device(s). 
 Drive in Box Name "macs1" rear slot 1   
 Removing Logical Nodes: 
 Removing c1t3d0s0 Removing c1t3d0s1 Removing c1t3d0s2 Removing
 c1t3d0s3 Removing c1t3d0s4 Removing c1t3d0s5 Removing c1t3d0s6
 Removing c1t3d0s7 Removing c2t3d0s0 Removing c2t3d0s1 Removing
 c2t3d0s2 Removing c2t3d0s3 Removing c2t3d0s4 Removing c2t3d0s5
 Removing c2t3d0s6 Removing c2t3d0s7#

Repeat for all nodes if the disk array is in a multi-host configuration.

Use the luxadm insert command to insert the new disk.

Repeat for all nodes. The output should be similar to the following:

# luxadm insert macs1,r1
The list of devices which will be inserted is: 
 1: Box Name "macs1" rear slot 1
 Please enter `q' to Quit or <Return> to Continue: Hit <Return>
 after inserting the device(s).

Insert the disk drive and enter Return.

The output should be similar to the following:

Hit <Return> after inserting the device(s).  Drive in Box Name
 "macs1" rear slot 1  Logical Nodes under /dev/dsk and /dev/rdsk :
 c1t3d0s0 c1t3d0s1 c1t3d0s2 c1t3d0s3 c1t3d0s4 c1t3d0s5 c1t3d0s6
 c1t3d0s7 c2t3d0s0 c2t3d0s1 c2t3d0s2 c2t3d0s3 c2t3d0s4 c2t3d0s5
 c2t3d0s6 c2t3d0s7#

Note -

The FPM icon for the disk drive you replaced should be lit. In addition, the green LED under the disk drive should be blinking.

Use scdidadm(1M) to update the DID pseudo device information.

On all nodes connected to the disk, execute the following command to update new Disk ID information.
# scdidadm -R DID_instance
where DID_instance is the instance number of the disk that was replaced. Refer to the scdidadm(1M) man page for more information.

Reboot all nodes connected to the new disk.

To avoid down time, use the haswitch(1M) command to switch ownership of all logical hosts that can be mastered by the node to be rebooted. For example,
# haswitch phys-hahost2 hahost1 hahost2

Label the disk, if needed.

For example:

# cat /tmp/c1t3d0.vtoc | fmthard -s - /dev/rdsk/c1t3d0s2
fmthard:  New volume table of contents now in place.

Replace the metadb, if needed.

For example:

# metadb -d c1t3d0s0; metadb -a c1t3d0s0

Enable the new disk slices with metareplace -e.

For example:
# metareplace -e d0 c1t3d0s0 d0: device c1t3d0s0 is enabled
This completes the disk replacement procedure.

14.3.5 How to Replace a Sun StorEdge A5000 Disk (SSVM or CVM)

Identify all volumes or applications using the failing disk.

If the volumes are mirrored or RAID5, the disk can be replaced without stopping the volume. Otherwise all I/O to the disk must be stopped using the appropriate commands. For example, use the umount(1M) command to unmount a file system on a stripe or concatenation.

Use the vxdiskadm command to replace and offline a disk device.

For SSVM, perform these commands on the machine mastering the logical host owning the disk group.

Enter 4 (Remove a disk for replacement), then enter 11 (Disable [offline] a disk device).

You can also use the graphical user interface if desired.

Use the luxadm command to remove the device and device nodes.

This command is interactive and will prompt you to physically remove the disk. For example:
# luxadm remove_device -F /dev/rdsk/c2t20d0s2
Perform the command on every node connected to the array.

Physically replace the disk, then use the luxadm command to insert the new disk.

This creates the new device and device nodes. For example:
# luxadm insert_device ratbert,r4
Perform the command on every node connected to the array.

Notify the volume manager of the new disk.
# vxdctl enable

Use the vxdiskadm command to bring the new disk into SSVM control.

Enter 5 (Replace a failed or removed disk).

(Optional) The volume can now be restored if needed.

This completes the disk replacement procedure.