test

Platform Notes: Using luxadm Software

Chapter 3 StorEdge A5000 Disk Array Hot-Plugging Procedures

This chapter describes how to hot-plug StorEdge A5000 disk arrays and disk drives. The procedures are grouped depending upon whether you are using UNIX file system (UFS) operations or Sun StorEdge Volume Manager to perform the procedures.

Note -

The procedure for hot-plugging an entire StorEdge A5000 disk array is similar to the procedure for removing and replacing an individual disk drive. Instead of specifying an enclosure,dev, you need to specify only the enclosure in the appropriate procedure.

You cannot perform hot-plug reconfiguration or operations on an active disk drive. All disk access activity must be stopped before you remove or replace a disk drive.

Caution - Caution -

As with other high-RAS products, you should not randomly remove disk drives. The StorEdge A5000 disk array design provides support to replace failed drives in redundant (mirrored or RAID) configurations. If the drive is active, you must stop that activity before removing it. You can do this without bringing down the operating system or powering down the unit. The StorEdge A5000 disk array supports hot-plugging, but there are software considerations that must be taken into account. Follow the procedures in this section when removing, replacing, or adding disk drives.

Refer to the Sun StorEdge A5000 Installation and Service Manual for details on removing disk drives.

It is divided into the following sections:

UNIX File System (UFS) Operations

Adding a Disk Drive

This section describes how to configure your system when you add a disk drive while the power is on and the operating system is running.

Caution - Caution -

These procedures should be performed only by a qualified system administrator. Performing hot-plug operations on an active disk drive can result in data loss and/or data corruption.

You must create a new device entry for the drive in the /devices and /dev/dsk and /dev/rdsk hierarchy. The new drive is assigned a name associated with the slot into which the drive was installed.

  1. Select any available slot in the StorEdge A5000 disk array for the new disk drive.

    For reference when you configure the software environment, make a note of which enclosure and slot you choose.

  2. Use the luxadm insert_device command to add the new device.

    This command is interactive. You will be guided through the procedure for inserting a new device or chain of devices. 

    # luxadm insert_device macs1,f1


The list of devices which will be inserted is:
  1: Box Name "macs1" front slot 1

Please enter 'q' to Quit or <Return> to Continue: 


Hit <Return> after inserting the device(s).

  3. Insert the disk drive and hit return.

    The following is displayed: 

     Drive in Box Name "macs1" front slot 1
  Logical Nodes under /dev/dsk and /dev/rdsk :
	c2t1d0s0
	c2t1d0s1
	c2t1d0s2
	c2t1d0s3
	c2t1d0s4
	c2t1d0s5
	c2t1d0s6
	c2t1d0s7
#

    The new disk drive is now available for use as a block or character device. Refer to the sd(7)man page for further details.

  4. Verify that the device label meets your requirements.

    You can use the prtvtoc command to inspect the label for your disk. To modify the label, use the format command. Refer to the prtvtoc(1M) and format(1M) man pages for more information.

  5. Once you have selected a disk slice for your UFS file system, create a file system on the slice: 

    # newfs /dev/rdsk/cwtxdysz

    Refer to the newfs(1M) man page for more information.

  6. If necessary, create a mountpoint for the new file system:

    # mkdir mount_point

    where: mount_point is a fully qualified path name. Refer to the mount(1M) man page for more information.

  7. After the file system and mountpoint have been created, modify the /etc/vfstab file to reflect the new file system.

    See the vfstab(4) man page for more details.

  8. Mount the new file system using the mount command: 

    # mount mount_point

    where: mount_point is the directory you created.

The file system is ready to be used.

Replacing a Disk Drive

This section describes how on configuring your system to replace a disk drive while the power is on and the operating system is running.

You must stop any activity on the disk; physically remove the old drive and install the new one; and configure the Solaris environment to recognize the drive. You must then configure your application to accept the new disk drive.

Caution - Caution -

These procedures should be performed only by a qualified system administrator. Performing hot-plug operations on an active disk drive can result in data loss and/or data corruption.

Different applications provide various levels of error logging. In general, you can find messages about failing or failed disks in your system console window. The information is also logged in the /usr/adm/messages file(s). See the documentation that came with your application for more information.

Preparing to Replace the Disk Drive

The following procedure describes how to unconfigure a disk being used by one or more UFS file systems.

  1. Stop any application processes on the file systems to be unconfigured.

  2. Back up your system.

  3. Determine what file system(s) are on the disk:

    # mount | grep cwtxdysz

    For example, if the device to be removed is c2t1d0, enter the following:

    # mount | grep c2t3d0
/export/home   (/dev/dsk/c2t1d0s7 ):   98892 blocks   142713 files
/export/home2  (/dev/dsk/c2t1d0s5 ):  153424 blocks   112107 files

  4. Determine and save the partition table for the disk.

    If the replacement disk is the same type as the faulty disk, you can use the format command to save the partition table of the disk. Use the save command in format to save a copy of the partition table to the /etc/format.dat file. This enables you to configure the replacement disk so that its layout matches the current disk.

    Refer to the format(1M) man page for more information.

  5. Unmount any file systems on the disk.

    Note -

    If the file system(s) is on a disk that is failing or has failed, the umount operation may not complete. A large number of error messages may be displayed in the system console and in the /var directory during the umount operation. If the umount operation does not complete, you may have to reboot the system.

    For each file system from Step 3 returned, type:

    # umount filesystem

    where filesystem is the first field for each line returned in Step 3.

    For example:

    # umount /export/home
# umount /export/home2

  6. Using the df command, verify that the file system has been unmounted.

Removing the Disk Drive

  1. Use the luxadm remove_device command to remove the disk.

    The luxadm remove_device command is interactive. You will be guided through the procedure for removing a device or chain of devices. 

    # luxadm remove_device /dev/rdsk/c2t1d0s5


  WARNING!!! Please ensure that no filesystems are mounted
on these device(s).
  All data on these devices should have been backed up.



The list of devices which will be removed is:
  1: Box Name "macs1" front slot 1

Please enter 'q' to Quit or <Return> to Continue: 

stopping:  Drive in "macs1" front slot 1....Done
offlining: Drive in "macs1" front slot 1....Done

Hit <Return> after removing the device(s).
#

  2. Remove the disk drive and then hit any key.

    Note -

    The yellow LED on the designated disk drive(s) should be flashing.

    The following is displayed:

     Drive in Box Name
"macs1" front slot 1

    Removing Logical Nodes: 
	Removing c2t1d0s0
	Removing c2t1d0s1
	Removing c2t1d0s2
	Removing c2t1d0s3
	Removing c2t1d0s4
	Removing c2t1d0s5
	Removing c2t1d0s6
	Removing c2t1d0s7
#

Installing the New Disk Drive

  1. Use the luxadm insert_device command to add the new device.

    This command is interactive. You will be guided through the procedure for inserting a new device or chain of devices. 

    # luxadm insert_device, macs1,f1

The list of devices which will be inserted is:
  1: Box Name "macs1" front slot 1

Please enter 'q' to Quit or <Return> to Continue: 


Hit <Return> after inserting the device(s).

  2. Insert the disk drive and hit Return.

    The following is displayed: 

      Drive in Box Name "macs1" front slot 1
  Logical Nodes under /dev/dsk and /dev/rdsk :
	c2t1d0s0
	c2t1d0s1
	c2t1d0s2
	c2t1d0s3
	c2t1d0s4
	c2t1d0s5
	c2t1d0s6
	c2t1d0s7
#

    The new disk drive is now available for use as a block or character device. Refer to the sd(7) man page for further details.

  3. Verify that the device label meets your requirements.

    You can use the prtvtoc command to inspect the label for your disk. To modify the label, use the format command. See the prtvtoc(1M) and format(1M) man pages for more information.

  4. Verify that the device's partition table satisfies the requirements of the file system(s) you intend to re-create.

    You can use the prtvtoc command to inspect the label for your device. If you need to modify the label, use the format command. Refer to the prtvtoc(1M) and format(1M) man pages for more information. For example:

    # prtvtoc /dev/rdsk/cwtxdysz

    If you have saved a disk partition table using the format utility and the replacement disk type matches the old disk type, then you can use the format utility's partition section to configure the partition table of the replacement disk. See the select and label commands in the partition section.

    If the replacement disk is of a different type than the disk it replaced, you can use the partition size information from the previous disk to set the partition table for the replacement disk. Refer to the prtvtoc(1M) and format(1M) man pages for more information.

  5. Once you have selected a disk slice for your UFS file system, create a file system on the slice:

    # newfs /dev/rdsk/cwtxdysz

  6. Mount the new file system using the mount command:

    # mount mount_point

    where: mount_point is the directory on which the faulty disk was mounted.

The new disk is ready to be used. You can now restore data from your backups.

Removing a Disk Drive

This section describes how to configure your system to remove a disk drive while the power is on and the operating system is running. Use the procedures in this chapter if you do not intend to replace the disk drive.

You must select the disk and stop any activity or applications on it, unmount it, physically remove the drive, and configure the Solaris environment to recognize that the drive is no longer there. You must then configure your application to operate without this device in place.

Caution - Caution -

These procedures should be performed only by a qualified system administrator. Performing hot-plug operations on an active disk drive can result in data loss and/or data corruption.

Preparing to Remove the Disk Drive

The following procedure describes how to unconfigure a disk being used by one or more UFS file systems.

  1. Stop any application processes on the file systems to be unconfigured.

  2. Back up your system.

  3. Determine what file system(s) are on the disk:

    # mount | grep cwtxdysz

    For example, if the device to be removed is c2t1d0, enter the following:

    # mount | grep c2t1d0
/export/home   (/dev/dsk/c2t1d0s7 ):   98892 blocks   142713 files
/export/home2  (/dev/dsk/c2t1d0s5 ):  153424 blocks   112107 files

  4. Unmount any file systems on the disk.

    Note -

    If the file system(s) are on a disk that is failing or has failed, the umount operation may not complete. A large number of error messages may be displayed in the system console and in the /var directory during the umount operation. If the umount operation does not complete, you may have to restart the system.

    For each file system returned, type:

    # umount filesystem

    where: filesystem is the first field for each line returned in Step 3.

    For example:

    # umount /export/home
# umount /export/home2

Removing the Disk Drive

  1. Use the luxadm remove_device command to remove the disk.

    The luxadm remove_device command is interactive. You will be guided through the procedure for removing a device or chain of devices. 

    # luxadm remove_device /dev/rdsk/c2t1d0s2


  WARNING!!! Please ensure that no filesystems are mounted
on these device(s).
  All data on these devices should have been backed up.



The list of devices which will be removed is:
  1: Box Name "macs1" front slot 1

Please enter 'q' to Quit or <Return> to Continue: 

stopping:  Drive in "macs1" front slot 1....Done
offlining: Drive in "macs1" front slot 1....Done

Hit <Return> after removing the device(s).

  2. Remove the disk drive and then hit any key.

    Note -

    The yellow LED on the designated disk drive(s) should be flashing.

    The following is displayed:

     
Drive in Box Name "macs1" front slot 1
    Removing Logical Nodes: 
	Removing c2t1d0s0
	Removing c2t1d0s1
	Removing c2t1d0s2
	Removing c2t1d0s3
	Removing c2t1d0s4
	Removing c2t1d0s5
	Removing c2t1d0s6
	Removing c2t1d0s7
#

Volume Manager Operations

Adding a Disk Drive

This section describes how to use Volume Manager to configure your system when you add a disk drive while the power is on and the operating system is running.

Caution - Caution -

These procedures should be performed only by a qualified system administrator. Performing hot-plug operations on an active disk drive may result in data loss and/or data corruption.

You must create a new device entry for the drive in the /devices and /dev/dsk and /dev/rdsk hierarchy. The new drive is assigned a name associated with the slot into which the drive was installed.

  1. Select any available slot in the StorEdge A5000 disk array for the new disk drive.

    For reference when you configure the software environment, make a note of which enclosure and slot you choose.

  2. Use the luxadm insert_device command to add the new device.

    This command is interactive. You will be guided through the procedure for inserting a new device or chain of devices. 

    # luxadm insert_device macs1,f1


The list of devices which will be inserted is:
  1: Box Name "macs1" front slot 1

Please enter 'q' to Quit or <Return> to Continue: 


Hit <Return> after inserting the device(s).

  3. Insert the disk drive and hit Return.

    The following is displayed:

     Drive in Box Name "macs1" front slot 1
  Logical Nodes under /dev/dsk and /dev/rdsk :
	c2t1d0s0
	c2t1d0s1
	c2t1d0s2
	c2t1d0s3
	c2t1d0s4
	c2t1d0s5
	c2t1d0s6
	c2t1d0s7
#

    The new disk drive is now available for use as a block or character device. Refer to the sd(7)man page for further details.

  4. Configure the Volume Manager to recognize the disk drive.

    # vxdctl enable

  5. Add the new disk to a new or existing Volume Manager disk group:

    # vxdiskadd cwtxdysz

    where: cwtxdysz is the new disk.

Refer to the vxdiskadd(1M) man page for further details.

The disk is now ready for use with Volume Manager as part of a new volume, added to an existing volume as a plex, or to increase an existing volume. Refer to your Sun StorEdge Volume Manager User's Guide for more information.

Replacing a Disk Drive

This section describes how on using Volume Manager to configuring your system to replace a disk drive while the power is on and the operating system is running.

Caution - Caution -

These procedures should be performed only by a qualified system administrator. Performing hot-plug operations on an active disk drive can result in data loss and/or data corruption.

Terminate all user- and application-level processes on all volumes, plexes, and/or subdisks that are located on the drive to be removed before performing this procedure.

Preparing to Replace the Disk Drive

  1. Identify the faulty disk drive.

    Different applications provide various levels of error logging. In general, you can find messages about failing or failed disks in your system console window. The information is also logged in the /usr/adm/messages file(s). See the documentation that came with your application for more information.

  2. Back up your system.

  3. Refer to the documentation that came with your system for backup details.

  4. Identify the disk media name for the disk you intend to replace.

    # vxdisk list | grep cwtxdysz

    For example, if the disk to be removed is c2t1d0, enter:

    # vxdisk list | grep c0t1d0
c2t1d0s2     sliced    disk01       rootdg       online

    The disk media name is the third field in the output above: disk01.

    You can use the vxdiskadm utility to prepare the disk for replacement.

  5. Type vxdiskadm in a shell.

    # vxdiskadm

    This operation is interactive and requires user confirmation of the operation.

  6. Select the "Remove a disk for replacement" option.

    When prompted for a disk name to replace, type the disk media name from Step 4.

    vxdiskadm marks the disk for replacement and saves the subdisk information to be rebuilt on the replacement disk.

    Redundant data is automatically recovered after the replacement disk has been reattached to Volume Manager. Nonredundant data is identified as unusable and must be re-created from backups.

    Refer to the vxdiskadm(1M) man page for further details.

  7. Quit the vxdiskadm utility.

Replacing the Disk Drive

  1. Use the luxadm remove_device command to remove the disk.

    The luxadm remove_device command is interactive. You will be guided through the procedure for removing a device or chain of devices. 

    # luxadm remove_device macs1,f1


  WARNING!!! Please ensure that no filesystems are mounted
on these device(s).
  All data on these devices should have been backed up.



The list of devices which will be removed is:

  1: Box Name "macs3" rear slot 1

Please enter 'q' to Quit OR <Return> to Continue: 

stopping:  Drive in "macs1" front slot 1....Done 
offlining: Drive in "macs1" front slot 1....Done

Hit <Return> after removing the device(s).

  2. Remove the disk drive and then hit any key.

    Note -

    The yellow LED on the designated disk drive(s) should be flashing.

    The following is displayed:

     
Drive in Box Name "macs1" front slot 1
    Removing Logical Nodes: 
	Removing c2t18d0s0
	Removing c2t18d0s1
	Removing c2t18d0s2
	Removing c2t18d0s3
	Removing c2t18d0s4
	Removing c2t18d0s5
	Removing c2t18d0s6
	Removing c2t18d0s7
#

  3. Use the luxadm insert_device command to add the new device.

    This command is interactive. You will be guided through the procedure for inserting a new device or chain of devices. 

    # luxadm insert_device macs1,f1

The list of devices which will be inserted is:
  1: Box Name "macs1" front slot 1

Please enter 'q' to Quit or <Return> to Continue: 

Hit <Return> after inserting the device(s).

  4. Insert the disk drive and then hit Return.

    The following is displayed: 

      Drive in Box Name "macs1" front slot 1
  Logical Nodes under /dev/dsk and /dev/rdsk :
	c2t1d0s0
	c2t1d0s1
	c2t1d0s2
	c2t1d0s3
	c2t1d0s4
	c2t1d0s5
	c2t1d0s6
	c2t1d0s7
#

The new disk drive is now available for use as a block or character device. Refer to the sd(7) man page for further details.

Recreating a Volume Manager Configuration on the New Drive

To re-create the replaced disk on the new drive:

  1. Configure the Volume Manager to recognize the disk drive.

    # vxdctl enable

  2. Use the vxdiskadm utility to replace the failed disk.

    Select the "Replace a failed or removed disk" option.

    This operation requires user confirmation. When prompted for a disk name to replace, use the disk media name from Step 4 of "Preparing to Replace the Disk Drive".

    vxdiskadm supplies a list of available disks to be used as replacements.

  3. Select the replacement drive.

    vxdiskadm automatically configures the replacement drive to match the failed drive.

    Redundant data is recovered automatically. Space for nonredundant data is created and identified. Nonredundant data must be recovered from backing store.

    See the vxdiskadm man page for further details.

Removing a Disk Drive

This section describes how to configure your system to remove a disk drive while the power is on and the operating system is running. Use the procedures in this section if you do not intend to replace the disk drive.

You must select the disk and stop any activity or applications on it, unmount it, physically remove the drive, and configure the Solaris environment to recognize that the drive is no longer there. You must then configure your application to operate without this device in place.

Caution - Caution -

These procedures should be performed only by a qualified system administrator. Performing hot-plug operations on an active disk drive can result in data loss and/or data corruption.

Preparing to Remove the Disk Drive

  1. Back up your system.

  2. Identify the disk media name for the disk you intend to remove.

    # vxdisk list | grep cwtxdysz

    For example, if the disk to be removed is c2t1d0, enter:

    # vxdisk list | grep c2t1d0
c2t1d0s2     sliced    disk01       rootdg       online

    The disk media name is the third field in the output above: disk01.

    You can use the vxdiskadm utility to prepare the disk for removal.

  3. Type vxdiskadm in a shell.

    For example:

    # vxdiskadm

    This operation is interactive and requires user confirmation of the operation.

  4. Select the "Remove a disk" option.

    When prompted for a disk name to remove, type the disk media name from Step 2.

    vxdiskadm marks the disk to be removed.

    Refer to the vxdiskadm(1M) man page for further details.

Removing the Disk Drive

  1. Use the luxadm remove_device command to remove the disk.

    The luxadm remove_device command is interactive. You will be guided through the procedure for removing a device or chain of devices. 

    # luxadm remove_device /dev/rdsk/c2t1d0s2


  WARNING!!! Please ensure that no filesystems are mounted
on these device(s).
  All data on these devices should have been backed up.



The list of devices which will be removed is:
  1: Box Name "macs1" front slot 1

Please enter 'q' to Quit or <Return> to Continue: 

stopping:  Drive in "macs1" front slot 1....Done
offlining: Drive in "macs1" front slot 1....Done

Hit <Return> after removing the device(s).

  2. Remove the disk drive and then hit any key.

    Note -

    The yellow LED on the designated disk drive(s) should be flashing.

    The following is displayed:

     
Drive in Box Name "macs1" front slot 1
    Removing Logical Nodes: 
	Removing c2t1d0s0
	Removing c2t1d0s1
	Removing c2t1d0s2
	Removing c2t1d0s3
	Removing c2t1d0s4
	Removing c2t1d0s5
	Removing c2t1d0s6
	Removing c2t1d0s7
#