3.11 Reattaching a Disk Drive
Disk drives sometimes become detached due to power failures, cable or controller problems, and so on. Detached disk drives result in plexes becoming detached and thus, unavailable. The remaining plex(es) in a mirrored volume are still available and therefore the volume is still active. It is possible to reattach the disk drives and recover from this condition without halting either node.
The following example configuration consists of five mirrored volumes. SPARCstorage Array c1 has been powered off. The mirrors are broken, but the volume remains active, as the remaining plex is still working.
# vxprint -g toi TY NAME ASSOC KSTATE LENGTH PLOFFS STATE TUTIL0 PUTIL0 dg toi toi - - - - - - dm c1t5d0 - - - - NODEVICE - - dm c1t5d1 - - - - NODEVICE - - dm c1t5d2 - - - - NODEVICE - - dm c1t5d3 - - - - NODEVICE - - dm c1t5d4 - - - - NODEVICE - - dm c2t5d0 c2t5d0s2 - 2050272 - - - - dm c2t5d1 c2t5d1s2 - 2050272 - - - - dm c2t5d2 c2t5d2s2 - 2050272 - - - - dm c2t5d3 c2t5d3s2 - 2050272 - - - - dm c2t5d4 c2t5d4s2 - 2050272 - - - - v toi-1 gen ENABLED 61440 - ACTIVE - - pl toi-1-01 toi-1 DISABLED 65840 - NODEVICE - - sd c1t5d0-01 toi-1-01 DISABLED 13104 0 NODEVICE - - sd c1t5d1-01 toi-1-01 DISABLED 13104 0 NODEVICE - - sd c1t5d2-01 toi-1-01 DISABLED 13104 0 NODEVICE - - sd c1t5d3-01 toi-1-01 DISABLED 13104 0 NODEVICE - - sd c1t5d4-01 toi-1-01 DISABLED 13104 0 NODEVICE - - pl toi-1-02 toi-1 ENABLED 65840 - ACTIVE - - sd c2t5d0-01 toi-1-02 ENABLED 13104 0 - - - sd c2t5d1-01 toi-1-02 ENABLED 13104 0 - - - sd c2t5d2-01 toi-1-02 ENABLED 13104 0 - - - sd c2t5d3-01 toi-1-02 ENABLED 13104 0 - - - sd c2t5d4-01 toi-1-02 ENABLED 13104 0 - - - v toi-2 gen ENABLED 61440 - ACTIVE - - pl toi-2-01 toi-2 DISABLED 65840 - NODEVICE - - sd c1t5d0-02 toi-2-01 DISABLED 13104 0 NODEVICE - - sd c1t5d1-02 toi-2-01 DISABLED 13104 0 NODEVICE - - sd c1t5d2-02 toi-2-01 DISABLED 13104 0 NODEVICE - - sd c1t5d3-02 toi-2-01 DISABLED 13104 0 NODEVICE - - sd c1t5d4-02 toi-2-01 DISABLED 13104 0 NODEVICE - - pl toi-2-02 toi-2 ENABLED 65840 - ACTIVE - - sd c2t5d0-02 toi-2-02 ENABLED 13104 0 - - - sd c2t5d1-02 toi-2-02 ENABLED 13104 0 - - - sd c2t5d2-02 toi-2-02 ENABLED 13104 0 - - - sd c2t5d3-02 toi-2-02 ENABLED 13104 0 - - - sd c2t5d4-02 toi-2-02 ENABLED 13104 0 - - - v toi-3 gen ENABLED 61440 - ACTIVE - - pl toi-3-01 toi-3 DISABLED 65840 - NODEVICE - - sd c1t5d0-03 toi-3-01 DISABLED 13104 0 NODEVICE - - sd c1t5d1-03 toi-3-01 DISABLED 13104 0 NODEVICE - - sd c1t5d2-03 toi-3-01 DISABLED 13104 0 NODEVICE - - sd c1t5d3-03 toi-3-01 DISABLED 13104 0 NODEVICE - - sd c1t5d4-03 toi-3-01 DISABLED 13104 0 NODEVICE - - pl toi-3-02 toi-3 ENABLED 65840 - ACTIVE - - sd c2t5d0-03 toi-3-02 ENABLED 13104 0 - - - sd c2t5d1-03 toi-3-02 ENABLED 13104 0 - - - sd c2t5d2-03 toi-3-02 ENABLED 13104 0 - - - sd c2t5d3-03 toi-3-02 ENABLED 13104 0 - - - sd c2t5d4-03 toi-3-02 ENABLED 13104 0 - - - v toi-4 gen ENABLED 61440 - ACTIVE - - pl toi-4-01 toi-4 DISABLED 65840 - NODEVICE - - sd c1t5d0-04 toi-4-01 DISABLED 13104 0 NODEVICE - - sd c1t5d1-04 toi-4-01 DISABLED 13104 0 NODEVICE - - sd c1t5d2-04 toi-4-01 DISABLED 13104 0 NODEVICE - - sd c1t5d3-04 toi-4-01 DISABLED 13104 0 NODEVICE - - sd c1t5d4-04 toi-4-01 DISABLED 13104 0 NODEVICE - - pl toi-4-02 toi-4 ENABLED 65840 - ACTIVE - - sd c2t5d0-04 toi-4-02 ENABLED 13104 0 - - - sd c2t5d1-04 toi-4-02 ENABLED 13104 0 - - - sd c2t5d2-04 toi-4-02 ENABLED 13104 0 - - - sd c2t5d3-04 toi-4-02 ENABLED 13104 0 - - - sd c2t5d4-04 toi-4-02 ENABLED 13104 0 - - - v toi-5 gen ENABLED 61440 - ACTIVE - - pl toi-5-01 toi-5 DISABLED 65840 - NODEVICE - - sd c1t5d0-05 toi-5-01 DISABLED 13104 0 NODEVICE - - sd c1t5d1-05 toi-5-01 DISABLED 13104 0 NODEVICE - - sd c1t5d2-05 toi-5-01 DISABLED 13104 0 NODEVICE - - sd c1t5d3-05 toi-5-01 DISABLED 13104 0 NODEVICE - - sd c1t5d4-05 toi-5-01 DISABLED 13104 0 NODEVICE - - pl toi-5-02 toi-5 ENABLED 65840 - ACTIVE - - sd c2t5d0-05 toi-5-02 ENABLED 13104 0 - - - sd c2t5d1-05 toi-5-02 ENABLED 13104 0 - - - sd c2t5d2-05 toi-5-02 ENABLED 13104 0 - - - sd c2t5d3-05 toi-5-02 ENABLED 13104 0 - - - sd c2t5d4-05 toi-5-02 ENABLED 13104 0 - - - # vxdisk list DEVICE TYPE DISK GROUP STATUS c0t0d0s4 simple c0t0d0s4 rootdg online c1t5d0s2 sliced - - online c1t5d1s2 sliced - - online c1t5d2s2 sliced - - online c1t5d3s2 sliced - - online c1t5d4s2 sliced - - online c2t5d0s2 sliced c2t5d0 toi online shared c2t5d1s2 sliced c2t5d1 toi online shared c2t5d2s2 sliced c2t5d2 toi online shared c2t5d3s2 sliced c2t5d3 toi online shared c2t5d4s2 sliced c2t5d4 toi online shared - - c1t5d0 toi failed was:c1t5d0s2 - - c1t5d1 toi failed was:c1t5d1s2 - - c1t5d2 toi failed was:c1t5d2s2 - - c1t5d3 toi failed was:c1t5d3s2 - - c1t5d4 toi failed was:c1t5d4s2 |
To reattach a detached disk, complete the following steps.
-
Fix the condition that resulted in the problem.
Be sure that the disks are spun up before proceeding further.
-
Enter the following commands on both nodes in the cluster.
In some cases, the drive(s) must be rediscovered by the node(s).
# drvconfig # disks
-
Enter the following commands on both nodes in the cluster.
CVM must scan the current disk configuration again.
# vxdctl enable # vxdisk -a online
-
From the master node, repeat the following command for each disk that has been disconnected.
The physical disk and the CVM access name for that disk must be reconnected.
# vxdg -g disk_group_name -k adddisk medianame=accessname
Note -The values for medianame and accessname can be obtained from the end of the vxdisk list command output.
For the example configuration:
# vxdg -g toi -k adddisk c1t5d0=c1t5d0s2 # vxdg -g toi -k adddisk c1t5d1=c1t5d1s2 # vxdg -g toi -k adddisk c1t5d2=c1t5d2s2 # vxdg -g toi -k adddisk c1t5d3=c1t5d3s2 # vxdg -g toi -k adddisk c1t5d4=c1t5d4s2
-
From the master node, start volume recovery.
# vxrecover -svc
For the example configuration:
# vxrecover -svc job 028125 dg toi volume toi-1: reattach plex toi-1-01 job 028125 done status=0 job 028126 dg toi volume toi-2: reattach plex toi-2-01 job 028126 done status=0 job 028127 dg toi volume toi-3: reattach plex toi-3-01 job 028127 done status=0 job 028129 dg toi volume toi-4: reattach plex toi-4-01 job 028129 done status=0 job 028130 dg toi volume toi-5: reattach plex toi-5-01 job 028130 done status=0
-
(Optional) Enter the vxprint -g command to see the changes.
# vxprint -g toi TY NAME ASSOC KSTATE LENGTH PLOFFS STATE TUTIL0 PUTIL0 dg toi toi - - - - - - dm c1t5d0 c1t5d0s2 - 2050272 - - - - dm c1t5d1 c1t5d1s2 - 2050272 - - - - dm c1t5d2 c1t5d2s2 - 2050272 - - - - dm c1t5d3 c1t5d3s2 - 2050272 - - - - dm c1t5d4 c1t5d4s2 - 2050272 - - - - dm c2t5d0 c2t5d0s2 - 2050272 - - - - dm c2t5d1 c2t5d1s2 - 2050272 - - - - dm c2t5d2 c2t5d2s2 - 2050272 - - - - dm c2t5d3 c2t5d3s2 - 2050272 - - - - dm c2t5d4 c2t5d4s2 - 2050272 - - - - v toi-1 gen ENABLED 61440 - ACTIVE - - pl toi-1-01 toi-1 ENABLED 65840 - ACTIVE - - sd c1t5d0-01 toi-1-01 ENABLED 13104 0 - - - sd c1t5d1-01 toi-1-01 ENABLED 13104 0 - - - sd c1t5d2-01 toi-1-01 ENABLED 13104 0 - - - sd c1t5d3-01 toi-1-01 ENABLED 13104 0 - - - sd c1t5d4-01 toi-1-01 ENABLED 13104 0 - - - pl toi-1-02 toi-1 ENABLED 65840 - ACTIVE - - sd c2t5d0-01 toi-1-02 ENABLED 13104 0 - - - sd c2t5d1-01 toi-1-02 ENABLED 13104 0 - - - sd c2t5d2-01 toi-1-02 ENABLED 13104 0 - - - sd c2t5d3-01 toi-1-02 ENABLED 13104 0 - - - sd c2t5d4-01 toi-1-02 ENABLED 13104 0 - - - v toi-2 gen ENABLED 61440 - ACTIVE - - pl toi-2-01 toi-2 ENABLED 65840 - ACTIVE - - sd c1t5d0-02 toi-2-01 ENABLED 13104 0 - - - sd c1t5d1-02 toi-2-01 ENABLED 13104 0 - - - sd c1t5d2-02 toi-2-01 ENABLED 13104 0 - - - sd c1t5d3-02 toi-2-01 ENABLED 13104 0 - - - sd c1t5d4-02 toi-2-01 ENABLED 13104 0 - - - pl toi-2-02 toi-2 ENABLED 65840 - ACTIVE - - sd c2t5d0-02 toi-2-02 ENABLED 13104 0 - - - sd c2t5d1-02 toi-2-02 ENABLED 13104 0 - - - sd c2t5d2-02 toi-2-02 ENABLED 13104 0 - - - sd c2t5d3-02 toi-2-02 ENABLED 13104 0 - - - sd c2t5d4-02 toi-2-02 ENABLED 13104 0 - - - v toi-3 gen ENABLED 61440 - ACTIVE - - pl toi-3-01 toi-3 ENABLED 65840 - ACTIVE - - sd c1t5d0-03 toi-3-01 ENABLED 13104 0 - - - sd c1t5d1-03 toi-3-01 ENABLED 13104 0 - - - sd c1t5d2-03 toi-3-01 ENABLED 13104 0 - - - sd c1t5d3-03 toi-3-01 ENABLED 13104 0 - - - sd c1t5d4-03 toi-3-01 ENABLED 13104 0 - - - pl toi-3-02 toi-3 ENABLED 65840 - ACTIVE - - sd c2t5d0-03 toi-3-02 ENABLED 13104 0 - - - sd c2t5d1-03 toi-3-02 ENABLED 13104 0 - - - sd c2t5d2-03 toi-3-02 ENABLED 13104 0 - - - sd c2t5d3-03 toi-3-02 ENABLED 13104 0 - - - sd c2t5d4-03 toi-3-02 ENABLED 13104 0 - - - v toi-4 gen ENABLED 61440 - ACTIVE - - pl toi-4-01 toi-4 ENABLED 65840 - ACTIVE - - sd c1t5d0-04 toi-4-01 ENABLED 13104 0 - - - sd c1t5d1-04 toi-4-01 ENABLED 13104 0 - - - sd c1t5d2-04 toi-4-01 ENABLED 13104 0 - - - sd c1t5d3-04 toi-4-01 ENABLED 13104 0 - - - sd c1t5d4-04 toi-4-01 ENABLED 13104 0 - - - pl toi-4-02 toi-4 ENABLED 65840 - ACTIVE - - sd c2t5d0-04 toi-4-02 ENABLED 13104 0 - - - sd c2t5d1-04 toi-4-02 ENABLED 13104 0 - - - sd c2t5d2-04 toi-4-02 ENABLED 13104 0 - - - sd c2t5d3-04 toi-4-02 ENABLED 13104 0 - - - sd c2t5d4-04 toi-4-02 ENABLED 13104 0 - - - v toi-5 gen ENABLED 61440 - ACTIVE - - pl toi-5-01 toi-5 ENABLED 65840 - ACTIVE - - sd c1t5d0-05 toi-5-01 ENABLED 13104 0 - - - sd c1t5d1-05 toi-5-01 ENABLED 13104 0 - - - sd c1t5d2-05 toi-5-01 ENABLED 13104 0 - - - sd c1t5d3-05 toi-5-01 ENABLED 13104 0 - - - sd c1t5d4-05 toi-5-01 ENABLED 13104 0 - - - pl toi-5-02 toi-5 ENABLED 65840 - ACTIVE - - sd c2t5d0-05 toi-5-02 ENABLED 13104 0 - - - sd c2t5d1-05 toi-5-02 ENABLED 13104 0 - - - sd c2t5d2-05 toi-5-02 ENABLED 13104 0 - - - sd c2t5d3-05 toi-5-02 ENABLED 13104 0 - - - sd c2t5d4-05 toi-5-02 ENABLED 13104 0 - - -
- © 2010, Oracle Corporation and/or its affiliates