test

Sun Cluster 3.0 Release Notes Supplement

Maintaining a Sun StorEdge T3 Disk Array

This section provides the procedures for maintaining a Sun StorEdge T3 disk array. The following table lists these procedures. This section does not include a procedure for adding a disk drive and a procedure for removing a disk drive because a Sun StorEdge T3 disk array only operates when fully configured.

Caution - Caution -

If you remove any field replaceable unit (FRU) for an extended period of time, thermal complications might result. To prevent this complication, the Sun StorEdge T3 disk array is designed so an orderly shutdown occurs when you remove a component for longer than 30 minutes. A replacement part must be immediately available before starting a FRU replacement procedure. You must replace a FRU within 30 minutes or the Sun StorEdge T3 disk array, and all attached Sun StorEdge T3 disk arrays, will shut down and power off.

Table B-2 Task Map: Maintaining a Sun StorEdge T3 Disk Array

Task 

For Instructions, Go To... 

Upgrade Sun StorEdge T3 disk array firmware 

"How to Upgrade Sun StorEdge T3 Disk Array Firmware"

Replace a disk drive 

"How to Replace a Disk Drive"

Add a Sun StorEdge T3 disk array 

"How to Add a Sun StorEdge T3 Disk Array"

Remove a Sun StorEdge T3 disk array 

"How to Remove a Sun StorEdge T3 Disk Array"

Replace a host-to-hub fiber optic cable 

"How to Replace a Host-to-Hub Component"

Replace an FC-100/S host adapter GBIC 

"How to Replace a Host-to-Hub Component"

Replace an FC-100 hub GBIC that connects a FC-100 hub to a host 

"How to Replace a Host-to-Hub Component"

Replace a hub-to-disk array fiber optic cable 

 

"How to Replace a Sun StorEdge FC-100 Hub and Hub-to-Disk Tray Component"

Replace an FC-100 hub GBIC that connects the FC-100 hub to a Sun StorEdge T3 disk array 

"How to Replace a Sun StorEdge FC-100 Hub and Hub-to-Disk Tray Component"

Replace a Sun StorEdge FC-100 hub 

 

"How to Replace a Sun StorEdge FC-100 Hub and Hub-to-Disk Tray Component"

Replace a Sun StorEdge FC-100 hub power cord 

"How to Replace a Sun StorEdge FC-100 Hub and Hub-to-Disk Tray Component"

Replace a media interface adapter (MIA) 

 

"How to Replace a Sun StorEdge FC-100 Hub and Hub-to-Disk Tray Component"

Replace a Sun StorEdge T3 disk array controller 

 

"How to Replace a Sun StorEdge T3 Disk Array Controller"

Replace a Sun StorEdge T3 disk array chassis 

 

"How to Replace a Sun StorEdge T3 Disk Array Chassis"

Replace a host adapter 

"How to Replace a Host Adapter"

Replace a Power and Cooling Unit (PCU) 

 

Follow the same procedure used in a non-cluster environment. 

Sun StorEdge T3 Installation, Operation, and Service Manual

Replace a unit interconnect card (UIC) 

 

Follow the same procedure used in a non-cluster environment. 

Sun StorEdge T3 Installation, Operation, and Service Manual

Replace a Sun StorEdge T3 disk array power cable 

 

Follow the same procedure used in a non-cluster environment. 

Sun StorEdge T3 Installation, Operation, and Service Manual

Replace an Ethernet cable 

 

Follow the same procedure used in a non-cluster environment. 

Sun StorEdge T3 Installation, Operation, and Service Manual

How to Upgrade Sun StorEdge T3 Disk Array Firmware

Use this procedure to upgrade Sun StorEdge T3 disk array firmware in a running cluster. Sun StorEdge T3 disk array firmware includes controller firmware, unit interconnect card (UIC) firmware, and disk drive firmware.

Caution - Caution -

Perform this procedure on one Sun StorEdge T3 disk array at a time. This procedure requires that you reset the Sun StorEdge T3 disk array you want to upgrade. If you reset more than one Sun StorEdge T3 disk array, your cluster will lose access to data if the Sun StorEdge T3 disk arrays are submirrors of each other.

  1. On one node attached to the Sun StorEdge T3 disk array you want to upgrade, detach that Sun StorEdge T3 disk array's submirrors.

    For more information, see your Solstice DiskSuite or VERITAS Volume Manager documentation.

  2. Apply the controller, disk drive, and UIC firmware patches.

    For the list of required Sun StorEdge T3 disk array patches, see the Sun StorEdge T3 Disk Tray Release Notes. For the procedure on applying firmware patches, see the firmware patch README. For the procedure on verifying the firmware level, see the Sun StorEdge T3 Installation, Operation, and Service Manual.

  3. Reset the Sun StorEdge T3 disk array, if you have not already done so.

    For the procedure on rebooting a Sun StorEdge T3 disk array, see the Sun StorEdge T3 Installation, Operation, and Service Manual.

  4. Reattach the submirrors to resynchronize them.

    For more information, see your Solstice DiskSuite or VERITAS Volume Manager documentation.

How to Replace a Disk Drive

Use this procedure to replace one failed disk drive in a Sun StorEdge T3 disk array in a running cluster.

Caution - Caution -

If you remove any field replaceable unit (FRU) for an extended period of time, thermal complications might result. To prevent this complication, the Sun StorEdge T3 disk array is designed so an orderly shutdown occurs when you remove a component for longer than 30 minutes. A replacement part must be immediately available before starting a FRU replacement procedure. You must replace a FRU within 30 minutes or the Sun StorEdge T3 disk array, and all attached Sun StorEdge T3 disk arrays, will shut down and power off.

  1. If the failed disk drive impacted the Sun StorEdge T3 disk tray logical volume's availability, remove the Sun StorEdge T3 disk tray logical volume from volume management control. Otherwise, proceed to Step 2.

    For more information, see your Solstice DiskSuite or VERITAS Volume Manager documentation.

  2. Replace the disk drive.

    For the procedure on replacing a disk drive, see the Sun StorEdge T3 Installation, Operation, and Service Manual.

  3. If you removed a LUN from volume management control in Step 1, return the LUN(s) to volume management control. Otherwise, Step 2 completes this procedure.

    For more information, see your Solstice DiskSuite or VERITAS Volume Manager documentation.

How to Add a Sun StorEdge T3 Disk Array

Use this procedure to add a new Sun StorEdge T3 disk array to a running cluster. This procedure provides flexibility so you can either add a Sun StorEdge T3 disk array, a Sun StorEdge FC-100 hub and host adapters, or add a Sun StorEdge T3 disk array to an existing Sun StorEdge FC-100 hub and host adapters.

This procedure defines Node A as the node you want to begin working with, and Node B as the remaining node.

  1. Set up a Reverse Address Resolution Protocol (RARP) server on the network you want the new Sun StorEdge T3 disk array to reside on, and then assign an IP address to the new Sun StorEdge T3 disk array.

    This RARP server enables you to assign an IP address to the new Sun StorEdge T3 disk array using the Sun StorEdge T3 disk array's unique MAC address.

    For the procedure on setting up a RARP server, see the Sun StorEdge T3 Installation, Operation, and Service Manual.

  2. Install the media interface adapter (MIA) in the Sun StorEdge T3 disk array you want to add as shown in Figure B-2.

    For the procedure on installing a media interface adapter (MIA), see the Sun StorEdge T3 Configuration Guide.

  3. If necessary, install a gigabit interface converter (GBIC) in the Sun StorEdge FC-100 hub as shown in Figure B-2.

    This GBIC allows you to connect the Sun StorEdge FC-100 hub to the Sun StorEdge T3 disk array you want to add.

    Note -

    There are no hub port assignment restrictions. You can connect your Sun StorEdge T3 disk array and node to any hub port.

    For the procedure on installing an FC-100 hub GBIC, see the FC-100 Hub Installation and Service Manual.

  4. Install the 10Base-T Ethernet cable between the Sun StorEdge T3 disk array and the Local Area Network (LAN) as shown in Figure B-2.

  5. Power on the Sun StorEdge T3 disk array.

    Note -

    The Sun StorEdge T3 disk array might take a few minutes to boot.

    For the procedure on powering on a Sun StorEdge T3 disk array, see the Sun StorEdge T3 Installation, Operation, and Service Manual.

  6. Telnet to the Sun StorEdge T3 disk array you want to add, and, if necessary, install the required Sun StorEdge T3 disk array controller firmware.

    Revision 1.16a firmware is required for the Sun StorEdge T3 disk array controller. For the procedure on upgrading firmware, see the firmware patch README.

  7. Does this new Sun StorEdge T3 disk array have a unique target address?

    • If yes, proceed to Step 8.

    • If no, change the target address for this new Sun StorEdge T3 disk array.

    For the procedure on verifying and assigning a target address, see the Sun StorEdge T3 Configuration Guide.

  8. Install a fiber optic cable between the Sun StorEdge FC-100 hub and the Sun StorEdge T3 disk array as shown in Figure B-2.

    Note -

    There are no hub port assignment restrictions. You can connect your Sun StorEdge T3 disk array and node to any hub port.

    For the procedure on installing a fiber optic cable, see the Sun StorEdge T3 Configuration Guide.

    Figure B-2 Adding a Sun StorEdge T3 disk array in a single-tray configuration

    Graphic

  9. Configure the new Sun StorEdge T3 disk array.

    For the procedure on creating a Sun StorEdge T3 disk tray logical volume, see the Sun StorEdge T3 Disk Tray Administrator's Guide.

  10. Determine the resource groups and device groups running on Node A and Node B.

    Record this information because you will use it in Step 42 of this procedure to return resource groups and device groups to these nodes.


    # scstat

  11. Move all resource groups and device groups off Node A.


    # scswitch -S -h nodename

  12. Do you need to install a host adapter in Node A?

  13. Is the host adapter you want to install the first FC-100/S host adapter on Node A?

    • If no, skip to Step 15.

    • If yes, determine whether the Fibre Channel support packages are already installed on these nodes. This product requires the following packages.


    # pkginfo | egrep Wlux
system 				SUNWluxd 					Sun Enterprise Network Array sf Device Driver
system 				SUNWluxdx					Sun Enterprise Network Array sf Device Driver (64-bit)
system 				SUNWluxl 					Sun Enterprise Network Array socal Device Driver
system 				SUNWluxlx 					Sun Enterprise Network Array socal Device Driver (64-bit)
system 				SUNWluxop 					Sun Enterprise Network Array firmware and utilities

  14. Are the Fibre Channel support packages installed?

    • If yes, proceed to Step 15.

    • If no, install them.

    The Sun StorEdge T3 disk array packages are located in the Product directory of the Solaris CD-ROM. Use the pkgadd command to add any necessary packages.


    # pkgadd -d path_to_Solaris/Product Pkg1 Pkg2 Pkg3 ... PkgN

  15. Stop the Sun Cluster software on Node A and shut down Node A.


    # shutdown -y -g0 -i0

    For the procedure on shutting down a node, see the Sun Cluster 3.0 System Administration Guide.

  16. Power off Node A.

  17. Install the host adapter in Node A.

    For the procedure on installing a host adapter, see the documentation that shipped with your host adapter and node.

  18. If necessary, power on and boot Node A.


    {0} ok boot -x

    For more information, see the Sun Cluster 3.0 System Administration Guide.

  19. If necessary, upgrade the host adapter firmware on Node A.

    For the required host adapter firmware patch, see the Sun StorEdge T3 Disk Tray Release Notes. For the procedure on applying the host adapter firmware patch, see the firmware patch README.

  20. If necessary, install gigabit interface converters (GBIC) as shown in Figure B-3.

    For the procedure on installing an FC-100 hub GBIC, see the FC-100 Hub Installation and Service Manual.

  21. If necessary, connect a fiber optic cable between the Sun StorEdge FC-100 hub and Node A as shown in Figure B-3.

    Note -

    There are no hub port assignment restrictions. You can connect your Sun StorEdge T3 disk array and node to any hub port.

    For the procedure on installing a FC-100/S host adapter GBIC, see your host adapter documentation. For the procedure on installing a fiber optic cable, see the Sun StorEdge T3 Configuration Guide.

    Figure B-3 Adding a Sun StorEdge T3 disk array in a single-tray configuration

    Graphic

  22. If necessary, install the required Solaris patches for Sun StorEdge T3 disk array support on Node A.

    For a list of required Solaris patches for Sun StorEdge T3 disk array support, see the Sun StorEdge T3 Disk Tray Release Notes.

  23. Shut down Node A.


    # shutdown -y -g0 -i0

  24. Perform a reconfiguration boot to create the new Solaris device files and links on Node A.


    {0} ok boot -r

  25. Label the new Sun StorEdge T3 disk tray logical volume.

    For the procedure on labeling a Sun StorEdge T3 disk tray logical volume, see the Sun StorEdge T3 Disk Tray Administrator's Guide.

  26. (Optional) On Node A, verify that the device IDs (DIDs) are assigned to the new Sun StorEdge T3 disk array.


    # scdidadm -l

  27. Do you need to install a host adapter in Node B?

  28. Is the host adapter you want to install the first FC-100/S host adapter on Node B?

    • If no, skip to Step 30.

    • If yes, determine whether the Fibre Channel support packages are already installed on these nodes. This product requires the following packages.


    # pkginfo | egrep Wlux
system 				SUNWluxd 					Sun Enterprise Network Array sf Device Driver
system 				SUNWluxdx					Sun Enterprise Network Array sf Device Driver (64-bit)
system 				SUNWluxl 					Sun Enterprise Network Array socal Device Driver
system 				SUNWluxlx 					Sun Enterprise Network Array socal Device Driver (64-bit)
system 				SUNWluxop 					Sun Enterprise Network Array firmware and utilities

  29. Are the Fibre Channel support packages installed?

    • If yes, proceed to Step 30.

    • If no, install them.

    The Sun StorEdge T3 disk array packages are located in the Product directory of the Solaris CD-ROM. Use the pkgadd command to add any necessary packages.


    # pkgadd -d path_to_Solaris/Product Pkg1 Pkg2 Pkg3 ... PkgN

  30. Move all resource groups and device groups off Node B.


    # scswitch -S -h nodename

  31. Stop the Sun Cluster software on Node B, and shut down the node.


    # shutdown -y -g0 -i0

    For the procedure on shutting down a node, see the Sun Cluster 3.0 System Administration Guide.

  32. Power off Node B.

    For more information, see the Sun Cluster 3.0 System Administration Guide.

  33. Install the host adapter in Node B.

    For the procedure on installing a host adapter, see the documentation that shipped with your host adapter and node.

  34. If necessary, power on and boot Node B.


    {0} ok boot -x

    For more information, see the Sun Cluster 3.0 System Administration Guide.

  35. If necessary, upgrade the host adapter firmware on Node B.

    For the required host adapter firmware patch, see the Sun StorEdge T3 Disk Tray Release Notes. For the procedure on applying the host adapter firmware patch, see the firmware patch README.

  36. If necessary, install gigabit interface converters (GBIC) as shown in Figure B-4.

    For the procedure on installing an FC-100 hub GBIC, see the FC-100 Hub Installation and Service Manual.

  37. If necessary, connect a fiber optic cable between the Sun StorEdge FC-100 hub and Node B as shown in Figure B-4.

    For the procedure on installing a FC-100/S host adapter GBIC, see your host adapter documentation. For the procedure on installing a fiber optic cable, see the Sun StorEdge T3 Configuration Guide.

    Figure B-4 Adding a Sun StorEdge T3 disk array in a single-tray configuration

    Graphic

  38. If necessary, install the required Solaris patches for Sun StorEdge T3 disk array support on Node B.

    For a list of required Solaris patches for Sun StorEdge T3 disk array support, see the Sun StorEdge T3 Disk Tray Release Notes.

  39. Shut down Node B.


    # shutdown -y -g0 -i0

  40. Perform a reconfiguration boot to create the new Solaris device files and links on Node B.


    {0} ok boot -r

  41. (Optional) On Node B, verify that the device IDs (DIDs) are assigned to the new Sun StorEdge T3 disk array.


    # scdidadm -l

  42. Return the resource groups and device groups you identified in Step 10 to Node A and Node B.


    # scswitch -z -g resource-group -h nodename
# scswitch -z -D device-group-name -h nodename

    For more information, see the Sun Cluster 3.0 System Administration Guide.

  43. Perform volume management administration to incorporate the new Sun StorEdge T3 disk tray logical volumes into the cluster.

    For more information, see your Solstice DiskSuite or VERITAS Volume Manager documentation.

How to Remove a Sun StorEdge T3 Disk Array

Use this procedure to permanently remove a Sun StorEdge T3 disk array and its submirrors from a running cluster. This procedure provides the flexibility to remove the host adapters from the nodes for the Sun StorEdge T3 disk array you want to remove.

This procedure defines Node A as the node you want to begin working with, and Node B as the remaining node.

Caution - Caution -

During this procedure, you will lose access to the data that resides on the Sun StorEdge T3 disk array you want to remove.

  1. If necessary, back up all database tables, data services, and volumes associated with the Sun StorEdge T3 disk array you want to remove.

  2. Detach the submirrors from the Sun StorEdge T3 disk array you want to remove to stop all I/O activity to the Sun StorEdge T3 disk array.

    For more information, see your Solstice DiskSuite or VERITAS Volume Manager documentation.

  3. Run the appropriate Solstice DiskSuite or VERITAS Volume Manager commands to remove the references to the LUN(s) from any diskset or disk group.

    For more information, see your Solstice DiskSuite or VERITAS Volume Manager documentation.

  4. Determine the resource groups and device groups running on Node B.


    # scstat

  5. Move all resource groups and device groups off Node A.


    # scswitch -S -h nodename

  6. Stop the Sun Cluster software on Node A, and shut down Node A.


    # shutdown -y -g0 -i0

    For the procedure on shutting down a node, see the Sun Cluster 3.0 System Administration Guide.

  7. Is the Sun StorEdge T3 disk array you want to remove the last Sun StorEdge T3 disk array connected to Node A?

    • If yes, disconnect the fiber optic cable between Node A and the Sun StorEdge FC-100 hub connected to this Sun StorEdge T3 disk tray, and then disconnect the fiber optic cable between the Sun StorEdge FC-100 hub and this Sun StorEdge T3 disk array.

    • If no, proceed to Step 8.

    For the procedure on removing a fiber optic cable, see the Sun StorEdge T3 Configuration Guide.

  8. Do you want to remove the host adapter from Node A?

    • If yes, power off Node A.

    • If no, skip to Step 10.

  9. Remove the host adapter from Node A.

    For the procedure on removing host adapters, see the documentation that shipped with your nodes.

  10. Without allowing the node to boot, power on Node A.

    For more information, see the Sun Cluster 3.0 System Administration Guide.

  11. Boot Node A into cluster mode.


    {0} ok boot

  12. Move all resource groups and device groups off Node B.


    # scswitch -S -h nodename

  13. Stop the Sun Cluster software on Node B, and shut down Node B.


    # shutdown -y -g0 -i0

  14. Is the Sun StorEdge T3 disk array you want to remove the last Sun StorEdge T3 disk array connected to the Sun StorEdge FC-100 hub.

    • If yes, disconnect the fiber optic cable connecting this Sun StorEdge FC-100 hub and Node B.

    • If no, proceed to Step 15.

    For the procedure on removing a fiber optic cable, see the Sun StorEdge T3 Configuration Guide.

  15. Do you want to remove the host adapter from Node B?

    • If yes, power off Node B.

    • If no, skip to Step 18.

  16. Remove the host adapter from Node B.

    For the procedure on removing host adapters, see the documentation that shipped with your nodes.

  17. Without allowing the node to boot, power on Node B.

    For more information, see the Sun Cluster 3.0 System Administration Guide.

  18. Boot Node B into cluster mode.


    {0} ok boot

    For more information, see the Sun Cluster 3.0 System Administration Guide.

  19. On all cluster nodes, update the /devices and /dev entries.


    # devfsadm -C
# scdidadm -C

  20. Return the resource groups and device groups you identified in Step 4 to Node A and Node B.


    # scswitch -z -g resource-group -h nodename
# scswitch -z -D device-group-name -h nodename

How to Replace a Host-to-Hub Component

Use this procedure to replace the following host-to-hub components.

  1. On the node connected to the host-to-hub connection you want to replace, determine the resource groups and device groups running on this node.


    # scstat

  2. Move all resource groups and device groups to another node.


    # scswitch -S -h nodename

  3. Replace the host-to-hub component.

    For the procedure on replacing a fiber optic cable, see the Sun StorEdge T3 Configuration Guide. For the procedure on replacing an FC-100 hub GBIC, see the FC-100 Hub Installation and Service Manual. For the procedure on replacing a FC-100/S host adapter GBIC, see your host adapter documentation.

  4. Return the resource groups and device groups you identified in Step 1 to the node connected to the host-to-hub connection you replaced. 


    # scswitch -z -g resource-group -h nodename
# scswitch -z -D device-group-name -h nodename

How to Replace a Sun StorEdge FC-100 Hub and Hub-to-Disk Tray Component

Use this procedure to replace the following hub-to-disk array components.

  1. Detach the submirrors on the Sun StorEdge T3 disk array connected to the hub-to-disk array fiber optic cable you want to replace to stop all I/O activity to this Sun StorEdge T3 disk array.

    For more information, see your Solstice DiskSuite or VERITAS Volume Manager documentation.

  2. Replace the hub-to-disk array component.

    For the procedure on replacing a fiber optic cable, see the Sun StorEdge T3 Configuration Guide. For the procedure on replacing an FC-100 hub GBIC, a Sun StorEdge FC-100 hub, or a Sun StorEdge FC-100 hub power cord, see the FC-100 Hub Installation and Service Manual. For the procedure on replacing an MIA, see the Sun StorEdge T3 Installation, Operation, and Service Manual.

  3. Reattach the submirrors to resynchronize them.

    For more information, see your Solstice DiskSuite or VERITAS Volume Manager documentation.

How to Replace a Sun StorEdge T3 Disk Array Controller

Use this procedure to replace a Sun StorEdge T3 disk array controller.

  1. Detach the submirrors on the Sun StorEdge T3 disk array connected to the controller you want to replace to stop all I/O activity to this Sun StorEdge T3 disk array.

    For more information, see your Solstice DiskSuite or VERITAS Volume Manager documentation.

  2. Replace the controller.

    For the procedure on replacing a Sun StorEdge T3 controller, see the Sun StorEdge T3 Installation, Operation, and Service Manual.

  3. Reattach the submirrors to resynchronize them.

    For more information, see your Solstice DiskSuite or VERITAS Volume Manager documentation.

How to Replace a Sun StorEdge T3 Disk Array Chassis

Use this procedure to replace a Sun StorEdge T3 disk array chassis. This procedure assumes that you want to retain all FRUs other than the chassis and the backplane. To replace the chassis, you must replace both the chassis and the backplane because these components are manufactured as one part.

Note -

Only trained, qualified service providers should use this procedure to replace a Sun StorEdge T3 disk array chassis.

  1. Detach the submirrors on the Sun StorEdge T3 disk array connected to the chassis you want to replace to stop all I/O activity to this Sun StorEdge T3 disk array.

    For more information, see your Solstice DiskSuite or VERITAS Volume Manager documentation.

  2. Replace the chassis/backplane.

    For the procedure on replacing a Sun StorEdge T3 chassis, see the Sun StorEdge T3 Field Service Manual.

  3. Reattach the submirrors to resynchronize them.

    Note -

    Account for the change in the World Wide Number (WWN).

    For more information, see your Solstice DiskSuite or VERITAS Volume Manager documentation.

How to Replace a Host Adapter

Use this procedure to replace a failed host adapter in a running cluster. Node A in this procedure refers to the node with the failed host adapter you want to replace. Node B is a backup node.

  1. Determine the resource groups and device groups running on Node A and Node B.

    Record this information because you will use it in Step 8 of this procedure to return resource groups and device groups to these nodes.


    # scstat

  2. Move all resource groups and device groups off Node A.


    # scswitch -S -h nodename

  3. Shut down Node A.


    # shutdown -y -g0 -i0

  4. Power off Node A.

    For more information, see the Sun Cluster 3.0 System Administration Guide.

  5. Replace the failed host adapter.

    For the procedure on removing and adding host adapters, see the documentation that shipped with your nodes.

  6. Power on Node A.

    For more information, see the Sun Cluster 3.0 System Administration Guide.

  7. Boot Node A into cluster mode.


    {0} ok boot

    For more information, see the Sun Cluster 3.0 System Administration Guide.

  8. Return the resource groups and device groups you identified in Step 1 to Node A and Node B.


    # scswitch -z -g resource-group -h nodename
# scswitch -z -D device-group-name -h nodename

    For more information, see the Sun Cluster 3.0 System Administration Guide.