This chapter contains the procedures about how to install and configure Sun StorEdgeTM 3900 and 6900 series systems in a Sun Cluster environment. It contains the following major sections:
The storage system configuration utilities can be run from a menu-driven interface or a command line interface. This chapter describes the menu-driven interface.
For information about storage system architecture, features, and configuration utilities, see your storage system documentation listed in Related Documentation.
This section contains instructions on installing storage systems both in new clusters and to existing clusters.
Table 2–1 Task Map: Installing Storage Systems
Task |
Information |
---|---|
Install a storage system in a new cluster, before the OS and Sun Cluster software are installed. | |
Add a storage system to an operational cluster. |
Use this procedure to install a storage system in an initial cluster. To add a storage system to an existing cluster, use the procedure in How to Add a Storage System to an Existing Cluster.
This procedure relies on the following assumptions:
You have not installed the Solaris Operating System.
You have not installed the Sun Cluster software.
Your cluster has not been established.
You have enough host adapters to connect the nodes and the storage system to the service processor panel.
If you need to install host adapters, see How to Replace a Host Adapter. When this procedure asks you to replace the failed host adapter, simply install the new host adapter instead.
Unpack, place, and level the storage system.
For instructions, see your storage system installation documentation. For a list of this documentation, see Related Documentation.
(Optional) Install the Fibre Channel (FC) switch for the storage system if you do not have a switch installed.
For the procedure about how to install an FC switch, see the documentation that shipped with your FC switch hardware.
Connect the nodes to the service processor panel.
(SAN Configuration) Connect the FC switches to the service processor panel.
(Direct-Attached Configuration) Connect each node to the service processor panel directly.
For the procedure about how to cable the storage system, see your storage system installation documentation.
Install the system power cord and the system antistatic strap.
For instructions, see your storage system installation documentation.
Power on the storage system and the nodes.
For instructions about how to power on the storage system, see your storage system installation documentation.
Configure the service processor.
For more information, see your storage system installation documentation.
On all nodes, install the Solaris operating system and apply the required Solaris patches for Sun Cluster software and storage array support.
For the procedure about how to install the Solaris operating environment, see How to Install Solaris Software in Sun Cluster Software Installation Guide for Solaris OS.
On all nodes, install any required patches or software for Solaris I/O multipathing software support to nodes and enable multipathing.
For the procedure about how to install the Solaris I/O multipathing software, see How to Install Sun Multipathing Software in Sun Cluster Software Installation Guide for Solaris OS.
To create a logical volume, see How to Create a Logical Volume.
To continue with Sun Cluster software installation tasks, see your Sun Cluster software installation documentation.
Use this procedure to add a new storage system to a running cluster. To install a new storage system in a Sun Cluster configuration that is not running, use the procedure in How to Install Storage Systems in a New Cluster
This procedure relies on the following assumptions:
You have enough host adapters to connect the nodes and the storage system to the service processor panel.
If you need to install host adapters, see How to Replace a Host Adapter. When this procedure asks you to replace the failed host adapter, simply install the new host adapter instead.
You do not need to install a new node in your cluster.
If you need to add a node to your cluster, see your Sun Cluster system administration documentation. Ensure that you install the required Solaris patches for storage system support.
Unpack, place, and level the storage system.
For instructions, see your storage system installation documentation. For a list of this documentation, see Related Documentation.
(Optional) Install the Fibre Channel (FC) switch for the storage system if you do not have a switch installed.
For the procedure about how to install an FC switch, see the documentation that shipped with your FC switch hardware.
Connect the nodes to the service processor panel.
(SAN Configuration) Connect the FC switches to the service processor panel.
(Direct-Attached Configuration) Connect each node to the service processor panel directly.
For the procedure about how to cable the storage system, see your storage system installation documentation.
Install the system power cord and the system antistatic strap.
For instructions, see your storage system installation documentation.
Power on the storage system and the nodes.
For instructions about how to power on the storage system, see your storage system installation documentation.
Configure the service processor.
For more information, see your storage system installation documentation.
To create a logical volume, see How to Create a Logical Volume.
If you added a new node, perform the steps in Install the Solaris Operating System and Configure Multipathing as appropriate. Apply the correct patches for storage system support and enable multipathing.
This section contains the procedures about how to configure a storage system in a running cluster. Table 2–2 lists these procedures.
Table 2–2 Task Map: Configuring a Storage System
Task |
Information |
---|---|
Create a logical volume. | |
Remove a logical volume. |
Use this procedure to create a logical volume from unassigned storage capacity.
Sun storage documentation uses the following terms:
Logical volume
Logical device
Logical unit number (LUN)
This manual uses logical volume to refer to all such logical constructs.
This procedure relies on the following prerequisites and assumptions.
All nodes are booted in cluster mode and attached to the storage device.
The storage device is installed and configured. If you are using multipathing, the storage device is configured as described in the installation procedure.
If you are using Solaris I/O multipathing (MPxIO) for the Solaris 10 OS, previously called Sun StorEdge Traffic Manager in the Solaris 9 OS, verify that it is installed and configured and the path to the storage device is functioning. To configure the Traffic Manager for the Solaris 9 OS, see the Sun StorEdge Traffic Manager Installation and Configuration Guide. To configure multipathing for the Solaris 10 OS, see the Solaris Fibre Channel Storage Configuration and Multipathing Support Guide.
This procedure provides the long forms of the Sun Cluster commands. Most commands also have short forms. Except for the forms of the command names, the commands are identical. For a list of the commands and their short forms, see Appendix A, Sun Cluster Object-Oriented Commands, in Sun Cluster 3.1 - 3.2 Hardware Administration Manual for Solaris OS.
Become superuser or assume a role that provides solaris.cluster.modify role-based access control (RBAC) authorization.
Follow the instructions in your storage device's documentation to create and map the logical volume. For a URL to this storage documentation, see Related Documentation.
Completely set up the logical volume. When you are finished, the volume must be created, mapped, mounted, and initialized.
If necessary, partition the volume.
To allow multiple clusters and nonclustered nodes to access the storage device, create initiator groups by using LUN masking.
If you are not using multipathing, skip to Step 5.
If you are using multipathing, and if any devices that are associated with the volume you created are at an unconfigured state, configure the multipathing paths on each node that is connected to the storage device.
To determine whether any devices that are associated with the volume you created are at an unconfigured state, use the following command.
# cfgadm -al | grep disk |
To configure the Solaris I/O multipathing paths on each node that is connected to the storage device, use the following command.
# cfgadm -o force_update -c configure controllerinstance |
To configure the Traffic Manager for the Solaris 9 OS, see the Sun StorEdge Traffic Manager Installation and Configuration Guide. To configure multipathing for the Solaris 10 OS, see the Solaris Fibre Channel Storage Configuration and Multipathing Support Guide.
On one node that is connected to the storage device, use the format command to label the new logical volume.
From any node in the cluster, update the global device namespace.
If you are using Sun Cluster 3.2, use the following command:
# cldevice populate |
If you are using Sun Cluster 3.1, use the following command:
# scgdevs |
You might have a volume management daemon such as vold running on your node, and have a DVD drive connected to the node. Under these conditions, a device busy error might be returned even if no disk is inserted in the drive. This error is expected behavior. You can safely ignore this error message.
To manage this volume with volume management software, use Solaris Volume Manager or Veritas Volume Manager commands to update the list of devices on all nodes that are attached to the new volume that you created.
For more information, see your Solaris Volume Manager or Veritas Volume Manager documentation.
To configure a logical volume as a quorum device, see Chapter 6, Administering Quorum, in Sun Cluster System Administration Guide for Solaris OS.
To create a new resource or configure a running resource to use the new logical volume, see Chapter 2, Administering Data Service Resources, in Sun Cluster Data Services Planning and Administration Guide for Solaris OS.
Use this procedure to remove a logical volume. This procedure defines Node A as the node with which you begin working.
Sun storage documentation uses the following terms:
Logical volume
Logical device
Logical unit number (LUN)
This manual uses logical volume to refer to all such logical constructs.
This procedure relies on the following prerequisites and assumptions.
All nodes are booted in cluster mode and attached to the storage device.
The logical volume and the path between the nodes and the storage device are both operational.
This procedure provides the long forms of the Sun Cluster commands. Most commands also have short forms. Except for the forms of the command names, the commands are identical. For a list of the commands and their short forms, see Appendix A, Sun Cluster Object-Oriented Commands, in Sun Cluster 3.1 - 3.2 Hardware Administration Manual for Solaris OS.
Become superuser or assume a role that provides solaris.cluster.read and solaris.cluster.modify RBAC authorization.
Identify the logical volume that you are removing.
Refer to your Solaris Volume Manager or Veritas Volume Manager documentation for more information.
(Optional) Migrate all data off the logical volume that you are removing. Alternatively, back up that data.
If the LUN that you are removing is configured as a quorum device, choose and configure another device as the quorum device. Then remove the old quorum device.
To determine whether the LUN is configured as a quorum device, use one of the following commands.
If you are using Sun Cluster 3.2, use the following command:
# clquorum show |
If you are using Sun Cluster 3.1, use the following command:
# scstat -q |
For procedures about how to add and remove quorum devices, see Chapter 6, Administering Quorum, in Sun Cluster System Administration Guide for Solaris OS.
If you are using volume management software, use that software to update the list of devices on all nodes that are attached to the logical volume that you are removing.
For instructions about how to update the list of devices, see your Solaris Volume Manager or Veritas Volume Manager documentation.
If you are using volume management software, run the appropriate Solaris Volume Manager or Veritas Volume Manager commands to remove the logical volume from any diskset or disk group.
For more information, see your Solaris Volume Manager or Veritas Volume Manager documentation.
Volumes that were managed by Veritas Volume Manager must be completely removed from Veritas Volume Manager control before you can delete them from the Sun Cluster environment. After you delete the volume from any disk group, use the following commands on both nodes to remove the volume from Veritas Volume Manager control.
# vxdisk offline Accessname # vxdisk rm Accessname |
Disk access name
If you are using multipathing, unconfigure the volume in Solaris I/O multipathing.
# cfgadm -o force_update -c unconfigure Logical_Volume |
Access the storage device and remove the logical volume.
To remove the volume, see your storage documentation. For a list of storage documentation, see Related Documentation.
Determine the resource groups and device groups that are running on all nodes.
Record this information because you use it in Step 14 and Step 15 of this procedure to return resource groups and device groups to these nodes.
Move all resource groups and device groups off Node A.
Shut down and reboot Node A.
To shut down and boot a node, see Chapter 3, Shutting Down and Booting a Cluster, in Sun Cluster System Administration Guide for Solaris OS.
On Node A, remove the paths to the logical volume that you removed. Remove obsolete device IDs.
For each additional node that is connected to the shared storage that hosted the logical volume, repeat Step 9 to Step 12.
(Optional) Restore the device groups to the original node.
Do the following for each device group that you want to return to the original node.
If you are using Sun Cluster 3.2, use the following command:
# cldevicegroup switch -n nodename devicegroup1[ devicegroup2 …] |
The node to which you are restoring device groups.
The device group or groups that you are restoring to the node.
If you are using Sun Cluster 3.1, use the following command:
# scswitch -z -D devicegroup -h nodename |
(Optional) Restore the resource groups to the original node.
Do the following for each resource group that you want to return to the original node.
If you are using Sun Cluster 3.2, use the following command:
# clresourcegroup switch -n nodename resourcegroup1[ resourcegroup2 …] |
For failover resource groups, the node to which the groups are returned. For scalable resource groups, the node list to which the groups are returned.
The resource group or groups that you are returning to the node or nodes.
If you are using Sun Cluster 3.1, use the following command:
# scswitch -z -g resourcegroup -h nodename |