Sun Cluster 3.0-3.1 With Sun StorEdge T3 or T3+ Array Manual for Solaris OS

Installing Sun StorEdge T3 and T3+ Arrays

This section contains the procedures about how to install storage arrays in a cluster. The following table lists these procedures.

Table 1–1 Task Map: Installing a Storage Array


Task	Information
Installing arrays in a new cluster, using a single-controller configuration	How to Install a Storage Array in a New Cluster Using a Single-Controller Configuration
Installing arrays in a new cluster, using a partner-group configuration	How to Install a Storage Array in a New Cluster, Using a Partner-Group Configuration
Adding arrays to an existing cluster, using a single-controller configuration.	How to Add a Storage Array to an Existing Cluster, Using a Single-Controller Configuration
Adding arrays to an existing cluster, using a partner-group configuration.	How to Add a Storage Array to an Existing Cluster, Using a Partner-Group Configuration
Upgrading a T3 storage array to a T3+ array.	How to Upgrade a StorEdge T3 Controller to a StorEdge T3+ Controller
Migrating a single-controller array configuration to a partner-group configuration.	How to Migrate From a Single-Controller Configuration to a Partner-Group Configuration

How to Install a Storage Array in a New Cluster Using a Single-Controller Configuration

Use this procedure to install and configure the first storage array in a new cluster, using a single-controller configuration. Perform the steps in this procedure in conjunction with the procedures in the Sun Cluster software installation documentation and your server hardware manual.

The following procedures contain instructions for other array-installation situations:

Note –

When you upgrade firmware on a storage device or on an enclosure, redefine the stripe size of a LUN, or perform other LUN operations, a device ID might change unexpectedly. When you perform a check of the device ID configuration by running the scdidadm -c command, the following error message appears on your console if the device ID changed unexpectedly.

device id for nodename:/dev/rdsk/cXtYdZsN does not match physical 
device's id for ddecimalnumber, device may have been replaced.

To fix device IDs that report this error, run the scdidadm -R command for each affected device.

Steps

Install the host adapters in the nodes that are to be connected to the storage array.

For the procedure about how to install host adapters, see the documentation that shipped with your host adapters and nodes.

Install the FC hubs/switches.

For the procedure about how to install FC hubs/switches, see the documentation that shipped with your FC hub/switch hardware.

Note –
If you are using two FC switches and Sun SAN software to create a storage area network (SAN), see SAN Solutions in a Sun Cluster Environment in Sun Cluster 3.0-3.1 Hardware Administration Manual for Solaris OS for more information.

Set up a Reverse Address Resolution Protocol (RARP) server on the network on which the new storage arrays are to reside.

This RARP server enables you to assign an IP address to the new storage array by using each storage array's unique MAC address.

For the procedure about how to set up a RARP server, see the Sun StorEdge T3 and T3+ Array Installation, Operation, and Service Manual.

Are you adding a StorEdge T3+ array?
- If yes, proceed to Step 5.
- If no, install the media interface adapters (MIAs) in the storage array that you are installing, as shown in Figure 1–1.
  
  For the procedure about how to install a media interface adapter (MIA), see the Sun StorEdge T3 and T3+ Array Configuration Guide.

If necessary, install gigabit interface converters (GBICs) or Small Form-Factor Pluggables (SFPs) in the FC hubs/switches, as shown in Figure 1–1.

The GBICs or SFPs let you connect the FC hubs/switches to the storage array that you are installing. For the procedure about how to install an FC hub/switch GBIC or an SFP, see the documentation that shipped with your FC hub/switch hardware.

Install fiber-optic cables between the FC hubs/switches and the storage array, as shown in Figure 1–1.

For the procedure about how to install a fiber-optic cable, see the Sun StorEdge T3 and T3+ Array Configuration Guide.

Install fiber-optic cables between the FC hubs/switches and the nodes, as shown in Figure 1–1.

Install the Ethernet cables between the storage array and the Local Area Network (LAN), as shown in Figure 1–1.

Figure 1–1 Installing a Single-Controller Configuration

Note –
Figure 1–1 shows how to cable two storage arrays to enable data sharing and host-based mirroring. This configuration prevents a single-point of failure.

Install power cords to each storage array that you are installing.

Power on the storage array and confirm that all components are powered on and functional.

Note –
The storage array might require a few minutes to boot.

For the procedure about how to power on a storage array, see the Sun StorEdge T3 and T3+ Array Installation, Operation, and Service Manual.

(Optional) Configure the storage array with logical volumes.

For the procedure about how to configure the storage array with logical volumes, see the Sun StorEdge T3 and T3+ Array Administrator's Guide.

Access each storage array that you are adding. Install the required controller firmware for the storage array.

PatchPro is a patch-management tool that eases the selection and download of patches required for installation or maintenance of Sun Cluster software. PatchPro provides an Interactive Mode tool especially for Sun Cluster. The Interactive Tool makes the installation of patches easier. PatchPro's Expert Mode tool helps you to maintain your configuration with the latest set of patches. Expert Mode is especially useful for obtaining all of the latest patches, not just the high availability and security patches.

To access the PatchPro tool for Sun Cluster software, go to http://www.sun.com/PatchPro/, click Sun Cluster, then choose either Interactive Mode or Expert Mode. Follow the instructions in the PatchPro tool to describe your cluster configuration and download the patches.

For third-party firmware patches, see the SunSolve^SM Online site at http://sunsolve.ebay.sun.com.

Ensure that this new storage array has a unique target address.

For the procedure on how to verify and assign a target address, see the Sun StorEdge T3 and T3+ Array Configuration Guide.

Reset the storage array.

For the procedure about how to reboot or reset a storage array, see the Sun StorEdge T3 and T3+ Array Installation, Operation, and Service Manual.

Install to the nodes the Solaris operating environment. Apply any required Solaris patches for Sun Cluster software and storage array support.

For the procedure about how to install the Solaris operating environment, see your Sun Cluster software installation documentation. For the location of required Solaris patches and installation instructions for Sun Cluster software support, see your Sun Cluster release notes documentation. For a list of required Solaris patches for storage array support, see the Sun StorEdge T3 and T3+ Array Release Notes.

How to Install a Storage Array in a New Cluster, Using a Partner-Group Configuration

Use this procedure to install and configure the first storage array partner groups in a new cluster. Perform the steps in this procedure in conjunction with the procedures in the Sun Cluster software installation documentation and your server hardware manual.

Make certain that you are using the correct procedure. This procedure contains instructions about how to install a partner group into a new cluster, before the cluster is operational. The following procedures contain instructions for other array-installation situations:

Note –

device id for nodename:/dev/rdsk/cXtYdZsN does not match physical 
device's id for ddecimalnumber, device may have been replaced.

To fix device IDs that report this error, run the scdidadm -R command for each affected device.

Steps

Install the host adapters in the nodes to be connected to the storage arrays.

For the procedure about how to install host adapters, see the documentation that shipped with your host adapters and nodes.

Install the Fibre Channel (FC) switches.

For the procedure about how to install an FC switch, see the documentation that shipped with your switch hardware.

Note –
If you are using two FC switches and Sun SAN software to create a storage area network (SAN), see SAN Considerations for more information.

Are you installing Sun StorEdge T3+ arrays?
- If no, proceed to Step 4
- If yes, install the media interface adapters (MIAs) in the Sun StorEdge T3 arrays that you are installing, as shown in Figure 1–2.
  
  Figure 1–2 Installing a Partner-Group Configuration
  
  For the procedure about how to install a media interface adapter (MIA), see the Sun StorEdge T3 and T3+ Array Configuration Guide.

If necessary, install GBICs or SFPs in the FC switches, as shown in Figure 1–2.

For the procedure about how to install a GBIC or an SFP to an FC switch, see the documentation that shipped with your FC switch hardware.

Set up a Reverse Address Resolution Protocol (RARP) server on the network on which the new storage arrays are to reside.

This RARP server enables you to assign an IP address to the new storage arrays. Assign an IP address by using the storage array's unique MAC address. For the procedure about how to set up a RARP server, see the Sun StorEdge T3 and T3+ Array Installation, Operation, and Service Manual.

Cable the storage arrays, as shown in Figure 1–2.
1. Connect the storage arrays to the FC switches by using fiber-optic cables.
2. Connect the Ethernet cables from each storage array to the LAN.
3. Connect interconnect cables between the two storage arrays of each partner group.
4. Connect power cords to each storage array.
For the procedure about how to install fiber-optic, Ethernet, and interconnect cables, see the Sun StorEdge T3 and T3+ Array Installation, Operation, and Service Manual.

Power on the storage arrays. Verify that all components are powered on and functional.

For the procedure about how to power on the storage arrays and verify the hardware configuration, see the Sun StorEdge T3 and T3+ Array Installation, Operation, and Service Manual.

Administer the storage arrays' network settings.

Use the telnet command to access the master controller unit and administer the storage arrays. For the procedure on how to administer the storage array network addresses and settings, see the Sun StorEdge T3 and T3+ Array Installation, Operation, and Service Manual.

The master controller unit is the storage array that has the interconnect cables attached to the second port of each interconnect card, when viewed from the rear of the storage arrays. For example, Figure 1–2 shows the master controller unit of the partner group as the lower storage array. In this diagram, the interconnect cables are connected to the second port of each interconnect card on the master controller unit.

Install any required storage array controller firmware.

For partner-group configurations, use the telnet command to access the master controller unit. Install the required controller firmware.

PatchPro is a patch-management tool that eases the selection and download of patches required for installation or maintenance of Sun Cluster software. PatchPro provides an Interactive Mode tool especially for Sun Cluster. The Interactive Tool makes the installation of patches easier. PatchPro's Expert Mode tool helps you to maintain your configuration with the latest set of patches. Expert Mode is especially useful for obtaining all of the latest patches, not just the high availability and security patches.

To access the PatchPro tool for Sun Cluster software, go to http://www.sun.com/PatchPro/, click Sun Cluster, then choose either Interactive Mode or Expert Mode. Follow the instructions in the PatchPro tool to describe your cluster configuration and download the patches.

For third-party firmware patches, see the SunSolve^SM Online site at http://sunsolve.ebay.sun.com.

Ensure that each storage array has a unique target address.

For the procedure about how to verify and assign a target address to a storage array, see the Sun StorEdge T3 and T3+ Array Configuration Guide.

Ensure that the cache and mirror settings for each storage array are set to auto.

For more information, see the Sun StorEdge T3 and T3+ Array Administrator's Guide.

Ensure that the mp_support parameter for each storage array is set to mpxio.

For more information, see the Sun StorEdge T3 and T3+ Array Administrator's Guide.

Ensure that both storage array controllers are online.

For more information about how to correct the situation if both controllers are not online, see the Sun StorEdge T3 and T3+ Array Administrator's Guide.

(Optional) Configure the storage arrays with the desired logical volumes.

For the procedure about how to create and initialize a logical volume, see the Sun StorEdge T3 and T3+ Array Administrator's Guide. For the procedure about how to mount a logical volume, see the Sun StorEdge T3 and T3+ Array Installation, Operation, and Service Manual.

Reset the storage arrays.

For the procedure about how to reboot or reset a storage array, see the Sun StorEdge T3 and T3+ Array Installation, Operation, and Service Manual.

On all nodes, install the Solaris operating environment. Apply the required Solaris patches for Sun Cluster software and storage array support.

For the procedure about how to install the Solaris operating environment, see How to Install Solaris Software in Sun Cluster Software Installation Guide for Solaris OS

Install any required patches or software for Sun StorEdge Traffic Manager software support to nodes.

For the procedure about how to install the Sun StorEdge Traffic Manager software, see How to Install Sun Multipathing Software in Sun Cluster Software Installation Guide for Solaris OS.

On all nodes, update the /devices and /dev entries.
# devfsadm -C

On all nodes, confirm that all storage arrays that you installed are visible.
# luxadm display

How to Add a Storage Array to an Existing Cluster, Using a Single-Controller Configuration

This procedure contains instructions about how to add a new storage array to a running cluster in a single-controller configuration. The following procedures contain instructions for other array-installation situations:

This procedure defines Node A as the node with which you begin working. Node B is another node in the cluster.

Steps

Set up a Reverse Address Resolution Protocol (RARP) server on the network you want the new storage arrays to reside on. Afterward, assign an IP address to the new storage arrays.

This RARP server enables you to assign an IP address to the new storage array by using the storage array's unique MAC address.

For the procedure about how to set up a RARP server, see the Sun StorEdge T3 and T3+ Array Installation, Operation, and Service Manual.

Are you adding a StorEdge T3+ array?
- If yes, proceed to Step 3.
- If no, skip to Step 4.

Install the media interface adapter (MIA) in storage array that you are adding, as shown in Figure 1–3.

For the procedure about how to install a media interface adapter (MIA), see the Sun StorEdge T3 and T3+ Array Configuration Guide.

If necessary, install gigabit interface converters (GBICs) or Small Form-Factor Pluggables (SFPs) in the FC hub/switch, as shown in Figure 1–3.

The GBICs or SFPs enables you to connect the FC hubs/switches to the storage array that you are adding.

For the procedure about how to install an FC hub/switch GBIC or an SFP, see the documentation that shipped with your FC hub/switch hardware.

Note –
If you are using two FC switches and Sun SAN software to create a storage area network (SAN), see SAN Solutions in a Sun Cluster Environment in Sun Cluster 3.0-3.1 Hardware Administration Manual for Solaris OS for more information.

Install the Ethernet cable between the storage array and the Local Area Network (LAN), as shown in Figure 1–3.

Power on the storage array array.

Note –
The storage array might require a few minutes to boot.

For the procedure about how to power on a storage array, see the Sun StorEdge T3 and T3+ Array Installation, Operation, and Service Manual.

Access the storage array that you are adding. If necessary, install the required controller firmware for the storage array.

PatchPro is a patch-management tool that eases the selection and download of patches required for installation or maintenance of Sun Cluster software. PatchPro provides an Interactive Mode tool especially for Sun Cluster. The Interactive Tool makes the installation of patches easier. PatchPro's Expert Mode tool helps you to maintain your configuration with the latest set of patches. Expert Mode is especially useful for obtaining all of the latest patches, not just the high availability and security patches.

To access the PatchPro tool for Sun Cluster software, go to http://www.sun.com/PatchPro/, click Sun Cluster, then choose either Interactive Mode or Expert Mode. Follow the instructions in the PatchPro tool to describe your cluster configuration and download the patches.

For third-party firmware patches, see the SunSolve^SM Online site at http://sunsolve.ebay.sun.com.

Does this new storage array have a unique target address?
- If yes, proceed to Step 9.
- If no, change the target address for this new storage array.
For the procedure about how to verify and assign a target address, see the Sun StorEdge T3 and T3+ Array Configuration Guide.

Install a fiber-optic cable between the FC hub/switch and the storage array, as shown in Figure 1–3.

For the procedure about how to install a fiber-optic cable, see the Sun StorEdge T3 and T3+ Array Configuration Guide.

Figure 1–3 Adding a Single-Controller Configuration: Part I

Note –
Figure 1–3 shows how to cable two storage arrays to enable data sharing and host-based mirroring. This configuration prevents a single-point of failure.

Configure the new storage array.

For the procedure about how to create a logical volume, see the Sun StorEdge T3 and T3+ Array Administrator's Guide.

Determine the resource groups and device groups that are running on Node A and Node B.

Record this information because you use this information in Step 41 of this procedure to return resource groups and device groups to these nodes.
# scstat

Move all resource groups and device groups off Node A.
# scswitch -S -h from-node

Do you need to install a host adapter in Node A?
- If yes, proceed to Step 14.
- If no, skip to Step 36.

Is the host adapter that you are installing the first FC host adapter on Node A?

If no, skip to Step 16.

If yes, determine whether the Fibre Channel support packages are already installed on these nodes. This product requires the following packages.

# pkginfo | egrep Wlux
system	SUNWluxd		Sun Enterprise Network Array sf Device Driver
system	SUNWluxdx	Sun Enterprise Network Array sf Device Driver 
									(64-bit)
system	SUNWluxl		Sun Enterprise Network Array socal Device Driver
system	SUNWluxlx	Sun Enterprise Network Array socal Device Driver 
									(64-bit)
system	SUNWluxop	Sun Enterprise Network Array firmware and utilities

Are the Fibre Channel support packages installed?
- If yes, proceed to Step 16.
- If no, install the required support packages that are missing.
The storage array packages are located in the Product directory of the Solaris CD-ROM. Add any necessary packages.

Shut down Node A.

For the procedure about how to shut down and power off a node, see your Sun Cluster system administration documentation.

Power off Node A.

Install the host adapter in Node A.

For the procedure about how to install a host adapter, see the documentation that shipped with your host adapter and node.

If necessary, power on and boot Node A into noncluster mode.

For the procedure about how to boot a node in noncluster mode, see your Sun Cluster system administration documentation.

If necessary, upgrade the host adapter firmware on Node A.

PatchPro is a patch-management tool that eases the selection and download of patches required for installation or maintenance of Sun Cluster software. PatchPro provides an Interactive Mode tool especially for Sun Cluster. The Interactive Tool makes the installation of patches easier. PatchPro's Expert Mode tool helps you to maintain your configuration with the latest set of patches. Expert Mode is especially useful for obtaining all of the latest patches, not just the high availability and security patches.

To access the PatchPro tool for Sun Cluster software, go to http://www.sun.com/PatchPro/, click Sun Cluster, then choose either Interactive Mode or Expert Mode. Follow the instructions in the PatchPro tool to describe your cluster configuration and download the patches.

For third-party firmware patches, see the SunSolve^SM Online site at http://sunsolve.ebay.sun.com.

Connect a fiber-optic cable between the FC hub/switch and Node A, as shown in Figure 1–4.

For the procedure about how to install an FC host adapter GBIC or an SFP, see your host adapter documentation. For the procedure about how to install a fiber-optic cable, see the Sun StorEdge T3 and T3+ Array Configuration Guide.

Figure 1–4 Adding a Single-Controller Configuration: Part II

If necessary, install the required Solaris patches for array support on Node A.

For a list of required Solaris patches for storage array support, see the Sun StorEdge T3 and T3+ Array Release Notes.

Shut down Node A.

For the procedure about how to shut down and power off a node, see your Sun Cluster system administration documentation.

Perform a reconfiguration boot to create the new Solaris device files and links on Node A.
# boot -r

Label the new logical volume.

For the procedure about how to label a logical volume, see the Sun StorEdge T3 and T3+ Array Administrator's Guide.

(Optional) On Node A, verify that the device IDs (DIDs) are assigned to the new LUNs.
# scdidadm -l

Do you need to install a host adapter in Node B?
- If yes, proceed to Step 28.
- If no, skip to Step 35.

Is the host adapter that you are installing the first FC host adapter on Node B?

If no, skip to Step 30.

If yes, determine whether the Fibre Channel support packages are already installed on these nodes. This product requires the following packages.

# pkginfo | egrep Wlux
system	SUNWluxd		Sun Enterprise Network Array sf Device Driver
system	SUNWluxdx	Sun Enterprise Network Array sf Device Driver 
									(64-bit)
system	SUNWluxl		Sun Enterprise Network Array socal Device Driver
system	SUNWluxlx	Sun Enterprise Network Array socal Device Driver 
									(64-bit)
system	SUNWluxop	Sun Enterprise Network Array firmware and utilities

Are the Fibre Channel support packages installed?
- If yes, proceed to Step 30.
- If no, install the required support packages that are missing.
The storage array packages are located in the Product directory of the Solaris CD-ROM. Add any necessary packages.

Shut down Node B.

For the procedure about how to shut down and power off a node, see your Sun Cluster system administration documentation.

Power off Node B.

For more information, see your Sun Cluster system administration documentation.

Install the host adapter in Node B.

For the procedure about how to install a host adapter, see the documentation that shipped with your host adapter and node.

If necessary, power on and boot Node B into noncluster mode.

For the procedure about how to boot a node in noncluster mode, see your Sun Cluster system administration documentation.

If necessary, upgrade the host adapter firmware on Node B.

PatchPro is a patch-management tool that eases the selection and download of patches required for installation or maintenance of Sun Cluster software. PatchPro provides an Interactive Mode tool especially for Sun Cluster. The Interactive Tool makes the installation of patches easier. PatchPro's Expert Mode tool helps you to maintain your configuration with the latest set of patches. Expert Mode is especially useful for obtaining all of the latest patches, not just the high availability and security patches.

To access the PatchPro tool for Sun Cluster software, go to http://www.sun.com/PatchPro/, click Sun Cluster, then choose either Interactive Mode or Expert Mode. Follow the instructions in the PatchPro tool to describe your cluster configuration and download the patches.

For third-party firmware patches, see the SunSolve^SM Online site at http://sunsolve.ebay.sun.com.

If necessary, install a GBIC or an SFP, as shown in Figure 1–5.

For the procedure about how to install an FC hub/switch GBIC or an SFP, see the documentation that shipped with your FC hub/switch hardware.

Note –
If you are using two FC switches and Sun SAN software to create a storage area network (SAN), see SAN Solutions in a Sun Cluster Environment in Sun Cluster 3.0-3.1 Hardware Administration Manual for Solaris OS for more information.

If necessary, connect a fiber-optic cable between the FC hub/switch and Node B, as shown in Figure 1–5.

For the procedure about how to install an FC host adapter GBIC or an SFP, see your host adapter documentation. For the procedure about how to install a fiber-optic cable, see the Sun StorEdge T3 and T3+ Array Configuration Guide.

Figure 1–5 Adding a Single-Controller Configuration: Part III

If necessary, install the required Solaris patches for storage array support on Node B.

For a list of required Solaris patches for storage array support, see the Sun StorEdge T3 and T3+ Array Release Notes.

Shut down Node B.

For the procedure about how to shut down and power off a node, see your Sun Cluster system administration documentation.

Perform a reconfiguration boot to create the new Solaris device files and links on Node B.
# boot -r

(Optional) On Node B, verify that the device IDs (DIDs) are assigned to the new LUNs.
# scdidadm -l

Return the resource groups and device groups that you identified in Step 11 to Node A and Node B.
# scswitch -z -g resource-group -h nodename # scswitch -z -D device-group-name -h nodename
For more information, see your Sun Cluster system administration documentation.

Perform volume management administration to incorporate the new logical volumes into the cluster.

For more information, see your Solstice DiskSuite/Solaris Volume Manager or VERITAS Volume Manager documentation.

How to Add a Storage Array to an Existing Cluster, Using a Partner-Group Configuration

This procedure contains instructions about how to add new storage array partner groups to a running cluster. The following procedures contain instructions for other array-installation situations:

This procedure defines Node A as the node that you begin working with. Node B is the second node.

Steps

Set up a Reverse Address Resolution Protocol (RARP) server on the network you want the new storage arrays to reside on. Afterward, assign an IP address to the new storage arrays.

Note –
Assign an IP address to the master controller unit only. The master controller unit is the storage array that has the interconnect cables attached to the to the second port of each interconnect card, as shown in Figure 1–6.

This RARP server enables you to assign an IP address to the new storage arrays. Assign an IP address by using the storage array's unique MAC address. For the procedure about how to set up a RARP server, see the Sun StorEdge T3 and T3+ Array Installation, Operation, and Service Manual.

Install the Ethernet cable between the storage arrays and the local area network (LAN), as shown in Figure 1–6.

If not already installed, install interconnect cables between the two storage arrays of each partner group, as shown in Figure 1–6.

For the procedure about how to install interconnect cables, see the Sun StorEdge T3 and T3+ Array Installation, Operation, and Service Manual.

Figure 1–6 Adding a Partner-Group Configuration: Part I

Power on the storage arrays.

Note –
The storage arrays might require several minutes to boot.

For the procedure about how to power on storage arrays, see the Sun StorEdge T3 and T3+ Array Installation, Operation, and Service Manual.

Administer the storage arrays' network addresses and settings.

Use the telnet command to access the master controller unit and administer the storage arrays.

For the procedure about how to administer the network address and the settings of a storage array, see the Sun StorEdge T3 and T3+ Array Installation, Operation, and Service Manual.

Install any required storage array controller firmware upgrades.

For partner-group configurations, use the telnet command to the master controller unit. If necessary, install the required controller firmware for the storage array.

For the required revision number of the storage array controller firmware, see the Sun StorEdge T3 Disk Tray Release Notes.

Ensure that each storage array has a unique target address.

For the procedure about how to verify and assign a target address to a storage array, see the Sun StorEdge T3 and T3+ Array Configuration Guide.

Ensure that the cache and mirror settings for each storage array are set to auto.

For more information, see the Sun StorEdge T3 and T3+ Array Administrator's Guide.

Ensure that the mp_support parameter for each storage array is set to mpxio.

For more information, see the Sun StorEdge T3 and T3+ Array Administrator's Guide.

Configure the new storage arrays with the desired logical volumes.

For the procedure about how to create and initialize a logical volume, see the Sun StorEdge T3 and T3+ Array Administrator's Guide. For the procedure about how to mount a logical volume, see the Sun StorEdge T3 and T3+ Array Installation, Operation, and Service Manual.

Reset the storage arrays.

For the procedure about how to reboot or reset a storage array, see the Sun StorEdge T3 and T3+ Array Installation, Operation, and Service Manual.

Are you adding Sun StorEdge T3+ arrays?
- If no, proceed to Step 13.
- If yes, install the media interface adapter (MIA) in the Sun StorEdge T3 arrays that you are adding, as shown in Figure 1–6.
  
  For the procedure about how to install an MIA, see the Sun StorEdge T3 and T3+ Array Configuration Guide.

If necessary, install GBICs or SFPs in the FC switches, as shown in Figure 1–6.

For the procedure about how to install a GBIC or an SFP to an FC switch, see the documentation that shipped with your FC switch hardware.

Install a fiber-optic cable between each FC switch and both new storage arrays of the partner group, as shown in Figure 1–6.

For the procedure about how to install a fiber-optic cable, see the Sun StorEdge T3 and T3+ Array Installation, Operation, and Service Manual.

Note –
If you are using two FC switches and Sun SAN software to create a storage area network (SAN), see SAN Considerations for more information.

Determine the resource groups and device groups that are running on all nodes.

Record this information because you use this information in Step 48 of this procedure to return resource groups and device groups to these nodes.
# scstat

Move all resource groups and device groups off Node A.
# scswitch -S -h from-node

Do you need to install host adapters in Node A?
- If no, skip to Step 39.
- If yes, proceed to Step 18.

Is the host adapter that you are installing the first host adapter on Node A?

If no, skip to Step 20.

If yes, determine whether the required support packages are already installed on this node. The following packages are required.

# pkginfo | egrep Wlux
system 	SUNWluxd		Sun Enterprise Network Array sf Device Driver
system 	SUNWluxdx	Sun Enterprise Network Array sf Device Driver
								(64-bit)
system 	SUNWluxl 	Sun Enterprise Network Array socal Device Driver
system 	SUNWluxlx 	Sun Enterprise Network Array socal Device Driver
								(64-bit)
system 	SUNWluxop 	Sun Enterprise Network Array firmware and utilities
system 	SUNWluxox 	Sun Enterprise Network Array libraries (64-bit)

Are the required support packages already installed?
- If yes, proceed to Step 20.
- If no, install the required support packages that are missing.
The support packages are located in the Product directory of the Solaris CD-ROM. Add any missing packages.

Shut down and power off Node A.

For the procedure about how to shut down and power off a node, see your Sun Cluster system administration documentation.

Install the host adapters in Node A.

For the procedure about how to install host adapters, see the documentation that shipped with your host adapters and nodes.

Power on and boot Node A into noncluster mode.

For more information about how to boot nodes, see your Sun Cluster system administration documentation.

If necessary, upgrade the host adapter firmware on Node A.

PatchPro is a patch-management tool that eases the selection and download of patches required for installation or maintenance of Sun Cluster software. PatchPro provides an Interactive Mode tool especially for Sun Cluster. The Interactive Tool makes the installation of patches easier. PatchPro's Expert Mode tool helps you to maintain your configuration with the latest set of patches. Expert Mode is especially useful for obtaining all of the latest patches, not just the high availability and security patches.

To access the PatchPro tool for Sun Cluster software, go to http://www.sun.com/PatchPro/, click Sun Cluster, then choose either Interactive Mode or Expert Mode. Follow the instructions in the PatchPro tool to describe your cluster configuration and download the patches.

For third-party firmware patches, see the SunSolve^SM Online site at http://sunsolve.ebay.sun.com.

Connect fiber-optic cables between Node A and the FC switches, as shown in Figure 1–7.

For the procedure about how to install a fiber-optic cable, see the Sun StorEdge T3 and T3+ Array Installation, Operation, and Service Manual.

Note –
If you are using two FC switches and Sun SAN software to create a storage area network (SAN), see SAN Considerations for more information.

Figure 1–7 Adding a Partner-Group Configuration: Part II

If necessary, install the required Solaris patches for storage array support on Node A.

PatchPro is a patch-management tool that eases the selection and download of patches required for installation or maintenance of Sun Cluster software. PatchPro provides an Interactive Mode tool especially for Sun Cluster. The Interactive Tool makes the installation of patches easier. PatchPro's Expert Mode tool helps you to maintain your configuration with the latest set of patches. Expert Mode is especially useful for obtaining all of the latest patches, not just the high availability and security patches.

To access the PatchPro tool for Sun Cluster software, go to http://www.sun.com/PatchPro/, click Sun Cluster, then choose either Interactive Mode or Expert Mode. Follow the instructions in the PatchPro tool to describe your cluster configuration and download the patches.

For third-party firmware patches, see the SunSolve^SM Online site at http://sunsolve.ebay.sun.com.

Shut down Node A.

For the procedure about how to shut down and power off a node, see your Sun Cluster system administration documentation.

Perform a reconfiguration boot on Node A to create the new Solaris device files and links.
# boot -r

On Node A, update the /devices and /dev entries.
# devfsadm -C

On Node A, update the paths to the DID instances.
# scdidadm -C

Label the new storage array logical volume.

For the procedure about how to label a logical volume, see the Sun StorEdge T3 and T3+ Array Administrator's Guide.

(Optional) On Node A, verify that the device IDs (DIDs) are assigned to the new LUNs.
# scdidadm -l

Do you need to install host adapters in Node B?
- If no, skip to Step 39.
- If yes, proceed to Step 33.

Is the host adapter that you are installing the first host adapter on Node B

If no, skip to Step 35.

If yes, determine whether the required support packages for host adapters are already installed on this node. The following packages are required.

# pkginfo | egrep Wlux
system	SUNWluxd		Sun Enterprise Network Array sf Device Driver
system	SUNWluxdx	Sun Enterprise Network Array sf Device Driver 
									(64-bit)
system	SUNWluxl		Sun Enterprise Network Array socal Device Driver
system	SUNWluxlx	Sun Enterprise Network Array socal Device Driver 
									(64-bit)
system	SUNWluxop	Sun Enterprise Network Array firmware and utilities
system	SUNWluxox	Sun Enterprise Network Array libraries (64-bit)

Are the required support packages already installed?
- If yes, skip to Step 35.
- If no, install the missing support packages.
The support packages are located in the Product directory of the Solaris CD-ROM. Add any missing packages.

Shut down and power off Node B.

For the procedure about how to shut down and power off a node, see your Sun Cluster system administration documentation.

Install the host adapters in Node B.

For the procedure about how to install host adapters, see the documentation that shipped with your host adapters and nodes.

Power on and boot Node B.

For more information on booting nodes, see your Sun Cluster system administration documentation.

If necessary, upgrade the host adapter firmware on Node B.

PatchPro is a patch-management tool that eases the selection and download of patches required for installation or maintenance of Sun Cluster software. PatchPro provides an Interactive Mode tool especially for Sun Cluster. The Interactive Tool makes the installation of patches easier. PatchPro's Expert Mode tool helps you to maintain your configuration with the latest set of patches. Expert Mode is especially useful for obtaining all of the latest patches, not just the high availability and security patches.

To access the PatchPro tool for Sun Cluster software, go to http://www.sun.com/PatchPro/, click Sun Cluster, then choose either Interactive Mode or Expert Mode. Follow the instructions in the PatchPro tool to describe your cluster configuration and download the patches.

For third-party firmware patches, see the SunSolve^SM Online site at http://sunsolve.ebay.sun.com.

If necessary, install GBICs or SFPs to the FC switches, as shown in Figure 1–8.

For the procedure about how to install GBICs or SFPs to an FC switch, see the documentation that shipped with your FC switch hardware.

Connect fiber-optic cables between the FC switches and Node B, as shown in Figure 1–8.

For the procedure about how to install fiber-optic cables, see the Sun StorEdge T3 and T3+ Array Installation, Operation, and Service Manual.

Note –
If you are using two FC switches and Sun SAN software to create a storage area network (SAN), see SAN Considerations for more information.

Figure 1–8 Adding a Partner-Group Configuration: Part III

If necessary, install the required Solaris patches for storage array support on Node B.

For a list of required Solaris patches for storage array support, see the Sun StorEdge T3 Disk Tray Release Notes.

Shut down Node B.

For the procedure about how to shut down and power off a node, see your Sun Cluster system administration documentation.

Perform a reconfiguration boot to create the new Solaris device files and links on Node B.
# boot -r

On Node B, update the /devices and /dev entries.
# devfsadm -C

On Node B, update the paths to the DID instances.
# scdidadm -C

(Optional) On Node B, verify that the DIDs are assigned to the new LUNs.
# scdidadm -l

On one node that is attached to the new storage arrays, reset the SCSI reservation state.
# scdidadm -R n
Where n is the DID instance of a storage array LUN that you are adding to the cluster.

Note –
Repeat this command on the same node for each storage array LUN that you are adding to the cluster.

Return the resource groups and device groups that you identified in Step 15 to all nodes.
# scswitch -z -g resource-group -h nodename # scswitch -z -D device-group-name -h nodename
For more information, see your Sun Cluster system administration documentation.

Perform volume management administration to incorporate the new logical volumes into the cluster.

For more information, see your Solstice DiskSuite or VERITAS Volume Manager documentation.

Next Steps

The best way to enable multipathing for a cluster is to install the multipathing software and enable multipathing before installing the Sun Cluster software and establishing the cluster. For this procedure, see How to Install Sun Multipathing Software in Sun Cluster Software Installation Guide for Solaris OS. If you need to add multipathing software to an established cluster, see How to Install Sun Multipathing Software in Sun Cluster Software Installation Guide for Solaris OS and follow the troubleshooting steps to clean up the device IDs.

Installing Sun StorEdge T3 and T3+ Arrays

How to Install a Storage Array in a New Cluster Using a Single-Controller Configuration

Steps

Figure 1–1 Installing a Single-Controller Configuration

See Also

How to Install a Storage Array in a New Cluster, Using a Partner-Group Configuration

Steps

Figure 1–2 Installing a Partner-Group Configuration

See Also

How to Add a Storage Array to an Existing Cluster, Using a Single-Controller Configuration

Steps

Figure 1–3 Adding a Single-Controller Configuration: Part I

Figure 1–4 Adding a Single-Controller Configuration: Part II

Figure 1–5 Adding a Single-Controller Configuration: Part III

How to Add a Storage Array to an Existing Cluster, Using a Partner-Group Configuration

Steps

Figure 1–6 Adding a Partner-Group Configuration: Part I

Figure 1–7 Adding a Partner-Group Configuration: Part II

Figure 1–8 Adding a Partner-Group Configuration: Part III

Next Steps