test

Sun Cluster 3.0-3.1 With SCSI JBOD Storage Device Manual for Solaris OS

Replacing a Host Adapter

You need to replace a host adapter if your host adapter fails, if it becomes unstable, or if you want to upgrade to a newer version. These procedures define Node A as the node with the host adapter that you plan to replace.

Choose the procedure that corresponds to your cluster configuration.

x86 only –

If your cluster is x86 based, Oracle RAC services are not supported. Follow the instructions in How to Replace a Host Adapter When Using Failover and Scalable Data Services Only.

Cluster Configuration 

Instructions 

Sun Cluster failover and scalable data services only, using the recommended HBA configuration 

How to Replace a Host Adapter When Using Failover and Scalable Data Services Only

Oracle Parallel Server/Real Application Clusters (OPS/RAC) only, using the recommended HBA configuration 

SPARC: How to Replace a Host Adapter When Using Oracle Real Application Clusters Only

Both failover and scalable data services and OPS/RAC, using the recommended HBA configuration 

SPARC: How to Replace a Host Adapter When Using Both Failover and Scalable Data Services and Oracle Real Application Clusters

All clusters using a single, dual-port HBA to provide both paths to shared data 

How to Replace a Host Adapter When Using a Single, Dual-Port HBA to Provide Both Paths to Shared Data

Note –

The first three procedures in this section assume that you are using the recommended HBA configuration: two redundant hardware paths to shared data. If you choose to use a single HBA configuration, see Configuring Cluster Nodes With a Single, Dual-Port HBA in Sun Cluster 3.0-3.1 Hardware Administration Manual for Solaris OS for the risks and restrictions of that configuration and use How to Replace a Host Adapter When Using a Single, Dual-Port HBA to Provide Both Paths to Shared Data.

ProcedureHow to Replace a Host Adapter When Using Failover and Scalable Data Services Only

Before You Begin

This procedure relies on the following prerequisites and assumptions.

If your nodes are configured for dynamic reconfiguration, see the Sun Cluster system administration documentation, and skip steps that instruct you to shut down the node.

Steps

  1. Does your cluster use Oracle Real Application Clusters?

  2. Determine the resource groups and device groups that are running on Node A.

    Record this information because you use this information in Step 17 of this procedure to return resource groups and device groups to Node A.


    # scstat

  3. (Optional) If necessary, move all resource groups and device groups off Node A.


    # scswitch -S -h nodename

  4. Determine if the storage device that is attached to the failed host adapter contains a quorum device.


    # scstat -q

    • If no, skip this step.

    • If yes, add a new quorum device on a different storage device and remove the old quorum device.

      For procedures about how to add and remove quorum devices, see the Sun Cluster system administration documentation.

  5. Detach the Solstice DiskSuite/Solaris Volume Manager submirrors or VERITAS Volume Manager plexes on the storage array.

    For more information, see your Solstice DiskSuite/Solaris Volume Manager or VERITAS Volume Manager documentation.

  6. Record the details of disk groups and volumes affected by the failed host adapter.

    Record this information because you use it in Step 16 of this procedure to reattach submirrors on the storage array. For more information about how to determine which submirrors or plexes are affected, see your Solstice DiskSuite/Solaris Volume Manager or VERITAS Volume Manager documentation.

  7. Is Node A enabled with the Solaris DR feature?

    • If yes, perform any DR-specific steps and skip to Step 10.

    • If no, proceed to Step 8.

    For more information, see your Sun Cluster system administration documentation.

  8. Shut down Node A.

    For the full procedure about how to shut down and power off a node, see your Sun Cluster system administration documentation.

  9. Power off Node A.

  10. Replace the failed host adapter.

    For the procedure about how to remove and add host adapters, see the documentation that shipped with your nodes.

  11. Is Node A enabled with the Solaris DR feature?

    • If yes, perform any DR-specific steps and skip to Step 15.

    • If no, proceed to Step 12.

    For more information, see your Sun Cluster system administration documentation.

  12. Power on Node A.

  13. x86: Set the HBA ports to ensure that each array has a unique SCSI address.

    For instructions on setting SCSI initiator IDs in x86 based systems, see x86: How to Install a Storage Array in a New X86 Based Cluster.

  14. Boot Node A into cluster mode.

    For more information about how to boot nodes, see your Sun Cluster system administration documentation.

  15. If necessary, upgrade the host adapter firmware on Node A.

    PatchPro is a patch-management tool that eases the selection and download of patches required for installation or maintenance of Sun Cluster software. PatchPro provides an Interactive Mode tool especially for Sun Cluster. The Interactive Tool makes the installation of patches easier. PatchPro's Expert Mode tool helps you to maintain your configuration with the latest set of patches. Expert Mode is especially useful for obtaining all of the latest patches, not just the high availability and security patches.

    To access the PatchPro tool for Sun Cluster software, go to http://www.sun.com/PatchPro/, click Sun Cluster, then choose either Interactive Mode or Expert Mode. Follow the instructions in the PatchPro tool to describe your cluster configuration and download the patches.

    For third-party firmware patches, see the SunSolveSM Online site at http://sunsolve.ebay.sun.com.

  16. Reattach the Solstice DiskSuite/Solaris Volume Manager submirrors or VERITAS Volume Manager plexes on the storage array.

    For more information, see your Solstice DiskSuite/Solaris Volume Manager or VERITAS Volume Manager documentation.

  17. (Optional) If necessary, return the resource groups and device groups you identified in Step 2 to Node A.


    # scswitch -z -g resource-group -h nodename
# scswitch -z -D device-group-name -h nodename

    For more information, see your Sun Cluster system administration documentation.

  18. Did you relocate the quorum device in Step 4?

    • If no, this step completes the procedure.

    • If yes, and you want the cluster configured as it was before replacing the host adapter, relocate the quorum device function back to this storage array.

      For procedures about how to add and remove quorum devices, see your Sun Cluster system administration documentation.

ProcedureSPARC: How to Replace a Host Adapter When Using Oracle Real Application Clusters Only

Before You Begin

This procedure relies on the following prerequisites and assumptions.

If your nodes are configured for dynamic reconfiguration, see the Sun Cluster system administration documentation, and skip steps that instruct you to shut down the node.

Steps

  1. Does your cluster use failover or scalable data services (other than Oracle Real Application Clusters)?

  2. Determine the Oracle instance that is running on Node A.


    # ps -ef | grep oracle

  3. Shut down the Oracle Real Application Clusters instance and any other process on Node A that should be stopped before shutting down the node.

    For information about how to shut down and restart an Oracle instance in the RAC environment, refer to your Oracle documentation.

  4. Determine if the storage device that are attached to the failed host adapter contains a quorum device.


    # scstat -q

    • If no, skip to Step 5.

    • If yes, add a new quorum device on a different storage device and remove the old quorum device.

      For procedures about how to add and remove quorum devices, see the Sun Cluster system administration documentation.

  5. Detach the VERITAS Volume Manager plexes on the storage array attached to the failed host adapter.

    For more information, see your VERITAS Volume Manager documentation.

  6. Record the details of disk groups and volumes affected by the failed host adapter

    Record this information because you use it in Step 15 of this procedure to reattach plexes on the storage array. For more information about how to determine which plexes are affected, see your VERITAS Volume Manager documentation.

  7. Is Node A enabled with the Solaris dynamic reconfiguration (DR) feature?

    • If yes, perform any DR-specific steps and skip to Step 10.

    • If no, proceed to Step 8.

    For more information, see your Sun Cluster system administration documentation.

  8. Shut down Node A.

    For the full procedure about how to shut down and power off a node, see your Sun Cluster system administration documentation.

  9. Power off Node A.

  10. Replace the failed host adapter.

    For the procedure about how to remove and add host adapters, see the documentation that shipped with your nodes.

  11. Is Node A enabled with the Solaris dynamic reconfiguration feature?

    • If yes, perform any DR-specific steps and skip to Step 14.

    • If no, proceed to Step 12.

    For more information, see your Sun Cluster system administration documentation.

  12. Power on Node A.

  13. Boot Node A into cluster mode.

    For more information about how to boot nodes, see your Sun Cluster system administration documentation.

  14. If necessary, upgrade the host adapter firmware on Node A.

    PatchPro is a patch-management tool that eases the selection and download of patches required for installation or maintenance of Sun Cluster software. PatchPro provides an Interactive Mode tool especially for Sun Cluster. The Interactive Tool makes the installation of patches easier. PatchPro's Expert Mode tool helps you to maintain your configuration with the latest set of patches. Expert Mode is especially useful for obtaining all of the latest patches, not just the high availability and security patches.

    To access the PatchPro tool for Sun Cluster software, go to http://www.sun.com/PatchPro/, click Sun Cluster, then choose either Interactive Mode or Expert Mode. Follow the instructions in the PatchPro tool to describe your cluster configuration and download the patches.

    For third-party firmware patches, see the SunSolveSM Online site at http://sunsolve.ebay.sun.com.

  15. Reattach the VERITAS Volume Manager plexes on the storage array to their respective volumes.

    For more information, see your VERITAS Volume Manager documentation.

  16. (Optional) Bring your Oracle Real Application Clusters instance online. This is the instance you identified in Step 2.

    For information about how to shut down and restart an Oracle instance in the RAC environment, refer to the Oracle 9iRAC Administration Guide.

  17. (Optional) Did you relocate a quorum device in Step 4?

    • If no, this step completes the procedure.

    • If yes, and you want your configuration to use the same quorum structure after the host adapter replacement, relocate the quorum device function back to this storage array.

      For procedures about how to add and remove quorum devices, see the Sun Cluster system administration documentation.

ProcedureSPARC: How to Replace a Host Adapter When Using Both Failover and Scalable Data Services and Oracle Real Application Clusters

Before You Begin

This procedure relies on the following prerequisites and assumptions.

If your nodes are configured for dynamic reconfiguration, see the Sun Cluster system administration documentation, and skip steps that instruct you to shut down the node.

Steps

  1. Does your cluster use both failover or scalable data services and Oracle Real Application Clusters?

  2. Determine the Oracle instance that is running on Node A.


    # ps -ef | grep oracle

  3. Shut down the Oracle Real Application Clusters instance identified in Step 2.

    For information about how to shut down and restart an Oracle instance in the RAC environment, refer to the Oracle 9iRAC Administration Guide.

  4. Determine the resource groups and device groups that are running on Node A.

    Record this information because you use it in Step 18 of this procedure to return resource groups and device groups to Node A.


    # scstat

  5. Move all resource groups and device groups off Node A.


    # scswitch -S -h nodename

  6. Determine if the storage device that is connected to the failed host adapter contains a quorum device.


    # scstat -q

  7. If Node A contains a quorum device, add a new quorum device on a different storage device and remove the old quorum device.

    For procedures about how to add and remove quorum devices, see the Sun Cluster system administration documentation.

  8. Detach the VERITAS Volume Manager plexes on the storage array that is attached to the failed host adapter.

    For more information, see your VERITAS Volume Manager documentation.

  9. Record the details of plexes that are affected by the failed host adapter.

    Record this information because you use it in Step 18 of this procedure to reattach plexes on the storage array. For more information about how to determine which plexes are affected, see your VERITAS Volume Manager documentation.

  10. Is Node A enabled with the Solaris dynamic reconfiguration (DR) feature?

    • If yes, perform any DR-specific steps and skip to Step 13.

    • If no, proceed to Step 11.

    For more information, see your Sun Cluster system administration documentation.

  11. Shut down Node A.

    For the full procedure about how to shut down and power off a node, see your Sun Cluster system administration documentation.

  12. Power off Node A.

  13. Replace the failed host adapter.

    For the procedure about how to remove and add host adapters, see the documentation that shipped with your nodes.

  14. Is Node A enabled with the Solaris DR feature?

    • If yes, perform any DR-specific steps and skip to Step 17.

    • If no, proceed to Step 15.

    For more information, see your Sun Cluster system administration documentation.

  15. Power on Node A.

  16. Boot Node A into cluster mode.

    For more information about how to boot nodes, see your Sun Cluster system administration documentation.

  17. If necessary, upgrade the host adapter firmware on Node A.

    PatchPro is a patch-management tool that eases the selection and download of patches required for installation or maintenance of Sun Cluster software. PatchPro provides an Interactive Mode tool especially for Sun Cluster. The Interactive Tool makes the installation of patches easier. PatchPro's Expert Mode tool helps you to maintain your configuration with the latest set of patches. Expert Mode is especially useful for obtaining all of the latest patches, not just the high availability and security patches.

    To access the PatchPro tool for Sun Cluster software, go to http://www.sun.com/PatchPro/, click Sun Cluster, then choose either Interactive Mode or Expert Mode. Follow the instructions in the PatchPro tool to describe your cluster configuration and download the patches.

    For third-party firmware patches, see the SunSolveSM Online site at http://sunsolve.ebay.sun.com.

  18. Reattach the VERITAS Volume Manager plexes on the storage array to their respective volumes.

    For more information, see your VERITAS Volume Manager documentation.

  19. (Optional) If necessary, return the resource groups and device groups you identified in Step 5 to Node A.


    # scswitch -z -g resource-group -h nodename
# scswitch -z -D device-group-name -h nodename

    For more information, see your Sun Cluster system administration documentation.

  20. (Optional) Bring your Oracle Real Application Clusters instance online. This is the instance you identified in Step 2.

    For information about how to shut down and restart an Oracle instance in the RAC environment, refer to the Oracle 9iRAC Administration Guide.

  21. (Optional) If you relocated a quorum device in Step 7 and you want your configuration to use the same quorum structure after the host adapter replacement, relocate the quorum device function back to this storage array.

    For procedures about how to add and remove quorum devices, see the Sun Cluster system administration documentation.

Example 2–1 Replacing a Host Adapter in a Running Cluster

In the following example, a two-node cluster is running Oracle Real Application Clusters and VERITAS Volume Manager. In this situation, you begin the host adapter replacement by determining the Oracle instance name.


# ps -ef | grep oracle
oracle 14716 14414  0 14:05:47 console  0:00 grep oracle
oracle 14438     1  0 13:05:44 ?        0:02 ora_lmon_tpcc1
.
.
.
oracle 14434     1  0 13:05:43 ?        0:00 ora_pmon_tpcc1
oracle 14458     1  0 13:05:50 ?        0:00 ora_d000_tpcc1

This output identifies the Oracle Real Application Clusters instance as tpcc1.

Shutting down the Oracle Real Application Clusters instance on Node A involves several steps, as shown in the following example. 


# su - oracle 
Sun Microsystems Inc.   SunOS 5.9       Generic May 2002
$ ksh 
$ ORACLE_SID=tpcc1
$ ORACLE_HOME=/export/home/oracle/OraHome1
$ export ORACLE_SID ORACLE_HOME 
$ sqlplus " /as sysdba " 

SQL*Plus: Release 9.2.0.4.0 - Production on Mon Jan 5 14:12:28 2004

Copyright (c) 1982, 2002, Oracle Corporation.  All rights reserved.


Connected to:
Oracle9i Enterprise Edition Release 9.2.0.4.0 - 64bit Production
With the Partitioning, Real Application Clusters, OLAP and Oracle Data 
Mining options
JServer Release 9.2.0.4.0 - Production

SQL> shutdown immediate ;
Database closed.
Database dismounted.
ORACLE instance shut down.

SQL> exit 
Disconnected from Oracle9i Enterprise Edition Release 9.2.0.4.0 - 64bit 
Production With the Partitioning, Real Application Clusters, OLAP and 
Oracle Data Mining options
JServer Release 9.2.0.4.0 - Production
$ lsnrctl 

LSNRCTL for Solaris: Version 9.2.0.4.0 - Production on 05-JAN-2004 14:15:09

Copyright (c) 1991, 2002, Oracle Corporation.  All rights reserved.

Welcome to LSNRCTL, type "help" for information.

LSNRCTL> stop 
Connecting to (DESCRIPTION=(ADDRESS=(PROTOCOL=IPC)(KEY=EXTPROC)))
The command completed successfully
LSNRCTL>

  1. After you have stopped the Oracle Real Application Clusters instance, check for a quorum device and, if necessary, reconfigure the quorum device.

  2. When you are certain that the node with the failed adapter does not contain a quorum device, proceed to determine the affected plexes.

    Record this information for use in reestablishing the original storage configuration. In the following example, c2 is the controller with the failed host adapter. 


 # vxprint -ht -g tpcc | grep c2
 dm tpcc01    c2t0d0s2     sliced   4063     8374320  -
 dm tpcc02    c2t1d0s2     sliced   4063     8374320  -
 dm tpcc03    c2t2d0s2     sliced   4063     8374320  -
 dm tpcc04    c2t3d0s2     sliced   4063     8374320  -
 dm tpcc09    c2t8d0s2     sliced   4063     8374320  -
 dm tpcc10    c2t9d0s2     sliced   4063     8374320  -
 sd tpcc02-01 control_001-01 tpcc02 0        41040    0       c2t1d0 ENA
.
.
.
 sd tpcc03-06 temp_0_0-02  tpcc03   2967840  276480   0       c2t2d0 ENA
 sd tpcc03-04 ware_0_0-02  tpcc03   2751840  95040    0       c2t2d0 ENA

From this output, you can easily determine which plexes and subdisks are affected by the failed adapter. These are the plexes you detach from the storage array. 


/usr/sbin/vxplex -g tpcc  det  control_001-02
/usr/sbin/vxplex -g tpcc  det  temp_0_0-02

  1. After the plexes are detached, you can safely shut down the node, if necessary.

  2. Proceed with replacing the failed host adapter, following instructions that accompanied that device.

  3. After you replace the failed host adapter, and Node A is in cluster mode, reattach the plexes and replace any quorum device to reestablish your original cluster configuration.

ProcedureHow to Replace a Host Adapter When Using a Single, Dual-Port HBA to Provide Both Paths to Shared Data

Before You Begin

This procedure relies on the following prerequisites and assumptions.

Steps

  1. If you are using scalable and failover services, determine the resource groups and device groups that are running on Node A.

    Record this information because you use it in Step 18 of this procedure to return resource groups and device groups to Node A.


    # scstat

  2. Record the details of metadevices that are affected by the failed host adapter.

  3. SPARC: If you are using Oracle Real Application Clusters, shut down all RAC instances running in your cluster.

    For information about how to shut down and restart an Oracle instance in the RAC environment, refer to the Oracle 9iRAC Administration Guide.

  4. Shut down the cluster.

    For the full procedure about how to shut down a cluster, see your Sun Cluster system administration documentation.

  5. Power off Node A.

  6. Replace the failed host adapter.

    For the procedure about how to remove and add host adapters, see the documentation that shipped with your nodes.

  7. Power on Node A.

  8. Boot all nodes into cluster mode.

    For more information about how to boot nodes, see your Sun Cluster system administration documentation.

  9. If necessary, upgrade the host adapter firmware on Node A.

    PatchPro is a patch-management tool that eases the selection and download of patches required for installation or maintenance of Sun Cluster software. PatchPro provides an Interactive Mode tool especially for Sun Cluster. The Interactive Tool makes the installation of patches easier. PatchPro's Expert Mode tool helps you to maintain your configuration with the latest set of patches. Expert Mode is especially useful for obtaining all of the latest patches, not just the high availability and security patches.

    To access the PatchPro tool for Sun Cluster software, go to http://www.sun.com/PatchPro/, click Sun Cluster, then choose either Interactive Mode or Expert Mode. Follow the instructions in the PatchPro tool to describe your cluster configuration and download the patches.

    For third-party firmware patches, see the SunSolveSM Online site at http://sunsolve.ebay.sun.com.

  10. Perform any volume management maintenance procedures that are necessary to fix any metadevices affected by this procedure.

    For more information, see your volume manager software documentation.

  11. (Optional) If necessary, return the resource groups and device groups you identified in Step 5 to Node A.


    # scswitch -z -g resource-group -h nodename
# scswitch -z -D device-group-name -h nodename

    For more information, see your Sun Cluster system administration documentation.

  12. (Optional) Bring all Oracle Real Application Clusters instance online.

    For information about how to shut down and restart an Oracle instance in the RAC environment, refer to the Oracle 9iRAC Administration Guide.