Sun Cluster Data Service for Oracle RAC Guide for Solaris OS

Verifying the Installation and Configuration of Sun Cluster Support for Oracle RAC

After you install, register, and configure Sun Cluster Support for Oracle RAC, verify the installation and configuration. Verifying the Sun Cluster Support for Oracle RAC installation and configuration determines if resources and resource groups for Oracle RAC behave as required.

Offline-restart dependencies between resources ensure that if the independent resource is about to be taken offline, the dependent resource is taken offline first. The dependent resource remains offline until the independent resource is restarted. The procedures in this section explain how to verify that these dependencies are correctly set. For detailed information about offline-restart dependencies, see the description of the resource_dependencies_offline_restart resource property in Resource Properties in Sun Cluster Data Services Planning and Administration Guide for Solaris OS.

    Verifying the installation and configuration of Sun Cluster Support for Oracle RAC involves the following tasks:

  1. Verifying the configuration of the RAC Framework resource group

  2. Verifying the configuration of storage resources for Oracle files

  3. (Oracle 10g R2 and Oracle 9i only) Verifying the configuration of resources for Oracle RAC database instances


    Note –

    If you are using Oracle 10g R1, no resources for Oracle RAC database instances are configured.


    The task to perform depends on the version of Oracle RAC that you are using:

  4. Verifying the correct behavior for shutdown and booting of the cluster

ProcedureHow to Verify the Configuration of the RAC Framework Resource Group

The RAC framework resource group is created when the task in Registering and Configuring the RAC Framework Resource Group is performed.

This procedure provides the long forms of the Sun Cluster maintenance commands. Most commands also have short forms. Except for the forms of the command names, the commands are identical. For a list of the commands and their short forms, see Appendix A, Sun Cluster Object-Oriented Commands, in Sun Cluster Data Services Planning and Administration Guide for Solaris OS.

  1. Become superuser on a cluster node or assume a role that provides solaris.cluster.read and solaris.cluster.admin RBAC authorizations.

  2. Verify that the RAC framework resource group is correctly configured.


    # clresourcegroup show rac-fmk-rg
    
    rac-fmk-rg

    Specifies the name of the RAC framework resource group.

  3. If the RAC framework resource group is not already online, bring online the RAC framework resource group.


    # clresourcegroup online rac-fmwk-rg
    
    rac-fmk-rg

    Specifies the name of the RAC framework resource group.

  4. Verify that all resource groups for Oracle RAC are online.


    # clresourcegroup status
    

ProcedureHow to Verify the Configuration of Storage Resources for Oracle Files

Storage resources for Oracle files are created when the task in Registering and Configuring Storage Resources for Oracle Files is performed.

Perform this task only if your configuration of storage management schemes requires storage resources for Oracle files.

This procedure provides the long forms of the Sun Cluster maintenance commands. Most commands also have short forms. Except for the forms of the command names, the commands are identical. For a list of the commands and their short forms, see Appendix A, Sun Cluster Object-Oriented Commands, in Sun Cluster Data Services Planning and Administration Guide for Solaris OS.

  1. Become superuser on a cluster node.

  2. Verify that all resource groups that contain storage resources for Oracle files are correctly configured.


    # clresourcegroup show rac-storage-rg-list
    
    rac-storage-rg-list

    Specifies a comma-separated list of resource groups that contain storage resources for Oracle files.

  3. Take offline the resource group that contains the resources on which the RAC database resource depends.


    # clresourcegroup offline rac-storage-rg
    
    rac-storage-rg

    Specifies the name of the resource group that contains the resources on which the RAC database resource depends. The resource group to take offline depends on your choice of storage management schemes for Oracle files.

    • If you are using a shared file system for Oracle files, take offline the resource group that contains scalable file-system mount-point resources.

    • If you are using a volume manager without a file system for Oracle files, take offline the resource group that contains scalable device-group resources.

    This step might require several minutes to complete.

  4. Verify that the resource groups for Oracle RAC behave as follows:

    • The status of the resource group that you took offline in Step 3 is offline.

    • The status of the RAC database resource group is offline.

    • The status of the RAC framework resource group depends on the version of Oracle that you are using:

      • If you are using Oracle 10g R2, the status of the RAC framework resource group is pending online blocked.

      • If you are using Oracle 10g R1 or Oracle 9i, the status of the RAC framework resource group remains online.


    # clresourcegroup status
    
  5. (Oracle 10g R2 only) Verify that the Oracle CRS are offline.

    To verify that the Oracle CRS are offline, consult the system messages file to find messages to indicate that CRS are being shut down.

  6. Bring online the resource group that you took offline in Step 3.


    # clresourcegroup online rac-storage-rg
    
    rac-storage-rg

    Specifies the name of the resource group that you took offline in Step 3.

    This step might require several minutes to complete.

  7. (Oracle 10g R2 only) On each node, restart the Oracle CRS.


    # /etc/init.d/init.crs start
    Startup will be queued to init within 30 seconds.

    This step might require several minutes to complete.

  8. (Oracle 10g R2 only) On each node, verify that the Oracle CRS are online.

    Use the Oracle command crstat for this purpose.


    # crs-home/bin/crs_stat
    
    crs-home

    Specifies the Oracle CRS home directory. This directory contains the Oracle CRS binary files and Oracle CRS configuration files.


    Note –

    The startup of Oracle CRS on all nodes might require several minutes to complete. If you perform this step before the Oracle CRS are online on all nodes, the status on some nodes might be offline. In this situation, repeat this step until the status of the Oracle CRS is online on all nodes.


  9. Verify that all resource groups for Oracle RAC are online.


    # clresourcegroup status
    

    Note –

    Bringing online the resource group that contains the resources on which the RAC database resource depends also brings online the RAC database resource group. If you perform this step before the RAC database resource group is online on all nodes, the status on some nodes might be online faulted. In this situation, repeat this step until the status of the RAC database resource group is online on all nodes.


ProcedureHow to Verify the Configuration of Resources for Oracle 10g R2 RAC Database Instances

Resources for Oracle 10g R2 RAC database instances are created when the tasks in one of the following sections are performed:

This procedure provides the long forms of the Sun Cluster maintenance commands. Most commands also have short forms. Except for the forms of the command names, the commands are identical. For a list of the commands and their short forms, see Appendix A, Sun Cluster Object-Oriented Commands, in Sun Cluster Data Services Planning and Administration Guide for Solaris OS.

  1. Become superuser on a cluster node.

  2. Verify that the RAC database resource group is correctly configured.


    # clresourcegroup show rac-db-rg
    
    rac-db-rg

    Specifies the name of the RAC database resource group.

  3. If required, verify that the Oracle CRS resources to represent Sun Cluster storage resources are correctly configured.

    Perform this step only if your configuration of storage management schemes requires storage resources for Oracle files.

    1. Confirm that the Oracle CRS resources to represent Sun Cluster storage resources exist.

      Use the Oracle command crstat for this purpose.


      # crs-home/bin/crs_stat | grep NAME=sun.
      
      crs-home

      Specifies the Oracle CRS home directory. This directory contains the Oracle CRS binary files and Oracle CRS configuration files.

    2. For each Oracle CRS resource that represents an Oracle RAC database instance, confirm that the required dependencies are set.

      Each Oracle CRS resource that represents an Oracle RAC database instance requires a dependency on a resource that is listed in Step a.


      # crs-home/bin/crs_stat crs-resource| grep REQUIRED_RESOURCE
      
      crs-home

      Specifies the Oracle CRS home directory. This directory contains the Oracle CRS binary files and Oracle CRS configuration files.

      crs-resource

      Specifies the name of an Oracle CRS resource that represents an Oracle RAC database instance. The format of this name is ora.dbname.sid.inst. The replaceable items in this format are as follows:

      dbname

      Specifies the database name of the instance.

      sid

      Specifies the Oracle SID of the instance.

  4. Disable the CRS framework resource.


    # clresource disable -t SUNW.crs_framework +
    

    This step might require several minutes to complete.

  5. Verify that the Oracle CRS are offline.

    1. Attempt to obtain the status of Oracle CRS resources.

      Use the Oracle command crstat for this purpose.


      # crs-home/bin/crs_stat -t
      CRS-0184: Cannot communicate with the CRS daemon.
      crs-home

      Specifies the Oracle CRS home directory. This directory contains the Oracle CRS binary files and Oracle CRS configuration files.

    2. Consult the system messages file to find messages to indicate that CRS are being shut down.

  6. Verify that the following resources are offline on all nodes:

    • The CRS framework resource

    • The RAC database resource


    # clresource status -t SUNW.crs_framework,SUNW.scalable_rac_server_proxy +
    
  7. On each node, restart the Oracle CRS.


    # /etc/init.d/init.crs start
    Startup will be queued to init within 30 seconds.

    This step might require several minutes to complete.

  8. On each node, verify that the Oracle CRS are online.

    Use the Oracle command crstat for this purpose.


    # crs-home/bin/crs_stat
    
    crs-home

    Specifies the Oracle CRS home directory. This directory contains the Oracle CRS binary files and Oracle CRS configuration files.


    Note –

    The startup of Oracle CRS on all nodes might require several minutes to complete. If you perform this step before the Oracle CRS are online on all nodes, the status on some nodes might be offline. In this situation, repeat this step until the status of the Oracle CRS is online on all nodes.


  9. Enable the CRS framework resource.


    # clresource enable -t SUNW.crs_framework +
    

    This step might require several minutes to complete.

  10. Verify that the following resources are online on all nodes:

    • The CRS framework resource

    • The RAC database resource


    # clresource status -t SUNW.crs_framework,SUNW.scalable_rac_server_proxy +
    

    Note –

    Enabling the CRS framework resource also enable the RAC database resource. If you perform this step before the RAC database resource is enabled on all nodes, the status on some nodes might be offline. In this situation, repeat this step until the status of the RAC database resource is online on all nodes.


ProcedureHow to Verify the Configuration of Resources for Oracle 9i RAC Database Instances

Resources for Oracle 9i RAC database instances are created when the tasks in one of the following sections are performed:

This procedure provides the long forms of the Sun Cluster maintenance commands. Most commands also have short forms. Except for the forms of the command names, the commands are identical. For a list of the commands and their short forms, see Appendix A, Sun Cluster Object-Oriented Commands, in Sun Cluster Data Services Planning and Administration Guide for Solaris OS.

  1. Become superuser on a cluster node, or assume a role that provides solaris.cluster.read and solaris.cluster.admin RBAC authorizations.

  2. Verify that the RAC database resource group and the resource groups for logical hostname resources are correctly configured.


    # clresourcegroup show rac-db-rg,lhrg-list
    
    rac-db-rg

    Specifies the name of the RAC database resource group.

    lhrg-list

    Specifies a comma-separated list of resource groups for logical hostname resources.

  3. Take offline the RAC database resource group.


    # clresourcegroup offline rac-db-rg
    
    rac-db-rg

    Specifies the name of the RAC database resource group.

  4. Verify that the RAC database resource group is offline.


    # clresourcegroup status rac-db-rg
    
    rac-db-rg

    Specifies the name of the RAC database resource group.

  5. Verify that the resources in the RAC database resource group are offline on all nodes.

    The RAC database resource group contains the following resources:

    • The scalable RAC server resource

    • The scalable RAC listener resource


    # clresource status -t SUNW.scalable_rac_server,SUNW.scalable_rac_listener +
    
  6. Bring online again the RAC database resource group.


    # clresourcegroup online rac-db-rg
    
    rac-db-rg

    Specifies the name of the RAC database resource group.

  7. Verify that the RAC database resource group is online.


    # clresourcegroup status rac-db-rg
    
    rac-db-rg

    Specifies the name of the RAC database resource group.

  8. Verify that the resources in the RAC database resource group are online on all nodes.

    The RAC database resource group contains the following resources:

    • The scalable RAC server resource

    • The scalable RAC listener resource


    # clresource status -t SUNW.scalable_rac_server,SUNW.scalable_rac_listener +
    

ProcedureHow to Verify the Correct Behavior for Shutdown and Booting of the Cluster

If your configuration of Sun Cluster Support for Oracle RAC is correct, Sun Cluster ensures that Oracle RAC is stopped and started correctly when you shut down and boot the cluster.


Caution – Caution –

This task requires downtime. If you are verifying the installation and configuration of Sun Cluster Support for Oracle RAC on a production cluster where other data services are running, omit this task.


This procedure provides the long forms of the Sun Cluster maintenance commands. Most commands also have short forms. Except for the forms of the command names, the commands are identical. For a list of the commands and their short forms, see Appendix A, Sun Cluster Object-Oriented Commands, in Sun Cluster Data Services Planning and Administration Guide for Solaris OS.

  1. Shut down the cluster.

    For instructions for performing this task, see How to Shut Down a Cluster in Sun Cluster System Administration Guide for Solaris OS.

  2. Confirm that the cluster shuts down correctly.

  3. Boot the cluster.

    For instructions for performing this task, see How to Boot a Cluster in Sun Cluster System Administration Guide for Solaris OS.

  4. Confirm that the cluster starts correctly.

  5. Verify that all Oracle RAC resource groups and their resources are online.


    # clresourcegroup status
    

    Note –

    The bringing online of all Oracle RAC resource groups might require several minutes to complete. If you perform this step before the resource groups are enabled on all nodes, the status on some nodes might be offline. In this situation, repeat this step until the status of all Oracle RAC resource groups is online on all nodes.