Sun Cluster Data Service for Oracle Real Application Clusters Guide for Solaris OS

Chapter 2 Administering Sun Cluster Support for Oracle Real Application Clusters

This chapter describes the steps to administer Sun Cluster Support for Oracle Real Application Clusters on your Sun Cluster nodes. This chapter contains the following procedures.

Overview of Administration Tasks for Sun Cluster Support for Oracle Real Application Clusters

Table 2–1 summarizes the tasks for setting up Sun Cluster Support for Oracle Real Application Clusters.

Perform these tasks in the order in which they are listed in the table.

Table 2–1 Tasks for Setting Up Sun Cluster Support for Oracle Real Application Clusters

Task 

Instructions 

Register and configure the Real Application Clusters (RAC) framework resource group 

If you are using the scsetup utility for this task, seeRegistering and Configuring the RAC Framework Resource Group.

If you are using the scrgadm utility for this task, see:

Install the Oracle Real Application Clusters software

Oracle Real Application Clusters installation documentation. 

Verify the installation of the Oracle Real Application Clusters software 

Verifying the Installation of Oracle Real Application Clusters.

Create your Oracle database 

Creating an Oracle Database.

Automate the startup and shutdown of Oracle Real Application Clusters database instances 

Automating the Startup and Shutdown of Oracle Real Application Clusters Database Instances.

Verify the Sun Cluster Support for Oracle Real Application Clusters installation and configuration 

Verifying the Sun Cluster Support for Oracle Real Application Clusters Installation and Configuration.

(Optional) Tune Sun Cluster Support for Oracle Real Application Clusters extension properties 

Tuning Sun Cluster Support for Oracle Real Application Clusters.

Table 2–2 summarizes other administration tasks for Sun Cluster Support for Oracle Real Application Clusters.

Perform these tasks whenever they are required.

Table 2–2 Other Administration Tasks for Sun Cluster Support for Oracle Real Application Clusters

Task 

Instructions 

Upgrade Sun Cluster Support for Oracle Real Application Clusters to upgrade your cluster to use a new version of Sun Cluster

“Upgrading Sun Cluster Software” in Sun Cluster Software Installation Guide for Solaris OS.

If you are using the scsetup utility, see alsoHow to Register and Configure the RAC Framework Resource Group for a Cluster.

If you are using the scrgadm utility, see also How to Create the RAC Framework Resource Group by Using the scrgadm Utility.

Remove Sun Cluster Support for Oracle Real Application Clusters 

If you are using the scsetup utility for this task, see Removing Sun Cluster Support for Oracle Real Application Clusters.

If you are using the scrgadm utility for this task, see:

Troubleshoot Sun Cluster Support for Oracle Real Application Clusters 

Chapter 3, Troubleshooting Sun Cluster Support for Oracle Real Application Clusters

Registering and Configuring the RAC Framework Resource Group

Registering and configuring the RAC framework resource group enables Sun Cluster Support for Oracle Real Application Clusters to be managed by using Sun Cluster commands.

You can register and configure the RAC framework resource group for the following entities:

Overview of the RAC Framework Resource Group

The RAC framework resource group enables Oracle Real Application Clusters to be managed by using Sun Cluster commands. This resource group contains an instance of the following single-instance resource types:

In addition, the RAC framework resource group contains an instance of a single-instance resource type that represents the storage management scheme that you are using for the Oracle Real Application Clusters database.

The resource that represents Sun StorEdge QFS shared file system is not contained in the RAC framework resource group. For information about this resource, see:


Note –

The resource types that are defined for the RAC framework resource group do not enable the Resource Group Manager (RGM) to manage instances of Oracle Real Application Clusters.


Determining Whether to Use scsetup or scrgadm

The procedures that follow explain how to configure resources for the RAC framework resource group by using the scsetup(1M) utility. The scsetup utility enables you to configure resources for the RAC framework resource group interactively. Configuring these resources interactively reduces the possibility for configuration errors that might result from command syntax errors or omissions. The scsetup utility ensures that all required resources are created on the basis of the software that is installed on your cluster nodes.


Note –

For instructions about how to configure resources for the RAC framework resource group by using the scrgadm(1M) utility, see Creating, Modifying, and Removing the RAC Framework Resource Group by Using the scrgadm Utility.


How to Register and Configure the RAC Framework Resource Group for a Cluster

When you register and configure the RAC framework resource group for a cluster, the RAC framework resource group is created.

Perform this procedure if you require Sun Cluster Support for Oracle Real Application Clusters to run on all nodes in a cluster.

Before you perform this procedure, ensure that the required Sun Cluster Support for Oracle Real Application Clusters software packages are installed on each node. The packages that are required depend on the storage management scheme that you are using for the Oracle Real Application Clusters database. For more information, see Installing Sun Cluster Support for Oracle Real Application Clusters Packages.

  1. Become superuser.

  2. From one node only, create the RAC framework resource group.


    Note –

    The following instructions explain how to perform this operation by using the scsetup utility. For information about how to perform this operation by using the scrgadm utility, see How to Create the RAC Framework Resource Group by Using the scrgadm Utility.


    1. Start the scsetup utility.


      # scsetup
      

      The scsetup main menu is displayed.

    2. Type the number that corresponds to the option for data services.

      The Data Services menu is displayed.

    3. Type the number that corresponds to the option for configuring Sun Cluster Support for Oracle Real Application Clusters.

      The Sun Cluster Support for Oracle RAC menu is displayed.

    4. Type the number that corresponds to the option for creating the RAC framework resource group.

      The scsetup utility displays a list of the cluster nodes on which the Sun Cluster Support for Oracle Real Application Clusters packages are installed. The scsetup utility also asks you to confirm that the RAC framework resource group should be created on these nodes.

    5. To confirm that the scsetup utility should create the RAC framework resource group on the listed nodes, type y.

      The scsetup utility creates the RAC framework resource group and the resources that this resource group contains on the listed nodes.


      Note –

      If the value of a resource property is changed from its default value, the scsetup utility sets the property to the changed value for the resource that the scsetup utility creates.


  3. Determine if the RAC framework resource group and its resources are online.

    Use the scstat(1M) utility for this purpose. The resource group to verify is named rac-framework-rg. The scsetup utility automatically assigns this name when you create the resource group.


    # scstat -g
    
    • If the RAC framework resource group and its resources are online, no further action is required.

    • If the RAC framework resource group and its resources are not online, bring them online.


      # scswitch -Z -g rac-framework-rg
      
      -Z

      Enables the resource and monitor, moves the resource group to the MANAGED state, and brings the resource group online

      -g rac-framework-rg

      Specifies that the resource group to be moved to the MANAGED state and brought online is rac-framework-rg

Where to Go From Here

The next steps are as follows:

  1. Installing the Oracle Real Application Clusters software. For more information, see your Oracle Real Application Clusters installation documentation.

  2. Verifying the installation of Oracle Real Application Clusters. For more information, see Verifying the Installation of Oracle Real Application Clusters.

How to Register and Configure the RAC Framework Resource Group for Selected Nodes

When you register and configure the RAC framework resource group for selected nodes, the nodes are added to the RAC framework resource group.

Perform this procedure in the following situations:

Before you perform this procedure, ensure that the required Sun Cluster Support for Oracle Real Application Clusters software packages are installed on each node. The packages that are required depend on the storage management scheme that you are using for the Oracle Real Application Clusters database. For more information, see Installing Sun Cluster Support for Oracle Real Application Clusters Packages.

  1. Become superuser.

  2. Add the nodes to the RAC framework resource group.


    Note –

    The following instructions explain how to perform this operation by using the scsetup utility. For information about how to perform this operation by using the scrgadm utility, see How to Add Nodes to the RAC Framework Resource Group by Using the scrgadm Utility.


    1. Start the scsetup utility.


      # scsetup
      
    2. Type the number that corresponds to the option for data services.

      The Data Services menu is displayed.

    3. Type the number that corresponds to the option for configuring Sun Cluster Support for Oracle Real Application Clusters.

      The Sun Cluster Support for Oracle RAC menu is displayed.

    4. Type the number that corresponds to the option for adding a node to the RAC framework resource group.

      The scsetup utility responds as follows:

      • The list of nodes that you can add to the RAC framework resource group is displayed. This list contains the cluster nodes on which the Sun Cluster Support for Oracle Real Application Clusters packages are installed, but on which the RAC framework resource group does not yet exist.

      • The scsetup utility prompts you for the list of nodes that you are adding.

    5. Type a comma-separated list of the nodes that you are adding to the RAC framework resource group.

  3. Bring the RAC framework resource group and its resources online.


    # scswitch -Z -g rac-framework-rg
    
    -Z

    Enables the resources, moves the resource group to the MANAGED state, and brings the resource group online

    -g rac-framework-rg

    Specifies that the resource group to be moved to the MANAGED state and brought online is rac-framework-rg

Where to Go From Here

The next steps are as follows:

  1. Installing the Oracle Real Application Clusters software. For more information, see your Oracle Real Application Clusters installation documentation.

  2. Verifying the installation of Oracle Real Application Clusters. For more information, see Verifying the Installation of Oracle Real Application Clusters.

Verifying the Installation of Oracle Real Application Clusters

After you have installed Oracle Real Application Clusters, verify that the installation is correct. Perform this verification before you attempt to create your Oracle database. This verification does not verify that Real Application Clusters database instances can be started and stopped automatically.

How to Verify the Installation of Oracle Real Application Clusters

  1. Confirm that the owner, group, and mode of the $ORACLE_HOME/bin/oracle file are as follows:

    • Owner: oracle

    • Group: dba

    • Mode: -rwsr-s--x


    # ls -l $ORACLE_HOME/bin/oracle
    
  2. Confirm that the binary files for the Oracle listener exist in the $ORACLE_HOME/bin directory.

Where to Go From Here

Go to Creating an Oracle Database.

Creating an Oracle Database

Perform this task to configure and create the initial Oracle database in a Sun Cluster environment. If you create and configure additional databases, you do not need to repeat this task.

How to Create an Oracle Database

  1. Ensure that the init$ORACLE_SID.ora file or the config$ORACLE_SID.ora file specifies the correct locations of the control files and alert files.

    The locations of these files are specified as follows:

    • The location of control files is specified by the control_files keyword.

    • The location of alert files is specified by the background_dump_dest keyword.

  2. If you use Solaris authentication for database logins, set the remote_os_authent variable in the init$ORACLE_SID.ora file to True.

  3. Ensure that all files that are related to the database are in the correct location.

  4. Start the creation of the database by using one command from the following list:

    • The Oracle dbca command

    • The Oracle sqlplus command

  5. Ensure that the file names of your control files match the file names in your configuration files.

Where to Go From Here

Go to Automating the Startup and Shutdown of Oracle Real Application Clusters Database Instances.

Automating the Startup and Shutdown of Oracle Real Application Clusters Database Instances

Automating the startup and shutdown of Oracle Real Application Clusters database instances involves registering and configuring the following resources:

The Oracle RAC server resources provide fault monitoring only to enable the status of Oracle Real Application Clusters resources to be monitored by Sun Cluster utilities. These resources do not provide automatic fault recovery.

The procedures that follow contain instructions for registering and configuring resources. These instructions explain how to set only extension properties that Sun Cluster Support for Oracle Real Application Clusters requires you to set. Optionally, you can set additional extension properties to override their default values. For more information, see the following sections:

Registering and Configuring Oracle RAC Server Resources

The SUNW.oracle_rac_server resource type represents the Oracle RAC server in a Sun Cluster configuration. Each instance of the Oracle RAC server is represented by a single SUNW.oracle_rac_server resource.

Configure each SUNW.oracle_rac_server resource as a single-instance resource that is restricted to run on only one node. You enforce this restriction as follows:

Oracle RAC server instances should be started only after the RAC framework is enabled on a cluster node. You ensure that this requirement is met by creating the following affinities and dependencies:

If you are using Sun StorEdge QFS shared file system, ensure that each Oracle RAC server instance is started only after Sun StorEdge QFS resources for this instance are started on a cluster node. You meet this requirement by creating a dependency between the Oracle RAC server resource and its related Sun StorEdge QFS resources.

How to Register and Configure Oracle RAC Server Resources

  1. On one node of the cluster, become superuser.

  2. Register the SUNW.oracle_rac_server resource type.


    # scrgadm -a -t SUNW.oracle_rac_server
    
  3. For each node where Sun Cluster Support for Oracle Real Application Clusters can run, create a resource group and a resource for the Oracle RAC server.

    1. Create a failover resource group to contain the Oracle RAC server resource.


      # scrgadm -a -g rac-server-rg -h node \
      -y RG_AFFINITIES=++rac-fmwk-rg \
      [-y RG_DEPENDENCIES=sqfs-rg-list]
      
      -g rac-server-rg

      Specifies the name that you are assigning to the resource group.

      -h node

      Specifies the node for which you are creating the resource group. You must specify only one node.

      -y RG_AFFINITIES=++rac-fmwk-rg

      Creates a strong positive affinity to the RAC framework resource group. If the RAC framework resource group was created by using the scsetup utility, the RAC framework resource group is named rac-framework-rg.

      -y RG_DEPENDENCIES=sqfs-rg-list

      Specifies a comma-separated list of Sun StorEdge QFS resource groups on which this Oracle RAC server instance depends. These resource groups are created when you register and configure the data service for the Sun StorEdge QFS metadata server. For more information about these resources, see Configuration Planning Questions. Create this dependency only if you are using Sun StorEdge QFS shared file system.

    2. Add an instance of the SUNW.oracle_rac_server resource type to the resource group that you created in Step a.

      When you create this resource, specify the following information about the resource:

      • The Oracle home directory. The Oracle home directory contains the binary files, log files, and parameter files for the Oracle software.

      • The Oracle system identifier. This identifier is the name of the Oracle database instance.


      # scrgadm -a -j rac-server-resource -g rac-server-rg \
      -t SUNW.oracle_rac_server \
      -y RESOURCE_DEPENDENCIES=rac-fmwk-rs[, sqfs-rs-list] \
      -x ORACLE_SID=ora-sid \
      -x ORACLE_HOME=ora-home
      
      -j rac-server-resource

      Specifies the name that you are assigning to the SUNW.oracle_rac_server resource.

      -g rac-server-rg

      Specifies the resource group to which you are adding the resource. This resource group must be the resource group that you created in Step a.

      -y RESOURCE_DEPENDENCIES=rac-fmwk-rs[, sqfs-rs-list]

      Specifies the resources on which this Oracle RAC server instance depends.

      You must specify the RAC framework resource. If the RAC framework resource group is created by using the scsetup utility, this resource is named rac_framework.

      If you are using Sun StorEdge QFS shared file system, you must also specify a comma-separated list of Sun StorEdge QFS resources. These resources are created when you register and configure the data service for the Sun StorEdge QFS metadata server. For more information about these resources, see Configuration Planning Questions.

      -x ORACLE_SID=ora-sid

      Specifies the Oracle system identifier. This identifier is the name of the Oracle database instance.

      -x ORACLE_HOME=ora-home

      Specifies the path to the Oracle home directory. The Oracle home directory contains the binary files, log files, and parameter files for the Oracle software.


Example 2–1 Registering and Configuring Oracle RAC Server Resources

This example shows the sequence of operations that is required to register and configure Oracle RAC server resources for a two-node cluster.

The example assumes that a RAC framework resource group named rac-framework-rg has been created. The example also assumes that this resource group contains a SUNW.rac_framework resource named rac_framework.

  1. To register the SUNW.oracle_rac_server resource type, the following command is run:


    # scrgadm -a -t SUNW.oracle_rac_server
    
  2. To create the RAC1-rg resource group for node node1, the following command is run:


    # scrgadm -a -g RAC1-rg -h node1 \
    -y RG_AFFINITIES=++rac-framework-rg
    
  3. To create the RAC2-rg resource group for node node2, the following command is run:


    # scrgadm -a -g RAC2-rg -h node2 \
    -y RG_AFFINITIES=++rac-framework-rg
    
  4. To create the RAC1-rs resource in the RAC1-rg resource group for node node1, the following command is run:


    # scrgadm -a -j RAC1-rs -g RAC1-rg \
    -t SUNW.oracle_rac_server \
    -y RESOURCE_DEPENDENCIES=rac_framework \
    -x ORACLE_SID=RAC1 \
    -x ORACLE_HOME=/oracle
    
  5. To create the RAC2-rs resource in the RAC2-rg resource group for node node2, the following command is run:


    # scrgadm -a -j RAC2-rs -g  RAC2-rg \
    -t SUNW.oracle_rac_server \
    -y RESOURCE_DEPENDENCIES=rac_framework \
    -x ORACLE_SID=RAC2 \
    -x ORACLE_HOME=/oracle
    

Where to Go From Here

Go to Registering and Configuring Oracle Listener Resources.

Registering and Configuring Oracle Listener Resources

How you configure Oracle listener resources depends on how you require Oracle listeners to serve Oracle Real Application Clusters database instances. For more information, see Resource Groups for Oracle Listener Resources.

How to Register and Configure Oracle Listener Resources

  1. On one node of the cluster, become superuser.

  2. Register the SUNW.oracle_listener resource type.


    # scrgadm -a -t SUNW.oracle_listener
    
  3. If your configuration of Oracle listeners requires a separate resource group, create a failover resource group for the listener resource.

    Create this resource group only if your configuration of Oracle listeners requires a separate resource group. When you create this resource group, create any dependencies on other resource groups that your configuration requires. For more information see Resource Groups for Oracle Listener Resources.


    # scrgadm -a -g rac-listener-rg \
    [-y RG_DEPENDENCIES=rg-list]\
    -h nodelist
    
    -g rac-listener-rg

    Specifies the name that you are assigning to the resource group.

    -y RG_DEPENDENCIES=rg-list

    Specifies a comma-separated list of resource groups that this resource group depends on. If the Oracle home directory resides on a Sun StorEdge QFS shared file system, rg-list must specify the resource group for the Sun StorEdge QFS metadata server for the file system.

    If the resource group for the listener resource depends on no other resource groups, omit this option.

    -h nodelist

    Specifies a comma-separated list of nodes where the resource group can be brought online. The list may contain more than one node only if you are configuring the listener to use a LogicalHostname resource. Otherwise, you must specify only one node.

  4. Add an instance of the SUNW.oracle_listener resource to each resource group that is to contain a SUNW.oracle_listener resource.

    When you create this resource, specify the following information about the resource:

    • The name of the Oracle listener. This name must match the corresponding entry in the listener.ora file.

    • The Oracle home directory. The Oracle home directory contains the binary files, log files, and parameter files for the Oracle software.


    # scrgadm -a -j listener-resource -g listener-rg \
    -t SUNW.oracle_listener \
    [-y RESOURCE_DEPENDENCIES=sqfs-rs-list] \
    -x LISTENER_NAME=listener \ 
    -x ORACLE_HOME=oracle-home
    
    -j listener-resource

    Specifies the name that you are assigning to the SUNW.oracle_listener resource.

    -g listener-rg

    Specifies the resource group to which you are adding the resource.

    -y RESOURCE_DEPENDENCIES=sqfs-rs-list

    Specifies a comma-separated list of Sun StorEdge QFS resources on which this Oracle listener instance depends. These resources are created when you register and configure the data service for the Sun StorEdge QFS metadata server. For more information about these resources, see Configuration Planning Questions. Create this dependency only if the Oracle home directory resides on a Sun StorEdge QFS shared file system.

    -x LISTENER_NAME=listener

    Specifies the name of the Oracle listener instance. This name must match the corresponding entry in the listener.ora file.

    -x ORACLE_HOME=ora-home

    Specifies the path to the Oracle home directory. The Oracle home directory contains the binary files, log files, and parameter files for the Oracle software.

  5. Bring online each RAC server resource group that you created in How to Register and Configure Oracle RAC Server Resources.

    For each resource group, type the following command:


    # scswitch -Z -g rac-server-rg
    
    -Z

    Moves the resource group to the MANAGED state, and brings online the resource group

    -g rac-server-rg

    Specifies that a resource group that you created in How to Register and Configure Oracle RAC Server Resources is to be moved to the MANAGED state and brought online

  6. If you created Oracle listener resource groups in Step 3, bring online these resource groups.

    For each resource group that you created, type the following command:


    # scswitch -Z -g rac-listener-rg
    
    -Z

    Moves the resource group to the MANAGED state, and brings online the resource group

    -g rac-listener-rg

    Specifies that a resource group that you created in Step 3 is to be moved to the MANAGED state and brought online


Example 2–2 Registering and Configuring Oracle Listener Resources

This example shows the sequence of operations that is required to register and configure Oracle RAC listener resources for a two-node cluster.

In this example, each listener serves only one Real Application Clusters instance. The listeners cannot fail over.

The example assumes that RAC server resource groups named RAC1-rg and RAC2-rg have been created as shown in Example 2–1.

  1. To register the SUNW.oracle_listener resource type, the following command is run:


    # scrgadm -a -t SUNW.oracle_listener
    
  2. To create the LRAC1-rs resource in the RAC1-rg resource group for node node1, the following command is run:


    # scrgadm -a -j LRAC1-rs -g RAC1-rg \
    -t SUNW.oracle_listener \
    -x LISTENER_NAME=LRAC1 \
    -x ORACLE_HOME=/oracle
    
  3. To create the LRAC2-rs resource in the RAC2-rg resource group for node node2, the following command is run:


    # scrgadm -a -j LRAC2-rs -g RAC2-rg \
    -t SUNW.oracle_listener \
    -x LISTENER_NAME=LRAC2 \
    -x ORACLE_HOME=/oracle
    

Where to Go From Here

Go to Verifying the Sun Cluster Support for Oracle Real Application Clusters Installation and Configuration.

Verifying the Sun Cluster Support for Oracle Real Application Clusters Installation and Configuration

After you install, register, and configure Sun Cluster Support for Oracle Real Application Clusters, verify the installation and configuration. Verifying the Sun Cluster Support for Oracle Real Application Clusters installation and configuration determines if Real Application Clusters database instances can be started and stopped automatically.

How to Verify the Sun Cluster Support for Oracle Real Application Clusters Installation and Configuration

Perform this task as superuser for each Oracle RAC server resource group that you created when you performed the procedure inRegistering and Configuring Oracle RAC Server Resources.

  1. Verify that the Oracle RAC server resource group is correctly configured.


    # scrgadm -pv -g rac-server-rg
    
    -g rac-server-rg

    Specifies the name of the Oracle RAC server resource group for the node

  2. Bring online the Oracle RAC server resource group.


    # scswitch -Z -g rac-server-rg
    
    -g rac-server-rg

    Specifies the name of the Oracle RAC server resource group for the node

  3. Verify that the Oracle RAC server resource group and its resources are online.


    # scstat -g
    
  4. Take offline the Oracle RAC server resource group.


    # scswitch -F -g rac-server-rg
    
    -g rac-server-rg

    Specifies the name of the Oracle RAC server resource group for the node

  5. Verify that the Oracle RAC server resource group and its resources are offline.


    # scstat -g
    
  6. Bring online again the Oracle RAC server resource group.


    # scswitch -Z -g rac-server-rg
    
    -g rac-server-rg

    Specifies the name of the Oracle RAC server resource group for the node

  7. Verify that the Oracle RAC server resource group and its resources are online.


    # scstat -g
    

Tuning Sun Cluster Support for Oracle Real Application Clusters

To tune the Sun Cluster Support for Oracle Real Application Clusters data service, you modify the extension properties of the resources for this data service. For details about these extension properties, see Appendix A, Sun Cluster Support for Oracle Real Application Clusters Extension Properties. Typically, you use the command line scrgadm -x parameter=value to set extension properties when you create the Sun Cluster Support for Oracle Real Application Clusters resources. You can also use the procedures in “Administering Data Service Resources” in Sun Cluster Data Services Planning and Administration Guide for Solaris OS to configure the resources later.

Guidelines for Setting Timeouts

Many of the extension properties for Sun Cluster Support for Oracle Real Application Clusters specify timeouts for steps in reconfiguration processes. The optimum values for most of these timeouts are independent of your cluster configuration. Therefore, you should not need to change the timeouts from their default values.

Timeouts that depend on your cluster configuration are described in the subsections that follow. If timeouts occur during reconfiguration processes, increase the values of these time-out properties to accommodate your cluster configuration.

VxVM Component Reconfiguration Step 4 Timeout

The time that is required for step 4 of a reconfiguration of the VxVM component of Sun Cluster Support for Oracle Real Application Clusters is affected by the size and complexity of your VERITAS shared-disk group configuration. If your VERITAS shared-disk group configuration is large or complex and the reconfiguration of the VxVM component times out, increase the timeout for step 4 of a reconfiguration of the VxVM component.

To increase the timeout for step 4 of a reconfiguration of the VxVM component, increase the value of the Cvm_step4_timeout extension property of the SUNW.rac_cvm resource.

For more information, see SUNW.rac_cvm Extension Properties.


Example 2–3 Setting the VxVM Component Reconfiguration Step 4 Timeout


# scrgadm -c -j rac_cvm -x cvm_step4_timeout=1200

This example sets the timeout for step 4 of a reconfiguration of the VxVM component to 1200 seconds. This example assumes that the VxVM component is represented by an instance of the SUNW.rac_cvm resource type that is named rac_cvm.


Reservation Step Timeout

The time that is required for reservation commands to run is affected by the following factors:

If the number of shared physical disks in the cluster is large, or if your cluster is heavily loaded, the reconfiguration of Sun Cluster Support for Oracle Real Application Clusters might time out. If such a timeout occurs, increase the reservation step timeout.

To increase the reservation step timeout, increase the Reservation_timeout extension property of the appropriate resource for your storage management scheme.

Storage Management Scheme 

Resource 

Solaris Volume Manager for Sun Cluster 

SUNW.rac_svm

VxVM with the cluster feature 

SUNW.rac_cvm

Hardware RAID support or Sun StorEdge QFS shared file system with hardware RAID support 

SUNW.rac_hwraid

Details of the extension properties of these resource types are available in the following sections:


Example 2–4 Setting the Reservation Step Timeout


# scrgadm -c -j rac_hwraid -x reservation_timeout=350

This example sets the timeout for the reservation step of a reconfiguration of Sun Cluster Support for Oracle Real Application Clusters to 350 seconds. In this example, the cluster uses hardware RAID support. This example assumes that the hardware RAID component is represented by an instance of the SUNW.rac_hwraid resource type that is named rac_hwraid.


Guidelines for Setting the Communications Port Range for the Oracle UDLM

An application other than the Oracle UDLM on a cluster node might use a range of communications ports that conflicts with the range for the Oracle UDLM. If such a conflict occurs, modify the range of communications ports that the Oracle UDLM uses.

The range of communications ports that the Oracle UDLM uses is determined by the values of the following extension properties of the SUNW.rac_udlm resource type:

For more information, see SUNW.rac_udlm Extension Properties.


Example 2–5 Setting the Communications Port Number for the Oracle UDLM


# scrgadm -c -j rac_udlm -x port=7000

This example sets the communications port number that the Oracle UDLM uses to 7000. The following assumptions apply to this example:


How to Modify an Extension Property That Is Tunable Only When a Resource Is Disabled

Restrictions apply to the circumstances in which you can modify an extension property that is tunable only when a resource is disabled. Those circumstances depend on the resource type as follows:

  1. Disable each resource that the RAC framework resource group contains and bring the RAC framework resource group into the UNMANAGED state.

    Disable the instance of the SUNW.rac_framework resource only after you have disabled all other resources that the RAC framework resource group contains. The other resources in the RAC framework resource group depend on the SUNW.rac_framework resource.

    For detailed instructions, see “Disabling Resources and Moving Their Resource Group Into the UNMANAGED State” in Sun Cluster Data Services Planning and Administration Guide for Solaris OS.

  2. Reboot all the nodes that are in the node list of the RAC framework resource group.

  3. Use the scrgadm utility to set the property to its new value.


    # scrgadm -c -j resource -x property=value
    

    -j resource

    Specifies the name of the resource for which you are modifying an extension property. If this resource was created by using the scsetup utility, the name depends on the resource type as shown in Table 2–3.

    property

    Specifies the name of the extension property that you are changing.

    value

    The new value of the extension property.

  4. Bring the RAC framework resource group and its resources online.


    # scswitch -Z -g resource-group
    
    -Z

    Enables the resource and monitor, moves the resource group to the MANAGED state, and brings the resource group online.

    -g resource-group

    Specifies the name of the RAC framework resource group that is to be moved to the MANAGED state and brought online. If this resource group was created by using the scsetup utility, the name of the resource group is rac-framework-rg.

Removing Sun Cluster Support for Oracle Real Application Clusters

You can remove Sun Cluster Support for Oracle Real Application Clusters from the following entities:

How to Remove Sun Cluster Support for Oracle Real Application Clusters From a Cluster

The cluster node from which you perform this task must be booted in cluster mode.

  1. On one node of the cluster, become superuser.

  2. Remove all RAC server resource groups in the cluster.

    These resource groups were created as explained in How to Register and Configure Oracle RAC Server Resources.

    Remove each RAC server resource group as follows:

    1. Disable each RAC server resource in the resource group.

      For each resource, type the following command:


      # scswitch -n -j resource
      
      -j resource

      Specifies the resource that you are disabling

    2. Remove each RAC server resource in the resource group.

      For each resource, type the following command:


      # scrgadm -r -j resource
      
      -j resource

      Specifies the resource that you are removing

    3. Remove the RAC server resource group.


      # scrgadm -r -g rac-server-rg
      
      -g rac-server-rg

      Specifies the resource group that you are removing

  3. Remove the RAC framework resource group.


    Note –

    The following instructions explain how to perform this operation by using the scsetup utility. For information about how to perform this operation by using the scrgadm utility, see How to Remove the RAC Framework Resource Group by Using the scrgadm Utility.


    1. Start the scsetup utility.


      # scsetup
      

      The scsetup main menu is displayed.

    2. Type the number that corresponds to the option for data services.

      The Data Services menu is displayed.

    3. Type the number that corresponds to the option for configuring Sun Cluster Support for Oracle Real Application Clusters.

      The Sun Cluster Support for Oracle RAC menu is displayed.

    4. Type the number that corresponds to the option for removing the RAC framework resource group.

      The scsetup utility displays a list of the cluster nodes on which the RAC framework resource group exists. The scsetup utility also asks you to confirm that the RAC framework resource group should be removed from these nodes.

    5. To confirm that the scsetup utility should remove the RAC framework resource group from the listed nodes, type y.

      The scsetup utility removes the RAC framework resource group and the resources that this resource group contains from the listed nodes.

  4. Boot each node in the cluster in noncluster mode.

  5. From each node in the cluster, uninstall the Sun Cluster Support for Oracle Real Application Clusters software packages for the storage management scheme that you are using for the Oracle Real Application Clusters database.

    • If you are using Solaris Volume Manager for Sun Cluster, type the following command:


      # pkgrm SUNWscucm SUNWudlm SUNWudlmr SUNWscmd
      
    • If you are using VxVM with the cluster feature, type the following command:


      # pkgrm SUNWscucm SUNWudlm SUNWudlmr SUNWcvmr SUNWcvm
      
    • If you are using hardware RAID support, type the following command:


      # pkgrm SUNWscucm SUNWudlm SUNWudlmr SUNWschwr
      
    • If you are using Sun StorEdge QFS shared file system with hardware RAID support, type the following command:


      # pkgrm SUNWscucm SUNWudlm SUNWudlmr SUNWschwr
      

    Note –

    To prevent the userland cluster membership monitor (UCMM) daemon ucmmd from being started when the cluster is rebooted, you must uninstall the Sun Cluster Support for Oracle Real Application Clusters software packages.


How to Remove Sun Cluster Support for Oracle Real Application Clusters From Selected Nodes

  1. Become superuser.

  2. Boot in noncluster mode the nodes from which you are removing Sun Cluster Support for Oracle Real Application Clusters.

  3. Remove the nodes from the RAC framework resource group.


    Note –

    The following instructions explain how to perform this operation by using the scsetup utility. For information about how to perform this operation by using the scrgadm utility, see How to Remove Nodes From the RAC Framework Resource Group by Using the scrgadm Utility.


    1. Start the scsetup utility.


      # scsetup
      
    2. Type the number that corresponds to the option for data services.

      The Data Services menu is displayed.

    3. Type the number that corresponds to the option for configuring Sun Cluster Support for Oracle Real Application Clusters.

      The Sun Cluster Support for Oracle RAC menu is displayed.

    4. Type the number that corresponds to the option for removing a node from the RAC framework resource group.

      The scsetup utility responds as follows:

      • The list of nodes in the RAC framework resource group is displayed.

      • The scsetup utility prompts you for the list of nodes that you are removing.

    5. Type a comma-separated list of the nodes that you removing from the RAC framework resource group.

  4. (Optional) From each node that you removed, uninstall the Sun Cluster Support for Oracle Real Application Clusters software packages for the storage management scheme that you are using for the Oracle Real Application Clusters database.

    • If you are using Solaris Volume Manager for Sun Cluster, type the following command:


      # pkgrm SUNWscucm SUNWudlm SUNWudlmr SUNWscmd
      
    • If you are using VxVM with the cluster feature, type the following command:


      # pkgrm SUNWscucm SUNWudlm SUNWudlmr SUNWcvmr SUNWcvm
      
    • If you are using hardware RAID support, type the following command:


      # pkgrm SUNWscucm SUNWudlm SUNWudlmr SUNWschwr
      
    • If you are using Sun StorEdge QFS shared file system with hardware RAID support, type the following command:


      # pkgrm SUNWscucm SUNWudlm SUNWudlmr SUNWschwr
      

Creating, Modifying, and Removing the RAC Framework Resource Group by Using the scrgadm Utility

The scrgadm utility enables you to automate the creation, modification, and removal of the RAC framework resource group by using scripts. Automating this process reduces the time for propagating the same configuration information to many nodes in a cluster.


Note –

For procedures that explain how to create, modify, or remove the RAC framework resource by using the scsetup utility, see Registering and Configuring the RAC Framework Resource Group and Removing Sun Cluster Support for Oracle Real Application Clusters. Using the scsetup utility reduces the possibility for configuration errors that might result from command syntax errors or omissions.


How to Create the RAC Framework Resource Group by Using the scrgadm Utility

  1. On one node of the cluster, become superuser.

  2. Create a scalable resource group.


    # scrgadm -a -g resource-group \
      -y nodelist=nodelist \
      -y maximum_primaries=num-in-list \
      -y desired_primaries=num-in-list \
      -y RG_mode=Scalable
    
    -g resource-group

    Specifies the name that you are assigning to the resource group.

    -y nodelist=nodelist

    Specifies a comma-separated list of cluster nodes on which Sun Cluster Support for Oracle Real Application Clusters is to be enabled. The Sun Cluster Support for Oracle Real Application Clusters software packages must be installed on each node in this list.

    -y maximum_primaries=num-in-list

    Specifies the number of nodes on which Sun Cluster Support for Oracle Real Application Clusters is to be enabled. This number must equal the number of nodes in nodelist.

    -y desired_primaries=num-in-list

    Specifies the number of nodes on which Sun Cluster Support for Oracle Real Application Clusters is to be enabled. This number must equal the number of nodes in nodelist.

    -y RG_mode=Scalable

    Specifies that the resource group is scalable.

  3. Register the SUNW.rac_framework resource type.


    # scrgadm -a -t SUNW.rac_framework
    
  4. Add an instance of the SUNW.rac_framework resource type to the resource group that you created in Step 2.


    # scrgadm -a -j fmwk-resource \
      -g resource-group \
      -t SUNW.rac_framework
    
    -j fmwk-resource

    Specifies the name that you are assigning to the SUNW.rac_framework resource.

    -g resource-group

    Specifies the resource group to which you are adding the resource. This resource group must be the resource group that you created in Step 2.

  5. Register the SUNW.rac_udlm resource type.


    # scrgadm -a -t SUNW.rac_udlm
    
  6. Add an instance of the SUNW.rac_udlm resource type to the resource group that you created in Step 2.

    Ensure that this instance depends on the SUNW.rac_framework resource that you created in Step 4.


    # scrgadm -a -j udlm-resource \
      -g resource-group \
      -t SUNW.rac_udlm \
      -y resource_dependencies=fmwk-resource
    
    -j udlm-resource

    Specifies the name that you are assigning to the SUNW.rac_udlm resource.

    -g resource-group

    Specifies the resource group to which you are adding the resource. This resource group must be the resource group that you created in Step 2.

    -y resource_dependencies=fmwk-resource

    Specifies that this instance depends on the SUNW.rac_framework resource that you created in Step 4.

  7. Register and add instances of the resource types that are required for the storage management scheme that you are using for the Oracle Real Application Clusters database.

    • If you are using Solaris Volume Manager for Sun Cluster, register and add an instance of the SUNW.rac_svm resource type to the resource group that you created in Step 2.

      Ensure that this instance depends on the rac_framework resource that you created in Step 4.


      # scrgadm -a -t SUNW.rac_svm
      

      # scrgadm -a -j svm-resource \
        -g resource-group \
        -t SUNW.rac_svm \
        -y resource_dependencies=fmwk-resource
      
      -j svm-resource

      Specifies the name that you are assigning to the SUNW.rac_svm resource.

      -g resource-group

      Specifies the resource group to which you are adding the resource. This resource group must be the resource group that you created in Step 2.

      -y resource_dependencies=fmwk-resource

      Specifies that this instance depends on the SUNW.rac_framework resource that you created in Step 4.

    • If you are using VxVM with the cluster feature, register and add an instance of the SUNW.rac_cvm resource type to the resource group that you created in Step 2.

      Ensure that this instance depends on the rac_framework resource that you created in Step 4.


      # scrgadm -a -t SUNW.rac_cvm
      

      # scrgadm -a -j cvm-resource \
        -g resource-group \
        -t SUNW.rac_cvm \
        -y resource_dependencies=fmwk-resource
      
      -j cvm-resource

      Specifies the name that you are assigning to the SUNW.rac_cvm resource.

      -g resource-group

      Specifies the resource group to which you are adding the resource. This resource group must be the resource group that you created in Step 2.

      -y resource_dependencies=fmwk-resource

      Specifies that this instance depends on the SUNW.rac_framework resource that you created in Step 4.

    • If you are using hardware RAID support, register and add an instance of the SUNW.rac_hwraid resource type to the resource group that you created in Step 2.

      Ensure that this instance depends on the rac_framework resource that you created in Step 4.


      # scrgadm -a -t SUNW.rac_hwraid
      

      # scrgadm -a -j raid-resource \
        -g resource-group \
        -t SUNW.rac_hwraid \
        -y resource_dependencies=fmwk-resource 
      
      -j raid-resource

      Specifies the name that you are assigning to the SUNW.rac_hwraid resource.

      -g resource-group

      Specifies the resource group to which you are adding the resource. This resource group must be the resource group that you created in Step 2.

      -y resource_dependencies=fmwk-resource

      Specifies that this instance depends on the SUNW.rac_framework resource that you created in Step 4.

    • If you are using Sun StorEdge QFS shared file system with hardware RAID support, you must register and add an instance of the resource type for hardware RAID support.

      No resource instance that represents Sun StorEdge QFS shared file system is required in the RAC framework resource group. Although a resource that represents each Sun StorEdge QFS shared file system is required, these resources are not contained in the RAC framework resource group. For information about these resources, see Configuration Planning Questions.

  8. Bring the RAC framework resource group and its resources online.


    # scswitch -Z -g resource-group
    
    -Z

    Enables the resource and monitor, moves the resource group to the MANAGED state, and brings the resource group online

    -g resource-group

    Specifies that the resource group that you created in Step 2 is to be moved to the MANAGED state and brought online

How to Add Nodes to the RAC Framework Resource Group by Using the scrgadm Utility

This procedure assumes that a RAC framework resource group has already been created for the cluster.

  1. On one node of the cluster, become superuser.

  2. For the RAC framework resource group, specify a node list that contains the following nodes:

    • The nodes on which Sun Cluster Support for Oracle Real Application Clusters is already enabled.

    • The nodes that you are adding to the RAC framework resource group.


    # scrgadm -c -g resource-group \
      -y nodelist=nodelist \
      -y maximum_primaries=num-in-list \
      -y desired_primaries=num-in-list 
    
    -g resource-group

    Specifies the name of the RAC framework resource group to which you are adding nodes. If this resource group was created by using the scsetup utility, the name of the resource group is rac-framework-rg.

    -y nodelist=nodelist

    Specifies a comma-separated list of cluster nodes on which Sun Cluster Support for Oracle Real Application Clusters is already enabled and the nodes that you are adding to the RAC framework resource group. The Sun Cluster Support for Oracle Real Application Clusters software packages must be installed on each node in this list.

    -y maximum_primaries=num-in-list

    Specifies the number of nodes on which Sun Cluster Support for Oracle Real Application Clusters is to be enabled. This number must equal the number of nodes in nodelist.

    -y desired_primaries=num-in-list

    Specifies the number of nodes on which Sun Cluster Support for Oracle Real Application Clusters is to be enabled. This number must equal the number of nodes in nodelist.

  3. Bring the RAC framework resource group and its resources online.


    # scswitch -Z -g resource-group
    
    -Z

    Enables the resource and monitor, moves the resource group to the MANAGED state, and brings the resource group online.

    -g resource-group

    Specifies the name of the RAC framework resource group that is to be moved to the MANAGED state and brought online. If this resource group was created by using the scsetup utility, the name of the resource group is rac-framework-rg.

How to Remove the RAC Framework Resource Group by Using the scrgadm Utility

The resources that the RAC framework resource group contains are described in Overview of the RAC Framework Resource Group. If the RAC framework resource group is created by using the scsetup utility, scsetup assigns names to the resources as listed in Table 2–3.

Table 2–3 Names Assigned to RAC Framework Resources by scsetup

Resource Type 

Resource Name 

SUNW.rac_svm

rac_svm

SUNW.rac_cvm

rac_cvm

SUNW.rac_hwraid

rac_hwraid

SUNW.rac_udlm

rac_udlm

SUNW.rac_framework

rac_framework

  1. On one node of the cluster, become superuser.

  2. Remove all RAC server resource groups in the cluster.

    These resource groups were created as explained in How to Register and Configure Oracle RAC Server Resources.

    Remove each RAC server resource group as follows:

    1. Disable each RAC server resource in the resource group.

      For each resource, type the following command:


      # scswitch -n -j resource
      
      -j resource

      Specifies the resource that you are disabling

    2. Remove each RAC server resource in the resource group.

      For each resource, type the following command:


      # scrgadm -r -j resource
      
      -j resource

      Specifies the resource that you are removing

    3. Remove the RAC server resource group.


      # scrgadm -r -g rac-server-rg
      
      -g rac-server-rg

      Specifies the resource group that you are removing

  3. Disable each resource that the RAC framework resource group contains.

    Disable the instance of the SUNW.rac_framework resource only after you have disabled all other resources that the RAC framework resource group contains. The other resources in the RAC framework resource group depend on SUNW.rac_framework.


    # scswitch -n -j resource
    
    -j resource

    Specifies the name of the resource that you are disabling. If this resource was created by using the scsetup utility, the name depends on the resource type as shown in Table 2–3.

  4. Remove each resource that you disabled in Step 3.

    Remove the instance of the SUNW.rac_framework resource only after you have removed all other resources that the RAC framework resource group contains. The other resources in the RAC framework resource group depend on SUNW.rac_framework.


    # scrgadm -r -j resource
    
    -j resource

    Specifies the name of the resource that you are removing. If this resource was created by using the scsetup utility, the name depends on the resource type as shown in Table 2–3.

  5. Unregister the resource type of each resource that you removed in Step 4.


    # scrgadm -r -t resource-type
    
    -t resource-type

    Specifies the name of the resource type that you are unregistering. This resource type was registered for the RAC framework resource group when the resource group was created. The resources that the RAC framework resource group contains are described in Overview of the RAC Framework Resource Group.

  6. Remove the RAC framework resource group.


    # scrgadm -r -g resource-group
    
    -g resource-group

    Specifies the name of the RAC framework resource group that you are removing. If this resource group was created by using the scsetup utility, the name of the resource group is rac-framework-rg.


Note –

After you have removed the RAC framework resource group, you must boot each cluster node in noncluster mode and uninstall the Sun Cluster Support for Oracle Real Application Clusters software packages. For more information, see How to Remove Sun Cluster Support for Oracle Real Application Clusters From a Cluster.



Example 2–6 Removing the RAC Framework Resource Group by Using the scrgadm Utility


# scswitch -n -j RAC1-rs
# scrgadm -r -j RAC1-rs
# scrgadm -r -g RAC1-rg
# scswitch -n -j RAC2-rs
# scrgadm -r -j RAC2-rs
# scrgadm -r -g RAC2-rg
# scswitch -n -j rac_svm
# scswitch -n -j rac_udlm
# scswitch -n -j rac_framework
# scrgadm -r -j rac_svm
# scrgadm -r -j rac_udlm
# scrgadm -r -j rac_framework
# scrgadm -r -t SUNW.rac_svm
# scrgadm -r -t SUNW.rac_udlm
# scrgadm -r -t SUNW.rac_framework
# scrgadm -r -g rac-framework-rg

This example shows the commands that are required to remove a RAC framework resource group that was created by using the scsetup utility. The resource groups RAC1-rg and RAC2-rg are RAC server resource groups that were created as shown in Example 2–1. The cluster from which this resource group is removed uses the Solaris Volume Manager for Sun Cluster.


How to Remove Nodes From the RAC Framework Resource Group by Using the scrgadm Utility

  1. On one node of the cluster, become superuser.

  2. Boot in noncluster mode the nodes from which you are removing Sun Cluster Support for Oracle Real Application Clusters.

  3. For the RAC framework resource group, specify a node list that contains only the nodes that are to remain in the RAC framework resource group.

    This node list must not include the nodes that you are removing.


    # scrgadm -c -g resource-group \
      -y nodelist=nodelist \
      -y maximum_primaries=num-in-list \
      -y desired_primaries=num-in-list 
    
    -g resource-group

    Specifies the name of the RAC framework resource group from which you are removing nodes. If this resource group was created by using the scsetup utility, the name of the resource group is rac-framework-rg.

    -y nodelist=nodelist

    Specifies a comma-separated list of cluster nodes that are to remain in the RAC framework resource group. This node list must not include the nodes that you are removing.

    -y maximum_primaries=num-in-list

    Specifies the number of nodes on which Sun Cluster Support for Oracle Real Application Clusters is to be enabled. This number must equal the number of nodes in nodelist.

    -y desired_primaries=num-in-list

    Specifies the number of nodes on which Sun Cluster Support for Oracle Real Application Clusters is to be enabled. This number must equal the number of nodes in nodelist.


Note –

After you have removed nodes from the RAC framework resource group, you can optionally uninstall the Sun Cluster Support for Oracle Real Application Clusters software packages from the nodes that you removed. For more information, see How to Remove Sun Cluster Support for Oracle Real Application Clusters From Selected Nodes.