How to Remove Sun Cluster Support for Oracle RAC From a Cluster (Sun Cluster Data Service for Oracle RAC Guide for Solaris OS)

Sun Cluster Data Service for Oracle RAC Guide for Solaris OS

Previous: Extending an Existing Configuration of Sun Cluster Support for Oracle RAC
Next: How to Remove Sun Cluster Support for Oracle RAC From Selected Nodes

How to Remove Sun Cluster Support for Oracle RAC From a Cluster

Perform this task to remove Sun Cluster Support for Oracle RAC from all nodes in a cluster.

On a cluster where multiple Oracle RAC databases are running, perform this task to remove an Oracle RAC database from the cluster. The remaining Oracle RAC databases continue to run in the cluster.

This procedure provides the long forms of the Sun Cluster maintenance commands. Most commands also have short forms. Except for the forms of the command names, the commands are identical. For a list of the commands and their short forms, see Appendix A, Sun Cluster Object-Oriented Commands, in Sun Cluster Data Services Planning and Administration Guide for Solaris OS.

This task involves removing the following resource groups from the cluster in the following order:

The resource group for the RAC database
Resource groups for logical hostname resources
Resource groups for scalable file-system mount-point resources
Resource groups that contain resources for the Sun StorEdge QFS metadata server
Resource groups for scalable device group resources
The RAC framework resource group

Caution –

You might perform this task to remove an Oracle RAC database from a cluster where multiple Oracle RAC databases are running. In this situation, do not remove any resource group on whose resources the remaining Oracle RAC databases depend. For example, you might have configured multiple database file systems to depend on a single device group. In this situation, do not remove the resource group that contains the resource for the scalable device group. Similarly, if multiple databases depend on the RAC framework resource group, do not remove this resource group.

Before You Begin

Ensure that the cluster node from which you perform this task is booted in cluster mode.

On one node of the cluster, become superuser.

(Oracle 9i and Oracle 10g R2 only) Remove the resource group for each RAC database that you are removing.

If you are using Oracle 10g R1, omit this step. For Oracle 10g R1, no resource groups for RAC databases are configured.

For each RAC database that you are removing, type the following command:
# clresourcegroup delete -F rac-db-rg
rac-db-rg

Specifies the resource group that you are removing.

(Oracle 9i only) Remove all resource groups for logical hostname resources that are used by each RAC database that you are removing.

If you are using Oracle 10g R1 or Oracle 10g R2 , omit this step. For Oracle 10g R1 and Oracle 10g R2, no resource groups for logical hostname resources are configured.

For each resource group that you are removing, type the following command:
# clresourcegroup delete -F lh-rg
lh-rg

Specifies the resource group that you are removing.

Use Oracle utilities to remove from the cluster each RAC database that you no longer require.

If you are removing Sun Cluster Support for Oracle RAC entirely, use Oracle utilities to remove the following items from all nodes in a cluster:
- The Oracle RAC software
- The Oracle CRS software

(Oracle 10g R2 only) Disable the CRS framework resource.

If you are using Oracle 9i or Oracle 10g R1, omit this step. For Oracle 9i and Oracle 10g R1, no CRS framework resource is configured.
# clresource disable crs-framework-rs
crs-framework-rs

Specifies the name of the resource that you are disabling. This resource is the instance of the SUNW.crs_framework resource type that is configured in the cluster.

Remove any resource groups that contain scalable file-system mount-point resources.

If no resource groups that contain scalable file-system mount-point resources are configured, omit this step.

For each resource group that you are removing, type the following command:
# clresourcegroup delete -F scal-mp-rg
scal-mp-rg

Specifies the resource group that you are removing.

Remove any resource groups that contain resources for the Sun StorEdge QFS metadata server.

If no resource groups that contain resources for the Sun StorEdge QFS metadata server are configured, omit this step.

For each resource group that you are removing, type the following command:
# clresourcegroup delete -F qfs-mds-rg
qfs-mds-rg

Specifies the resource group that you are removing.

Remove the Sun StorEdge QFS shared file systems that were represented by resources in the resource group that you deleted in Step 8.

For instructions for performing this task, see Sun StorEdge QFS Configuration and Administration Guide, Version 4, Update 5.

Remove any resource groups that contain scalable device group resources.

If no resource groups that contain scalable device group resources are configured, omit this step.

For each resource group that you are removing, type the following command:
# clresourcegroup delete -F scal-dg-rg
scal-dg-rg

Specifies the resource group that you are removing.

Destroy any scalable device groups that were affected by the removal of resource groups in Step 10.

How to perform this step depends on the type of the scalable device group.
- For each Solaris Volume Manager for Sun Cluster multi-owner disk set, destroy the disk set as follows:
  1. Remove all metadevices such as volumes, soft partitions, and mirrors from the disk set.
    
    Use the metaclear(1M) command for this purpose.
    # metaclear -s scal-dg-ms -a
    -s scal-dg-ms
    
    Specifies the name of the disk set from which you are removing metadevices.
  2. Remove all global devices from the disk set.
    # metaset -s scal-dg-ms -d -f alldevices
    -s scal-dg-ms
    
    Specifies the name of the disk set from which you are removing global devices.
    
    alldevices
    
    Specifies a space-separated list that contains all global devices that were added to the disk set when the disk set was created. The format of each device ID path name is /dev/did/dsk/dN, where N is the device number.
  3. Remove all nodes from the disk set that you are destroying.
    
    The removal of all nodes from a disk set destroys the disk set.
    # metaset -s scal-dg-ms -d -h allnodes
    -s scal-dg-ms
    
    Specifies the name of the disk set that you are destroying.
    
    -h allnodes
    
    Specifies a space-separated list that contains all nodes that were added to the disk set when the disk set was created.
- For each VxVM shared-disk group, use VERITAS commands to destroy the VxVM shared-disk group.
  
  For more information, see your VxVM documentation.
Note –
If you are removing an Oracle RAC database from a cluster where multiple Oracle RAC databases are running, omit the remaining steps in this procedure.

Remove the RAC framework resource group.
# clresourcegroup delete -F rac-fmwk-rg
rac-fmwk-rg

Specifies the resource group that you are removing.

Unregister the resource type of each resource that you removed in this procedure.
# clresourcetype unregister resource-type-list
resource-type-list

Specifies a comma-separated list of the names of the resource types that you are unregistering. For a list of the resource types that are associated with Sun Cluster Support for Oracle RAC, see Automatically Generated Names for Sun Cluster Objects.

(Optional) From each node in the cluster, uninstall the Sun Cluster Support for Oracle RAC software packages.

Use the Sun Java^TM Enterprise System uninstaller for this purpose. For more information, see Chapter 8, Uninstalling, in Sun Java Enterprise System 5 Installation Guide for UNIX.

Reboot each node in the cluster.

Example 6–4 Removing Sun Cluster Support for Oracle RAC From a Cluster

This example shows the sequence of operations that is required to remove Sun Cluster Support for Oracle RAC from all nodes of a four-node cluster. The nodes in this cluster are named pclus1, pclus2, pclus3, and pclus4. Only one RAC database is configured on the cluster.

The configuration of Sun Cluster Support for Oracle RAC in this example is as follows:

The version of Oracle RAC is 10g R2.
Sun StorEdge QFS shared file system on Solaris Volume Manager for Sun Cluster is used to store Oracle files.
The mount points of file systems that are used for Oracle files are as follows:
- Oracle database files: /db_qfs/OraData
- Oracle binary files and related files: /db_qfs/OraHome
The name of the Oracle RAC database is swb.
The Sun StorEdge QFS shared file systems use a Solaris Volume Manager for Sun Cluster multi-owner disk set that is named oradg. The creation of this disk set is shown in Example 2–1.

The configuration of resource groups in this example is shown in the following table.

Resource Group	Purpose
`rac-framework-rg`	RAC framework resource group.
`scaldg-rg`	Resource group for scalable device-group resources.
`qfsmds-rg`	Resource group for Sun StorEdge QFS metadata server resources.
`scalmnt-rg`	Resource group for scalable file-system mount-point resources.
`rac_server_proxy-rg`	RAC database resource group.

The resource groups that are required for this configuration are shown in Figure A–2.

To remove the resource group for RAC database, the following command is run:
# clresourcegroup delete -F rac_server_proxy-rg
After the removal of this resource group, Oracle utilities are used to remove the following items:
- The Oracle RAC database
- The Oracle RAC software
- The Oracle CRS software
The removal of these items is beyond the scope of this example.
To disable the CRS framework resource, the following command is run:
# clresource disable crs_framework-rs
To remove the resource group that contains scalable file-system mount-point resources, the following command is run:
# clresourcegroup delete -F scalmnt-rg
To remove the resource group that contains resources for the Sun StorEdge QFS metadata server, the following command is run:
# clresourcegroup delete -F qfsmds-rg
After the removal of this resource group, Sun StorEdge QFS utilities are used to remove the Sun StorEdge QFS shared file systems that are used for Oracle files. The removal of these file systems is beyond the scope of this example.
To remove the resource group that contains scalable device group resources, the following command is run:
# clresourcegroup delete -F scaldg-rg
To destroy the Solaris Volume Manager for Sun Cluster multi-owner disk set oradg, the following commands are run:
# metaclear -s oradg -a # metaset -s oradg -d \ -f /dev/did/dsk/d8 /dev/did/dsk/d9 /dev/did/dsk/d15 /dev/did/dsk/d16 # metaset -s oradg -d -h pclus1 pclus2 pclus3 pclus4
The following global devices are removed from the disk set:
- /dev/did/dsk/d8
- /dev/did/dsk/d9
- /dev/did/dsk/d15
- /dev/did/dsk/d16
To remove the RAC framework resource group, the following command is run:
# clresourcegroup delete -F rac-framework-rg
To unnregister the resource type of each resource that was removed, the following command is run:
# clresourcetype unregister \ SUNW.scalable_rac_server_proxy,\ SUNW.ScalMountPoint,\ SUNW.qfs,\ SUNW.ScalDeviceGroup,\ SUNW.rac_svm,\ SUNW.crs_framework,\ SUNW.rac_udlm,\ SUNW.rac_framework
This configuration is running on the SPARC® platform. Therefore, SUNW.rac_udlm is in the list of resource types that are unregistered.

After the unregistration of these resource types, the following operations are performed:
- The removal of the Sun Cluster Support for Oracle RAC software packages
- The reboot of each node in the cluster
These operations are beyond the scope of this example.