How to Remove Support for Oracle RAC From a Cluster

Language:

Perform this task to remove Support for Oracle RAC from all nodes in a cluster.

On a cluster where multiple Support for Oracle RAC databases are running, perform this task to remove a Support for Oracle RAC database from the cluster. The remaining Support for Oracle RAC databases continue to run in the cluster.

This task involves removing the following resource groups from the cluster in the following order:

The resource group for the Support for Oracle RAC database
Resource groups for logical hostname resources
Resource groups for scalable file-system mount-point resources
Resource groups that contain resources for the Sun QFS metadata server
Resource groups for scalable device group resources
The Support for Oracle RAC framework resource group
The multiple-owner volume-manager framework resource group, if used

Caution - You might perform this task to remove a Support for Oracle RAC database from a cluster where multiple Support for Oracle RAC databases are running. In this situation, do not remove any resource group on whose resources the remaining Support for Oracle RAC databases depend. For example, you might have configured multiple database file systems to depend on a single device group. In this situation, do not remove the resource group that contains the resource for the scalable device group. Similarly, if multiple databases depend on the Support for Oracle RAC framework resource group, do not remove this resource group.

Before You Begin

Ensure that the cluster node from which you perform this task is booted in cluster mode.

On one node of the cluster, assume the root role.
Remove the resource group for each Support for Oracle RAC database that you are removing.
For each Support for Oracle RAC database that you are removing, type the following command:
```
# clresourcegroup delete -F rac-db-rg
```
rac-db-rg

Specifies the resource group that you are removing.
Use Oracle Database utilities to remove from the cluster each Support for Oracle RAC database that you no longer require.
If you are removing Support for Oracle RAC entirely, use Oracle Database utilities to remove the following items from all nodes in a cluster:
- Support for Oracle RAC software
- Oracle Grid Infrastructure software
Disable the Oracle Grid Infrastructure framework resource.
```
# clresource disable crs-framework-rs
```
crs-framework-rs

Specifies the name of the resource that you are disabling. This resource is the instance of the SUNW.crs_framework resource type that is configured in the cluster.
Remove any resource groups that contain scalable file-system mount-point resources.
If no resource groups that contain scalable file-system mount-point resources are configured, omit this step.

For each resource group that you are removing, type the following command:
```
# clresourcegroup delete -F scal-mp-rg
```
scal-mp-rg

Specifies the resource group that you are removing.

Remove any resource groups that contain resources for the Sun QFS metadata server.
If no resource groups that contain resources for the Sun QFS metadata server are configured, omit this step.

For each resource group that you are removing, type the following command:
```
# clresourcegroup delete -F qfs-mds-rg
```
qfs-mds-rg

Specifies the resource group that you are removing.
Remove the Sun QFS shared file systems that were represented by resources in the resource group that you deleted in Step 7.
For instructions for performing this task, see Using Sun QFS and Sun Storage Archive Manager with Oracle Solaris Cluster .

Remove any resource groups that contain scalable device group resources.
If no resource groups that contain scalable device group resources are configured, omit this step.

For each resource group that you are removing, type the following command:
```
# clresourcegroup delete -F scal-dg-rg
```
scal-dg-rg

Specifies the resource group that you are removing.
Destroy any scalable device groups that were affected by the removal of resource groups in Step 9.
How to perform this step depends on the type of the scalable device group.
- For each Solaris Volume Manager for Sun Cluster multi-owner disk set, destroy the disk set as follows:
  1. Remove all metadevices such as volumes, soft partitions, and mirrors from the disk set.
    Use the metaclear (1M) command for this purpose.
```
# metaclear -s scal-dg-ms -a
```
    –s scal-dg-ms
    
    Specifies the name of the disk set from which you are removing metadevices.
  2. Remove all global devices from the disk set.
```
# metaset -s scal-dg-ms -d -f alldevices
```
    -s scal-dg-ms
    
    Specifies the name of the disk set from which you are removing global devices.
    
    alldevices
    
    Specifies a space-separated list that contains all global devices that were added to the disk set when the disk set was created. The format of each device ID path name is /dev/did/dsk/dN, where N is the device number.
  3. Remove all nodes from the disk set that you are destroying.
    The removal of all nodes from a disk set destroys the disk set.
```
# metaset -s scal-dg-ms -d -h allnodes
```
    -s scal-dg-ms
    
    Specifies the name of the disk set that you are destroying.
    
    -h allnodes
    
    Specifies a space-separated list that contains all nodes that were added to the disk set when the disk set was created.
Note - If you are removing a Support for Oracle RAC database from a cluster where multiple Support for Oracle RAC databases are running, omit the remaining steps in this procedure.

Remove the Support for Oracle RAC framework resource group.
```
# clresourcegroup delete -F rac-fmwk-rg
```
rac-fmwk-rg

Specifies the resource group that you are removing.

Remove the multiple-owner volume-manager framework resource group, if used.
```
# clresourcegroup delete -F vucmm-fmwk-rg
```
vucmm-fmwk-rg

Specifies the resource group that you are removing.

Unregister the resource type of each resource that you removed in this procedure.
```
# clresourcetype unregister resource-type-list
```
resource-type-list

Specifies a comma-separated list of the names of the resource types that you are unregistering. For a list of the resource types that are associated with Support for Oracle RAC, see Automatically Generated Names for Oracle Solaris Cluster Objects.

(Optional) From each node in the cluster, uninstall the Support for Oracle RAC software packages.
```
# pkg uninstall ha-cluster/data-service/oracle-database ha-cluster/library/ucmm
```

Reboot each node in the cluster.

Example 7-2 Removing Support for Oracle RAC From a Cluster

This example shows the sequence of operations that is required to remove Support for Oracle RAC from all nodes of a four-node cluster. The nodes in this cluster are named pclus1, pclus2, pclus3, and pclus4. Only one Support for Oracle RAC database is configured on the cluster.

The configuration of Support for Oracle RAC in this example is as follows:

Sun QFS shared file system on Solaris Volume Manager for Sun Cluster is used to store Oracle Database files.
The mount points of file systems that are used for Oracle Database files are as follows:
- Oracle Database files: /db_qfs/OraData
- Oracle Database binary files and related files: /db_qfs/OraHome
The oradg disk set is used only by the Support for Oracle RAC database.
The name of the Support for Oracle RAC database is swb.
The Sun QFS shared file systems use a Solaris Volume Manager for Sun Cluster multi-owner disk set that is named oradg. The creation of this disk set is shown in Example 3–1.
The configuration uses a multiple-owner volume-manager framework resource group.

The resource groups that are required for this configuration are shown in Figure A–2.

Resource Group	Purpose
`vucmm-framework-rg`	Multiple-owner volume-manager resource group.
`rac-framework-rg`	Support for Oracle RAC framework resource group.
`scaldg-rg`	Resource group for scalable device-group resources.
`qfsmds-rg`	Resource group for Sun QFS metadata server resources.
`scalmnt-rg`	Resource group for scalable file-system mount-point resources.
`rac_server_proxy-rg`	Support for Oracle RAC database resource group.

The resource groups that are required for this configuration are shown in Figure A–2.

To remove the resource group for the Support for Oracle RAC database, the following command is run:
```
# clresourcegroup delete -F rac_server_proxy-rg
```
After the removal of this resource group, Oracle utilities are used to remove the following items:
- The Support for Oracle RAC database
- The Support for Oracle RAC software
- The Oracle Clusterware software
The removal of these items is beyond the scope of this example.
To disable the Oracle Clusterware framework resource, the following command is run:
```
# clresource disable crs_framework-rs
```
To remove the resource group that contains scalable file-system mount-point resources, the following command is run:
```
# clresourcegroup delete -F scalmnt-rg
```
To remove the resource group that contains resources for the Sun QFS metadata server, the following command is run:
```
# clresourcegroup delete -F qfsmds-rg
```
After the removal of this resource group, Sun QFS utilities are used to remove the Sun QFS shared file systems that are used for Oracle Database files. The removal of these file systems is beyond the scope of this example.
To remove the resource group that contains scalable device group resources, the following command is run:
```
# clresourcegroup delete -F scaldg-rg
```
To destroy the Solaris Volume Manager for Sun Cluster multi-owner disk set oradg, the following commands are run:
```
# metaclear -s oradg -a
# metaset -s oradg -d \
-f /dev/did/dsk/d8 /dev/did/dsk/d9 /dev/did/dsk/d15 /dev/did/dsk/d16
# metaset -s oradg -d -h pclus1 pclus2 pclus3 pclus4
```
- /dev/did/dsk/d8
- /dev/did/dsk/d9
- /dev/did/dsk/d15
- /dev/did/dsk/d16
To remove the Support for Oracle RAC framework resource group, the following command is run:
```
# clresourcegroup delete -F rac-framework-rg
```
To remove the multiple-owner volume-manager framework resource group, the following command is run:
```
# clresourcegroup delete -F vucmm-framework-rg
```
To unregister the resource type of each resource that was removed, the following command is run:
```
# clresourcetype unregister \
SUNW.scalable_rac_server_proxy,\
SUNW.ScalMountPoint,\
SUNW.qfs,\
SUNW.ScalDeviceGroup,\
SUNW.rac_svm,\
SUNW.crs_framework,\
SUNW.rac_framework
```
- The removal of the Support for Oracle RAC software packages
- The reboot of each node in the cluster
These operations are beyond the scope of this example.