Perform this procedure if you are adding nodes to a cluster and you require Support for Oracle RAC to run on the nodes. Perform this procedure from only one node.
This task involves adding the selected nodes from the following resource groups in the following order:
Resource groups for scalable file-system mount-point resources
The multiple-owner volume-manager framework resource group, if used.
The Support for Oracle RAC framework resource group
Resource groups for scalable device group resources
Resource groups that contain resources for the StorageTek QFS metadata server
Resource groups for logical hostname resources
The resource group for the Support for Oracle RAC database
Before You Begin
Ensure that the required Support for Oracle RAC software packages are installed on each node to which you are adding Support for Oracle RAC. For more information, see Installing the Support for Oracle RAC Package.
Ensure that the node that you add is connected to the shared storage that is used by the Support for Oracle RAC configuration.
If no resource groups that contain scalable file-system mount-point resources are configured, omit this step.
For each resource group to which you are adding nodes, run the following command:
# clresourcegroup add-node -S -n nodelist scal-mp-rg
Specifies a comma-separated list of cluster nodes to which you are adding Support for Oracle RAC.
Specifies the name of the resource group to which you are adding nodes.
# clresourcegroup add-node -S -n nodelist vucmm-fmwk-rg
Specifies a comma-separated list of cluster nodes to which you are adding the resource group.
Specifies the name of the resource group to which you are adding nodes.
# clresourcegroup add-node -S -n nodelist rac-fmwk-rg
Specifies a comma-separated list of cluster nodes to which you are adding Support for Oracle RAC.
Specifies the name of the resource group to which you are adding nodes.
If you are not using any scalable device groups for Oracle Database files, omit this step.
How to perform this step depends on the type of the scalable device group.
# metaset -s set-name -M -a -h nodelist
Specifies the Solaris Volume Manager for Sun Cluster multi-owner disk set to which you are adding nodes.
Specifies a space-separated list of cluster nodes that you are adding to the multi-owner disk set.
If no resource groups that contain scalable device group resources are configured, omit this step.
For each resource group to which you are adding nodes, run the following command:
# clresourcegroup add-node -S -n nodelist scal-dg-rg
Specifies a comma-separated list of cluster nodes to which you are adding Support for Oracle RAC.
Specifies the name of the resource group to which you are adding nodes.
If no shared file systems are to be accessed from the nodes that you are adding, omit this step.
For each file system that you are mounting, type the following command:
# mount mount-point
Specifies the mount point of the file system that you are mounting.
If no resource groups that contain resources for the StorageTek QFS metadata server are configured, omit this step.
For each resource group to which you are adding nodes, run the following command:
# clresourcegroup add-node -n nodelist qfs-mds-rg
Specifies a comma-separated list of cluster nodes to which you are adding Support for Oracle RAC.
Specifies the name of the resource group to which you are adding nodes.
These resource groups contain scalable device group resources.
If no resource groups that contain scalable device group resources are configured, omit this step.
For each resource group that you are bringing online, type the following command:
# clresourcegroup online -eM scal-dg-rg
Specifies the name of the resource group that you are bringing online.
# /etc/init.d/init.crs start Startup will be queued to init within 30 seconds.
For each resource group to which you are adding nodes, run the following command:
# clresourcegroup add-node -S -n nodelist rac-db-rg
Specifies a comma-separated list of cluster nodes to which you are adding Support for Oracle RAC.
Specifies the name of the resource group to which you are adding nodes.
Create an Oracle Grid Infrastructure resource for each Oracle Solaris Cluster resource for scalable device groups and scalable file-system mount points on which Oracle components depend. For more information, see How to Create an Oracle Grid Infrastructure Resource for Interoperation With Oracle Solaris Cluster.
For each resource that you are modifying, perform these steps:
# clresource disable rac-db-rs
Specifies the name of the Support for Oracle RAC database resource that you are disabling.
# clresource enable rac-db-rs
Specifies the name of the Support for Oracle RAC database resource that you are enabling.
For each resource group that you are bringing online, run the following command:
# clresourcegroup online -eM rac-db-rg
Specifies the name of the resource group that you are bringing online.
This example shows the sequence of operations that is required to add Support for Oracle RAC to nodes pclus3 and pclus4 of a four-node cluster.
The configuration of Support for Oracle RAC in this example is as follows:
StorageTek QFS shared file system on Solaris Volume Manager for Sun Cluster is used to store Oracle Database files.
The mount points of file systems that are used for Oracle Database files are as follows:
Oracle Database files: /db_qfs/OraData
Oracle Database binary files and related files: /db_qfs/OraHome
The oradg disk set is used only by the Support for Oracle RAC database.
The name of the Support for Oracle RAC database is swb.
The StorageTek QFS shared file systems use a Solaris Volume Manager for Sun Cluster multi-owner disk set that is named oradg. The creation of this disk set is shown in Example 3, Creating a Multi-Owner Disk Set in Solaris Volume Manager for Sun Cluster.
The configuration uses a multiple-owner volume-manager framework resource group.
The configuration of resource groups in this example is shown in the following table.
|
The resource groups that are required for this configuration are shown in Configuration of Support for Oracle RAC With Solaris Volume Manager for Sun Cluster and StorageTek QFS Shared File System.
To add the nodes to the resource group that contains scalable file-system mount-point resources, the following command is run:
# clresourcegroup add-node -S -n pclus3,pclus4 scalmnt-rg
To add the nodes to the multiple-owner volume-manager framework resource group, the following command is run:
# clresourcegroup add-node -S -n pclus3,plcus4 vucmm-framework-rg
To add the nodes to the Support for Oracle RAC framework resource group, the following command is run:
# clresourcegroup add-node -S -n pclus3,plcus4 rac-framework-rg
To add the nodes to the Solaris Volume Manager for Sun Cluster multi-owner disk set oradg, the following command is run:
# metaset -s oradg -M -a -h pclus3 pclus4
To add the nodes to the resource group that contains scalable device group resources, the following command is run:
# clresourcegroup add-node -S -n pclus3,pclus4 scaldg-rg
To mount the shared file systems that are to be accessed from the nodes that are being added, the following commands are run:
# mount /db_qfs/OraData # mount /db_qfs/OraHome
To add the nodes to the resource group that contains resources for the StorageTek QFS metadata server, the following command is run:
# clresourcegroup add-node -n pclus3,pclus4 qfsmds-rg
To bring online the resource group that contains scalable device group resources, the following command is run:
# clresourcegroup online -eM scaldg-rg
To start Oracle Clusterware and to verify the correct startup of Oracle Clusterware, the following commands are run:
# /etc/init.d/init.crs start Startup will be queued to init within 30 seconds. # /db_qfs/OraHome/crs/bin/crsctl check crs CSS appears healthy CRS appears healthy EVM appears healthy
To add the nodes to the resource group for the Support for Oracle RAC database, the following command is run:
# clresourcegroup add-node -S -n pclus3,pclus4 rac_server_proxy-rg
After the addition of the nodes to the resource group for the Support for Oracle RAC database, the required Oracle Clusterware resources are created. The creation of these Oracle Clusterware resources is beyond the scope of this example.
To bring online the resource group for the Support for Oracle RAC database, the following command is run:
# clresourcegroup online -eM rac_server_proxy-rg