Creating Storage Management Resources by Using Sun Cluster Maintenance Commands

The tasks in this section are alternatives for the resource-configuration steps in How to Register and Configure Storage Resources for Oracle Files by Using clsetup.

The following resources to represent storage for Oracle files are required:

Resources for scalable device groups and scalable file-system mount points
Resources for the Sun StorEdge QFS metadata server

Resources for Scalable Device Groups and Scalable File-System Mount Points

If you are using Solaris Volume Manager for Sun Cluster or VxVM, configure storage resources as follows:

Create one scalable resource group to contain all resources for scalable device groups.
Create one resource for each Solaris Volume Manager for Sun Cluster multi-owner disk set or VxVM shared-disk group that you are using for Oracle files.

If you are using Sun StorEdge^TM QFS or Network Appliance NAS devices, configure storage resources as follows:

Create one scalable resource group to contain all resources for scalable file-system mount points.
Create one resource for each Sun StorEdge QFS shared file system or NFS file system on a Network Appliance NAS device that you are using for Oracle files.

The resource that represents a Sun StorEdge QFS shared file system can start only if the file system's Sun StorEdge QFS metadata server is running. Similarly, the resource that represents a Sun StorEdge QFS shared file system can stop only if the file system's Sun StorEdge QFS metadata server is stopped. To meet this requirement, configure a resource for each Sun StorEdge QFS metadata server. For more information, see Resources for the Sun StorEdge QFS Metadata Server.

Resources for the Sun StorEdge QFS Metadata Server

If you are using the Sun StorEdge QFS shared file system, create one resource for each Sun StorEdge QFS metadata server. The configuration of resource groups for these resources depends on the version of Oracle that you are using.

Configuration of Sun StorEdge QFS Resource Groups With Oracle 9i and Oracle 10g R2

If you are using Oracle 9i or Oracle 10g R2, the configuration of resource groups depends on the number of file systems in your configuration.

If your configuration contains a small number of file systems, create one resource group for all resources for the Sun StorEdge QFS metadata server.
If your configuration contains a large number of file systems, configure resources for the Sun StorEdge QFSmetadata server in several resource groups as follows:
- Distribute resources among the resource groups to ensure optimum load balancing.
- Select a different primary node for each resource group to prevent all the resource groups from being online on the same node simultaneously.

Configuration of Sun StorEdge QFS Resource Groups With Oracle 10g R1

If you are using Oracle 10g, Oracle CRS manage RAC database instances. These database instances must be started only after all shared file systems are mounted.

You might use multiple file systems for database files and related files. For more information, see Sun StorEdge QFS File Systems for Database Files and Related Files. In this situation, ensure that the file system that contains the Oracle CRS voting disk is mounted only after the file systems for other database files have been mounted. This behavior ensures that, when a node is booted, Oracle CRS are started only after all Sun StorEdge QFS file systems are mounted.

If you are using Oracle 10g R1, the configuration of resource groups must ensure that Sun Cluster mounts the file systems in the required order. To meet this requirement, configure resource groups for the metadata servers of the file systems as follows:

Create the resources for the metadata servers in separate resource groups.
Set the resource group for the file system that contains the Oracle CRS voting disk to depend on the other resource groups.

How to Create a Resource for a Scalable Device Group

This procedure provides the long forms of the Sun Cluster maintenance commands. Most commands also have short forms. Except for the forms of the command names, the commands are identical. For a list of the commands and their short forms, see Appendix A, Sun Cluster Object-Oriented Commands, in Sun Cluster Data Services Planning and Administration Guide for Solaris OS.

Perform this procedure on only one node of the cluster.

Become superuser or assume a role that provides solaris.cluster.admin and solaris.cluster.modify RBAC authorizations.

Create a scalable resource group to contain the scalable device group resource.

Set a strong positive affinity by the resource group for the RAC framework resource group.

Tip –

If you require Sun Cluster Support for Oracle RAC to run on all cluster nodes, specify the -S option in the command that follows and omit the options -n, -p maximum_primaries, -p desired_primaries, and -p rg_mode.

# clresourcegroup create -p nodelist=nodelist \
-p desired_primaries=num-in-list \
-p maximum_primaries=num-in-list \
-p rg_affinities=++rac-fmwk-rg \
[-p rg_description="description" \]
-p rg_mode=Scalable \
scal-dg-rg

# clresourcetype register SUNW.ScalDeviceGroup

For each scalable device group that you are using for Oracle files, add an instance of the SUNW.ScalDeviceGroup resource type to the resource group that you created in Step 2.

Set a strong dependency for the instance of SUNW.ScalDeviceGroup on the resource in the RAC framework resource group that represents the volume manager for the device group. Limit the scope of this dependency to only the node where the SUNW.ScalDeviceGroup resource is running.
# clresource create -t SUNW.ScalDeviceGroup -g scal-dg-rg \ -p resource_dependencies=fm-vol-mgr-rs{local_node} \ -p diskgroupname=disk-group scal-dg-rs

Bring online and in a managed state the resource group that you created in Step 2.
# clresourcegroup online -emM scal-dg-rg

How to Register and Configure Resources for the Sun StorEdge QFS Metadata Server

Perform this task only if you are using the Sun StorEdge QFS shared file system.

Perform this procedure on only one node of the cluster.

Become superuser or assume a role that provides solaris.cluster.admin and solaris.cluster.modify RBAC authorizations.

Create a failover resource group to contain the resources for the Sun StorEdge QFS metadata server.

If you are also using a volume manager, set a strong positive affinity by the resource group for the resource group that contains the volume manager's scalable device-group resource. This resource group is created in How to Create a Resource for a Scalable Device Group.
# clresourcegroup create -n nodelist \ [-p rg_affinities=++scal-dg-rg \] [-p rg_description="description" \] qfs-mds-rg

For each Sun StorEdge QFS shared file system that you are using, add an instance of the SUNW.qfs resource type to the resource group that you created in Step 2.

Each instance of SUNW.qfs represents the metadata server of the file system.

If you are also using a volume manager, set a strong dependency by the instance of SUNW.qfs on the resource for the scalable device group that is to store the file system . This resource is created in How to Create a Resource for a Scalable Device Group.
# clresource create -t SUNW.qfs -g qfs-mds-rg \ -p qfsfilesystem=path \ [-p resource_dependencies=scal-dg-rs \] qfs-mds-rs

Bring online and in a managed state the resource group that you created in Step 2.
# clresourcegroup online -emM qfs-mds-rg

How to Create a Resource for a File-System Mount Point

Perform this procedure on only one node of the cluster.

Become superuser or assume a role that provides solaris.cluster.admin and solaris.cluster.modify RBAC authorizations.

Create a scalable resource group to contain the resource for a scalable file-system mount point.

If you are also using a volume manager, set a strong positive affinity by the resource group for the resource group that contains the volume manager's scalable device-group resource. This resource group is created in How to Create a Resource for a Scalable Device Group.

Tip –

# clresourcegroup create -n nodelist \
-p desired_primaries=num-in-list \
-p maximum_primaries=num-in-list \
[-p rg_affinities=++scal-dg-rg \]
[-p rg_description="description" \]
-p rg_mode=Scalable scal-mp-rg

# clresourcetype register SUNW.ScalMountPoint

For each shared file system that requires a scalable file-system mount-point resource, add an instance of the SUNW.ScalMountPoint resource type to the resource group that you created in Step 2.

For each Sun StorEdge QFS shared file system, type the following command:

Set a strong dependency by the instance of SUNW.ScalMountPoint on the resource for the Sun StorEdge QFS metadata server for the file system. The resource for the Sun StorEdge QFS metadata server set is created in How to Register and Configure Resources for the Sun StorEdge QFS Metadata Server.

If you are also using a volume manager, set an offline-restart dependency by the instance of SUNW.ScalMountPoint on the resource for the scalable device group that is to store the file system. This resource is created in How to Create a Resource for a Scalable Device Group.

# clresource create -t SUNW.ScalMountPoint -g scal-mp-rg \
-p resource_dependencies=qfs-mds-rs \
[-p resource_dependencies_offline_restart=scal-dg-rs \]
-p mountpointdir=mp-path \
-p filesystemtype=s-qfs \
-p targetfilesystem=fs-name qfs-mp-rs

For each file system on a Network Appliance NAS device, type the following command:

# clresource create -t SUNW.ScalMountPoint -g scal-mp-rg \
[-p resource_dependencies_offline_restart=scal-dg-rs \]
-p mountpointdir=mp-path \
-p filesystemtype=nas \
-p targetfilesystem=nas-device:fs-name nas-mp-rs

Bring online and in a managed state the resource group that you created in Step 2.
# clresourcegroup online -emM scal-mp-rg