Sun Cluster Data Service for Oracle RAC Guide for Solaris OS

Previous: Registering and Configuring the Framework Resource Groups by Using Sun Cluster Maintenance Commands
Next: Creating Resources for Interoperation With Oracle 10g or 11g by Using Sun Cluster Maintenance Commands

Creating Storage Management Resources by Using Sun Cluster Maintenance Commands

The tasks in this section are alternatives for the resource-configuration steps in How to Register and Configure Storage Resources for Oracle Files by Using clsetup. The following information is in this section:

The following resources to represent storage for Oracle files are required:

Resources for scalable device groups and scalable file-system mount points
Resources for the Sun QFS metadata server

Resources for Scalable Device Groups and Scalable File-System Mount Points

If you are using Solaris Volume Manager for Sun Cluster or VxVM, configure storage resources as follows:

Create one scalable resource group to contain all resources for scalable device groups.
Create one resource for each Solaris Volume Manager for Sun Cluster multi-owner disk set or VxVM shared-disk group that you are using for Oracle files.

If you are using Sun QFS or qualified NAS devices, configure storage resources as follows:

Create one scalable resource group to contain all resources for scalable file-system mount points.
Create one resource for each Sun QFS shared file system or NFS file system on a qualified NAS device that you are using for Oracle files.

The resource that represents a Sun QFS shared file system can start only if the file system's Sun QFS metadata server is running. Similarly, the resource that represents a Sun QFS shared file system can stop only if the file system's Sun QFS metadata server is stopped. To meet this requirement, configure a resource for each Sun QFS metadata server. For more information, see Resources for the Sun QFS Metadata Server.

Resources for the Sun QFS Metadata Server

If you are using the Sun QFS shared file system, create one resource for each Sun QFS metadata server. The configuration of resource groups for these resources depends on the version of Oracle that you are using:

Configuration of Sun QFS Resource Groups With Oracle 9i and Oracle 10g Release 2 or 11g

If you are using Oracle 9i, Oracle 10g Release 2, or Oracle 11g, the configuration of resource groups depends on the number of file systems in your configuration.

If your configuration contains a small number of file systems, create one resource group for all resources for the Sun QFS metadata server.
If your configuration contains a large number of file systems, configure resources for the Sun QFSmetadata server in several resource groups as follows:
- Distribute resources among the resource groups to ensure optimum load balancing.
- Select a different primary node for each resource group to prevent all the resource groups from being online on the same node simultaneously.

Configuration of Sun QFS Resource Groups With Oracle 10g Release 1

If you are using Oracle 10g, Oracle CRS manages RAC database instances. These database instances must be started only after all shared file systems are mounted.

You might use multiple file systems for database files and related files. For more information, see Sun QFS File Systems for Database Files and Related Files. In this situation, ensure that the file system that contains the Oracle CRS voting disk is mounted only after the file systems for other database files have been mounted. This behavior ensures that, when a node is booted, Oracle CRS are started only after all Sun QFS file systems are mounted.

If you are using Oracle 10g Release 1, the configuration of resource groups must ensure that Sun Cluster mounts the file systems in the required order. To meet this requirement, configure resource groups for the metadata servers of the file systems as follows:

Create the resources for the metadata servers in separate resource groups.
Set the resource group for the file system that contains the Oracle CRS voting disk to depend on the other metadata resource groups.

How to Create a Resource for a Scalable Device Group in the Global Cluster

This procedure provides the long forms of the Sun Cluster maintenance commands. Most commands also have short forms. Except for the forms of the command names, the commands are identical. For a list of the commands and their short forms, see Appendix A, Sun Cluster Object-Oriented Commands, in Sun Cluster Data Services Planning and Administration Guide for Solaris OS.

Perform this procedure on only one node of the cluster.

Become superuser or assume a role that provides solaris.cluster.admin and solaris.cluster.modify RBAC authorizations.

Create a scalable resource group to contain the scalable device group resource.

Set a strong positive affinity by the resource group for the RAC framework resource group.

Tip –

If you require Sun Cluster Support for Oracle RAC to run on all cluster nodes, specify the -S option in the command that follows and omit the options -n, -p maximum_primaries, -p desired_primaries, and -p rg_mode.

# clresourcegroup create -p nodelist=nodelist \
-p desired_primaries=num-in-list \
-p maximum_primaries=num-in-list \
-p rg_affinities=++rac-fmwk-rg \
[-p rg_description="description"] \
-p rg_mode=Scalable \
scal-dg-rg

# clresourcetype register SUNW.ScalDeviceGroup

For each scalable device group that you are using for Oracle files, add an instance of the SUNW.ScalDeviceGroup resource type to the resource group that you created in Step 2.

Set a strong dependency for the instance of SUNW.ScalDeviceGroup on the resource in the RAC framework resource group that represents the volume manager for the device group. Limit the scope of this dependency to only the node where the SUNW.ScalDeviceGroup resource is running.
# clresource create -t SUNW.ScalDeviceGroup -g scal-dg-rg \ -p resource_dependencies=fm-vol-mgr-rs{local_node} \ -p diskgroupname=disk-group scal-dg-rs

Bring online and in a managed state the resource group that you created in Step 2.
# clresourcegroup online -emM scal-dg-rg

How to Create a Resource for a Scalable Device Group in a Zone Cluster

Perform this procedure from the global cluster.

Become superuser or assume a role that provides solaris.cluster.admin and solaris.cluster.modify RBAC authorizations.

Create a scalable resource group to contain the scalable device group resource.

Set a strong positive affinity by the resource group for the RAC framework resource group.

Tip –

# clresourcegroup create -Z zcname -p nodelist=nodelist \
-p desired_primaries=num-in-list \
-p maximum_primaries=num-in-list \
-p rg_affinities=++rac-fmwk-rg \
[-p rg_description="description"] \
-p rg_mode=Scalable \
scal-dg-rg

# clresourcetype register -Z zcname SUNW.ScalDeviceGroup

For each scalable device group that you are using for Oracle files, add an instance of the SUNW.ScalDeviceGroup resource type to the resource group that you created in Step 2.

Set a strong dependency for the instance of SUNW.ScalDeviceGroup on the resource in the RAC framework resource group that represents the volume manager for the device group. Limit the scope of this dependency to only the node where the SUNW.ScalDeviceGroup resource is running.
# clresource create -Z zcname -t SUNW.ScalDeviceGroup -g scal-dg-rg \ -p resource_dependencies=fm-vol-mgr-rs{local_node} \ -p diskgroupname=disk-group scal-dg-rs

Bring online and in a managed state the resource group that you created in Step 2.
# clresourcegroup online -Z zcname-emM scal-dg-rg

How to Register and Configure Resources for the Sun QFS Metadata Server in the Global Cluster

Perform this task only if you are using the Sun QFS shared file system.

Perform this procedure on only one node of the cluster.

Become superuser or assume a role that provides solaris.cluster.admin and solaris.cluster.modify RBAC authorizations.

Create a failover resource group to contain the resources for the Sun QFS metadata server.

If you are also using a volume manager, set a strong positive affinity by the resource group for the resource group that contains the volume manager's scalable device-group resource. This resource group is created in How to Create a Resource for a Scalable Device Group in the Global Cluster.
# clresourcegroup create -n nodelist \ [-p rg_affinities=++scal-dg-rg] \ [-p rg_description="description"] \ qfs-mds-rg

For each Sun QFS shared file system that you are using, add an instance of the SUNW.qfs resource type to the resource group that you created in Step 2.

Each instance of SUNW.qfs represents the metadata server of the file system.

If you are also using a volume manager, set a strong dependency by the instance of SUNW.qfs on the resource for the scalable device group that is to store the file system . This resource is created in How to Create a Resource for a Scalable Device Group in the Global Cluster.
# clresource create -t SUNW.qfs -g qfs-mds-rg \ -p qfsfilesystem=path \ [-p resource_dependencies=scal-dg-rs] \ qfs-mds-rs

Bring online and in a managed state the resource group that you created in Step 2.
# clresourcegroup online -emM qfs-mds-rg

How to Register and Configure Resources for the Sun QFS Metadata Server for a Zone Cluster

Perform the steps in this procedure to register and configure resources for the Sun QFS metadata server for a zone cluster.

Perform these steps in the global cluster.

Become superuser or assume a role that provides solaris.cluster.admin and solaris.cluster.modify RBAC authorizations.

Create a scalable resource group to contain the SUNW.wait_zc_boot resource in the global cluster.

# clresourcegroup create -n nodelist \
-p rg_mode=Scalable \
-p maximum_primaries=num-in-list \
-p desired_primaries=num-in-list \
[-p rg_mode=Scalable \
zc-wait-rg

# clresourcetype register SUNW.wait_zc_boot

Add an instance of the SUNW.wait_zc_boot resource type to the resource group that you created in Step 2.
# clresource create -g zc-wait-rg -t SUNW.wait_zc_boot \ -p ZCName=zcname zc-wait-rs

Bring online and in a managed state the resource group that you created in Step 2.
# clresourcegroup online -emM zc-wait-rg

Create a failover resource group to contain the resources for the Sun QFS metadata server.

Set a strong positive affinity by the resource group for the resource group that contains the SUNW.wait_zc_boot resource that is configured for the zone cluster.

If you also use a volume manager, set a strong positive affinity by the resource group for the resource group that contains the volume manager's scalable device-group resource. This resource group is created in How to Create a Resource for a Scalable Device Group in the Global Cluster.
# clresourcegroup create -n nodelist \ -p rg_affinities=++wait-zc-rg[,++scal-dg-rg] \ [-p rg_description="description"] \ qfs-mds-rg

Add an instance of the SUNW.qfs resource type to the resource group that you created in Step 6 for each Sun QFS shared file system that you are using.

Each instance of SUNW.qfs represents the metadata server of the file system.

Set a strong dependency by the instance of SUNW.qfs on the SUNW.wait_zc_boot resource that is configured for the zone cluster.

If you are also using a volume manager, set a strong dependency by the instance of SUNW.qfs on the resource for the scalable device group that is to store the file system. This resource is created in How to Create a Resource for a Scalable Device Group in the Global Cluster.
# clresource create -t SUNW.qfs -g qfs-mds-rg \ -p qfsfilesystem=path \-p resource_dependencies=zc-wait-rs[,scal-dg-rs] \ qfs-mds-rs

Bring online and in a managed state the resource group that you created in Step 6.
# clresourcegroup online -emM qfs-mds-rg

How to Create a Resource for a File-System Mount Point in the Global Cluster

Perform this procedure on only one node of the cluster.

Become superuser or assume a role that provides solaris.cluster.admin and solaris.cluster.modify RBAC authorizations.

Create a scalable resource group to contain the resource for a scalable file-system mount point.

If you are also using a volume manager, set a strong positive affinity by the resource group for the resource group that contains the volume manager's scalable device-group resource. This resource group is created in How to Create a Resource for a Scalable Device Group in the Global Cluster.

Tip –

# clresourcegroup create -n nodelist \
-p desired_primaries=num-in-list \
-p maximum_primaries=num-in-list \
[-p rg_affinities=++scal-dg-rg] \
[-p rg_description="description"] \
-p rg_mode=Scalable scal-mp-rg

# clresourcetype register SUNW.ScalMountPoint

For each shared file system that requires a scalable file-system mount point resource, add an instance of the SUNW.ScalMountPoint resource type to the resource group that you created in Step 2.

For each Sun QFS shared file system, type the following command:

Set a strong dependency by the instance of SUNW.ScalMountPoint on the resource for the Sun QFS metadata server for the file system. The resource for the Sun QFS metadata server set is created in How to Register and Configure Resources for the Sun QFS Metadata Server in the Global Cluster.

If you are also using a volume manager, set an offline-restart dependency by the instance of SUNW.ScalMountPoint on the resource for the scalable device group that is to store the file system. This resource is created in How to Create a Resource for a Scalable Device Group in the Global Cluster.

# clresource create -t SUNW.ScalMountPoint -g scal-mp-rg \
-p resource_dependencies=qfs-mds-rs \
[-p resource_dependencies_offline_restart=scal-dg-rs] \
-p mountpointdir=mp-path \
-p filesystemtype=s-qfs \
-p targetfilesystem=fs-name qfs-mp-rs

For each file system on a qualified NAS device, type the following command:

# clresource create -t SUNW.ScalMountPoint -g scal-mp-rg \
[-p resource_dependencies_offline_restart=scal-dg-rs] \
-p mountpointdir=mp-path \
-p filesystemtype=nas \
-p targetfilesystem=nas-device:fs-name nas-mp-rs

Bring online and in a managed state the resource group that you created in Step 2.
# clresourcegroup online -emM scal-mp-rg

How to Create a Resource for a File-System Mount Point in Zone Cluster

Perform the steps in this procedure to create a resource for a file-system mount point in a zone cluster. For RAC configurations with the Sun QFS shared file system on Solaris Volume Manager for Sun Cluster and the Sun QFS shared file system on hardware RAID, you create a scalable resource group to contain all the scalable mount point resources in a zone cluster.

Note –

The node list is the list of zone-cluster nodes.

Perform this procedure from the global cluster.

Become superuser or assume a role that provides solaris.cluster.admin and solaris.cluster.modify RBAC authorizations.

Create a scalable resource group to contain the resource for a scalable file-system mount point in zone cluster.

Tip –

# clresourcegroup create -Z zcname zcnodelist \
-p desired_primaries=num-in-list \
-p maximum_primaries=num-in-list \
[-p rg_affinities=++global:scal-dg-rg] \
[-p rg_description="description"] \
-p rg_mode=Scalable scal-mp-rg

# clresourcetype register -Z zcname SUNW.ScalMountPoint

For each Sun QFS shared file system that requires a scalable file-system mount point resource, add an instance of the SUNW.ScalMountPoint resource type to the resource group that you created in Step 2.

# clresource create -Z zcname -t SUNW.ScalMountPoint -d -g scal-mp-rg \
-p resource_dependencies=global:qfs-mds-rs \
[-y resource_dependencies_offline_restart=global:scal-dg-rs \]
-x mountpointdir=mp-path \
-x filesystemtype=s-qfs \
-x targetfilesystem=fs-name qfs-mp-rs

Set a strong dependency by the instance of SUNW.ScalMountPoint on the resource for the Sun QFS metadata server for the file system.

The resource for the Sun QFS metadata server set is created in How to Register and Configure Resources for the Sun QFS Metadata Server in the Global Cluster.

If you are also using a volume manager, set an offline-restart dependency by the instance of SUNW.ScalMountPoint on the resource for the scalable device group that is to store the file system.

This resource is created in How to Create a Resource for a Scalable Device Group in the Global Cluster.

Bring online and in a managed state the resource group that you created in Step 2.
# clresourcegroup online -Z zcname -emM scal-mp-rg