Creating Oracle ACFS File Systems

This section provides procedures to create an Oracle Automatic Storage Management Cluster File System (Oracle ACFS) file system to support data services. This file system can be used as a general-purpose file system or as the database home for an Oracle database. An Oracle ACFS file system is supported for use in the global cluster and in zone clusters.

The following table lists the tasks to perform to create an Oracle ACFS file system. Complete the procedures in the order that is indicated.

Table 6-1 Task Map: Creating Oracle ACFS File Systems

Sample Configurations of an Oracle ACFS File System

The following diagrams illustrate the configuration of an Oracle ACFS file system in the global zone and in a zone cluster, using Solaris Volume Manager or hardware RAID.

Figure 6-1 Configuration of Oracle ACFS in the Global Zone With Solaris Volume Manager

Figure 6-2 Configuration of Oracle ACFS in the Global Zone With Hardware RAID

Figure 6-3 Configuration of Oracle ACFS in a Zone Cluster with Solaris Volume Manager

Figure 6-4 Configuration of Oracle ACFS in a Zone Cluster with Hardware RAID

How to Register and Configure the Framework Resource Groups

Use this procedure to configure a scalable Oracle RAC framework resource group and, if Solaris Volume Manager for Sun Cluster is used, a multiple-owner volume-manager framework resource group.

Perform all steps from one node of the global cluster.

1. Become superuser or assume a role that provides solaris.cluster.admin and solaris.cluster.modify RBAC authorizations.
2. Create a scalable Oracle RAC framework resource group.

   This framework resource group is used regardless of whether the file system is for general purpose or for a database home.

   1. Create the Oracle RAC framework resource group.

      # clresourcegroup create -n nodelist \
        -p maximum_primaries=num-in-list \
        -p desired_primaries=num-in-list \
        [-p rg_description="description"] \
        -p rg_mode=Scalable rac-fmwk-rg

      -n nodelist=nodelist

      Specifies a comma-separated list of cluster nodes on which the data service is to be enabled. The data service software packages must be installed on each node in this list.

      -p maximum_primaries=num-in-list

      Specifies the number of nodes on which the data service is to be enabled. This number must equal the number of nodes in nodelist.

      -p desired_primaries=num-in-list

      Specifies the number of nodes on which the data service is to be enabled. This number must equal the number of nodes in nodelist.

      -p rg_description="description"

      Specifies an optional brief description of the resource group. This description is displayed when you use Oracle Solaris Cluster maintenance commands to obtain information about the resource group.

      -p rg_mode=Scalable

      Specifies that the resource group is scalable.

      rac-fmwk-rg

      Specifies the name that you are assigning to the Oracle RAC framework resource group.

   2. Register the SUNW.rac_framework resource type.

      # clresourcetype register SUNW.rac_framework

   3. Add an instance of the SUNW.rac_framework resource type to the Oracle RAC framework resource group.

      # clresource create -g rac-fmwk-rg -t SUNW.rac_framework rac-fmwk-rs

      -g rac-fmwk-rg

      Specifies the Oracle RAC framework resource group to which you are adding the resource.

      rac-fmwk-rs

      Specifies the name that you are assigning to the SUNW.rac_framework resource.

   4. SPARC: Register the SUNW.rac_udlm resource type.

      # clresourcetype register SUNW.rac_udlm

   5. SPARC: Add an instance of the SUNW.rac_udlm resource type to the Oracle RAC framework resource group.

      Ensure that this instance depends on the SUNW.rac_framework resource.

      # clresource create -g resource-group \
       -t SUNW.rac_udlm \
       -p resource_dependencies=rac-fmwk-rs rac-udlm-rs

      -g rac-fmwk-rg

      Specifies the Oracle RAC framework resource group to which you are adding the resource.

      -p resource_dependencies=rac-fmwk-rs

      Specifies that this instance depends on the SUNW.rac_framework resource.

      rac-udlm-rs

      Specifies the name that you are assigning to the SUNW.rac_udlm resource.

   6. Register the Oracle Clusterware framework resource type

      # clresourcetype register SUNW.crs_framework

   7. Add an instance of the SUNW.crs_framework resource type to the Oracle RAC framework resource group.

      # clresource create -g rac-fmwk-rg \
      -p resource_dependencies=rac-fmwk-rs \
      -t SUNW.crs_framework \
      crs-fmwk-rs

      crs-fmwk-rs

      Specifies the name that you are assigning to the SUNW.crs_framework resource.

3. If you are using Solaris Volume Manager for Sun Cluster, create a scalable multiple-owner volume-manager framework resource group.

   This resource group manages Solaris Volume Manager for Sun Cluster.

   If you are using hardware RAID, skip to Step 4.

   1. Create the resource group

      # clresourcegroup create -n nodelist -S vucmm-fmwk-rg

      -n nodelist=nodelist

      Specifies the same node list that you configured for the scalable Oracle RAC framework resource group.

      vucmm-fmwk-rg

      Specifies the name that you are assigning to the multiple-owner volume-manager framework resource group.

   2. Register the SUNW.vucmm_framework resource type.

      # clresourcetype register SUNW.vucmm_framework

   3. Add an instance of the SUNW.vucmm_framework resource type to the multiple-owner volume-manager resource group.

      # clresource create -g vucmm-fmwk-rg -t SUNW.vucmm_framework vucmm-fmwk-rs

      -g vucmm-fmwk-rg

      Specifies the multiple-owner volume-manager resource group to which you are adding the resource.

      vucmm-fmwk-rs

      Specifies the name that you are assigning to the SUNW.vucmm_framework resource.

   4. Register the SUNW.vucmm_svm resource type.

      # clresourcetype register SUNW.vucmm_svm

   5. Add an instance of the SUNW.vucmm_svm resource type to the SUNW.vucmm_framework resource group.

      Ensure that this instance depends on the SUNW.vucmm_framework resource that you created.

      # clresource create -g vucmm-fmwk-rg \
        -t svm-rt \
        -p resource_dependencies=vucmm-fmwk-rs svm-rs

      -g vucmm-fmwk-rg

      Specifies the multiple-owner volume-manager resource group.

      -p resource_dependencies=vucmm-fmwk-rs

      Specifies that this instance depends on the SUNW.vucmm_framework resource.

      svm-rs

      Specifies the name that you are assigning to the SUNW.vucmm_svm resource.

4. Bring online and in a managed state the Oracle RAC framework resource group, the multiple-owner volume-manager framework resource group if used, and their resources.

   # clresourcegroup online -emM rac-fmwk-rg [vucmm-fmwk-rg]

   rac-fmwk-rg

   Specifies that the Oracle RAC framework resource group is to be moved to the MANAGED state and brought online.

   vucmm-fmwk-rg

   Specifies that the multiple-owner volume-manager framework resource group is to be moved to the MANAGED state and brought online.

Next Steps

Go to How to Create an Oracle ACFS File System.

How to Create an Oracle ACFS File System

Use this procedure to create an Oracle ACFS file system. Perform all steps from the one node of the global cluster.

Before You Begin

• Ensure that the resource framework groups are configured. See How to Register and Configure the Framework Resource Groups.

• Observe the following guidelines and restrictions for configuring an Oracle ACFS file system in an Oracle Solaris Cluster configuration.

  • Ensure that a minimum of Oracle ASM version 11g version 2 is installed.

  • An Oracle ACFS file system is supported in a global cluster and a zone cluster, but not in individual non-global zones.

  • An Oracle ACFS file system must be managed by an Oracle Clusterware resource.

1. Create an Oracle ACFS file system.

   Follow procedures in Creating an Oracle ACFS File System in Oracle Automatic Storage Management Administrator's Guide.

   Observe the following special instructions:

   • Do not register the Oracle ACFS file-system mount point with the Oracle ACFS registry, if you will use the file system as a general purpose file system. Only register the mount point with the Oracle ACFS registry if the file system will be used as the database home.

   • Configure the Oracle ACFS file system only in the global zone. To use the file system in a zone cluster, you direct mount the file system in the zone cluster.

   • Configure the Oracle ACFS resource on the same nodes on which you configure the clustered Oracle ASM disk-group proxy resource for the Oracle ASM disk group that contains the Oracle ACFS volume.

2. Create a mount point for the Oracle ACFS file system.

   ---

   Note - For a zone cluster, create the mount point under the zone root path:

   # mkdir -p /zonepath/root/path-to-filesystem

   ---

3. For a zone cluster, ensure that the zone cluster is online.

   # clzonecluster status zonecluster

4. Start and mount the Oracle ACFS file system.

   # /Grid_home/bin/srvctl add filesystem -d /dev/asm/volume-dev-path
   # /Grid_home/bin/srvctl start filesystem -d /dev/asm/volume-dev-path

5. For a zone cluster, add the file system to the zone cluster.

   Perform these steps from the global zone of one node.

   1. Add the Oracle ACFS file system to the zone cluster.

      # clzonecluster configure zonecluster
      clzc:zonecluster> add fs
      clzc:zonecluster:fs> set dir=mountpoint
      clzc:zonecluster:fs> set special=/dev/asm/volume-dev-path
      clzc:zonecluster:fs> set type=acfs
      clzc:zonecluster:fs> end
      clzc:zonecluster> exit

   2. Verify that the Oracle ACFS file system is added to the zone cluster.

      # clzonecluster show zonecluster
      …
         Resource Name:                fs
         dir:                          mountpoint
         special                       volume
         raw:
         type:                         acfs
         options:                      []
         cluster-control:              true
      …

Next Steps

If you are using Solaris Volume Manager for Sun Cluster, go to How to Register and Configure the Scalable Device-Group Resource Group.

Otherwise, go to How to Register and Configure the Oracle ASM Resource Group

How to Register and Configure the Scalable Device-Group Resource Group

If you use Solaris Volume Manager for Sun Cluster, register and configure a scalable device-group resource group. Perform all steps from one node of the global cluster.

If your configuration does not use Solaris Volume Manager for Sun Cluster, do not perform this procedure. Proceed to How to Register and Configure the Oracle ASM Resource Group.

Before You Begin

Ensure that the Oracle ACFS file system is created. See How to Create an Oracle ACFS File System.

1. Become superuser or assume a role that provides solaris.cluster.admin and solaris.cluster.modify RBAC authorizations.
2. Create a scalable resource group to contain the scalable device-group resource.

   Set a strong positive affinity by the resource group for the multiple-owner volume-manager framework resource group.

   # clresourcegroup create -p nodelist=nodelist \
   -p desired_primaries=num-in-list \
   -p maximum_primaries=num-in-list \
   -p rg_affinities=++vucmm-fmwk-rg \
   [-p rg_description="description"] \
   -p rg_mode=Scalable \
   scal-dg-rg

3. Register the SUNW.ScalDeviceGroup resource type.

   # clresourcetype register SUNW.ScalDeviceGroup

4. Add an instance of the SUNW.ScalDeviceGroup resource type to the SUNW.ScalDeviceGroup resource group.

   Set a strong dependency for the instance of SUNW.ScalDeviceGroup on the svm-rs resource in the SUNW.vucmm_svm framework resource group. Limit the scope of this dependency to only the node where the SUNW.ScalDeviceGroup resource is running.

   # clresource create -t SUNW.ScalDeviceGroup -g scal-dg-rg \
   -p resource_dependencies=svm-rs{local_node} \
   -p diskgroupname=disk-group scal-dg-rs

5. Bring online and in a managed state the scalable device-group resource group.

   # clresourcegroup online -emM scal-dg-rg

6. Set a strong positive affinity on vucmm-fmwk-rg by scal-dg-rg.

   # clresourcegroup set -p rg_affinities=++scal-dg-rg vucmm-fmwk-rg

7. Set an offline-restart dependency on crs-fmwk-rs by scal-dg-rs.

   E clresource set -p resource_dependency_offline_restart=scal-dg-rs crs-fmwk-rs

Next Steps

Go to How to Register and Configure the Oracle ASM Resource Group.

How to Register and Configure the Oracle ASM Resource Group

Use this procedure to register and configure the Oracle Automatic Storage Management (Oracle ASM) resource group. Perform all steps from one node of the global cluster.

Before You Begin

• Ensure that the framework resource groups are created. See How to Register and Configure the Framework Resource Groups.

• If you use Solaris Volume Manager for Sun Cluster, ensure that the scalable device–group resource group is created. See How to Register and Configure the Scalable Device-Group Resource Group.

1. Become superuser or assume a role that provides solaris.cluster.admin and solaris.cluster.modify RBAC authorizations.
2. Register the Oracle ASM resource types for the data service.
   1. Register the scalable Oracle ASM instance proxy resource type.

      # clresourcetype register SUNW.scalable_asm_instance_proxy

   2. Register the Oracle ASM disk-group resource type.

      # clresourcetype register SUNW.scalable_asm_diskgroup_proxy

3. Create resource groups asm-inst-rg and asm-dg-rg.

   # clresourcegroup create -S asm-inst-rg asm-dg-rg

   asm-inst-rg

   Specifies the name of the Oracle ASM instance resource group.

   asm-dg-rg

   Specifies the name of the Oracle ASM disk-group resource group.

4. Set a strong positive affinity on rac-fmwk-rg by asm-inst-rg.

   # clresourcegroup set -p rg_affinities=++rac-fmwk-rg asm-inst-rg

5. Set a strong positive affinity by asm-dg-rg.
   • If you are using hardware RAID, set the affinity on asm-inst-rg

     # clresourcegroup set -p rg_affinities=++asm-inst-rg asm-dg-rg

   • If you are using Solaris Volume Manager for Sun Cluster, set the affinity on scal-dg-rg and asm-inst-rg.

     # clresourcegroup set -p rg_affinities=++asm-inst-rg,++scal-dg-rg asm-dg-rg

6. Create a SUNW.scalable_asm_instance_proxy resource and set the resource dependencies.

   # clresource create -g asm-inst-rg \
   -t SUNW.scalable_asm_instance_proxy \
   -p ORACLE_HOME=Grid_home \
   -p CRS_HOME=Grid_home \
   -p "ORACLE_SID{node1}"=+ASM1 \
   -p "ORACLE_SID{node2}"=+ASM2 \
   -p resource_dependencies_offline_restart=crs-fmwk-rs \
   -d asm-inst-rs

   -t SUNW.scalable_asm_instance_proxy

   Specifies the type of the resource to add.

   -p ORACLE_HOME=Grid_home

   Sets the path to the Oracle Grid Infrastructure home directory, where Oracle ASM is installed.

   -p CRS_HOME=Grid_home

   Sets the path to the Oracle Grid Infrastructure home directory, where Oracle Clusterware is installed.

   -p ORACLE_SID=+ASMn

   Sets the Oracle ASM system identifier.

   -d asm-inst-rs

   Specifies the name of the Oracle ASM instance resource that you create.

7. Bring online the asm-inst-rg resource group in a managed state on a cluster node.

   # clresourcegroup online -eM asm-inst-rg

8. Add an Oracle ASM disk-group resource to the asm-dg-rg resource group.
   • For hardware RAID, use the following command:

     # clresource create -g asm-dg-rg \
     -t SUNW.scalable_asm_diskgroup_proxy \
     -p asm_diskgroups=dg[,dg…] \
     -p resource_dependencies_offline_restart=asm-inst-rs \
     -d asm-dg-rs

   • For Solaris Volume Manager for Sun Cluster, use the following command:

     # clresource create -g asm-dg-rg \
     -t SUNW.scalable_asm_diskgroup_proxy \
     -p asm_diskgroups=dg[,dg…] \
     -p resource_dependencies_offline_restart=asm-inst-rs,scal-dg-rs \
     -d asm-dg-rs

9. Bring online the asm-dg-rg resource group in a managed state on a cluster node.

   # clresourcegroup online -eM asm-dg-rg

10. For a zone cluster, from the global zone of one node, create a SUNW.wait_zc_boot resource group.

    If the Oracle ACFS file system will not be used by a zone cluster, omit this step.

    # clresourcetype register SUNW.wait_zc_boot
    # clresourcegroup create -S scal-wait-zc-rg
    # clresource create -g scal-wait-zc-rg \
    -t SUNW.wait_zc—boot \
    -p zcname=zonecluster \
    wait-zc-rs
    # clresourcegroup online -eM scal-wait-zc-rg

Next Steps

Go to How to Create an Oracle Grid Infrastructure Resource for Interoperation With Oracle Solaris Cluster.

How to Register and Configure the Oracle ACFS Proxy Resource Group

Use this procedure to register and configure the Oracle ACFS proxy resource group. Perform all steps from one node of the global cluster.

Before You Begin

Ensure that you have registered and configured the Oracle Grid Infrastructure resource. See How to Create an Oracle Grid Infrastructure Resource for Interoperation With Oracle Solaris Cluster.

1. Become superuser or assume a role that provides solaris.cluster.admin and solaris.cluster.modify RBAC authorizations.
2. Register the SUNW.scalable_acfs_proxy resource type.
   • If the file system is for use in the global cluster, use the following command:

     # clresourcetype register SUNW.scalable_acfs_proxy

   • If the file system is for use by a zone cluster, use the following command:

     # clresourcetype register -Z zonecluster SUNW.scalable_acfs_proxy

3. Create the Oracle ACFS resource group with offline-restart resource dependencies.
   • If the file system is for use in the global cluster, use the following command:

     # clresourcegroup create -S -p rg_affinities=++asm-dg-rg acfs-rg

     asm-dg-rg

     Specifies the name of the Oracle ASM disk-group resource group.

     acfs-rg

     Specifies the name of the Oracle ACFS resource group.

   • If the file system is for use by a zone cluster, use the following command:

     # clresourcegroup create -S -p rg_affinities=++asm-dg-rg[,++scal-wait-zc-rg] acfs-rg

     scal-wait-zc-rg

     For a zone cluster, specifies the SUNW.wait_zc_boot resource group.

4. Add an instance of the SUNW.scalable_acfs_proxy resource type to the Oracle ACFS resource group.
   • If the file system is for use in the global cluster, use the following command:

     # clresource create -g acfs-rg \
     -t SUNW.scalable_acfs_proxy \
     -p acfs_mountpoint=/acfs-mountpoint \
     -p resource_dependencies_offline_restart=asm-dg-rs \
     -d acfs-rs

   • If the file system is for use by a zone cluster, use the following command:

     # clresource create -Z zonecluster -g acfs-rg \
     -t SUNW.scalable_acfs_proxy \
     -p acfs_mountpoint=/acfs-mountpoint \
     -p resource_dependencies_offline_restart=asm-dg-rs \
     -d acfs-rs

5. Bring online the acfs-rg resource group in a managed state on a cluster node.

   # clresourcegroup online -eM acfs-rg

6. Verify the Oracle ACFS configuration.

   # clresource status +

Next Steps

Determine from the following list the next task to perform that applies to your cluster configuration. If you need to perform more than one task from this list, go to the first of those tasks in this list.

• To create a zone cluster, go to Configuring a Zone Cluster.

• To create non-global zones on a node, go to Configuring a Non-Global Zone on a Global-Cluster Node.

• SPARC: To configure Sun Management Center to monitor the cluster, go to SPARC: Installing the Oracle Solaris Cluster Module for Sun Management Center.

• Install third-party applications, register resource types, set up resource groups, and configure data services. See the documentation that is supplied with the application software and the Oracle Solaris Cluster Data Services Planning and Administration Guide.

How to Create an Oracle Grid Infrastructure Resource for Interoperation With Oracle Solaris Cluster

Use this procedure to create an Oracle Grid Infrastructure resource. This resource coordinates operations that are managed by Oracle Clusterware with operations that are managed by Oracle Solaris Cluster. Perform all steps from one node of the global cluster.

Before You Begin

Ensure that you have registered and configured the Oracle ASM resource groups. See How to Register and Configure the Oracle ASM Resource Group.

1. Become superuser or assume a role that provides solaris.cluster.admin and solaris.cluster.modify RBAC authorizations.
2. If the file system will be used by a zone cluster, from the global zone of one node, create an Oracle Clusterware proxy resource.
   1. Create the resource.

      # /Grid_home/bin/crsctl add type sun.zcboot_proxy.type -basetype local_resource
      # /Grid_home/bin/crsctl add res sun.wait-zc-rs \
      -type sun.zcboot_proxy.type \
      -attr "ACTION_SCRIPT='/opt/SUNWscor/dsconfig/bin/scproxy_crs_action' \
      ACL='owner:root:rwx,pgrp:oinstall:rwx,other::r--' \
      SCRIPT_TIMEOUT='20' \
      RESTART_ATTEMPTS='60' "

   2. Verify the resource.

      # /Grid_home/bin/crsctl stat res sun.wait-zc-rs -p
      NAME=sun.wait-zc-rs
      TYPE=sun.zcboot_proxy.type
      ACL=owner:root:rwx,pgrp:oinstall:rwx,other::r-
      …

   3. Bring the resource online.

      # /Grid_home/bin/crsctl start res sun.wait-zc-rs

3. If using Solaris Volume Manager for Sun Cluster, create the Oracle Grid Infrastructure sun.storage_proxy.type resource type.

   # /Grid_home/bin/crsctl \
   add type sun.storage_proxy.type \
   -basetype cluster_resource \
   -attr \
   "ATTRIBUTE=ACTION_SCRIPT,TYPE=string", \
   "ATTRIBUTE=HOSTING_MEMBERS,TYPE=string", \
   "ATTRIBUTE=CARDINALITY,TYPE=string", \
   "ATTRIBUTE=PLACEMENT,TYPE=string", \
   "ATTRIBUTE=SCRIPT_TIMEOUT,TYPE=int", \
   "ATTRIBUTE=RESTART_ATTEMPTS,TYPE=int", \
   "ATTRIBUTE=ACL,TYPE=string", \
   "ATTRIBUTE=VERSION,TYPE=string"

4. If using Solaris Volume Manager for Sun Cluster, create the Oracle Solaris Cluster sun.resource resource of type sun.storage_proxy.type.

   The Oracle Grid Infrastructure resource name uses the form sun.resource, where resource is the name of the SUNW.ScalDeviceGroup or SUNW.ScalMountPoint resource.

   # /Grid_home/bin/crsctl add resource sun.resource \
   -type sun.storage_proxy.type \
   -attr "ACTION_SCRIPT='/opt/SUNWscor/dsconfig/bin/scproxy_crs_action' \
   CARDINALITY='number-nodes' \
   SCRIPT_TIMEOUT='timeout' \
   PLACEMENT='restricted' \
   RESTART_ATTEMPTS='restarts' \
   HOSTING_MEMBERS='nodelist' \
   VERSION='1' "

   CARDINALITY

   The number of nodes in the cluster membership

   HOSTING_MEMBERS

   The list of nodes in the cluster membership

5. Bring online the Oracle Grid Infrastructure storage_proxy resource.

   # /Grid_home/bin/crsctl start resource sun.resource

6. Create the Oracle Grid Infrastructure stop trigger resource.
   1. Create the stop trigger resource.

      # /Grid_home/bin/crsctl add type sun.stoptrigger.type -basetype cluster_resource
      # /Grid_home/bin/crsctl add res sun.resource -type sun.stoptrigger.type \
      -attr "action_script='/opt/SUNWscor/dsconfig/bin/crs_stoptrigger_action' \
      HOSTING_MEMBERS='node1 node2 […]' \
      CARDINALITY='number-nodes' \
      placement='restricted' \
      ACL='owner:root:rwx,pgrp:oinstall:rwx,other::r--' \
      SCRIPT_TIMEOUT='20' \
      RESTART_ATTEMPTS='60' \
      START_DEPENDENCIES='hard(ora.appdg.ASMvolume.acfs) pullup:always(ora.appdg.ASMvolume.acfs)' \
      STOP_DEPENDENCIES='hard(ora.appdg.ASMvolume.acfs)' "

   2. Verify the stop trigger resource.

      # /Grid_home/bin/crsctl stat res sun.resource -p
      NAME=sun.resource
      TYPE=sun.stoptrigger.type
      …

   3. Start the stop trigger resource.

      # /Grid_home/bin/crsctl start res sun.resource

   4. Verify that the resource is online on all nodes.

      # /Grid_home/bin/crsctl stat res sun.resource

Next Steps

Go to How to Register and Configure the Oracle ACFS Proxy Resource Group.