1. Planning the Oracle Solaris Cluster Configuration
2. Installing Software on Global-Cluster Nodes
3. Establishing the Global Cluster
4. Configuring Solaris Volume Manager Software
5. Installing and Configuring Veritas Volume Manager
Installing and Configuring VxVM Software
Setting Up a Root Disk Group Overview
How to Install Veritas Volume Manager Software
SPARC: How to Encapsulate the Root Disk
How to Create a Root Disk Group on a Nonroot Disk
How to Mirror the Encapsulated Root Disk
How to Unencapsulate the Root Disk
6. Creating a Cluster File System
7. Creating Non-Global Zones and Zone Clusters
8. Installing the Oracle Solaris Cluster Module to Sun Management Center
9. Uninstalling Software From the Cluster
A. Oracle Solaris Cluster Installation and Configuration Worksheets
This section describes how to create VxVM disk groups in a cluster. The following table describes the types of VxVM disk groups you can configure in an Oracle Solaris Cluster configuration and their characteristics.
|
The following table lists the tasks to perform to create VxVM disk groups in an Oracle Solaris Cluster configuration. complete the procedures in the order that is indicated.
Table 5-2 Task Map: Creating VxVM Disk Groups
|
Use this procedure to create your VxVM disk groups and volumes.
Perform this procedure from a node that is physically connected to the disks that make the disk group that you add.
Before You Begin
Perform the following tasks:
Make mappings of your storage disk drives. See the appropriate manual in the Oracle Solaris Cluster Hardware Administration Collection to perform an initial installation of your storage device.
Complete the following configuration planning worksheets.
See Planning Volume Management for planning guidelines.
If you did not create root disk groups, ensure that you have rebooted each node on which you installed VxVM, as instructed in Step 12 of How to Install Veritas Volume Manager Software.
Observe the following special instructions:
SPARC: If you are installing Oracle Real Application Clusters, create shared VxVM disk groups by using the cluster feature of VxVM. Observe guidelines and instructions in How to Create a VxVM Shared-Disk Group for the Oracle RAC Database in Oracle Solaris Cluster Data Service for Oracle Real Application Clusters Guide and in the Veritas Volume Manager Administrator's Reference Guide.
Otherwise, create VxVM disk groups by using the standard procedures that are documented in the VxVM documentation.
Note - A disk group that is configured to be local only is not highly available or globally accessible.
phys-schost# clsetup
Only one node at any time is permitted to master the disk group. You can later change which node is the configured master.
Next Steps
Determine your next step:
SPARC: If the VxVM cluster feature is enabled, go to How to Verify the Disk Group Configuration.
If you created disk groups that are not local and the VxVM cluster feature is not enabled, register the disk groups as Oracle Solaris Cluster device groups. Go to How to Register a Disk Group.
If you created only local disk groups, go to How to Verify the Disk Group Configuration.
If the VxVM cluster feature is not enabled, perform this procedure to register disk groups that are not local as Oracle Solaris Cluster device groups.
Note - SPARC: If the VxVM cluster feature is enabled or you created a local disk group, do not perform this procedure. Instead, proceed to How to Verify the Disk Group Configuration.
phys-schost# clsetup
phys-schost# vxdg deport diskgroup # vxdg import dg
phys-schost# vxvol -g diskgroup startall
If the value of the flags property of the disk group is nogdl, the disk group is correctly configured for local-only access.
phys-schost# vxdg list diskgroup | grep flags flags: nogdl
Look for the disk device information for the new disk that is displayed by the following command.
phys-schost# cldevicegroup status
Next Steps
Go to How to Verify the Disk Group Configuration.
Troubleshooting
Stack overflow – If a stack overflows when the device group is brought online, the default value of the thread stack size might be insufficient. On each node, add the entry set cl_haci:rm_thread_stacksize=0xsize to the /etc/system file, where size is a number greater than 8000, which is the default setting.
Configuration changes – If you change any configuration information for a VxVM device group or its volumes, you must register the configuration changes by using the clsetup utility. Configuration changes that you must register include adding or removing volumes and changing the group, owner, or permissions of existing volumes. See Administering Device Groups in Oracle Solaris Cluster System Administration Guide for procedures to register configuration changes that are made to a VxVM device group.
If device group registration fails because of a minor-number conflict with another disk group, you must assign the new disk group a new, unused minor number. Perform this procedure to reminor a disk group.
phys-schost# ls -l /global/.devices/node@1/dev/vx/dsk/*
phys-schost# vxdg reminor diskgroup base-minor-number
Example 5-2 How to Assign a New Minor Number to a Device Group
This example uses the minor numbers 16000-16002 and 4000-4001. The vxdg reminor command reminors the new device group to use the base minor number 5000.
phys-schost# ls -l /global/.devices/node@1/dev/vx/dsk/* /global/.devices/node@1/dev/vx/dsk/dg1 brw------- 1 root root 56,16000 Oct 7 11:32 dg1v1 brw------- 1 root root 56,16001 Oct 7 11:32 dg1v2 brw------- 1 root root 56,16002 Oct 7 11:32 dg1v3 /global/.devices/node@1/dev/vx/dsk/dg2 brw------- 1 root root 56,4000 Oct 7 11:32 dg2v1 brw------- 1 root root 56,4001 Oct 7 11:32 dg2v2 phys-schost# vxdg reminor dg3 5000
Next Steps
Register the disk group as an Oracle Solaris Cluster device group. Go to How to Register a Disk Group.
Perform this procedure on each node of the cluster.
phys-schost# vxdisk list
phys-schost# cldevicegroup list -v
Ensure that the following requirements are met:
The root disk group includes only local disks.
All disk groups and any local disk groups are imported on the current primary node only.
phys-schost# vxprint
phys-schost# cldevicegroup status
Output should not display any local disk groups.
phys-schost# prtvtoc /dev/rdsk/cNtXdYsZ > filename
Store the file in a location outside the cluster. If you make any disk configuration changes, run this command again to capture the changed configuration. If a disk fails and needs replacement, you can use this information to restore the disk partition configuration. For more information, see the prtvtoc(1M) man page.
An archived backup of your cluster configuration facilitates easier recovery of the your cluster configuration. For more information, see How to Back Up the Cluster Configuration in Oracle Solaris Cluster System Administration Guide.
Observe the following guidelines for administering VxVM disk groups in an Oracle Solaris Cluster configuration:
VxVM device groups – VxVM disk groups that have been registered as device groups are managed by Oracle Solaris Cluster software. After a disk group is registered as a device group, you should never import or deport that VxVM disk group by using VxVM commands. The Oracle Solaris Cluster software can handle all cases where device groups need to be imported or deported. See Administering Device Groups in Oracle Solaris Cluster System Administration Guide for procedures about how to manage device groups.
Local disk groups – Local VxVM disk groups are not managed by Oracle Solaris Cluster software. Use VxVM commands to administer local disk groups as you would in a nonclustered system.
Troubleshooting
If the output of the cldevicegroup status command includes any local disk groups, the displayed disk groups are not configured correctly for local-only access. Return to How to Create a Disk Group to reconfigure the local disk group.
Next Steps
Determine from the following list the next task to perform that applies to your cluster configuration. If you need to perform more than one task from this list, go to the first of those tasks in this list.
To create cluster file systems, go to How to Create Cluster File Systems.
To create non-global zones on a node, go to How to Create a Non-Global Zone on a Global-Cluster Node.
SPARC: To configure Sun Management Center to monitor the cluster, go to SPARC: Installing the Oracle Solaris Cluster Module for Sun Management Center.
Install third-party applications, register resource types, set up resource groups, and configure data services. See the documentation that is supplied with the application software and the Oracle Solaris Cluster Data Services Planning and Administration Guide.