This section provides procedures to add a quorum device. Ensure that all nodes in the cluster are online before adding a new quorum device. For information about determining the number of quorum vote counts necessary for your cluster, recommended quorum configurations, and failure fencing, see Quorum and Quorum Devices in Oracle Solaris Cluster Concepts Guide .
Caution - Do not add a disk that is currently configured as a quorum device to a Solaris ZFS storage pool. When a configured quorum device is added to a Solaris ZFS storage pool, the disk is relabeled as an EFI disk and quorum configuration information is lost and the disk no longer provides a quorum vote to the cluster. Once a disk is in a storage pool, that disk can then be configured as a quorum device. You can also unconfigure the disk, add it to the storage pool, and then reconfigure the disk as a quorum device. |
The Oracle Solaris Cluster software supports the following types of quorum devices:
Shared LUNs from the following:
Shared SCSI disk
Serial Attached Technology Attachment (SATA) storage
Oracle ZFS Storage Appliance
Oracle Solaris Cluster Quorum Server
Procedures for adding these devices are provided in the following sections:
Disk-name is a replicated device. Replicated devices cannot be configured as quorum devices.
A shared-disk quorum device is any attached storage device that is supported by Oracle Solaris Cluster software. The shared disk is connected to two or more nodes of your cluster. If you turn fencing on, a dual-ported disk can be configured as a quorum device that uses SCSI-2 or SCSI-3 (the default is SCSI-2). If fencing is turned on and your shared device is connected to more than two nodes, you can configure your shared disk as a quorum device that uses the SCSI-3 protocol (the default protocol for more than two nodes). You can use the SCSI override flag to make the Oracle Solaris Clustersoftware use the SCSI-3 protocol for dual-ported shared disks.
If you turn fencing off for a shared disk, you can then configure the disk as a quorum device that uses the software quorum protocol. This would be true regardless of whether the disk supports SCSI-2 or SCSI-3 protocols. Software quorum is a protocol from Oracle that emulates a form of SCSI Persistent Group Reservations (PGR).
Caution - If you are using disks that do not support SCSI (such as SATA), you should turn SCSI fencing off. |
For quorum devices, you can use a disk that contains user data or is a member of a device group. View the protocol that is used by the quorum subsystem with a shared disk by looking at the access-mode value for the shared disk in the output from the cluster show command.
You can also create a quorum server device or a shared disk quorum device using the Oracle Solaris Cluster Manager GUI. For GUI log-in instructions, see How to Access Oracle Solaris Cluster Manager.
See the clsetup(1CL) and clquorum(1CL) man pages for information about the commands that are used in the following procedures.
Oracle Solaris Cluster software supports shared-disk (both SCSI and SATA) devices as quorum devices. A SATA device does not support a SCSI reservation, and you must disable the SCSI reservation fencing flag and use the software quorum protocol to configure these disks as quorum devices.
To complete this procedure, identify a disk drive by its device ID (DID), which is shared by the nodes. Use the cldevice show command to see the list of DID names. Refer to the cldevice(1CL) man page for additional information. Ensure that all nodes in the cluster are online before adding a new quorum device.
Use this procedure to configure SCSI or SATA devices.
The phys-schost# prompt reflects a global-cluster prompt. Perform this procedure on a global cluster.
This procedure provides the long forms of the Oracle Solaris Cluster commands. Most commands also have short forms. Except for the long and short forms of the command names, the commands are identical.
# clsetup
The clsetup Main Menu is displayed.
The Quorum Menu is displayed.
The clsetup utility asks what type of quorum device you want to add.
The clsetup utility asks which global device you want to use.
The clsetup utility asks you to confirm that the new quorum device should be added to the global device you specified.
If the new quorum device is added successfully, the clsetup utility displays a message to that effect.
# clquorum list -v
The following example shows the clquorum command generated by clsetup when it adds a shared-disk quorum device and a verification step.
Assume the root role that provides solaris.cluster.modify RBAC authorization on any cluster node. [Start the clsetup utility:] # clsetup [Select Quorum>Add a quorum device] [Answer the questions when prompted.] [You will need the following information.] [Information: Example:] [Directly attached shared disk shared_disk] [Global device d20] [Verify that the clquorum command was completed successfully:] clquorum add d20 Command completed successfully. [Quit the clsetup Quorum Menu and Main Menu.] [Verify that the quorum device is added:] # clquorum list -v Quorum Type ------- ---- d20 shared_disk scphyshost-1 node scphyshost-2 node
Ensure that all nodes in the cluster are online before adding a new quorum device.
The phys-schost# prompt reflects a global-cluster prompt. Perform this procedure on a global cluster.
This procedure provides the long forms of the Oracle Solaris Cluster commands. Most commands also have short forms. Except for the long and short forms of the command names, the commands are identical.
You can also use the Oracle Solaris Cluster Manager GUI to add an Oracle ZFS Storage Appliance NAS device. For log-in instructions, see How to Access Oracle Solaris Cluster Manager.
# iscsiadm modify discovery -s enable # iscsiadm list discovery Discovery: Static: enabled Send Targets: disabled iSNS: disabled # iscsiadm add static-config iqn.LUNName,IPAddress_of_NASDevice # devfsadm -i iscsi # cldevice refresh
# /usr/cluster/bin/cldevice populate
Use the cldevice show command to see the list of DID names. Refer to the cldevice (1CL) man page for additional information.
# clquorum add d20
The cluster has default rules for deciding whether to use scsi-2, scsi-3, or software quorum protocols. See the clquorum(1CL) man page for more information.
Before You Begin
Before you can add an Oracle Solaris Cluster quorum server as a quorum device, the Oracle Solaris Cluster quorum server software must be installed on the host machine and the quorum server must be started and running. For information about installing the quorum server, see the How to Install and Configure Oracle Solaris Cluster Quorum Server Software in Oracle Solaris Cluster Software Installation Guide .
The phys-schost# prompt reflects a global-cluster prompt. Perform this procedure on a global cluster.
This procedure provides the long forms of the Oracle Solaris Cluster commands. Most commands also have short forms. Except for the long and short forms of the command names, the commands are identical.
You can also create a quorum server device using the Oracle Solaris Cluster Manager GUI. For GUI log-in instructions, see How to Access Oracle Solaris Cluster Manager.
The switch supports Rapid Spanning Tree Protocol (RSTP).
Fast port mode is enabled on the switch.
One of these features is required to ensure immediate communication between cluster nodes and the quorum server. If this communication is significantly delayed by the switch, the cluster interprets this prevention of communication as loss of the quorum device.
If you use classful subnets, as defined in RFC 791, you do not need to perform these steps.
The following is an example entry which contains a public-network IP address and netmask:
10.11.30.0 255.255.255.0
nodename netmask + broadcast +
Add a hostname-to-address mapping to the file, such as the following.
ipaddress qshost1
The IP address of the computer where the quorum server is running.
The hostname of the computer where the quorum server is running.
# clsetup
The clsetup Main Menu is displayed.
The Quorum Menu is displayed.
Then type yes to confirm that you are adding a quorum device.
The clsetup utility asks what type of quorum device you want to add.
The clsetup utility asks you to provide the name of the new quorum device.
The quorum device name can be any name you choose. The name is only used to process future administrative commands.
The clsetup utility asks you to provide the name of the host of the quorum server.
This name specifies the IP address of the machine where the quorum server runs or the hostname of the machine on the network.
Depending on the IPv4 or IPv6 configuration of the host, the IP address of the machine must be specified in the /etc/hosts file, the /etc/inet/ipnodes file, or both.
The clsetup utility asks you to provide the port number of the quorum server.
The clsetup utility asks you to confirm that the new quorum device should be added.
If the new quorum device is added successfully, the clsetup utility displays a message to that effect.
# clquorum list –v
The following example shows the clquorum command that is generated by clsetup when it adds a quorum server quorum device. The example also shows a verification step.
Assume the root role that provides solaris.cluster.modify RBAC authorization on any cluster node. [Start the clsetup utility:] # clsetup [Select Quorum > Add a quorum device] [Answer the questions when prompted.] [You will need the following information.] [Information: Example:] [Quorum Device quorum_server quorum device] [Name: qd1] [Host Machine Name: 10.11.124.84] [Port Number: 9001] [Verify that the clquorum command was completed successfully:] clquorum add -t quorum_server -p qshost=10.11.124.84 -p port=9001 qd1 Command completed successfully. [Quit the clsetup Quorum Menu and Main Menu.] [Verify that the quorum device is added:] # clquorum list -v Quorum Type ------- ---- qd1 quorum_server scphyshost-1 node scphyshost-2 node # clquorum status === Cluster Quorum === -- Quorum Votes Summary -- Needed Present Possible ------ ------- -------- 3 5 5 -- Quorum Votes by Node -- Node Name Present Possible Status --------- ------- -------- ------ phys-schost-1 1 1 Online phys-schost-2 1 1 Online -- Quorum Votes by Device -- Device Name Present Possible Status ----------- ------- -------- ------ qd1 1 1 Online d3s2 1 1 Online d4s2 1 1 Online