JavaScript is required to for searching.
Skip Navigation Links
Exit Print View
Oracle Solaris Cluster System Administration Guide     Oracle Solaris Cluster 4.1
search filter icon
search icon

Document Information

Preface

1.  Introduction to Administering Oracle Solaris Cluster

2.  Oracle Solaris Cluster and RBAC

3.  Shutting Down and Booting a Cluster

4.  Data Replication Approaches

5.  Administering Global Devices, Disk-Path Monitoring, and Cluster File Systems

6.  Administering Quorum

Administering Quorum Devices

Dynamic Reconfiguration With Quorum Devices

Adding a Quorum Device

How to Add a Shared Disk Quorum Device

How to Add a Sun ZFS Storage Appliance NAS Quorum Device

How to Add a Quorum Server Quorum Device

Removing or Replacing a Quorum Device

How to Remove a Quorum Device

How to Remove the Last Quorum Device From a Cluster

How to Replace a Quorum Device

Maintaining Quorum Devices

How to Modify a Quorum Device Node List

How to Put a Quorum Device Into Maintenance State

How to Bring a Quorum Device Out of Maintenance State

How to List the Quorum Configuration

How to Repair a Quorum Device

Changing the Quorum's Default Time-out

Administering Oracle Solaris Cluster Quorum Servers

Starting and Stopping the Quorum Server Software

How to Start a Quorum Server

How to Stop a Quorum Server

Displaying Information About the Quorum Server

How to Display Information About the Quorum Server

Cleaning Up Stale Quorum Server Cluster Information

How to Clean Up the Quorum Server Configuration Information

7.  Administering Cluster Interconnects and Public Networks

8.  Adding and Removing a Node

9.  Administering the Cluster

10.  Configuring Control of CPU Usage

11.  Updating Your Software

12.  Backing Up and Restoring a Cluster

A.  Example

Index

Administering Quorum Devices

A quorum device is a shared storage device or quorum server that is shared by two or more nodes and that contributes votes that are used to establish a quorum. This section provides the procedures for administering quorum devices.

You can use the clquorum command to perform all quorum device administrative procedures. In addition, you can accomplish some procedures by using the clsetup interactive utility. Whenever possible, quorum procedures are described in this section by using the clsetup utility. For more information, see the clquorum(1CL) and clsetup(1CL) man pages.

When you work with quorum devices, keep in mind the following guidelines:


Note - The clsetup command is an interactive interface to the other Oracle Solaris Cluster commands. When clsetup runs, the command generates the appropriate specific commands, in this case clquorum commands. These generated commands are shown in the examples at the end of the procedures.


To view the quorum configuration, use clquorum show. The clquorum list command displays the names of quorum devices in the cluster. The clquorum status command provides status and vote count information.

Most examples shown in this section are from a three-node cluster.

Table 6-1 Task List: Administering Quorum

Task
For Instructions
Add a quorum device to a cluster by using the clsetup utility
Remove a quorum device from a cluster by using the clsetup utility (to generate clquorum)
Remove the last quorum device from a cluster by using the clsetup utility (to generate clquorum)
Replace a quorum device in a cluster by using the add and remove procedures
Modify a quorum device list by using the add and remove procedures
Put a quorum device into maintenance state by using the clsetup utility (to generate clquorum)

(While in maintenance state, the quorum device does not participate in voting to establish the quorum.)

Reset the quorum configuration to its default state by using the clsetup utility (to generate clquorum)
List the quorum devices and vote counts by using the clquorum command

Dynamic Reconfiguration With Quorum Devices

You must consider a few issues when completing dynamic reconfiguration (DR) operations on quorum devices in a cluster.

To remove a quorum device, you must complete the following steps, in the order indicated.

Table 6-2 Task Map: Dynamic Reconfiguration With Quorum Devices

Task
For Instructions
1. Enable a new quorum device to replace the one being removed.
2. Disable the quorum device to be removed.
3. Perform the DR remove operation on the device being removed.

Adding a Quorum Device

This section provides procedures to add a quorum device. Ensure that all nodes in the cluster are online before adding a new quorum device. For information about determining the number of quorum vote counts necessary for your cluster, recommended quorum configurations, and failure fencing, see Quorum and Quorum Devices in Oracle Solaris Cluster Concepts Guide.


Caution

Caution - Do not add a disk that is currently configured as a quorum device to a Solaris ZFS storage pool. When a configured quorum device is added to a Solaris ZFS storage pool, the disk is relabeled as an EFI disk and quorum configuration information is lost and the disk no longer provides a quorum vote to the cluster. Once a disk is in a storage pool, that disk can then be configured as a quorum device. You can also unconfigure the disk, add it to the storage pool, and then reconfigure the disk as a quorum device.


The Oracle Solaris Cluster software supports the following types of quorum devices:

Procedures for adding these devices are provided in the following sections:


Note - You cannot configure replicated disks as quorum devices. If you try to add a replicated disk as a quorum device, you receive the following error message and the command exits with an error code.

Disk-name is a replicated device. Replicated devices cannot be configured as
 quorum devices.

A shared-disk quorum device is any attached storage device that is supported by Oracle Solaris Cluster software. The shared disk is connected to two or more nodes of your cluster. If you turn fencing on, a dual-ported disk can be configured as a quorum device that uses SCSI-2 or SCSI-3 (the default is SCSI-2). If fencing is turned on and your shared device is connected to more than two nodes, you can configure your shared disk as a quorum device that uses the SCSI-3 protocol (the default protocol for more than two nodes). You can use the SCSI override flag to make the Oracle Solaris Clustersoftware use the SCSI-3 protocol for dual-ported shared disks.

If you turn fencing off for a shared disk, you can then configure the disk as a quorum device that uses the software quorum protocol. This would be true regardless of whether the disk supports SCSI-2 or SCSI-3 protocols. Software quorum is a protocol from Oracle that emulates a form of SCSI Persistent Group Reservations (PGR).


Caution

Caution - If you are using disks that do not support SCSI (such as SATA), you should turn SCSI fencing off.


For quorum devices, you can use a disk that contains user data or is a member of a device group. View the protocol that is used by the quorum subsystem with a shared disk by looking at the access-mode value for the shared disk in the output from the cluster show command.

See the clsetup(1CL) and clquorum(1CL) man pages for information about the commands that are used in the following procedures.

How to Add a Shared Disk Quorum Device

Oracle Solaris Cluster software supports shared-disk (both SCSI and SATA) devices as quorum devices. A SATA device does not support a SCSI reservation, and you must disable the SCSI reservation fencing flag and use the software quorum protocol to configure these disks as quorum devices.

To complete this procedure, identify a disk drive by its device ID (DID), which is shared by the nodes. Use the cldevice show command to see the list of DID names. Refer to the cldevice(1CL) man page for additional information. Ensure that all nodes in the cluster are online before adding a new quorum device.

Use this procedure to configure SCSI or SATA devices.

The phys-schost# prompt reflects a global-cluster prompt. Perform this procedure on a global cluster.

This procedure provides the long forms of the Oracle Solaris Cluster commands. Most commands also have short forms. Except for the long and short forms of the command names, the commands are identical.

  1. Assume a role that provides solaris.cluster.modify RBAC authorization on any node of the cluster.
  2. Start the 1 utility.
    # clsetup

    The clsetup Main Menu is displayed.

  3. Type the number for the option for Quorum.

    The Quorum Menu is displayed.

  4. Type the number for the option for adding a quorum device, then type yes when the clsetup utility asks you to confirm the quorum device that you are adding.

    The clsetup utility asks what type of quorum device you want to add.

  5. Type the number for the option for a shared-disk quorum device.

    The clsetup utility asks which global device you want to use.

  6. Type the global device you are using.

    The clsetup utility asks you to confirm that the new quorum device should be added to the global device you specified.

  7. Type yes to continue adding the new quorum device.

    If the new quorum device is added successfully, the clsetup utility displays a message to that effect.

  8. Verify that the quorum device has been added.
    # clquorum list -v

Example 6-1 Adding a Shared Disk Quorum Device

The following example shows the clquorum command generated by clsetup when it adds a shared-disk quorum device and a verification step.

Assume the root role that provides solaris.cluster.modify RBAC authorization on any
    cluster node.

[Start the clsetup utility:]
# clsetup
[Select Quorum>Add a quorum device]
[Answer the questions when prompted.]
[You will need the following information.]
  [Information:                       Example:]
  [Directly attached shared disk      shared_disk]
  [Global device                          d20]

[Verify that the clquorum command was completed successfully:]
 clquorum add d20
 
    Command completed successfully.
[Quit the clsetup Quorum Menu and Main Menu.]
[Verify that the quorum device is added:]
# clquorum list -v
 
Quorum         Type
-------         ----
d20              shared_disk
scphyshost-1    node
scphyshost-2    node

How to Add a Sun ZFS Storage Appliance NAS Quorum Device

Ensure that all nodes in the cluster are online before adding a new quorum device.

The phys-schost# prompt reflects a global-cluster prompt. Perform this procedure on a global cluster.

This procedure provides the long forms of the Oracle Solaris Cluster commands. Most commands also have short forms. Except for the long and short forms of the command names, the commands are identical.

  1. Consult the installation documentation that shipped with the Sun ZFS Storage Appliance or the appliance's online Help for instructions on setting up an iSCSI device.
  2. On each of the cluster nodes, discover the iSCSI LUN and set the iSCSI access list to static configuration.
    # iscsiadm modify discovery -s enable
    
        # iscsiadm list discovery
        Discovery:
                Static: enabled
                Send Targets: disabled
                iSNS: disabled
    
        #  iscsiadm add static-config iqn.LUNName,IPAddress_of_NASDevice
    # devfsadm -i iscsi
    # cldevice refresh
  3. From one cluster node, configure the DIDs for the iSCSI LUN.
    # /usr/cluster/bin/cldevice populate
  4. Identify the DID device that represents the NAS device LUN that has just been configured into the cluster using iSCSI.

    Use the cldevice show command to see the list of DID names. Refer to the cldevice(1CL) man page for additional information.

  5. Assume a role that provides solaris.cluster.modify RBAC authorization on any node of the cluster.
  6. Use the clquorum command to add the NAS device as a quorum device using the DID device identified in Step 4.
    # clquorum add d20

    The cluster has default rules for deciding whether to use scsi-2, scsi-3, or software quorum protocols. See the clquorum(1CL) man page for more information.

How to Add a Quorum Server Quorum Device

Before You Begin

Before you can add an Oracle Solaris Cluster Quorum Server as a quorum device, the Oracle Solaris Cluster Quorum Server software must be installed on the host machine and the quorum server must be started and running. For information about installing the quorum server, see the How to Install and Configure Oracle Solaris Cluster Quorum Server Software in Oracle Solaris Cluster Software Installation Guide.

The phys-schost# prompt reflects a global-cluster prompt. Perform this procedure on a global cluster.

This procedure provides the long forms of the Oracle Solaris Cluster commands. Most commands also have short forms. Except for the long and short forms of the command names, the commands are identical.

  1. Assume a role that provides solaris.cluster.modify RBAC authorization on any node of the cluster.
  2. Ensure that all Oracle Solaris Cluster nodes are online and can communicate with the Oracle Solaris Cluster Quorum Server.
    1. Ensure that network switches that are directly connected to cluster nodes meet one of the following criteria:
      • The switch supports Rapid Spanning Tree Protocol (RSTP).

      • Fast port mode is enabled on the switch.

      One of these features is required to ensure immediate communication between cluster nodes and the quorum server. If this communication is significantly delayed by the switch, the cluster interprets this prevention of communication as loss of the quorum device.

    2. If the public network uses variable-length subnetting, also called Classless Inter-Domain Routing (CIDR), modify the following files on each node.

      If you use classful subnets, as defined in RFC 791, you do not need to perform these steps.

      1. Add to the /etc/inet/netmasks file an entry for each public subnet that the cluster uses.

        The following is an example entry which contains a public-network IP address and netmask:

        10.11.30.0    255.255.255.0
      2. Append netmask + broadcast + to the hostname entry in each /etc/hostname.adapter file.
        nodename netmask + broadcast +
    3. On each node in the cluster, add the quorum server hostname to the /etc/inet/hosts file or the /etc/inet/ipnodes file.

      Add a hostname-to-address mapping to the file, such as the following.

      ipaddress qshost1
      ipaddress
      The IP address of the computer where the quorum server is running.
      qshost1

      The hostname of the computer where the quorum server is running.

    4. If you use a naming service, add the quorum server host's name-to-address mapping to the name-service database.
  3. Start the clsetup utility.
    # clsetup

    The clsetup Main Menu is displayed.

  4. Type the number for the option for Quorum.

    The Quorum Menu is displayed.

  5. Type the number for the option for adding a quorum device.

    Then type yes to confirm that you are adding a quorum device.

    The clsetup utility asks what type of quorum device you want to add.

  6. Type the number for the option for a quorum-server quorum device. Then type yes to confirm that you are adding a quorum-server quorum device.

    The clsetup utility asks you to provide the name of the new quorum device.

  7. Type the name of the quorum device you are adding.

    The quorum device name can be any name you choose. The name is only used to process future administrative commands.

    The clsetup utility asks you to provide the name of the host of the quorum server.

  8. Type the name of the host of the quorum server.

    This name specifies the IP address of the machine where the quorum server runs or the hostname of the machine on the network.

    Depending on the IPv4 or IPv6 configuration of the host, the IP address of the machine must be specified in the /etc/hosts file, the /etc/inet/ipnodes file, or both.


    Note - The machine you specify must be reachable by all cluster nodes and must run the quorum server.


    The clsetup utility asks you to provide the port number of the quorum server.

  9. Type the port number that is used by the quorum server to communicate with the cluster nodes.

    The clsetup utility asks you to confirm that the new quorum device should be added.

  10. Type yes to continue adding the new quorum device.

    If the new quorum device is added successfully, the clsetup utility displays a message to that effect.

  11. Verify that the quorum device has been added.
    # clquorum list -v

Example 6-2 Adding a Quorum Server Quorum Device

The following example shows the clquorum command that is generated by clsetup when it adds a quorum server quorum device. The example also shows a verification step.

Assume the root role that provides solaris.cluster.modify RBAC authorization on any
    cluster node.

[Start the clsetup utility:]
# clsetup
[Select Quorum > Add a quorum device]
[Answer the questions when prompted.]
[You will need the following information.]
  [Information:                Example:]
  [Quorum Device               quorum_server quorum device]
  [Name:                           qd1]
  [Host Machine Name:          10.11.124.84]
  [Port Number:                9001]

[Verify that the clquorum command was completed successfully:]
 clquorum add -t quorum_server -p qshost=10.11.124.84 -p port=9001 qd1
 
    Command completed successfully.
[Quit the clsetup Quorum Menu and Main Menu.]
[Verify that the quorum device is added:]
# clquorum list -v
 
Quorum         Type
-------         ----
qd1             quorum_server
scphyshost-1    node
scphyshost-2    node

# clquorum status 

=== Cluster Quorum ===
-- Quorum Votes Summary --
 
        Needed     Present    Possible
        ------     -------    -------- 
        3          5           5
   
-- Quorum Votes by Node --
 
  Node Name        Present    Possible   Status
  ---------        -------    --------  ------
  phys-schost-1    1          1          Online
  phys-schost-2    1          1          Online
 
-- Quorum Votes by Device --
 
  Device Name       Present   Possible   Status
  -----------       -------   --------   ------
  qd1               1         1          Online
  d3s2              1         1          Online
  d4s2              1         1          Online

Removing or Replacing a Quorum Device

This section provides the following procedures for removing or replacing a quorum device:

How to Remove a Quorum Device

When a quorum device is removed, it no longer participates in the voting to establish quorum. Note that all two-node clusters require that at least one quorum device be configured. If this is the last quorum device on a cluster, clquorum(1CL) will fail to remove the device from the configuration. If you are removing a node, remove all quorum devices connected to the node.


Note - If the device you intend to remove is the last quorum device in the cluster, see the procedure How to Remove the Last Quorum Device From a Cluster.


The phys-schost# prompt reflects a global-cluster prompt. Perform this procedure on a global cluster.

This procedure provides the long forms of the Oracle Solaris Cluster commands. Most commands also have short forms. Except for the long and short forms of the command names, the commands are identical.

  1. Assume a role that provides solaris.cluster.modify RBAC authorization on any node in the cluster.
  2. Determine the quorum device to be removed.
    # clquorum list -v
  3. Execute the clsetup utility.
    # clsetup

    The Main Menu is displayed.

  4. Type the number for the option for Quorum.
  5. Type the number for the option to remove a quorum device.

    Answer the questions displayed during the removal process.

  6. Quit clsetup.
  7. Verify that the quorum device is removed.
    # clquorum list -v

Example 6-3 Removing a Quorum Device

This example shows how to remove a quorum device from a cluster with two or more quorum devices configured.

Assume the root role that provides solaris.cluster.modify RBAC 
authorization on any cluster node.

[Determine the quorum device to be removed:]
# clquorum list -v
[Start the clsetup utility:]
# clsetup
[Select Quorum>Remove a quorum device]
[Answer the questions when prompted.] 
Quit the clsetup Quorum Menu and Main Menu.]
[Verify that the quorum device is removed:]
# clquorum list -v
 
 Quorum         Type
-------         ----
scphyshost-1    node
scphyshost-2    node
scphyshost-3    node

Troubleshooting

If you lose communications between the cluster and the quorum server host while removing a quorum server quorum device, you must clean up stale configuration information about the quorum server host. For instructions on performing this cleanup, see Cleaning Up Stale Quorum Server Cluster Information.

How to Remove the Last Quorum Device From a Cluster

This procedure removes the last quorum device from a two-node cluster by using the clquorum force option, -F. Generally, you should first remove the failed device and then add the replacement quorum device. If this is not the last quorum device in a two-node cluster, follow the steps in How to Remove a Quorum Device.

Adding a quorum device involves a node reconfiguration, which touches the failed quorum device and panics the machine. The Force option lets you remove the failed quorum device without panicking the machine. The clquorum command enables you to remove the device from the configuration. For more information, see the clquorum(1CL) man page. After you remove the failed quorum device, you can add a new device with the clquorum add command. See Adding a Quorum Device.

The phys-schost# prompt reflects a global-cluster prompt. Perform this procedure on a global cluster.

This procedure provides the long forms of the Oracle Solaris Cluster commands. Most commands also have short forms. Except for the long and short forms of the command names, the commands are identical.

  1. Assume a role that provides solaris.cluster.modify RBAC authorization on any node in the cluster.
  2. Remove the quorum device by using the clquorum command.

    If the quorum device failed, use the -F Force option to remove the failed device.

    # clquorum remove -F qd1

    Note - You can also place the node to be removed in maintenance state and then remove the quorum device with the clquorum remove quorum command. The clsetup cluster administration menu options are not available while the cluster is in install mode. See How to Put a Node Into Maintenance State and the clsetup(1CL) man page for more information.


  3. Verify that the quorum device has been removed.
    # clquorum list -v

Example 6-4 Removing the Last Quorum Device

This example shows how to put the cluster in maintenance mode and remove the last remaining quorum device in a cluster configuration.

[Assume the root role that provides solaris.cluster.modify RBAC authorization on any
    cluster node.]
[Place the cluster in install mode:]
# cluster set -p installmode=enabled
[Remove the quorum device:]
# clquorum remove d3
[Verify that the quorum device has been removed:]
# clquorum list -v
 Quorum         Type
-------         ----
scphyshost-1    node
scphyshost-2    node
scphyshost-3    node

How to Replace a Quorum Device

Use this procedure to replace an existing quorum device with another quorum device. You can replace a quorum device with a similar device type, such as replacing a NAS device with another NAS device, or you can replace the device with a dissimilar device, such as replacing a NAS device with a shared disk.

The phys-schost# prompt reflects a global-cluster prompt. Perform this procedure on a global cluster.

This procedure provides the long forms of the Oracle Solaris Cluster commands. Most commands also have short forms. Except for the long and short forms of the command names, the commands are identical.

  1. Configure a new quorum device.

    You need to first add a new quorum device to the configuration to take the place of the old device. See Adding a Quorum Device to add a new quorum device to the cluster.

  2. Remove the device that you are replacing as a quorum device.

    See How to Remove a Quorum Device to remove the old quorum device from the configuration.

  3. If the quorum device is a failed disk, replace the disk.

    Refer to the hardware procedures in your hardware manual for your disk enclosure. See also the Oracle Solaris Cluster 4.1 Hardware Administration Manual.

Maintaining Quorum Devices

This section provides the following procedures for maintaining quorum devices:

How to Modify a Quorum Device Node List

You can use the clsetup utility to add a node to or remove a node from the node list of an existing quorum device. To modify a quorum device's node list, you must remove the quorum device, modify the physical connections of nodes to the quorum device you removed, then add the quorum device to the cluster configuration again. When a quorum device is added, the clquorum command automatically configures the node-to-disk paths for all nodes attached to the disk. For more information, see the clquorum(1CL) man page

The phys-schost# prompt reflects a global-cluster prompt. Perform this procedure on a global cluster.

This procedure provides the long forms of the Oracle Solaris Cluster commands. Most commands also have short forms. Except for the long and short forms of the command names, the commands are identical.

  1. Assume a role that provides solaris.cluster.modify RBAC authorization on any node of the cluster.
  2. Determine the name of the quorum device you are modifying.
    # clquorum list -v
  3. Start the clsetup utility.
    # clsetup

    The Main Menu is displayed.

  4. Type the number for the Quorum option.

    The Quorum Menu is displayed.

  5. Type the number for the option to remove a quorum device.

    Follow the instructions. You will be asked the name of the disk to be removed.

  6. Add or delete the node connections to the quorum device.
  7. Type the number for the option to add a quorum device.

    Follow the instructions. You will be asked the name of the disk to be used as the quorum device.

  8. Verify that the quorum device has been added.
    # clquorum list -v

Example 6-5 Modifying a Quorum Device Node List

The following example shows how to use the clsetup utility to add nodes to or delete nodes from a quorum device node list. In this example, the quorum device name is d2, and the final result of the procedures adds another node to the quorum device node list.

[Assume the root role that provides solaris.cluster.modify RBAC 
authorization on any node in the cluster.]

[Determine the quorum device name:]
# clquorum list -v
Quorum            Type
-------            -----
d2                 shared_disk
sc-phys-schost-1   node
sc-phys-schost-2   node
sc-phys-schost-3   node

[Start the clsetup utility:]
# clsetup

[Type the number that corresponds with the quorum option.]
.
[Type the number that corresponds with the option to remove a quorum device.]
.
[Answer the questions when prompted.]
[You will need the following information:]

   Information:            Example:
   Quorum Device Name:     d2

[Verify that the clquorum command completed successfully:]
 clquorum remove d2
     Command completed successfully.

[Verify that the quorum device was removed.]
# clquorum list -v
Quorum            Type
-------            -----
sc-phys-schost-1   node
sc-phys-schost-2   node
sc-phys-schost-3   node

[Type the number that corresponds with the Quorum option.]
.
[Type the number that corresponds with the option to add a quorum device.]
.
[Answer the questions when prompted.]
[You will need the following information:]

   Information            Example:
   quorum device name     d2

[Verify that the clquorum command was completed successfully:] 
clquorum add d2
     Command completed successfully.

Quit the clsetup utility.

[Verify that the correct nodes have paths to the quorum device. 
In this example, note that phys-schost-3 has been added to the 
enabled hosts list.]
# clquorum show d2 | grep Hosts
=== Quorum Devices ===

Quorum Device Name:        d2
   Hosts (enabled):        phys-schost-1, phys-schost-2, phys-schost-3

[Verify that the modified quorum device is online.]

# clquorum status d2
=== Cluster Quorum ===

--- Quorum Votes by Device ---

Device Name       Present      Possible      Status
-----------       -------      --------      ------
d2                1            1             Online

How to Put a Quorum Device Into Maintenance State

Use theclquorum command to put a quorum device into maintenance state. For more information, see the clquorum(1CL) man page. The clsetup utility does not currently have this capability.

Put a quorum device into maintenance state when taking the quorum device out of service for an extended period of time. This way, the quorum device's quorum vote count is set to zero and does not contribute to the quorum count while the device is being serviced. While in maintenance state, the quorum device's configuration information is preserved.


Note - All two-node clusters require at least one configured quorum device. If this is the last quorum device on a two-node cluster, clquorum will fail to put the device into maintenance state.


To put a cluster node into maintenance state, see How to Put a Node Into Maintenance State.

The phys-schost# prompt reflects a global-cluster prompt. Perform this procedure on a global cluster.

This procedure provides the long forms of the Oracle Solaris Cluster commands. Most commands also have short forms. Except for the long and short forms of the command names, the commands are identical.

  1. Assume a role that provides solaris.cluster.modify RBAC authorization on any node of the cluster.
  2. Put the quorum device into the maintenance state.
    # clquorum disable device
    device

    Specifies the DID name of the disk device to change, for example, d4.

  3. Verify that the quorum device is now in maintenance state.

    The output for the device you placed in maintenance state should read zero for the Quorum Device Votes.

    # clquorum status device

Example 6-6 Putting a Quorum Device Into Maintenance State

The following example shows how to put a quorum device into maintenance state and how to verify the results.

# clquorum disable d20
# clquorum status d20
  
=== Cluster Quorum ===

--- Quorum Votes by Device ---

Device Name       Present      Possible      Status
-----------       -------      --------      ------
d20                1            1             Offline

See Also

To re-enable the quorum device, see How to Bring a Quorum Device Out of Maintenance State.

To put a node into maintenance state, see How to Put a Node Into Maintenance State.

How to Bring a Quorum Device Out of Maintenance State

Run this procedure each time a quorum device is in maintenance state and you want to bring the quorum device out of maintenance state and reset the quorum vote count to the default.


Caution

Caution - If you do not specify either the globaldev or node options, the quorum count is reset for the entire cluster.


When you configure a quorum device, Oracle Solaris Cluster software assigns the quorum device a vote count of N-1 where N is the number of connected votes to the quorum device. For example, a quorum device that is connected to two nodes with nonzero vote counts has a quorum count of one (two minus one).

The phys-schost# prompt reflects a global-cluster prompt. Perform this procedure on a global cluster.

This procedure provides the long forms of the Oracle Solaris Cluster commands. Most commands also have short forms. Except for the long and short forms of the command names, the commands are identical.

  1. Assume a role that provides solaris.cluster.modify RBAC authorization on any node of the cluster.
  2. Reset the quorum count.
    # clquorum enable device
    device

    Specifies the DID name of the quorum device to reset, for example, d4.

  3. If you are resetting the quorum count because a node was in maintenance state, reboot the node.
  4. Verify the quorum vote count.
    # clquorum show +

Example 6-7 Resetting the Quorum Vote Count (Quorum Device)

The following example resets the quorum count for a quorum device back to the default and verifies the result.

# clquorum enable d20
# clquorum show +
  
=== Cluster Nodes ===                          

Node Name:                                      phys-schost-2
  Node ID:                                        1
  Quorum Vote Count:                              1
  Reservation Key:                                0x43BAC41300000001

Node Name:                                      phys-schost-3
  Node ID:                                        2
  Quorum Vote Count:                              1
  Reservation Key:                                0x43BAC41300000002


=== Quorum Devices ===                         

Quorum Device Name:                             d3
  Enabled:                                        yes
  Votes:                                          1
  Global Name:                                    /dev/did/rdsk/d20s2
  Type:                                           shared_disk
  Access Mode:                                    scsi3
  Hosts (enabled):                                phys-schost-2, phys-schost-3

How to List the Quorum Configuration

You do not need to be in the root role to list the quorum configuration. You can assume any role that provides solaris.cluster.read RBAC authorization.


Note - When you increase or decrease the number of node attachments to a quorum device, the quorum vote count is not automatically recalculated. You can reestablish the correct quorum vote if you remove all quorum devices and then add them back into the configuration. For a two-node cluster, temporarily add a new quorum device before you remove and add back the original quorum device. Then remove the temporary quorum device.


The phys-schost# prompt reflects a global-cluster prompt. Perform this procedure on a global cluster.

This procedure provides the long forms of the Oracle Solaris Cluster commands. Most commands also have short forms. Except for the long and short forms of the command names, the commands are identical.

Example 6-8 Listing the Quorum Configuration

% clquorum show +

=== Cluster Nodes ===                          

Node Name:                                      phys-schost-2
  Node ID:                                        1
  Quorum Vote Count:                              1
  Reservation Key:                                0x43BAC41300000001

Node Name:                                      phys-schost-3
  Node ID:                                        2
  Quorum Vote Count:                              1
  Reservation Key:                                0x43BAC41300000002


=== Quorum Devices ===                         

Quorum Device Name:                             d3
  Enabled:                                        yes
  Votes:                                          1
  Global Name:                                    /dev/did/rdsk/d20s2
  Type:                                           shared_disk
  Access Mode:                                    scsi3
  Hosts (enabled):                                phys-schost-2, phys-schost-3

How to Repair a Quorum Device

Use this procedure to replace a malfunctioning quorum device.

The phys-schost# prompt reflects a global-cluster prompt. Perform this procedure on a global cluster.

This procedure provides the long forms of the Oracle Solaris Cluster commands. Most commands also have short forms. Except for the long and short forms of the command names, the commands are identical.

  1. Remove the disk device that you are replacing as a quorum device.

    Note - If the device you intend to remove is the last quorum device, you might want to first add another disk as a new quorum device. This step assures a valid quorum device if a failure occurs during the replacement procedure. See Adding a Quorum Device to add a new quorum device.


    See How to Remove a Quorum Device to remove a disk device as a quorum device.

  2. Replace the disk device.

    To replace the disk device, see the procedures for the disk enclosure in the hardware guide. See also the Oracle Solaris Cluster 4.1 Hardware Administration Manual.

  3. Add the replaced disk as a new quorum device.

    See Adding a Quorum Device to add a disk as a new quorum device.


    Note - If you added an additional quorum device in Step 1, it is now safe to remove it. See How to Remove a Quorum Device to remove the quorum device.


Changing the Quorum's Default Time-out

A default 25–second time-out exists for the completion of quorum operations during a cluster reconfiguration. You can increase the quorum time-out to a higher value by following the instructions in How to Configure Quorum Devices in Oracle Solaris Cluster Software Installation Guide. Rather than increasing the time-out value, you can also switch to a different quorum device.

Additional troubleshooting information is available in How to Configure Quorum Devices in Oracle Solaris Cluster Software Installation Guide.


Note - For Oracle Real Application Clusters (Oracle RAC), do not change the default quorum time-out of 25 seconds. In certain split-brain scenarios, a longer time-out period might lead to the failure of Oracle RAC VIP failover, due to the VIP resource timing out. If the quorum device being used is not conforming with the default 25–second time-out, use a different quorum device.