Sun Cluster Software Installation Guide for Solaris OS

ProcedureHow to Configure Quorum Devices


Note –

You do not need to configure quorum devices in the following circumstances:

Instead, proceed to How to Verify the Quorum Configuration and Installation Mode.


Perform this procedure one time only, after the cluster is fully formed. Use this procedure to assign quorum votes and then to remove the cluster from installation mode.

Before You Begin
  1. To use a quorum server as a quorum device, prepare the cluster to communicate with the quorum server.

    1. Edit the quorum-server configuration file /etc/scqsd/scqsd.conf.

      When you install the Sun Cluster software, a default configuration file, /etc/scqsd/scqsd.conf, is created that contains information about a single default quorum server. Each line in the /etc/scqsd/scqsd.conf file has the following format:


      /usr/cluster/lib/sc/scqsd [-d quorumdirectory] [-i instancename] -p port
      
      /usr/cluster/lib/sc/scqsd

      The full path to where you installed the Sun Cluster software. This value must be /usr/cluster/lib/sc/scqsd.

      -d quorumdirectory

      The path to the directory where the quorum server can store quorum data.

      The quorum server process creates one file per cluster in this directory to store cluster-specific quorum information. By default, the value of this option is /var/scqsd. This directory must be unique for each quorum server that you configure.

      -i instancename

      A unique name that you choose for the quorum server instance.

      -p port

      The port number on which the quorum server listens for requests from the cluster. The default port is 9000.

      Instance names are optional. If you specify a name for the quorum server, that name must be unique among all quorum servers in your system. If you choose to omit the instance name option, you must refer to the quorum server by the port on which it listens.

    2. If the public network uses variable-length subnetting, also called Classless Inter-Domain Routing (CIDR), modify the following files on each node.

      If you use classful subnets, as defined in RFC 791, you do not need to perform these steps.

      1. Add to the /etc/inet/netmasks file an entry for each public subnet that the cluster uses.

        The following is an example entry which contains a public-network IP address and netmask:


        10.11.30.0	255.255.255.0
      2. Append netmask + broadcast + to the hostname entry in each /etc/hostname.adapter file.


        nodename netmask + broadcast +
        
    3. Ensure that the IP address of the quorum server is included in the /etc/inet/hosts or /etc/inet/ipnodes file on each node in the cluster.

    4. If you use a naming service, ensure that the quorum server is included in the name-to-address mappings.

  2. On one node, become superuser.

  3. To use a shared disk as a quorum device, verify device connectivity to the cluster nodes and choose the device to configure.

    1. From one node of the cluster, display a list of all the devices that the system checks.

      You do not need to be logged in as superuser to run this command.


      phys-schost-1# cldevice list -v
      

      Output resembles the following:


      DID Device          Full Device Path
      ----------          ----------------
      d1                  phys-schost-1:/dev/rdsk/c0t0d0
      d2                  phys-schost-1:/dev/rdsk/c0t6d0
      d3                  phys-schost-2:/dev/rdsk/c1t1d0
      d3                  phys-schost-1:/dev/rdsk/c1t1d0
      …
    2. Ensure that the output shows all connections between cluster nodes and storage devices.

    3. Determine the global device-ID name of each shared disk that you are configuring as a quorum device.


      Note –

      Any shared disk that you choose must be qualified for use as a quorum device. See Quorum Devices for further information about choosing quorum devices.


      Use the scdidadm output from Step a to identify the device–ID name of each shared disk that you are configuring as a quorum device. For example, the output in Step a shows that global device d2 is shared by phys-schost-1 and phys-schost-2.

  4. If you intend to configure a quorum device from a shared disk that does not support the SCSI protocol, ensure that fencing is disabled for that shared disk.

    1. Display the fencing setting for the individual disk.


      # cldevice show device
      
      === DID Device Instances ===
      DID Device Name:                                      /dev/did/rdsk/dN
      …
        default_fencing:                                     nofencing
    2. If default_fencing is not set to nofencing or nofencing-noscrub, determine whether fencing is disabled globally.


      # cluster show -t global
      
      === Cluster ===
      Cluster name:                                         cluster
      …
         global_fencing:                                      nofencing
    3. If neither default_fencing nor global_fencing is set to nofencing or nofencing-noscrub, disable fencing for the shared disk.


      # cldevice set -p default_fencing=nofencing-noscrub device
      
    4. Verify that fencing for the shared disk is now disabled.


      # cldevice show device
      
  5. Start the clsetup utility.


    phys-schost# clsetup
    

    The Initial Cluster Setup screen is displayed.


    Note –

    If the Main Menu is displayed instead, initial cluster setup was already successfully performed. Skip to Step 10.


  6. Answer the prompt Do you want to add any quorum disks?.

    • If your cluster is a two-node cluster, you must configure at least one shared quorum device. Type Yes to configure one or more quorum devices.

    • If your cluster has three or more nodes, quorum device configuration is optional.

      • Type No if you do not want to configure additional quorum devices. Then skip to Step 9.

      • Type Yes to configure additional quorum devices. Then proceed to Step 7.

  7. Specify what type of device you want to configure as a quorum device.

    Quorum Device Type 

    Description 

    shared_disk

    Sun NAS device or shared disk 

    quorum_server

    Quorum server 

    netapp_nas

    Network Appliance NAS device 

  8. Specify the name of the device to configure as a quorum device.

    • For a quorum server, also specify the following information:

      • The IP address of the quorum server host

      • The port number that is used by the quorum server to communicate with the cluster nodes

    • For a Network Appliance NAS device, also specify the following information:

      • The name of the NAS device

      • The LUN ID of the NAS device

  9. At the prompt Is it okay to reset "installmode"?, type Yes.

    After the clsetup utility sets the quorum configurations and vote counts for the cluster, the message Cluster initialization is complete is displayed. The utility returns you to the Main Menu.

  10. Quit the clsetup utility.

Next Steps

Verify the quorum configuration and that installation mode is disabled. Go to How to Verify the Quorum Configuration and Installation Mode.

Troubleshooting

Interrupted clsetup processing - If the quorum setup process is interrupted or fails to be completed successfully, rerun clsetup.

Changes to quorum vote count – If you later increase or decrease the number of node attachments to a quorum device, the quorum vote count is not automatically recalculated. You can reestablish the correct quorum vote by removing each quorum device and then add it back into the configuration, one quorum device at a time. For a two-node cluster, temporarily add a new quorum device before you remove and add back the original quorum device. Then remove the temporary quorum device. See the procedure “How to Modify a Quorum Device Node List” in Chapter 6, Administering Quorum, in Sun Cluster System Administration Guide for Solaris OS.