Sun Cluster 3.0 12/01 System Administration Guide

6.2 Adding and Removing a Cluster Node

The following table lists the tasks to perform when adding a node to an existing cluster. To complete the procedure correctly, these tasks must be performed in the order shown

Table 6-2 Task Map: Adding a Cluster Node to an Existing Cluster

Task 

For Instructions, Go To 

Install the host adapter on the node and verify that the existing cluster interconnects can support the new node 

Sun Cluster 3.0 12/01 Hardware Guide

Add shared storage 

Sun Cluster 3.0 12/01 Hardware Guide

Add the node to the authorized node list 

   - Use scsetup.

"6.2.1 How to Add a Cluster Node to the Authorized Node List"

Install and configure the software on the new cluster node 

   - Install the Solaris Operating Environment and Sun Cluster software 

   - Configure the node as part of the cluster 

Sun Cluster 3.0 12/01 Software Installation Guide: See the section on installing and configuring Sun Cluster software.

The following table lists the tasks to perform when removing a node from an existing cluster. To complete the procedure correctly, the tasks must be performed in the order shown.

Table 6-3 Task Map: Removing a Cluster Node

Task 

For Instructions, Go To 

Place node being removed into maintenance state 

   - Use shutdown and scconf

"6.1.7 How to Put a Node Into Maintenance State"

Remove node from all resource groups 

   - Use scrgadm

Sun Cluster 3.0 12/01 Data Services Installation and Configuration Guide: see the procedure for how to remove a node from an existing resource group.

Remove node from all device groups of which the node is a member 

   - Use volume manager commands 

"3.3.4 How to Remove a Node From a Disk Device Group (Solstice DiskSuite)"

or 

"3.3.15 How to Remove a Node From a Disk Device Group (VERITAS Volume Manager)"

Remove all logical transport connections to the node being removed 

   - Use scsetup

"5.1.4 How to Remove Cluster Transport Cables, Transport Adapters, and Transport Junctions"

 

To remove the physical hardware from the node, see the Sun Cluster 3.0 12/01 Hardware Guide section on installing and maintaining cluster interconnect and public network hardware.

Remove all quorum devices shared with the node being removed 

   - Use scsetup

"4.1.3 How to Remove a Quorum Device"

Remove node from the cluster software configuration 

   - Use scconf

"6.2.2 How to Remove a Node From the Cluster Software Configuration"

Remove required shared storage from the node and cluster 

   - Follow the procedures in your volume manager documentation and hardware guide 

SDS or VxVM administration guide 

Sun Cluster 3.0 12/01 Hardware Guide

6.2.1 How to Add a Cluster Node to the Authorized Node List

Before adding a machine to an existing cluster, be sure the node has all of the necessary hardware correctly installed and configured, including a good physical connection to the private cluster interconnect.

For hardware installation information, refer to the Sun Cluster 3.0 12/01 Hardware Guide or the hardware documentation that shipped with your server.

This procedure permits a machine to install itself into a cluster by adding its node name to the list of authorized nodes for that cluster.

You must be superuser on a current cluster member node to complete this procedure.

  1. Be sure you have correctly completed all prerequisite hardware installation and configuration tasks listed in the task map for "6.2 Adding and Removing a Cluster Node".

  2. Execute the scsetup(1M) utility.


    # scsetup
    

    The Main Menu is displayed.

  3. To modify the authorized list, type 3 at the New Nodes Menu, Specify the name of a machine which may add itself.

    Follow the prompts to add the node's name to the cluster. You will be asked for the name of the node to be added.

  4. To access the New Nodes Menu, type 6 at the Main Menu.

  5. Verify that the task has been performed successfully.

    The scsetup utility prints a "Command completed successfully" message if it completes the task without error.

  6. To prevent any new machines from being added to the cluster, type 1 at the New Nodes Menu.

    Follow the scsetup prompts. This option tells the cluster to ignore all requests coming in over the public network from any new machine trying to add itself to the cluster.

  7. Quit the scsetup utility.

  8. Install and configure the software on the new cluster node.

    Use either scinstall or JumpStartTM to complete the installation and configuration of the new node, as described in the Sun Cluster 3.0 12/01 Software Installation Guide.

6.2.1.1 Example--Adding a Cluster Node to the Authorized Node List

The following example shows how to add a node named phys-schost-3 to the authorized node list in an existing cluster.


[Become superuser and execute the scsetup utility.]
# scsetup
Select New nodes>Specify the name of a machine which may add itself.
Answer the questions when prompted.
Verify that the scconf command completed successfully.
 
scconf -a -T node=phys-schost-3
 
    Command completed successfully.
Select Prevent any new machines from being added to the cluster.
Quit the scsetup New Nodes Menu and Main Menu.
[Install the cluster software.]

6.2.1.2 Where to Go From Here

For an overall list of tasks for adding a cluster node, see Table 6-2, "Task Map: Adding a Cluster Node."

To add a node to an existing resource group, see the Sun Cluster 3.0 12/01 Data Services Installation and Configuration Guide.

6.2.2 How to Remove a Node From the Cluster Software Configuration

This is the last software configuration procedure that needs to be accomplished in the process for removing a node from a cluster. You must be superuser on a node in the cluster to perform this procedure.

  1. Be sure you have correctly completed all prerequisite tasks listed in the task map for "6.2 Adding and Removing a Cluster Node".


    Note -

    Be sure you have placed the node in maintenance state and removed it from all resource groups, device groups, and quorum device configurations before continuing with this procedure.


  2. Determine the local disks in the cluster and their associated raw disk device group names, for example dsk/d4.


    # scconf -pvv | grep Local_Disk	
    

  3. Identify which local disks and raw disk device groups in the cluster are connected to the node being removed.


    # scconf -pvv | grep node-name | grep Device	
    

  4. Disable the localonly property for each local disk identified in Step 3.

    See the scconf_dg_rawdisk(1M) man page for more information about the localonly property.


    # scconf -c -D name=rawdisk-device-group,localonly=false
    

  5. Remove the node from all raw disk device groups, of which the node is a member.

    This step must be completed for each raw disk device group that is connected to the node being removed.


    # scconf -r -D name=rawdisk-device-group,nodelist=node
    

  6. Remove the node from the cluster.


    # scconf -r -h node=node
    

  7. Verify the node removal using scstat.


    # scstat -n
    

  8. To physically remove the node from the cluster, remove the hardware connections as described in the Sun Cluster 3.0 12/01 Hardware Guide.


Note -

After the device has been removed from the cluster, you must reinstall the Solaris operating environment on the removed host before it can be placed back into service in any capacity.


6.2.2.1 Example--Removing a Node From the Cluster Software Configuration

This example shows how to remove a node (phys-schost-2) from a cluster.


[Become superuser on any node and identify all local disks and their raw disk device group names:]
# scconf -pvv | grep Local_Disk
	(dsk/d4) Device group type:          Local_Disk
	(dsk/d8) Device group type:          Local_Disk
[Identify the local disks and raw disk device groups connected to the node being removed:]
# scconf -pvv | grep phys-schost-2 | grep Device	
	(dsk/d4) Device group node list:  phys-schost-2
	(dsk/d2) Device group node list:  phys-schost-1, phys-schost-2
	(dsk/d1) Device group node list:  phys-schost-1, phys-schost-2
[Remove the localonly flag for each local disk on the node:]
# scconf -c -D name=dsk/d4,localonly=false
[Remove the node from all raw disk device groups:]
# scconf -r -D name=dsk/d4,nodelist=phys-schost-2
# scconf -r -D name=dsk/d2,nodelist=phys-schost-2
# scconf -r -D name=dsk/d1,nodelist=phys-schost-2
[Remove the node from the cluster:]
# scconf -r -h node=phys-schost-2
[Verify node removal:]
# scstat -n
-- Cluster Nodes --
                    Node name           Status
                    ---------           ------
  Cluster node:     phys-schost-1       Online

6.2.2.2 Where to Go From Here

For hardware procedures, see the Sun Cluster 3.0 12/01 Hardware Guide.

For an overall list of tasks for removing a cluster node, see Table 6-3, "Task Map: Removing a Cluster Node."

To add a node to an existing cluster, see "6.2.1 How to Add a Cluster Node to the Authorized Node List".