Sun Cluster Software Installation Guide for Solaris OS

ProcedureHow to Change the Private Network Configuration When Adding Nodes or Private Networks

Perform this task to change the cluster private IP address range to accommodate an increase in the number of nodes or non-global zones or in the number of private networks, or a combination. You can also use this procedure to decrease the private IP address range.


Note –

This procedure requires you to shut down the entire cluster.


Before You Begin

Ensure that remote shell (rsh(1M)) or secure shell (ssh(1)) access for superuser is enabled for all cluster nodes.

  1. Become superuser on a node of the cluster.

  2. From one node, start the clsetup utility.


    # clsetup
    

    The clsetup Main Menu is displayed.

  3. Switch each resource group offline.

    If the node contains non-global zones, any resource groups in the zones are also switched offline.

    1. Type the number that corresponds to the option for Resource groups and press the Return key.

      The Resource Group Menu is displayed.

    2. Type the number that corresponds to the option for Online/Offline or Switchover a resource group and press the Return key.

    3. Follow the prompts to take offline all resource groups and to put them in the unmanaged state.

    4. When all resource groups are offline, type q to return to the Resource Group Menu.

  4. Disable all resources in the cluster.

    1. Type the number that corresponds to the option for Enable/Disable a resource and press the Return key.

    2. Choose a resource to disable and follow the prompts.

    3. Repeat the previous step for each resource to disable.

    4. When all resources are disabled, type q to return to the Resource Group Menu.

  5. Quit the clsetup utility.

  6. Verify that all resources on all nodes are Offline and that all resource groups are in the Unmanaged state.


    # cluster status -t resource,resourcegroup
    
    -t

    Limits output to the specified cluster object

    resource

    Specifies resources

    resourcegroup

    Specifies resource groups

  7. From one node, shut down the cluster.


    # cluster shutdown -g0 -y
    
    -g

    Specifies the wait time in seconds

    -y

    Prevents the prompt that asks you to confirm a shutdown from being issued

  8. Boot each node into noncluster mode.

    • On SPARC based systems, perform the following command:


      ok boot -x
      
    • On x86 based systems, perform the following commands:

      1. In the GRUB menu, use the arrow keys to select the appropriate Solaris entry and type e to edit its commands.

        The GRUB menu appears similar to the following:


        GNU GRUB version 0.95 (631K lower / 2095488K upper memory)
        +----------------------------------------------------------------------+
        | Solaris 10 /sol_10_x86                                               |
        | Solaris failsafe                                                     |
        |                                                                      |
        +----------------------------------------------------------------------+
        Use the ^ and v keys to select which entry is highlighted.
        Press enter to boot the selected OS, 'e' to edit the
        commands before booting, or 'c' for a command-line.

        For more information about GRUB based booting, see Chapter 11, GRUB Based Booting (Tasks), in System Administration Guide: Basic Administration.

      2. In the boot parameters screen, use the arrow keys to select the kernel entry and type e to edit the entry.

        The GRUB boot parameters screen appears similar to the following:


        GNU GRUB version 0.95 (615K lower / 2095552K upper memory)
        +----------------------------------------------------------------------+
        | root (hd0,0,a)                                                       |
        | kernel /platform/i86pc/multiboot                                     |
        | module /platform/i86pc/boot_archive                                  |
        +----------------------------------------------------------------------+
        Use the ^ and v keys to select which entry is highlighted.
        Press 'b' to boot, 'e' to edit the selected command in the
        boot sequence, 'c' for a command-line, 'o' to open a new line
        after ('O' for before) the selected line, 'd' to remove the
        selected line, or escape to go back to the main menu.
      3. Add -x to the command to specify that the system boot into noncluster mode.


        [ Minimal BASH-like line editing is supported. For the first word, TAB
        lists possible command completions. Anywhere else TAB lists the possible
        completions of a device/filename. ESC at any time exits. ]
        
        grub edit> kernel /platform/i86pc/multiboot -x
        
      4. Press Enter to accept the change and return to the boot parameters screen.

        The screen displays the edited command.


        GNU GRUB version 0.95 (615K lower / 2095552K upper memory)
        +----------------------------------------------------------------------+
        | root (hd0,0,a)                                                       |
        | kernel /platform/i86pc/multiboot -x                                  |
        | module /platform/i86pc/boot_archive                                  |
        +----------------------------------------------------------------------+
        Use the ^ and v keys to select which entry is highlighted.
        Press 'b' to boot, 'e' to edit the selected command in the
        boot sequence, 'c' for a command-line, 'o' to open a new line
        after ('O' for before) the selected line, 'd' to remove the
        selected line, or escape to go back to the main menu.-
      5. Type b to boot the node into noncluster mode.


        Note –

        This change to the kernel boot parameter command does not persist over the system boot. The next time you reboot the node, it will boot into cluster mode. To boot into noncluster mode instead, perform these steps to again to add the -x option to the kernel boot parameter command.


  9. From one node, start the clsetup utility.

    When run in noncluster mode, the clsetup utility displays the Main Menu for noncluster-mode operations.

  10. Type the number that corresponds to the option for Change IP Address Range and press the Return key.

    The clsetup utility displays the current private-network configuration, then asks if you would like to change this configuration.

  11. To change either the private-network IP address or the IP address range, type yes and press the Return key.

    The clsetup utility displays the default private-network IP address, 172.16.0.0, and asks if it is okay to accept this default.

  12. Change or accept the private-network IP address.

    • To accept the default private-network IP address and proceed to changing the IP address range, type yes and press the Return key.

      The clsetup utility will ask if it is okay to accept the default netmask. Skip to the next step to enter your response.

    • To change the default private-network IP address, perform the following substeps.

      1. Type no in response to the clsetup utility question about whether it is okay to accept the default address, then press the Return key.

        The clsetup utility will prompt for the new private-network IP address.

      2. Type the new IP address and press the Return key.

        The clsetup utility displays the default netmask and then asks if it is okay to accept the default netmask.

  13. Change or accept the default private-network IP address range.

    The default netmask is 255.255.248.0. This default IP address range supports up to 64 nodes and up to 10 private networks in the cluster.

    • To accept the default IP address range, type yes and press the Return key.

      Then skip to the next step.

    • To change the IP address range, perform the following substeps.

      1. Type no in response to the clsetup utility's question about whether it is okay to accept the default address range, then press the Return key.

        When you decline the default netmask, the clsetup utility prompts you for the number of nodes and private networks that you expect to configure in the cluster.

      2. Enter the number of nodes and private networks that you expect to configure in the cluster.

        From these numbers, the clsetup utility calculates two proposed netmasks:

        • The first netmask is the minimum netmask to support the number of nodes and private networks that you specified.

        • The second netmask supports twice the number of nodes and private networks that you specified, to accommodate possible future growth.

      3. Specify either of the calculated netmasks, or specify a different netmask that supports the expected number of nodes and private networks.

  14. Type yes in response to the clsetup utility's question about proceeding with the update.

  15. When finished, exit the clsetup utility.

  16. Reboot each node back into the cluster.

    1. Shut down each node.


      # shutdown -g0 -y
      
    2. Boot each node into cluster mode.

      • On SPARC based systems, do the following:


        ok boot
        
      • On x86 based systems, do the following:

        When the GRUB menu is displayed, select the appropriate Solaris entry and press Enter. The GRUB menu appears similar to the following:


        GNU GRUB version 0.95 (631K lower / 2095488K upper memory)
        +-------------------------------------------------------------------------+
        | Solaris 10 /sol_10_x86                                                  |
        | Solaris failsafe                                                        |
        |                                                                         |
        +-------------------------------------------------------------------------+
        Use the ^ and v keys to select which entry is highlighted.
        Press enter to boot the selected OS, 'e' to edit the
        commands before booting, or 'c' for a command-line.

        For more information about GRUB based booting, see Chapter 11, GRUB Based Booting (Tasks), in System Administration Guide: Basic Administration.

  17. From one node, start the clsetup utility.


    # clsetup
    

    The clsetup Main Menu is displayed.

  18. Re-enable all disabled resources.

    1. Type the number that corresponds to the option for Resource groups and press the Return key.

      The Resource Group Menu is displayed.

    2. Type the number that corresponds to the option for Enable/Disable a resource and press the Return key.

    3. Choose a resource to enable and follow the prompts.

    4. Repeat for each disabled resource.

    5. When all resources are re-enabled, type q to return to the Resource Group Menu.

  19. Bring each resource group back online.

    If the node contains non-global zones, also bring online any resource groups that are in those zones.

    1. Type the number that corresponds to the option for Online/Offline or Switchover a resource group and press the Return key.

    2. Follow the prompts to put each resource group into the managed state and then bring the resource group online.

  20. When all resource groups are back online, exit the clsetup utility.

    Type q to back out of each submenu, or press Ctrl-C.

Next Steps

To add a node to an existing cluster, go to one of the following procedures:

To create a non-global zone on a cluster node, go to Configuring a Non-Global Zone on a Cluster Node.