How to Change the Private Network Configuration When Adding Nodes or Private Networks

Language:

Perform this task to change the global-cluster's private IP address range to accommodate an increase in one or more of the following cluster components:

The number of nodes or non-global zones
The number of private networks
The number of zone clusters

You can also use this procedure to decrease the private IP address range.

Note - This procedure requires you to shut down the entire cluster. If you need to change only the netmask, for example, to add support for zone clusters, do not perform this procedure. Instead, run the following command from a global-cluster node that is running in cluster mode to specify the expected number of zone clusters:

phys-schost# cluster set-netprops num_zoneclusters=N

This command does not require you to shut down the cluster.

Assume the root role on a node of the cluster.
From one node, start the clsetup utility.
```
phys-schost# clsetup
```
The clsetup Main Menu is displayed.
Switch each resource group offline.
1. Choose the Resource Groups menu item.
  The Resource Group Menu is displayed.
2. Choose the Online/Offline or Switchover a Resource Group menu item.
3. Follow the prompts to take offline all resource groups and to put them in the unmanaged state.
4. When all resource groups are offline, type q to return to the Resource Group Menu.
Disable all resources in the cluster.
1. Choose the Enable/Disable a Resource menu item.
2. Choose a resource to disable and follow the prompts.
3. Repeat the previous step for each resource to disable.
4. When all resources are disabled, type q to return to the Resource Group Menu.
Quit the clsetup utility.
Verify that all resources on all nodes are Offline and that all resource groups are in the Unmanaged state.
```
# cluster status -t resource,resourcegroup
```
–t

Limits output to the specified cluster object

resource

Specifies resources

resourcegroup

Specifies resource groups
From one node, shut down the cluster.
```
# cluster shutdown -g0 -y
```
–g

Specifies the wait time in seconds

–y

Prevents the prompt that asks you to confirm a shutdown from being issued
Boot each node into noncluster mode.
- SPARC:
```
ok boot -x
```
- x86:
  1. In the GRUB menu, use the arrow keys to select the appropriate Oracle Solaris entry and type e to edit its commands.
    For more information about GRUB based booting, see Booting a System in Booting and Shutting Down Oracle Solaris 11.3 Systems.
  2. In the boot parameters screen, use the arrow keys to select the kernel entry and type e to edit the entry.
  3. Add -x to the multiboot command to specify that the system boot into noncluster mode.
  4. Press Enter to accept the change and return to the boot parameters screen.
    The screen displays the edited command.
  5. Type b to boot the node into noncluster mode.
    Note - This change to the kernel boot parameter command does not persist over the system boot. The next time you reboot the node, it will boot into cluster mode. To boot into noncluster mode instead, perform these steps to again add the –x option to the kernel boot parameter command.
From one node, start the clsetup utility.
When run in noncluster mode, the clsetup utility displays the Main Menu for noncluster-mode operations.
Choose the Change Network Addressing and Ranges for the Cluster Transport menu item.
The clsetup utility displays the current private network configuration, then asks if you would like to change this configuration.
To change either the private network IP address or the IP address range, type yes and press the Return key.
The clsetup utility displays the default private network IP address, 172.16.0.0, and asks if it is okay to accept this default.
Change or accept the private-network IP address.
- To accept the default private network IP address and proceed to changing the IP address range, type yes and press the Return key.
- To change the default private network IP address:
  1. Type no in response to the clsetup utility question about whether it is okay to accept the default address, then press the Return key.
    The clsetup utility will prompt for the new private-network IP address.
  2. Type the new IP address and press the Return key.
    The clsetup utility displays the default netmask and then asks if it is okay to accept the default netmask.
Change or accept the default private network IP address range.
The default netmask is 255.255.240.0. This default IP address range supports up to 64 nodes, 12 zone clusters, and 10 private networks in the cluster.
- To accept the default IP address range, type yes and press the Return key.
- To change the IP address range:
  1. Type no in response to the clsetup utility's question about whether it is okay to accept the default address range, then press the Return key.
    When you decline the default netmask, the clsetup utility prompts you for the number of nodes and private networks, and zone clusters that you expect to configure in the cluster.
  2. Provide the number of nodes, private networks, and zone clusters that you expect to configure in the cluster.
    From these numbers, the clsetup utility calculates two proposed netmasks:
    - The first netmask is the minimum netmask to support the number of nodes, private networks, and zone clusters that you specified.
    - The second netmask supports twice the number of nodes, private networks, and zone clusters that you specified, to accommodate possible future growth.
  3. Specify either of the calculated netmasks, or specify a different netmask that supports the expected number of nodes, private networks, and zone clusters.
Type yes in response to the clsetup utility's question about proceeding with the update.
When finished, exit the clsetup utility.
Reboot each node back into the cluster.
1. Shut down each node.
```
# shutdown -g0 -y
```
2. Boot each node into cluster mode.
  - SPARC:
```
ok boot
```
  - x86:
    When the GRUB menu is displayed, select the appropriate Oracle Solaris entry and press Enter.
    For more information about GRUB based booting, see Booting a System in Booting and Shutting Down Oracle Solaris 11.3 Systems.
From one node, start the clsetup utility.
```
# clsetup
```
The clsetup Main Menu is displayed.
Re-enable all disabled resources.
1. Choose the Resource Groups menu item.
  The Resource Group Menu is displayed.
2. Choose the Enable/Disable a Resource menu item.
3. Choose a resource to enable and follow the prompts.
4. Repeat for each disabled resource.
5. When all resources are re-enabled, type q to return to the Resource Group Menu.
Bring each resource group back online.
If the node contains non-global zones, also bring online any resource groups that are in those zones.
1. Choose the Online/Offline or Switchover a Resource Group menu item.
2. Follow the prompts to put each resource group into the managed state and then bring the resource group online.
When all resource groups are back online, exit the clsetup utility.
Type q to back out of each submenu, or press Control-C.

Next Steps

To add a node to an existing cluster, go to one of the following procedures: