test

Sun Cluster 3.1 10/03 Software Installation Guide

Upgrading to Sun Cluster 3.1 10/03 Software (Nonrolling)

Perform the following tasks to perform a nonrolling upgrade from Sun Cluster 3.x software to Sun Cluster 3.1 10/03 software. In a nonrolling upgrade, you shut down the entire cluster before you upgrade the cluster nodes. This procedure also enables you to upgrade the cluster from Solaris 8 software to Solaris 9 software.

Note –

To perform a rolling upgrade to Sun Cluster 3.1 10/03 software, instead perform the procedures in Upgrading to Sun Cluster 3.1 10/03 Software (Rolling).

Table 3–1 Task Map: Upgrading to Sun Cluster 3.1 10/03 Software (Nonrolling)

Task 

Instructions 

1. Read the upgrade requirements and restrictions. 

Upgrade Requirements and Restrictions

2. Take the cluster out of production, disable resources, and back up shared data and system disks.  

How to Prepare the Cluster for Upgrade (Nonrolling)

3. Upgrade the Solaris software, if necessary, to a supported Solaris update release. Optionally, upgrade VERITAS Volume Manager (VxVM).  

How to Upgrade the Solaris Operating Environment (Nonrolling)

4. Upgrade to Sun Cluster 3.1 10/03 framework and data-service software. If necessary, upgrade applications. If you upgraded VxVM, upgrade disk groups. 

How to Upgrade to Sun Cluster 3.1 10/03 Software (Nonrolling)

5. (Optional) Upgrade the Sun Cluster module to Sun Management Center, if needed.

How to Upgrade Sun Cluster–Module Software for Sun Management Center (Nonrolling)

6. Reregister resource types, enable resources, and bring resource groups online. 

How to Finish Upgrading to Sun Cluster 3.1 10/03 Software (Nonrolling)

How to Prepare the Cluster for Upgrade (Nonrolling)

Before you upgrade the software, perform the following steps to take the cluster out of production:

  1. Ensure that the configuration meets requirements for upgrade.

    See Upgrade Requirements and Restrictions.

  2. Have available the CD-ROMs, documentation, and patches for all software products you are upgrading.

    • Solaris 8 or Solaris 9 operating environment

    • Sun Cluster 3.1 10/03 framework

    • Sun Cluster 3.1 10/03 data services (agents)

    • Applications that are managed by Sun Cluster 3.1 10/03 data-service agents

    • VERITAS Volume Manager

    See “Patches and Required Firmware Levels” in Sun Cluster 3.1 Release Notes for the location of patches and installation instructions.

  3. (Optional) Install Sun Cluster 3.1 10/03 documentation.

    Install the documentation packages on your preferred location, such as an administrative console or a documentation server. See the index.html file at the top level of the Sun Cluster 3.1 10/03 CD-ROM to access installation instructions.

  4. Are you upgrading from Sun Cluster 3.0 software?

    • If no, proceed to Step 5.

    • If yes, have available your list of test IP addresses, one for each public network adapter in the cluster.

      A test IP address is required for each public network adapter in the cluster, regardless of whether the adapter is the active adapter or the backup adapter in the group. The test IP addresses will be used to reconfigure the adapters to use IP Network Multipathing.

      Note –

      Each test IP address must be on the same subnet as the existing IP address that is used by the public network adapter.

      To list the public network adapters on a node, run the following command: 


      % pnmstat

      See the IP Network Multipathing Administration Guide (Solaris 8) or System Administration Guide: IP Services (Solaris 9) for more information about test IP addresses for IP Network Multipathing.

  5. Notify users that cluster services will be unavailable during upgrade.

  6. Ensure that the cluster is functioning normally.

    • To view the current status of the cluster, run the following command from any node: 


      % scstat

      See the scstat(1M) man page for more information.

    • Search the /var/adm/messages log on the same node for unresolved error messages or warning messages.

    • Check volume-manager status.

  7. Become superuser on a node of the cluster.

  8. Switch each resource group offline.


    # scswitch -F -g resource-group

    -F

    Switches a resource group offline

    -g resource-group

    Specifies the name of the resource group to take offline

  9. Disable all resources in the cluster.

    The disabling of resources before upgrade prevents the cluster from bringing the resources online automatically if a node is mistakenly rebooted into cluster mode.

    Note –

    If you are upgrading from a Sun Cluster 3.1 release, you can use the scsetup(1M) utility instead of the command line. From the Main Menu, choose Resource Groups, then choose Enable/Disable Resources.

    1. From any node, list all enabled resources in the cluster.


      # scrgadm -pv | grep "Res enabled"

    2. Identify those resources that depend on other resources.

      You must disable dependent resources first before you disable the resources that they depend on.

    3. Disable each enabled resource in the cluster.


      scswitch -n -j resource
      -n

      Disables

      -j resource

      Specifies the resource

      See the scswitch(1M) man page for more information.

  10. Move each resource group to the unmanaged state. 


    # scswitch -u -g resource-group

    -u

    Moves the specified resource group to the unmanaged state

    -g resource-group

    Specifies the name of the resource group to move into the unmanaged state

  11. Verify that all resources on all nodes are disabled and that all resource groups are in the unmanaged state.


    # scstat -g

  12. Stop all databases that are running on each node of the cluster.

  13. Ensure that all shared data is backed up.

  14. From one node, shut down the cluster.


    # scshutdown
ok

    See the scshutdown(1M) man page for more information.

  15. Boot each node into noncluster mode.


    ok boot -x

  16. Ensure that each system disk is backed up.

  17. Determine whether to upgrade the Solaris operating environment.

    See “Supported Products” in Sun Cluster 3.1 10/03 Release Notes for more information.

How to Upgrade the Solaris Operating Environment (Nonrolling)

Perform this procedure on each node in the cluster to upgrade the Solaris operating environment. If the cluster already runs on a version of the Solaris environment that supports Sun Cluster 3.1 10/03 software, this procedure is optional.

Note –

The cluster must already run on, or be upgraded to, at least the minimum required level of the Solaris 8 or Solaris 9 environment to support Sun Cluster 3.1 10/03 software. See “Supported Products” in Sun Cluster 3.1 10/03 Release Notes for more information.

  1. Ensure that all steps in How to Prepare the Cluster for Upgrade (Nonrolling) are completed.

  2. Become superuser on the cluster node to upgrade.

  3. Determine whether the following Apache links already exist, and if so, whether the file names contain an uppercase K or S:


    /etc/rc0.d/K16apache 
/etc/rc1.d/K16apache 
/etc/rc2.d/K16apache 
/etc/rc3.d/S50apache 
/etc/rcS.d/K16apache

    • If these links already exist and do contain an uppercase K or S in the file name, no further action is necessary for these links.

    • If these links do not exist, or if these links exist but instead contain a lowercase k or s in the file name, you move aside these links in Step 8.

  4. Comment out all entries for globally mounted file systems in the /etc/vfstab file.

    1. Make a record of all entries that are already commented out for later reference.

    2. Temporarily comment out all entries for globally mounted file systems in the /etc/vfstab file.

      Entries for globally mounted file systems contain the global mount option. Comment out these entries to prevent the Solaris upgrade from attempting to mount the global devices.

  5. Determine which procedure to follow to upgrade the Solaris operating environment.

    Volume Manager 

    Procedure to Use 

    Location of Instructions 

    Solstice DiskSuite/Solaris Volume Manager 

    Upgrading Solaris software  

    Solaris 8 or Solaris 9 installation documentation 

    VERITAS Volume Manager 

    Upgrading VxVM and Solaris software 

    VERITAS Volume Manager installation documentation 

  6. Upgrade the Solaris software, following the procedure you selected in Step 5.

    Note –

    Ignore the instruction to reboot at the end of the Solaris software upgrade process. You must first perform Step 7 and Step 8, then reboot into noncluster mode in Step 9 to complete Solaris software upgrade.

    If you are instructed to reboot a node at other times during the upgrade process, always add the -x option to the command. This option ensures that the node reboots into noncluster mode. For example, either of the following two commands boot a node into single-user noncluster mode:


    # reboot -- -xs
ok boot -xs

  7. In the /a/etc/vfstab file, uncomment those entries for globally mounted file systems that you commented out in Step 4.

  8. If the Apache links in Step 3 did not already exist or if they contained a lowercase k or s in the file names before you upgraded the Solaris software, move aside the restored Apache links.

    Use the following commands to rename the files with a lowercase k or s:


    # mv /a/etc/rc0.d/K16apache /a/etc/rc0.d/k16apache 
# mv /a/etc/rc1.d/K16apache /a/etc/rc1.d/k16apache
# mv /a/etc/rc2.d/K16apache /a/etc/rc2.d/k16apache
# mv /a/etc/rc3.d/S50apache /a/etc/rc3.d/s50apache
# mv /a/etc/rcS.d/K16apache /a/etc/rcS.d/k16apache

  9. Reboot the node into noncluster mode.

    Include the double dashes (--) in the following command:


    # reboot -- -x

  10. Install any required Solaris software patches and hardware-related patches, and download any needed firmware that is contained in the hardware patches.

    For Solstice DiskSuite software (Solaris 8), also install any Solstice DiskSuite software patches.

    Note –

    Do not reboot after you add patches. You reboot the node after you upgrade the Sun Cluster software.

    See “Patches and Required Firmware Levels” in Sun Cluster 3.1 Release Notes for the location of patches and installation instructions.

  11. Upgrade to Sun Cluster 3.1 10/03 software.

    Go to How to Upgrade to Sun Cluster 3.1 10/03 Software (Nonrolling).

    Note –

    To complete upgrade from Solaris 8 to Solaris 9 software, you must also upgrade to the Solaris 9 version of Sun Cluster 3.1 10/03 software, even if the cluster already runs on Sun Cluster 3.1 10/03 software.

How to Upgrade to Sun Cluster 3.1 10/03 Software (Nonrolling)

This procedure describes how to upgrade the cluster to Sun Cluster 3.1 10/03 software. You must also perform this procedure to complete cluster upgrade from Solaris 8 to Solaris 9 software.

Tip –

You can perform this procedure on more than one node at the same time.

  1. Ensure that all steps in How to Prepare the Cluster for Upgrade (Nonrolling) are completed.

    If you upgraded from Solaris 8 to Solaris 9 software, also ensure that all steps in How to Upgrade the Solaris Operating Environment (Nonrolling) are completed.

  2. Become superuser on a node of the cluster.

  3. Ensure that you have installed all required Solaris software patches and hardware-related patches.

    For Solstice DiskSuite software (Solaris 8), also ensure that you have installed all required Solstice DiskSuite software patches.

  4. Insert the Sun Cluster 3.1 10/03 CD-ROM into the CD-ROM drive on the node.

    If the Volume Management daemon vold(1M) is running and configured to manage CD-ROM devices, it automatically mounts the CD-ROM on the /cdrom/suncluster_3_1_u1 directory.

  5. Upgrade the node to Sun Cluster 3.1 10/03 software.

    1. Change to the /cdrom/suncluster_3_1/SunCluster_3.1/Sol_ver/Tools directory, where ver is 8 (for Solaris 8) or 9 (for Solaris 9) . 


      # cd /cdrom/suncluster_3_1_u1/SunCluster_3.1/Sol_ver/Tools

    2. Upgrade the cluster framework software.

      • To upgrade from Sun Cluster 3.0 software, run the following command:


        # ./scinstall -u update -S interact -M patchdir=dirname
        -S

        Specifies the test IP addresses to use to convert NAFO groups to IP Network Multipathing groups

        interact

        Specifies that scinstall prompts the user for each test IP address needed

        -M patchdir=dirname[[,patchlistfile=filename]]

        Specifies the path to patch information so that the specified patches can be installed using the scinstall command. If you do not specify a patch-list file, the scinstall command installs all the patches in the directory dirname, including tarred, jarred, and zipped patches.

        The -M option is not required. You can use any method you prefer for installing patches.

      • To upgrade from Sun Cluster 3.1 software, run the following command:


        # ./scinstall -u update -M patchdir=dirname
        -M patchdir=dirname[[,patchlistfile=filename]]

        Specifies the path to patch information so that the specified patches can be installed using the scinstall command. If you do not specify a patch-list file, the scinstall command installs all the patches in the directory dirname, including tarred, jarred, and zipped patches.

      The -M option is not required. You can use any method you prefer for installing patches.

      See “Patches and Required Firmware Levels” in Sun Cluster 3.1 Release Notes for the location of patches and installation instructions.

      Tip –

      If upgrade processing is interrupted, use the scstat(1M) command to ensure that the node is in noncluster mode (Offline), then restart the scinstall command. 


      # scstat -n
-- Cluster Nodes --
                   Node name      Status
                   ---------      ------
  Cluster node:    nodename        Offline
  Cluster node:    nodename        Offline

      See the scinstall(1M) man page for more information. See the IP Network Multipathing Administration Guide (Solaris 8) or System Administration Guide: IP Services (Solaris 9) for information about test addresses for IP Network Multipathing.

      Note –

      Sun Cluster 3.1 software requires at least version 3.5.1 of Sun Explorer software. Upgrade to Sun Cluster software includes installing Sun Explorer data collector software, to be used in conjunction with the sccheck utility. If another version of Sun Explorer software was already installed before Sun Cluster upgrade, it is replaced by the version that is provided with Sun Cluster software. Options such as user identity and data delivery are preserved, but crontab entries must be manually recreated.

      During Sun Cluster upgrade, scinstall might make one or more of the following configuration changes:

      • Convert NAFO groups to IP Network Multipathing groups but keep the original NAFO-group name.

      • Rename the ntp.conf file to ntp.conf.cluster, if ntp.conf.cluster does not already exist on the node.

      • Set the local-mac-address? variable to true, if the variable is not already set to that value.

    3. Change to the CD-ROM root directory and eject the CD-ROM.

  6. Upgrade software applications that are installed on the cluster.

    Ensure that application levels are compatible with the current version of Sun Cluster and Solaris software. See your application documentation for installation instructions. In addition, follow these guidelines to upgrade applications in a Sun Cluster 3.1 10/03 configuration:

    • If the applications are stored on shared disks, you must master the relevant disk groups and manually mount the relevant file systems before you upgrade the application.

    • If you are instructed to reboot a node during the upgrade process, always add the -x option to the command. This option ensures that the node reboots into noncluster mode. For example, either of the following two commands boot a node into single-user noncluster mode:


      # reboot -- -xs
ok boot -xs

  7. (Optional) Upgrade Sun Cluster data services to the Sun Cluster 3.1 10/03 software versions.

    Note –

    You must upgrade the Sun Cluster HA for Oracle 3.0 64–bit for Solaris 9 data service to the Sun Cluster 3.1 10/03 version. Otherwise, you can continue to use Sun Cluster 3.0 data services after upgrade to Sun Cluster 3.1 10/03 software.

    Only those data services that are provided on the Sun Cluster 3.1 Agents CD-ROM are automatically upgraded by scinstall(1M). You must manually upgrade any custom or third-party data services.

    1. Insert the Sun Cluster 3.1 Agents CD-ROM into the CD-ROM drive on the node to upgrade.

    2. Upgrade the data-service software.


      # scinstall -u update -s all -d /cdrom/cdrom0

      -u update

      Specifies upgrade

      -s all

      Updates all Sun Cluster data services that are installed on the node

      Tip –

      If upgrade processing is interrupted, use the scstat(1M) command to ensure that the node is in noncluster mode (Offline), then restart the scinstall command. 


      # scstat -n
-- Cluster Nodes --
                   Node name      Status
                   ---------      ------
  Cluster node:    nodename        Offline
  Cluster node:    nodename        Offline

    3. Change to the CD-ROM root directory and eject the CD-ROM.

    4. As needed, manually upgrade any custom data services that are not supplied on the Sun Cluster 3.1 Agents CD-ROM.

    5. Install any Sun Cluster 3.1 10/03 data-service patches.

      See “Patches and Required Firmware Levels” in Sun Cluster 3.1 Release Notes for the location of patches and installation instructions.

  8. After all nodes are upgraded, reboot each node into the cluster.


    # reboot

  9. Verify that all upgraded software is at the same version on all upgraded nodes.

    1. On each upgraded node, view the installed levels of Sun Cluster software.


      # scinstall -pv

    2. From one node, verify that all upgraded cluster nodes are running in cluster mode (Online).


      # scstat -n

      See the scstat(1M) man page for more information about displaying cluster status.

  10. Did you upgrade from Solaris 8 to Solaris 9 software?

  11. On each node, run the following command to verify the consistency of the storage configuration:


    # scdidadm -c
    -c

    Perform a consistency check

    Caution – Caution –

    Do not proceed to Step 12 until your configuration passes this consistency check. Failure to do so might result in errors in device identification and cause data corruption.

    The following table lists the possible output from the scdidadm -c command and the action you must take, if any.

    Example Message 

    Action to Take 

    device id for 'phys-schost-1:/dev/rdsk/c1t3d0' does not match physical device's id, device may have been replaced

    Go to Recovering From Storage Configuration Changes During Upgrade and perform the appropriate repair procedure.

    device id for 'phys-schost-1:/dev/rdsk/c0t0d0' needs to be updated, run scdidadm –R to update

    None. You update this device ID in Step 12.

    No output message 

    None 

    See the scdidadm(1M) man page for more information.

  12. On each node, migrate the Sun Cluster storage database to Solaris 9 device IDs.


    # scdidadm -R all
    -R

    Perform repair procedures

    all

    Specify all devices

  13. On each node, run the following command to verify that storage database migration to Solaris 9 device IDs is successful:


    # scdidadm -c

    • If the scdidadm command displays a message, return to Step 11 to make further corrections to the storage configuration or the storage database.

    • If the scdidadm command displays no messages, the device-ID migration is successful. If device-ID migration is verified on all cluster nodes, proceed to Step 14.

  14. Did you upgrade VxVM?

    • If no, proceed to Step 15.

    • If yes, upgrade all disk groups.

      To upgrade a disk group to the highest version supported by the VxVM release you installed, run the following command from the primary node of the disk group:


      # vxdg upgrade dgname

      See your VxVM administration documentation for more information about upgrading disk groups.

  15. Do you intend to use Sun Management Center to monitor the cluster?

Example—Upgrade From Sun Cluster 3.0 to Sun Cluster 3.1 10/03 Software

The following example shows the process of a nonrolling upgrade of a two-node cluster from Sun Cluster 3.0 to Sun Cluster 3.1 10/03 software on the Solaris 8 operating environment. The cluster node names are phys-schost-1 and phys-schost-2.


(On the first node, upgrade framework software from the Sun Cluster 3.1 10/03 CD-ROM)
phys-schost-1# cd /cdrom/suncluster_3_1_u1/SunCluster_3.1/Sol_8/Tools
phys-schost-1# ./scinstall -u update -S interact
 
(On the first node, upgrade data services from the Sun Cluster 3.1 Agents CD-ROM)
phys-schost-1# ./scinstall -u update -s all -d /cdrom/cdrom0
 
(On the second node, upgrade framework software from the Sun Cluster 3.1 10/03 CD-ROM)
phys-schost-2# cd /cdrom/suncluster_3_1_u1/SunCluster_3.1/Sol_8/Tools
phys-schost-2# ./scinstall -u update -S interact
 
(On the second node, upgrade data services from the Sun Cluster 3.1 Agents CD-ROM)
phys-schost-2# ./scinstall -u update -s all -d /cdrom/cdrom0
 
(Reboot each node into the cluster)
phys-schost-1# reboot
phys-schost-2# reboot
 
(Verify cluster membership)
# scstat
-- Cluster Nodes --
                   Node name      Status
                   ---------      ------
  Cluster node:    phys-schost-1  Online
  Cluster node:    phys-schost-2  Online

How to Upgrade Sun Cluster–Module Software for Sun Management Center (Nonrolling)

Perform the following steps to upgrade to the Sun Cluster 3.1 10/03 module software packages for Sun Management Center on the Sun Management Center server machine and help-server machine.

  1. Ensure that all Sun Management Center core packages are installed on the appropriate machines, as described in your Sun Management Center installation documentation.

    This step includes installing Sun Management Center agent packages on each cluster node.

  2. Become superuser on the Sun Management Center server machine.

  3. Insert the Sun Cluster 3.1 10/03 CD-ROM into the CD-ROM drive.

  4. Change to the /cdrom/suncluster_3_1/SunCluster_3.1/Sol_ver/Packages directory, where ver is 8 (for Solaris 8) or 9 (for Solaris 9) .


    # cd /cdrom/suncluster_3_1_u1/SunCluster_3.1/Sol_ver/Packages

  5. Install the Sun Cluster–module server package SUNWscssv.


    # pkgadd -d . SUNWscssv

  6. Change to the CD-ROM root directory and eject the CD-ROM.

  7. Become superuser on the Sun Management Center help-server machine.

  8. Repeat Step 3 through Step 6 to install the Sun Cluster–module help-server package SUNWscshl.

  9. Finish the upgrade.

    Go to How to Finish Upgrading to Sun Cluster 3.1 10/03 Software (Nonrolling).

How to Finish Upgrading to Sun Cluster 3.1 10/03 Software (Nonrolling)

Perform this procedure to reregister and reversion all resource types that received a new version from the upgrade, then to re-enable resources and bring resource groups back online.

Note –

To upgrade future versions of resource types, see “Upgrading a Resource Type” in Sun Cluster 3.1 Data Service 4/03 Planning and Administration Guide.

  1. Ensure that all steps in How to Upgrade to Sun Cluster 3.1 10/03 Software (Nonrolling) are completed.

  2. From any node, start the scsetup(1M) utility.


    # scsetup

  3. To work with resource groups, type 2 (Resource groups).

  4. To register resource types, type 4 (Resource type registration).

    Type yes when prompted to continue.

  5. Type 1 (Register all resource types which are not yet registered).

    The scsetup utility displays all resource types that are not registered.

    Type yes to continue to register these resource types.

  6. Type 8 (Change properties of a resource).

    Type yes to continue.

  7. Type 3 (Manage resource versioning).

    Type yes to continue.

  8. Type 1 (Show versioning status).

    The scsetup utility displays which resources you can upgrade to new versions of the same resource type. The utility also displays the state that the resource should be in before the upgrade can begin.

    Type yes to continue.

  9. Type 4 (Re-version all eligible resources).

    Type yes to continue when prompted.

  10. Return to the Resource Group Menu.

  11. Type 6 (Enable/Disable a resource).

    Type yes to continue when prompted.

  12. Select a resource to enable and follow the prompts.

  13. Repeat Step 12 for each disabled resource.

  14. When all resources are re-enabled, type q to return to the Resource Group Menu.

  15. Type 5 (Online/Offline or Switchover a resource group).

    Type yes to continue when prompted.

  16. Follow the prompts to bring each resource group online.

  17. Exit the scsetup utility.

    Type q to back out of each submenu, or press Ctrl-C.

The cluster upgrade is complete. You can now return the cluster to production.