Sun Cluster Quick Start Guide for Solaris OS

Installing the Software

Perform the following procedures to install the packages and patches for all software products and set up the user environment.


Note –

You install the Oracle software later in this manual.


ProcedureHow to Install the Administrative Console

Before You Begin

Have the following available:

  1. Become superuser on the administrative console.

  2. Configure the preinstalled Solaris 10 11/06 software, if you have not already done so.

    For more information, see the Sun Ultra 20 Workstation Getting Started Guide (819–2148).

  3. Download, install, and configure Sun Update Connection.

    See http://www.sun.com/service/sunupdate/gettingstarted.html for details. Documentation for Sun Update Connection is available at http://docs.sun.com/app/docs/coll/1320.2.

  4. Download and apply any Solaris 10 patches by using Sun Update Connection.

  5. Load the Java Availability Suite DVD-ROM into the DVD-ROM drive.

  6. Change to the Solaris_sparc/Product/sun_cluster/Solaris_10/Packages/ directory.

  7. Install software packages for the Cluster Control Panel and man pages.


    admincon# pkgadd -d . SUNWccon SUNWscman
    
  8. Change to a directory that does not reside on the DVD-ROM and eject the DVD-ROM.


    host# cd /
    host# eject cdrom
    
  9. Create an /etc/cluster file that contains the cluster name and the two node names.


    admincon# vi /etc/clusters
    sccluster phys-sun phys-moon
  10. Create an /etc/serialports file that contains both node names and the hostname and port number that each node uses to connect to the management network.


    admincon# vi /etc/serialports
    phys-sun phys-sun 46
    phys-moon phys-moon 47
  11. Add the Sun Cluster PATH and MANPATH to the .cshrc user initialization file.

    • To the PATH entry, add /opt/SUNWcluster/bin.

    • To the MANPATH entry, add /opt/SUNWcluster/man and /usr/cluster/man.

  12. Initialize your modifications.


    admincon# cd
    admincon# source .cshrc
    

ProcedureHow to Install the Solaris Operating System

This procedure describes how to install the Solaris 10 OS to meet Sun Cluster software installation requirements.


Note –

If your system comes with the Solaris OS preinstalled but does not meet Sun Cluster software installation requirements, perform this procedure to reinstall Solaris software to meet installation requirements.


Before You Begin

Have the following available:

  1. Add all public hostnames and logical addresses for the cluster to the naming service.


    Note –

    The IP addresses in this step are for example only and are not valid for use on the public network. Substitute your own IP addresses when you perform this step.



    192.168.10.1      phys-sun
    192.168.10.2      phys-moon
    192.168.10.3      apache-lh
    192.168.10.4      nfs-lh
    192.168.10.5      oracle-lh
    192.168.10.6      admincon
    
    192.168.11.1      phys-sun-11
    192.168.11.2      phys-moon-11
    192.168.11.3      se3510fc
    192.168.11.4      admincon-11

    For more information about naming services, see System Administration Guide: Naming and Directory Services (DNS, NIS, and LDAP).

  2. From the administrative console, start the cconsole(1M) utility.


    admincon# cconsole &
    

    Use the cconsole utility to communicate with each individual cluster node or use the master window to send commands to both nodes simultaneously.

  3. Insert the Solaris 10 11/06 DVD-ROM in the DVD-ROM drive of phys-sun.

  4. Access the console window for phys-sun.

  5. Boot phys-sun.

    • If the system is new, turn on the system.

    • If the system is currently running, shut down the system.


      phys-sun# init 0
      

    The ok prompt is displayed.

  6. Disable automatic reboot.


    ok setenv auto-boot? false
    

    Disabling automatic reboot prevents continuous boot cycling.

  7. Create an alias for each disk.

    The assignment of aliases to the disks enables you to access and boot from the second disk if you cannot boot from the default disk.

    1. Display the disks and choose the boot disk.


      ok show-disks
      …
          Enter selection, q to quit: X
      
    2. Assign the alias name rootdisk to the disk that you chose.


      ok nvalias rootdisk Control-Y
      

      The Control-Y keystroke combination enters the disk name that you chose from the show-disks menu.

    3. Save the disk alias.


      ok nvstore
      
    4. Repeat the preceding steps to identify and assign the alias name backup_root to the alternate boot disk.

    5. Set the boot-device environment variable to the aliases for the default boot disk and backup boot disk.


      ok setenv boot-device rootdisk backup_root
      

    For more information, see OpenBoot 4.x Command Reference Manual.

  8. Start the Solaris installation program.


    ok boot cdrom
    
  9. Follow the prompts.

    • Make the following installation choices:

      Prompt 

      Value 

      Solaris Software Group 

      Entire Plus OEM Support 

      Partitions 

      Manual formatting 

      Root password 

      Same password on both nodes 

      Automatic reboot 

      No 

      Enable network services for remote clients 

      Yes 

    • Set the following partition sizes and file-system names, if not already set:

      Slice 

      Size 

      File System Name 

      remaining free space 

      /

      2 Gbyte 

      swap 

      512 Mbyte 

      /globaldevices

      2 Gbyte 

      /var

      32 Mbyte 

      for Solaris Volume Manager use 

  10. Return to Step 3 and repeat these steps on phys-moon.

  11. On both nodes, download, install, and configure Sun Update Connection.

    See http://www.sun.com/service/sunupdate/gettingstarted.html for details. Documentation for Sun Update Connection is available at http://docs.sun.com/app/docs/coll/1320.2.

  12. On both nodes, download and apply any Solaris 10 patches by using Sun Update Connection.

ProcedureHow to Set Up the User Environment

Perform this procedure on both nodes. The steps in this procedure use the C shell environment. If you are using a different shell, perform the equivalent tasks for your preferred shell environment.

For more information, see Customizing a User’s Work Environment in System Administration Guide: Basic Administration.

  1. Open the cconsole master console window, if it is not already open.

    Use the master console window to perform the steps in this procedure on both nodes at the same time.

  2. Display the settings for the umask and the environment variables.


    phys-X# umask
    phys-X# env | more
    
  3. If not already set, set the umask to 22.

    This entry sets the default permissions for newly created files.


    umask 022
  4. Ensure that the PATH includes the following paths.

    • /usr/bin

    • /usr/cluster/bin

    • /usr/sbin

    • /oracle/oracle/product/10.2.0/bin

  5. (Optional) Add the following paths to the MANPATH.

    • /usr/cluster/man

    • /usr/apache/man

  6. Set the ORACLE_BASE and ORACLE_SID environment variables.


    ORACLE_BASE=/oracle
    ORACLE_SID=orasrvr
  7. Verify the setting changes that you made.


    phys-X# umask
    phys-X# env | more
    

ProcedureHow to Configure the Operating System

This procedure describes how to modify certain system settings to support the Quick Start configuration.

  1. On both nodes, enable Solaris multipathing functionality.


    phys-X# /usr/sbin/stmsboot -e
    
    -e

    Enables Solaris I/O multipathing

    For more information, see the stmsboot(1M) man page.

  2. On both nodes, update the /etc/inet/ipnodes file with all public hostnames and logical addresses for the cluster.

    Except for the loghost entries, these entries are the same on both nodes.


    Note –

    The IP addresses in this step are for example only and are not valid for use on the public network. Substitute your own IP addresses when you perform this step.



    phys-X# vi /etc/inet/ipnodes
    
    • On phys-sun, add the following entries:


      127.0.0.1         localhost
      192.168.10.1      phys-sun  loghost
      192.168.10.2      phys-moon
      192.168.10.3      apache-lh
      192.168.10.4      nfs-lh
      192.168.10.5      oracle-lh
      192.168.10.6      admincon
      
      192.168.11.1      phys-sun-11
      192.168.11.2      phys-moon-11
      192.168.11.3      se3510fc-11
      192.168.11.4      admincon-11
    • On phys-moon, add the following entries:


      127.0.0.1         localhost
      192.168.10.1      phys-sun
      192.168.10.2      phys-moon  loghost
      192.168.10.3      apache-lh
      192.168.10.4      nfs-lh
      192.168.10.5      oracle-lh
      192.168.10.6      admincon
      
      192.168.11.1      phys-sun-11
      192.168.11.2      phys-moon-11
      192.168.11.3      se3510fc-11
      192.168.11.4      admincon-11
  3. On both nodes, ensure that the following kernel parameters are set to at least the minimum values that Oracle requires.

    1. Display the settings for the default project.


      phys-X# prctl -i project default
      
    2. If no kernel parameters are set, or if any kernel parameters are not set to the minimum required value for Oracle as shown in the following table, set the parameter.


      phys-X# projmod -s -K "parameter=(priv,value,deny)" default
      

      Oracle Kernel Parameter 

      Minimum Required Value 

      process.max-sem-nsems

      256 

      project.max-sem-ids

      100 

      project.max-shm-ids

      100 

      project.max-shm-memory

      4294967295 

    3. Verify the new settings.


      phys-X# prctl -i project default
      

    These settings are the minimum required values to support the Oracle software in a Sun Cluster Quick Start configuration. For more information about these parameters, see the Oracle10g Installation Guide.

  4. On both nodes, add the following entries to the /etc/system file.


    phys-X# vi /etc/system
    set ce:ce_taskq_disable=1
    exclude:lofs
    • The first entry supports ce adapters for the private interconnect.

    • The second entry disables the loopback file system (LOFS), which must be disabled when Sun Cluster HA for NFS is configured on a highly available local file system. For more information and alternatives to disabling LOFS when Sun Cluster HA for NFS is configured, see the information about loopback file systems in Solaris OS Feature Restrictions in Sun Cluster Software Installation Guide for Solaris OS.

    These changes take effect at the next system reboot.

  5. On both nodes, set NFS version 3 as the default version.

    1. Add the following entry to the /etc/default/nfs file.


      NFS_SERVER_VERSMAX=3
    2. Disable the NFS service.


      phys-X# svcadm disable network/nfs/server
      
    3. Re-enable the NFS service.


      phys-X# svcadm enable network/nfs/server
      
  6. On both nodes, update the /devices and /dev entries.


    phys-X# devfsadm -C
    
  7. On both nodes, confirm that the storage array is visible.


    phys-X# luxadm probe
    

ProcedureHow to Create State Database Replicas

This procedure assumes that the specified disks are available for creation of database replicas. Substitute your own disk names in this procedure.

  1. On both nodes, create state database replicas.

    Create three replicas on each of the two internal disks.


    phys-X# metadb -af -c 3 c0t0d0s7
    phys-X# metadb -a -c 3 c0t1d0s7
    
  2. On both nodes, verify the replicas.


    phys-X# metadb
    flags            first blk      block count
        a       u       16          8192         /dev/dsk/c0t0d0s7
        a       u       8208        8192         /dev/dsk/c0t0d0s7
        a       u       16400       8192         /dev/dsk/c0t0d0s7
        a       u       16          8192         /dev/dsk/c0t1d0s7
        a       u       8208        8192         /dev/dsk/c0t1d0s7
        a       u       16400       8192         /dev/dsk/c0t1d0s7

ProcedureHow to Mirror the Root (/) File System

Perform this procedure on one node at a time.

This procedure assumes that the cluster node contains the internal nonshared disks c0t0d0 and c0t1d0. Substitute your own internal disk names if necessary in the steps of this procedure.

  1. On phys-sun, place the root slice c0t0d0s0 in a single-slice (one-way) concatenation.


    phys-sun# metainit -f d10 1 1 c0t0d0s0
    
  2. Create a second concatenation with the other internal disk, c0t1d0s0.


    phys-sun# metainit d20 1 1 c0t1d0s0
    
  3. Create a one-way mirror with one submirror.


    phys-sun# metainit d0 -m d10
    
  4. Set up the system files for the root directory.


    phys-sun# metaroot d0
    

    The metaroot command edits the /etc/vfstab and /etc/system files so that the system can be booted with the root (/) file system on a metadevice or volume. For more information, see the metaroot(1M) man page.

  5. Flush all file systems.


    phys-sun# lockfs -fa
    

    The lockfs command flushes all transactions from the log and writes the transactions to the master file system on all mounted UFS file systems. For more information, see the lockfs(1M) man page.

  6. Reboot the node to remount the newly mirrored root (/) file system.


    phys-sun# init 6
    
  7. Attach the second submirror to the mirror.


    phys-sun# metattach d0 d20
    

    For more information, see the metattach(1M) man page.

  8. Record the alternate boot path for possible future use.

    If the primary boot device fails, you can then boot from this alternate boot device. For more information about alternate boot devices, see Creating a RAID-1 Volume in Solaris Volume Manager Administration Guide.


    phys-sun# ls -l /dev/rdsk/c0t1d0s0
    
  9. Repeat Step 1 through Step 8 on phys-moon.

ProcedureHow to Install Sun Cluster Software

This procedure installs software packages for the Sun Cluster framework and for the Sun Cluster HA for Apache, Sun Cluster HA for NFS, and Sun Cluster HA for Oracle data services.

Before You Begin

Have available the following:

  1. On phys-sun, load the Java Availability Suite DVD-ROM in the DVD-ROM drive.

  2. Start the Java Enterprise System (ES) installer program.


    phys-sun# ./installer
    

    For more information about using the Java ES installer program, see the Sun Java Enterprise System 5 Installation Guide for UNIX.

  3. Follow the onscreen instructions to install the Sun Cluster framework packages.

    Screen Name 

    Instructions 

    Software License Agreement 

    Accept the license agreement. 

    Language Support 

    Choose any languages that you want to install in addition to English. 

    Installation Type 

    Answer no when asked if you want to install the full set of Java ES software.

    Component Selection 

    Choose Sun Cluster and Sun Cluster Agents. Do not deselect Sun Cluster Manager. Confirm your selection when prompted.

    Follow the onscreen instructions to install the following data service packages: 

    • Sun Cluster HA for Apache

    • Sun Cluster HA for NFS

    • Sun Cluster HA for Oracle

    Shared Component Upgrades Required 

    Accept upgrade of the list of shared components. 

    Configuration Type 

    Choose Configure Later.

    After the installation is finished, the installer program provides an installation summary. This summary enables you to view logs that the program created during the installation. These logs are located in the /var/sadm/install/logs/ directory.

  4. Change to a directory that does not reside on the DVD-ROM and eject the DVD-ROM.


    host# cd /
    host# eject cdrom
    
  5. Return to Step 1 and repeat all steps on phys-moon.

  6. On both nodes, use Sun Update Connection to download and apply any needed patches.

ProcedureHow to Set Up the Oracle System Groups and User

Perform the steps in this procedure on both nodes.

  1. Open the cconsole master console window, if it is not already open.

    Use the master console window to perform the steps in this procedure on both nodes at the same time.

  2. Create the Oracle Inventory group, oinstall, and the database administrator group, dba.


    phys-X# groupadd oinstall
    phys-X# groupadd dba
    
  3. Create the Oracle user account, oracle.

    Specify the Oracle home directory, /oracle/oracle/product/10.2.0. Set dba as the primary group and set oinstall as the secondary group.


    phys-X# useradd -g dba -G oinstall -d /oracle/oracle/product/10.2.0 oracle
    
  4. Set the oracle password.


    phys-X# passwd -r files oracle