3 Cloning Oracle Clusterware

This chapter describes how to clone an Oracle Grid Infrastructure home and use the cloned home to create a cluster. You perform the cloning procedures in this chapter by running scripts in silent mode. The cloning procedures are applicable to Linux and UNIX systems. Although the examples in this chapter use Linux and UNIX commands, the cloning concepts and procedures apply generally to all platforms.

Note:

This chapter assumes that you are cloning an Oracle Clusterware 11g release 2 (11.2) installation configured as follows:

No Grid Naming Service (GNS)
No Intelligent Management Platform Interface specification (IPMI)
Voting disk and Oracle Cluster Registry (OCR) are stored in Oracle Automatic Storage Management (ASM)
Single Client Access Name (SCAN) resolves through DNS

This chapter contains the following topics:

Introduction to Cloning Oracle Clusterware
Preparing the Oracle Grid Infrastructure Home for Cloning
Creating a Cluster by Cloning Oracle Clusterware
Using Cloning to Add Nodes to a Cluster
Locating and Viewing Log Files Generated During Cloning

Introduction to Cloning Oracle Clusterware

Cloning is the process of copying an existing Oracle Clusterware installation to a different location and then updating the copied installation to work in the new environment. Changes made by one-off patches applied on the source Oracle Grid Infrastructure home are also present after cloning. During cloning, you run a script that replays the actions that installed the Oracle Grid Infrastructure home.

Cloning requires that you start with a successfully installed Oracle Grid Infrastructure home. You use this home as the basis for implementing a script that extends the Oracle Grid Infrastructure home to create a cluster based on the original Grid home.

Manually creating the cloning script can be error prone because you prepare the script without interactive checks to validate your input. Despite this, the initial effort is worthwhile for scenarios where you run a single script to configure tens or even hundreds of clusters. If you have only one cluster to install, then you should use the traditional, automated and interactive installation methods, such as Oracle Universal Installer (OUI) or the Provisioning Pack feature of Oracle Enterprise Manager.

Note:

Cloning is not a replacement for Oracle Enterprise Manager cloning that is a part of the Provisioning Pack. During Oracle Enterprise Manager cloning, the provisioning process simplifies cloning by interactively asking for details about the Oracle home. The interview questions cover such topics as the location to which you want to deploy the cloned environment, the name of the Oracle database home, a list of the nodes in the cluster, and so on.

The Provisioning Pack feature of Oracle Enterprise Manager Grid Control provides a framework that automates the provisioning of nodes and clusters. For data centers with many clusters, the investment in creating a cloning procedure to provision new clusters and new nodes to existing clusters is worth the effort.

The following list describes some situations in which cloning is useful:

Cloning prepares an Oracle Grid Infrastructure home once and deploys it to many hosts simultaneously. You can complete the installation in silent mode, as a noninteractive process. You do not need to use a graphical user interface (GUI) console, and you can perform cloning from a Secure Shell (SSH) terminal session, if required.
Cloning enables you to create an installation (copy of a production, test, or development installation) with all patches applied to it in a single step. Once you have performed the base installation and applied all patch sets and patches on the source system, cloning performs all of these individual steps as a single procedure. This is in contrast to going through the installation process to perform the separate steps to install, configure, and patch the installation on each node in the cluster.
Installing Oracle Clusterware by cloning is a quick process. For example, cloning an Oracle Grid Infrastructure home to a cluster with more than two nodes requires a few minutes to install the Oracle software, plus a few minutes more for each node (approximately the amount of time it takes to run the root.sh script).
Cloning provides a guaranteed method of accurately repeating the same Oracle Clusterware installation on multiple clusters.

A cloned installation acts the same as its source installation. For example, you can remove the cloned Oracle Grid Infrastructure home using OUI or patch it using OPatch. You can also use the cloned Oracle Grid Infrastructure home as the source for another cloning operation. You can create a cloned copy of a test, development, or production installation by using the command-line cloning scripts.

The default cloning procedure is adequate for most cases. However, you can also customize some aspects of cloning, for example, to specify custom port assignments or to preserve custom settings.

The cloning process works by copying all of the files from the source Oracle Grid Infrastructure home to the destination Oracle Grid Infrastructure home. You can clone either a non-shared or shared Oracle Grid Infrastructure home. Thus, any files used by the source instance that are located outside the source Oracle Grid Infrastructure home's directory structure are not copied to the destination location.

The size of the binary files at the source and the destination may differ because these files are relinked as part of the cloning operation, and the operating system patch levels may also differ between these two locations. Additionally, the number of files in the cloned home would increase because several files copied from the source, specifically those being instantiated, are backed up as part of the clone operation.

Preparing the Oracle Grid Infrastructure Home for Cloning

To prepare the source Oracle Grid Infrastructure home to be cloned, create a copy of an installed Oracle Grid Infrastructure home and then use it to perform the cloning procedure on other nodes. Use the following step-by-step procedure to prepare the copy of the Oracle Grid Infrastructure home.

Step 1: Install Oracle Clusterware

Use the detailed instructions in the Oracle Grid Infrastructure Installation Guide to perform the following steps on the source node:

Install Oracle Clusterware 11g release 2 (11.2). This installation puts Oracle Cluster Registry (OCR) and the voting disk on Oracle Automatic Storage Management (Oracle ASM).

Note:
Either install and configure the Grid Infrastructure for a cluster or install just the Oracle Clusterware software, as described in your platform-specific Oracle Grid Infrastructure Installation Guide.

To install and configure the Grid Infrastructure for a cluster, stop Oracle Clusterware before performing the cloning procedures. If you install just Oracle Clusterware, then you do not have to stop Oracle Clusterware.
Install any patches that are required (for example, a Grid Infrastructure bundle patch), if necessary.
Apply one-off patches, if necessary.

See Also:
Oracle Grid Infrastructure Installation Guide for Oracle Clusterware installation instructions

Step 2: Shut Down Running Software

Before copying the source Oracle Grid Infrastructure home, shut down all of the services, databases, listeners, applications, Oracle Clusterware, and Oracle ASM instances that run on the node. Use the Server Control (SRVCTL) and Oracle Clusterware Control (CRSCTL) utilities to shut down these components.

Step 3: Create a Copy of the Oracle Grid Infrastructure Home

To keep the installed Oracle Grid Infrastructure home as a working home, make a full copy of the source Oracle Grid Infrastructure home for cloning. Because the Oracle Grid Infrastructure home contains files that are relevant only to the source node, you can optionally remove the unnecessary files from the copy.

Note:

When creating the copy, a best practice is to include the release number in the name of the file.

Use one of the following methods to create a compressed copy of the Oracle Grid Infrastructure home.

Method 1: Create a copy of the Oracle Grid Infrastructure home and remove the unnecessary files from the copy:

On the source node, create a copy of the Oracle Grid Infrastructure home. To keep the installed Oracle Grid Infrastructure home as a working home, make a full copy of the source Oracle Grid Infrastructure home and remove the unnecessary files from the copy. For example, as root on Linux systems, run the cp command:
```
# cp -prf Grid_home location_of_the_copy_of_Grid_home
```

Delete unnecessary files from the copy.

The Oracle Grid Infrastructure home contains files that are relevant only to the source node, so you can remove the unnecessary files from the copy of the Grid Infrastructure home in the log, crs/init, crf, and cdata directories. The following example for Linux and UNIX systems shows the commands to run to remove the unnecessary files from the copy of the Oracle Grid Infrastructure home:

[root@node1 root]# cd /file_system_with_enough_space/cloned_crs
[root@node1 crs]# rm -rf host_name
[root@node1 crs]# rm -rf crs/init
[root@node1 crs]# rm -rf cdata
[root@node1 crs]# rm -rf crf
[root@node1 crs]# find gpnp -type f -exec rm -f {} \;
[root@node1 crs]# rm -rf network/admin/*.ora
[root@node1 crs]# find . -name '*.ouibak' -exec rm {} \;
[root@node1 crs]# find . -name '*.ouibak.1' -exec rm {} \;
[root@node1 crs]# rm -rf root.sh*
[root@node1 crs]# rm -rf /inventory/ContentsXML/oraclehomeproperties.xml
[root@node1 crs]# cd cfgtoollogs
[root@node1 cfgtoollogs]# find . -type f -exec rm -f {} \;

Create a compressed copy of the previously copied Oracle Grid Infrastructure home using tar or gzip on Linux and UNIX systems. Ensure that the tool you use preserves the permissions and file timestamps. For example:

On Linux and UNIX systems:
```
[root@node1 root]# cd /opt/oracle/product/11g/crs/
[root@node1 crs]# tar -zcvpf /path_name/gridHome.tgz .
```
In the example, the cd command changes the location to the Oracle Grid Infrastructure home, and the tar command creates the copy named crs11101.tgz. In the tar command, path_name represents the location of the file.

On AIX or HPUX systems:
```
tar cpf - . | compress -fv > temp_dir/gridHome.tar.Z
```
On Windows systems, use WinZip to create a zip file.

Method 2: Create a compressed copy of the Oracle Grid Infrastructure home using the -X option:

Create a file that lists the unnecessary files in the Oracle Grid Infrastructure home. For example, list the following file names, using the asterisk (*) wildcard, in a file called excludeFileList:

./opt/oracle/product/11g/crs/log/host_name
./opt/oracle/product/11g/crs/root.sh*
./opt/oracle/products/11g/crs/gpnp
./opt/oracle/products/11g/crs/network/admin/*.ora
./opt/oracle/products/11g/crs/crf

Use the tar command or Winzip to create a compressed copy of the Oracle Grid Infrastructure home. For example, on Linux and UNIX systems, run the following command to archive and compress the source Oracle Grid Infrastructure home:
```
tar cpfX - excludeFileList . | compress -fv > temp_dir/gridHome.tar.Z
```
Note:
Do not use the jar utility to copy and compress the Oracle Grid Infrastructure home.

At this point, you are ready to do either of the following:

Creating a Cluster by Cloning Oracle Clusterware
Using Cloning to Add Nodes to a Cluster

Creating a Cluster by Cloning Oracle Clusterware

This section explains how to create a cluster by cloning a successfully installed Oracle Clusterware environment and copying it to the nodes on the destination cluster. The procedures in this section describe how to use cloning for Linux, UNIX, and Windows systems. OCR and voting disks are not shared between the two clusters after you successfully create a cluster from a clone.

For example, you can use cloning to quickly duplicate a successfully installed Oracle Clusterware environment to create a cluster. Figure 3-1 shows the result of a cloning procedure in which the Oracle Grid Infrastructure home on Node 1 has been cloned to Node 2 and Node 3 on Cluster 2, making Cluster 2 a new two-node cluster.

Figure 3-1 Cloning to Create a Oracle Clusterware Environment

Description of "Figure 3-1 Cloning to Create a Oracle Clusterware Environment"

The steps to create a cluster through cloning are as follows:

Step 1: Prepare the New Cluster Nodes
Step 2: Deploy the Oracle Grid Infrastructure Home on the Destination Nodes
Step 3: Run the clone.pl Script on Each Destination Node
Step 4: Launch the Configuration Wizard

Step 1: Prepare the New Cluster Nodes

On each destination node, perform the following preinstallation steps:

Specify the kernel parameters
Configure block devices for Oracle Clusterware devices
Ensure that you have set the block device permissions correctly
Use short, nondomain-qualified names for all of the names in the Hosts file
Test whether the interconnect interfaces are reachable using the ping command
Verify that the VIP addresses are not active at the start of the cloning process by using the ping command (the ping command of the VIP address must fail)
Run CVU to verify your hardware and operating system environment

Refer to your platform-specific Oracle Clusterware installation guide for the complete preinstallation checklist.

Note:

Unlike traditional methods of installation, the cloning process does not validate your input during the preparation phase. (By comparison, during the traditional method of installation using OUI, various checks occur during the interview phase.) Thus, if you make errors during the hardware setup or in the preparation phase, then the cloned installation fails.

Step 2: Deploy the Oracle Grid Infrastructure Home on the Destination Nodes

Before you begin the cloning procedure that is described in this section, ensure that you have completed the prerequisite tasks to create a copy of the Oracle Grid Infrastructure home, as described in the section titled "Preparing the Oracle Grid Infrastructure Home for Cloning".

On each destination node, deploy the copy of the Oracle Grid Infrastructure home that you created in "Step 3: Create a Copy of the Oracle Grid Infrastructure Home", as follows:

If you do not have a shared Oracle Grid Infrastructure home, then restore the copy of the Oracle Grid Infrastructure home on each node in the destination cluster. Use the equivalent directory structure as the directory structure that was used in the Oracle Grid Infrastructure home on the source node. Skip this step if you have a shared Oracle Grid Infrastructure home.

For example, on Linux or UNIX systems, run commands similar to the following:
```
[root@node1 root]# mkdir -p /u01/app/11.2.0/grid
[root@node1 root]# cd /u01/app/11.2.0/grid
[root@node1 crs]# tar -zxvf /path_name/gridHome.tgz
```
In this example, path_name represents the directory structure in which you want to install the Oracle Grid Infrastructure home. Note that you can change the Grid home location as part of the clone process.

On Windows systems, unzip the Oracle Grid Infrastructure home on the destination node in the equivalent directory structure as the directory structure in which the Oracle Grid Infrastructure home resided on the source node.
If you have not already deleted unnecessary files from the Oracle Grid Infrastructure home, then repeat step 2 in "Method 1: Create a copy of the Oracle Grid Infrastructure home and remove the unnecessary files from the copy:".
If necessary, on the destination node, change the ownership of all of the files to belong to the oracle:oinstall group, and create a directory for the Oracle Inventory. The following example shows the commands to do this on a Linux system:
```
[root@node1 crs]# chown oracle:oinstall /u01/app/oraInventory
[root@node1 crs]# mkdir -p /u01/app/oraInventory
```
Note:
If the oracle user and oinstall group are different between the source node and destination node, then run the following command:
```
[root@node1 crs]# chown -R oracle:oinstall /u01/app/11.2.0/grid
```
When you run the preceding command on the Grid home, it clears setuid and setgid information from the Oracle binary. Run the following commands to restore the cleared information:
```
chmod u+s Grid_home/bin/oracle
chmod g+s Grid_home/bin/oracle
```
It is important to remove any Oracle network files from the /u01/app/11.2.0/grid/network/admin directory on both nodes before continuing. For example, remove any tnsnames.ora, listener.ora or sqlnet.ora files.

See Also:
"Locating and Viewing Log Files Generated During Cloning"

Step 3: Run the clone.pl Script on Each Destination Node

To set up the new Oracle Clusterware environment, the clone.pl script requires you to provide several setup values for the script. You can provide the variable values by either supplying input on the command line when you run the clone.pl script, or by creating a file in which you can assign values to the cloning variables. The following discussions describe these options.

Supplying input to the clone.pl script on the command line

If you do not have a shared Oracle Grid Infrastructure home, navigate to the $ORACLE_HOME/clone/bin directory on each destination node and run the clone.pl script, which performs the main Oracle Clusterware cloning tasks. To run the script, you must supply input to several parameters. Table 3-1 describes the clone.pl script parameters.

Table 3-1 Parameters for the clone.pl Script

Parameters	Description
`ORACLE_BASE=ORACLE_BASE`	The complete path to the Oracle base to be cloned. If you specify an invalid path, then the script exits. This parameter is required.
`ORACLE_HOME=GRID_HOME`	The complete path to the Grid Infrastructure home for cloning. If you specify an invalid path, then the script exits. This parameter is required.
`ORACLE_HOME_NAME=Oracle_home_name` (or) `-defaultHomeName`	The Oracle home name of the home to be cloned. Optionally, you can specify the `-defaultHomeName` flag. This parameter is not required.
`INVENTORY_LOCATION=location_of_inventory`	The location for the Oracle Inventory.
`-O'"CLUSTER_NODES={node_name,node_name,...}"'`	The short node names separated by commas for the nodes that are to be part of this new cluster.
`CRS=TRUE`	This parameter is necessary to set this property on the Oracle Universal Installer inventory.
`-O'"LOCAL_NODE=node_name"'`	The short node name for the node on which `clone.pl` is running.
`OSDBA_GROUP=OSDBA_privileged_group`	Specify the operating system group you want to use as the OSDBA privileged group. This parameter is optional if you do not want the default value.
`OSASM_GROUP=OSASM_privileged_group`	Specify the operating system group you want to use as the OSASM privileged group. This parameter is optional if you do not want the default value.
`OSOPER_GROUP=OSOPER_privileged_group`	Specify the operating system group you want to use as the OSOPER privileged group. This parameter is optional if you do not want the default value.
`-debug`	Specify this option to run the `clone.pl` script in debug mode.
`-help`	Specify this option to obtain help for the `clone.pl` script.

For example, on Linux and UNIX systems:

$ perl clone.pl -silent ORACLE_BASE=/u01/app/oracle ORACLE_HOME=
/u01/app/1.2.0/grid ORACLE_HOME_NAME=OraHome1Grid
INVENTORY_LOCATION=/u01/app/oraInventory -O'"CLUSTER_NODES={node1, node2}"'
-O'"LOCAL_NODE=node1"' CRS=TRUE

On Windows systems:

C:\>perl clone.pl ORACLE_BASE=D:\u01\app\grid ORACLE_HOME=D:\u01\app\grid\11.2.0
ORACLE_HOME_NAME=OraHome1Grid -O'"CLUSTER_NODES={node1, node2}"' -O'"LOCAL_NODE=node1"'
CRS=TRUE

For Windows platforms, on all other nodes, run the same command with an additional argument: PERFORM_PARTITION_TASKS=FALSE.

For example:

C:\>perl clone.pl ORACLE_BASE=D:\u01\app\grid ORACLE_HOME=\u01\app\grid\11.2.0
ORACLE_HOME_NAME=\u01\app\grid\11.2.0 CRS=TRUE PERFORM_PARTITION_TASKS=FALSE

Refer to Table 3-1 for descriptions of the various variables in the preceding examples.

If you have a shared Oracle Grid Infrastructure home, then append the -cfs option to the command example in this step and provide a complete path location for the cluster file system.

Supplying Input to the clone.pl Script in a File

Because the clone.pl script is sensitive to the parameter values that it receives, you must be accurate in your use of brackets, single quotation marks, and double quotation marks. To avoid errors, create a file that is similar to the start.sh script shown in Example 3-1 in which you can specify environment variables and cloning parameters for the clone.pl script.

Example 3-1 shows an excerpt from an example script called start.sh that calls the clone.pl script; the example is configured for a cluster named crscluster. Run the script as the operating system user that installed Oracle Clusterware.

Example 3-1 Excerpt From the start.sh Script to Clone Oracle Clusterware

#!/bin/sh
ORACLE_BASE=/u01/app/oracle
GRID_HOME=/u01/app/11.2.0/grid
THIS_NODE='hostname -s'
 
E01=ORACLE_BASE=${ORACLE_BASE}
E02=ORACLE_HOME=${ORACLE_HOME}
E03=ORACLE_HOME_NAME=OraGridHome1
E04=INVENTORY_LOCATION=${ORACLE_BASE}/oraInventory
 
#C00="-O'-debug'"
C01="'-O\"CLUSTER_NODES={node1,node2}\"'"
C02="'-O\"LOCAL_NODE=${THIS_NODE}\"'"
 
perl ${GRID_HOME}/clone/bin/clone.pl -silent $E01 $E02 $E03 $E04 $C01 $C02

The start.sh script sets several environment variables and cloning parameters, as described in Table 3-2 and Table 3-3, respectively. Table 3-2 describes the environment variables E01, E02, E03, and E04 that are shown in bold typeface in Example 3-1.

Table 3-2 Environment Variables Passed to the clone.pl Script

Symbol	Variable	Description
E01	`ORACLE_BASE`	The location of the Oracle base directory.
`E02`	`ORACLE_HOME`	The location of the Oracle Grid Infrastructure home. This directory location must exist and must be owned by the Oracle operating system group: oinstall.
E03	`ORACLE_HOME_NAME`	The name of the Oracle Grid Infrastructure home. This is stored in the Oracle Inventory.
E04	`INVENTORY_LOCATION`	The location of the Oracle Inventory. This directory location must exist and must initially be owned by the Oracle operating system group: oinstall.
C01	`CLUSTER_NODES`	This list of short node names for the nodes in the cluster.
C02	`LOCAL_NODE`	The short name of the local node.

Step 4: Launch the Configuration Wizard

The Configuration Wizard helps you to prepare the crsconfig_params file, prompts you to run the root.sh script (which calls the rootcrs.pl script), relinks Oracle binaries, and runs cluster verifications.

Start the Configuration Wizard, as follows:

$ Oracle_home/crs/config/config.sh

Parameter Name and Value	Description
`SILENT=true`	OUI sets the value to true or false based on the mode of installation. true for silent install (`runInstaller -silent`) and false otherwise.
`ORACLE_OWNER=oracle`	OUI sets the value to login name of the installing user. Note: This parameter is not used on Windows.
`ORA_DBA_GROUP=oinstall`	OUI sets the value to active primary group of the installing user.
`ORA_ASM_GROUP=oinstall`	OUI sets the value to the OSASM group selected by you during the interview. For example, `asmadmin`.
`LANGUAGE_ID=AMERICAN_AMERICA.WE8ISO8859P1`	OUI sets the value to the `LANGUAGE_TERRITORY.CHARACTERSET` corresponding to the locale in which OUI is run.
`OLD_CRS_HOME=Grid_home`	OUI sets the path of the previously configured Grid home.
`CRFHOME=Oracle_home`	OUI sets the value to the Oracle home ("Software Location") entered during the grid installation interview.
`ORACLE_HOME=/u01/app/11.2.0/grid`	OUI sets the value to the Oracle home ("Software Location") entered during the grid installation interview.
`ORACLE_BASE=/u01/app/oracle`	OUI sets the value to the `ORACLE_BASE` ('Oracle Base') entered during interview of the grid installation. For example. `/u01/app/oracle`.
`JREDIR=/u01/app/11.2.0/grid/jdk/jre/`	Set to `$ORACLE_HOME/jdk/jre`.
`JLIBDIR=/u01/app/11.2.0/grid/jlib`	Set to `$ORACLE_HOME/jlib`.
`VNDR_CLUSTER=false`	Explicitly set.
`OCR_LOCATIONS=NO_VAL`	OUI sets the value for the OCR and mirror locations to a comma-delimited list of OCR and mirror location path names. If OCR and the voting disk are on Oracle ASM, then set it to `NO_VAL`.
`CLUSTER_NAME=rac-cluster`	OUI sets the value to cluster name you specify during interview.
`HOST_NAME_LIST=node1,node2`	OUI sets the value to a list of nodes you specify.
`NODE_NAME_LIST=node1,node2`	OUI sets the value to a list of nodes you specify.
`PRIVATE_NAME_LIST=`
`VOTING_DISKS=NO_VAL`	OUI sets the value for the voting disk and mirror locations to a comma-delimited list of voting disk location path names specified. If OCR and voting disk are on Oracle ASM, then set it to `NO_VAL`.
`TZ=time_zone`	This parameter contains the time zone ID of the installation user environment, such as `TZ=PST8PDT`.
`#VF_DISCOVERY_STRING=%s_vfdiscoverystring%`
`ASM_UPGRADE=false`	OUI sets the value to true if Oracle ASM is being upgraded in this session, otherwise false.
`ASM_SPFILE=`	Leave blank.
`ASM_DISK_GROUP=DATA`	OUI sets the value to the name specified by you during the interview for the disk group to store OCR and the voting disk. For example, `DATA`.
`ASM_DISCOVERY_STRING=/dev/sd1`	OUI sets the value to the disk discovery string specified by you during the interview for the disk group to store OCR and the voting disk. If disks are on default raw device locations, such as `/dev/raw/*` on Linux, then this is left empty.
`ASM_DISKS=/dev/sdb1,/dev/sdc1,/dev/sdd1,/dev/sde1,/dev/sdf1`	OUI sets the value to the disks selected by you during the interview for the disk group to store OCR and the voting disks. The disks that you specify should match the discovery pattern specified.
`ASM_REDUNDANCY=NORMAL`	OUI sets the value to the redundancy level specified by you during the interview for the disk group to store OCR and the voting disk.
`CRS_STORAGE_OPTION=1`	OUI sets the value to 1 for OCR and the voting disk on Oracle ASM and 2 for OCR and voting disk on a file system.
`CSS_LEASEDURATION=400`	Explicitly set.
`CRS_NODEVIPS='node1-vip/255.255.255.0/eth0,node2-vip/255.255.255.0/eth0'`	OUI sets the value to be the list of the VIPs that you specified. If you are using DHCP, then set this to `AUTO`. The format of the list of VIPs is `'{name` `\|` `ip}/netmask[/if1[\|if2\|...]]'`. Note: You must enclose the entire value for this parameter in single quotation marks (`''`). See Also: Oracle Real Application Clusters Administration and Deployment Guide for more information about this format
`NODELIST=node1,node2`	OUI sets the value to be the list of nodes that you specify.
`NETWORKS="eth0"/10.10.10.0:public,"eth1"/192.168.1.0:cluster_interconnect`	OUI sets the value to list of interface selections by the user format of each part: `"interface name"/Subnet/Type`, where `Type` is one of `public` or `cluster_interconnect`. Note: You must enclose interface names in double quotation marks (`""`).
`SCAN_NAME=rac-cluster-scan`	OUI sets the value to the SCAN Name specified by you.
`SCAN_PORT=1521`	OUI sets the value to port number for SCAN listener specified by you.
`GPNP_PA=`
`OCFS_CONFIG=`	OUI sets it to the list of partitions selected by you to be formatted to OCFS format, on Windows. Can be left empty for UNIX.
`GNS_CONF=false`	OUI sets the value to true if you have selected to enable GNS for this installation.
`GNS_ADDR_LIST=`	OUI sets the value to GNS virtual IP address specified by you.
`GNS_DOMAIN_LIST=`	OUI sets the value to GNS domain specified by you.
`GNS_ALLOW_NET_LIST=`
`GNS_DENY_NET_LIST=`
`GNS_DENY_ITF_LIST=`
`NEW_HOST_NAME_LIST=`
`NEW_NODE_NAME_LIST=`
`NEW_PRIVATE_NAME_LIST=`
`GPNPCONFIGDIR=$ORACLE_HOME`
`GPNPGCONFIGDIR=$ORACLE_HOME`
`OCRLOC=`
`OLRLOC=`
`OCRID=`
`CLUSTER_GUID=`
`CLSCFG_MISSCOUNT=`

Using Cloning to Add Nodes to a Cluster

You can also use cloning to add nodes to a cluster. Figure 6–2 shows the result of a cloning procedure in which the Oracle Grid Infrastructure home on Node 1 has been cloned to Node 2 in the same cluster, making it a two-node cluster. Newly added nodes to the cluster share the same OCR and voting disks.

Figure 3-2 Cloning to Add Nodes to a Cluster

Description of "Figure 3-2 Cloning to Add Nodes to a Cluster"

To add nodes to a cluster using cloning:

Prepare the new nodes as described in "Step 1: Prepare the New Cluster Nodes".
Deploy the Oracle Grid Infrastructure home on the nodes you want to add as described in "Step 2: Deploy the Oracle Grid Infrastructure Home on the Destination Nodes".

Run the clone.pl script on each node you add. The following example is for Linux or UNIX systems:

perl clone.pl ORACLE_HOME=Grid_home ORACLE_HOME_NAME=Grid_home_name
ORACLE_BASE=ORACLE_BASE SHOW_ROOTSH_CONFIRMATION=false

The following example is for Windows systems:

perl clone.pl ORACLE_BASE=ORACLE_BASE ORACLE_HOME=Grid_home ORACLE_HOME_name=Grid_home_name
'-O-noConfig' '-OPERFORM_PARTITION_TASKS=FALSE'

If you are prompted to run root.sh, then ignore the prompt and proceed to the next step.

In the Central Inventory directory on each destination node, run the orainstRoot.sh script as the operating system user that installed Oracle Clusterware. This script populates the /etc/oraInst.loc directory with the location of the central inventory. You can run the script on each node simultaneously. For example:
```
root@node1 root]# /opt/oracle/oraInventory/orainstRoot.sh
```
Run the addNode.sh script on the source node, as follows, where new_node is the name of the destination node and new_node-vip is the VIP address for the destination node:
```
$ addNode.sh -silent -noCopy ORACLE_HOME=$CRSHOME "CLUSTER_NEW_NODES={new_node}"
"CLUSTER_NEW_VIRTUAL_HOSTNAMES={new_node_vip}" "CLUSTER_NEW_VIPS={new_node_vip}"
CRS_ADDNODE=true CRS_DHCP_ENABLED=false
```
Note:
Because you already ran the clone.pl script on the destination node, this step only updates the inventories on the nodes and instantiates scripts on the local node.
Copy the Grid_home/crs/install/crsconfig_addparams and Grid_home/gpnp files from the node on which you ran addnode.sh to the destination node.
On each destination node, run the Grid_homegrid/root.sh script. Run this script first on the local and then, after the script completes, you can run it in parallel on the rest of the nodes in the cluster. The following example is for a Linux or UNIX system. On the first node, run the following command:
```
[root@node1 root]# /u01/app/11.2.0/grid/root.sh
```
Ensure that the root.sh script has completed on the first node before running it on subsequent nodes.

The root.sh script automatically configures the following node applications:
- Global Services Daemon (GSD)
- Oracle Notification Service (ONS)
- Virtual IP (VIP) resources in the Oracle Cluster Registry (OCR)
- Single Client Access Name (SCAN) VIPs and SCAN listeners
- Oracle ASM
Navigate to the Oracle_home/oui/bin directory on node1 and run the addNode.sh script using the following syntax:
```
$ ./addNode.sh -silent "CLUSTER_NEW_NODES={node3}"
```
Run the Oracle_home/root.sh script on node3 as root, where Oracle_home is the Oracle RAC home.
Run the Grid_home/crs/install/rootcrs.pl script on node3 as root, following the instructions generated when you ran root.sh in the previous step.
Run the following cluster verification utility (CVU) command:
```
$ cluvfy stage -post nodeadd -n node3 [-verbose]
```
See Also:
"cluvfy stage [-pre | -post] nodeadd" for more information about this CVU command

Locating and Viewing Log Files Generated During Cloning

The cloning script runs multiple tools, each of which can generate log files. After the clone.pl script finishes running, you can view log files to obtain more information about the status of your cloning procedures. Table 3-4 shows the log files that are generated during cloning that are the key log files for diagnostic purposes:

Table 3-4 Cloning Log Files and their Descriptions

Log File Name and Location	Description
`Central_Inventory/logs/cloneActions/timestamp.log`	Contains a detailed log of the actions that occur during the OUI part of the cloning.
`Central_Inventory/logs/oraInstall/timestamp.err`	Contains information about errors that occur when OUI is running.
`Central_Inventory/logs/oraInstall/timestamp.out`	Contains other miscellaneous information.

Table 3-5 describes how to find the location of the Oracle inventory directory.

Table 3-5 Finding the Location of the Oracle Inventory Directory

Type of System	Location of the Oracle Inventory Directory
All UNIX computers except Linux and IBM AIX	`/var/opt/oracle/oraInst.loc`
IBM AIX and Linux	`/etc/oraInst.loc` file