This deployment example demonstrates a working example of Oracle E-Business Suite 12.2.4 with technology stack (TXK) and Applications Database (AD) C.Delta.6 on Oracle Solaris Cluster 4.3.
This deployment example is based on the information available in the “Deployment Option with Single Web Entry Point and Multiple Managed Servers” section of the My Oracle Support (MOS) note, Using Load-Balancers with Oracle E-Business Suite Release 12.2 (Doc ID 1375686.1), with the modification that the Admin Server and its Node Manager are running on the Web Entry Point server.
The deployment example uses two Oracle Solaris Cluster nodes psmash1 and psmash2. There are also two zone clusters, zc1 and zc2, deployed across those two nodes. The respective zone nodes are vzsmash1 and vzsmash2 for zc1 and vzsmash1b and vzsmash2b for zc2. Oracle E-Business Suite 12.2.4 services are deployed as follows:
The Primary Applications Node, hosting the HTTP Server and WebLogic Admin Server, has been installed using logical host smash-6 which is deployed within zone cluster zc1 (vzsmash1 and vzsmash2).
Web Applications are deployed on Secondary Application Nodes within the global cluster (psmash1 and psmash2).
Concurrent Managers are deployed on Secondary Application Nodes within zone cluster zc2 (vzsmash1b and vzsmash2b).
The following Oracle Solaris Cluster resources have already been setup that include Oracle Grid Infrastructure for the Cluster, Oracle ASM, and Oracle RAC.
root@psmash1:~# clresource status
=== Cluster Resources ===
Resource Name Node Name State Status Message
------------- --------- ----- --------------
crs-fmwk-rs psmash2 Online Online
psmash1 Online Online
rac-fmwk-rs psmash2 Online Online
psmash1 Online Online
asm-inst-rs psmash2 Online Online - +ASM2 is UP and ENABLED
psmash1 Online Online - +ASM1 is UP and ENABLED
asm-dg-rs psmash2 Online Online - Mounted: DATA
psmash1 Online Online - Mounted: DATA
oep-rs psmash2 Online Online - Service VIS is UP [Instance is OPEN]
psmash1 Online Online - Service VIS is UP [Instance is OPEN]
root@psmash1:~#
The following Oracle Solaris Cluster Zone Clusters have been installed and configured with the Shared Application Tier File System (/global/ebs) and logical host (smash-6) on zc1.
root@psmash1:~# clzonecluster status
=== Zone Clusters ===
--- Zone Cluster Status ---
Name Brand Node Name Zone Host Name Status Zone Status
---- ----- --------- -------------- ------ -----------
zc1 solaris psmash1 vzsmash1 Online Running
psmash2 vzsmash2 Online Running
zc2 solaris psmash1 vzsmash1b Online Running
psmash2 vzsmash2b Online Running
root@psmash1:~#
root@psmash1:~# clzonecluster configure zc1
clzc:zc1> info fs
fs:
dir: /global/ebs
special: /global/ebs
raw not specified
type: lofs
options: []
cluster-control: true
clzc:zc1> info net
net:
address: smash-6
physical: auto
clzc:zc1> exit
root@psmash1:~#
root@psmash1:~# clzonecluster configure zc2
clzc:zc2> info fs
fs:
dir: /global/ebs
special: /global/ebs
raw not specified
type: lofs
options: []
cluster-control: true
clzc:zc2> info net
clzc:zc2> exit
root@psmash1:~#
Create a storage resource to manage the /global/ebs/VIS Shared Application File System. The following /etc/vfstab entry exists on psmash1 and psmash2 and mount points exist for /global/ebs on psmash1, psmash2, vzsmash1, vzsmash2, vzsmash1b and vzsmash2b.
/dev/md/dg1/dsk/d100 /dev/md/dg1/rdsk/d100 /global/ebs ufs 3 yes global,logging
root@psmash1:~# clresourcetype register SUNW.HAStoragePlus
root@psmash1:~# clresourcetype register -Z zc1 SUNW.HAStoragePlus
root@psmash1:~# clresourcetype register -Z zc2 SUNW.HAStoragePlus
root@psmash1:~#
root@psmash1:~# clresourcegroup create -S hasp-rg
root@psmash1:~#
root@psmash1:~# clresourcegroup create -S -Z zc1 \
-p RG_Affinities=++global:hasp-rg hasp-rg
root@psmash1:~#
root@psmash1:~# clresourcegroup create -S -Z zc2 \
-p RG_Affinities=++global:hasp-rg hasp-rg
root@psmash1:~#
root@psmash1:~# clresource create -g hasp-rg -t SUNW.HAStoragePlus \
-p FileSystemMountPoints=/global/ebs -d hasp-rs
root@psmash1:~#
root@psmash1:~# clresourcegroup online -eM hasp-rg
root@psmash1:~#
root@psmash1:~# clresource create -Z zc1 -g hasp-rg -t SUNW.HAStoragePlus \
-p FileSystemMountPoints=/global/ebs \
-p resource_dependencies_offline_restart=global:hasp-rs -d hasp-rs
root@psmash1:~#
root@psmash1:~# clresource create -Z zc2 -g hasp-rg -t SUNW.HAStoragePlus \
-p FileSystemMountPoints=/global/ebs \
-p resource_dependencies_offline_restart=global:hasp-rs -d hasp-rs
root@psmash1:~#
root@psmash1:~# clresourcegroup online -eM -Z zc1 hasp-rg
root@psmash1:~# clresourcegroup online -eM -Z zc2 hasp-rg
root@psmash1:~# clresource status -Z all -g hasp-rg
=== Cluster Resources ===
Resource Name Node Name State Status Message
------------- --------- ----- --------------
hasp-rs psmash2 Online Online
psmash1 Online Online
hasp-rs vzsmash2 Online Online
vzsmash1 Online Online
hasp-rs vzsmash2b Online Online
vzsmash1b Online Online
root@psmash1:~#
In subsequent steps, you will create resources of type ORCL.ebs. Once created, these resources will manage the start and stop of various Oracle E-Business Suite 12.2.4 services. However, before creating these resources, you must ensure that those services can be manually started and stopped.
On the Primary Applications Node (smash-6), manually start and stop the following services:
OPMN
Oracle HTTP Server
TNS Listener
Node Manager
WebLogic Admin Server
root@psmash1:~# zlogin zc1 [Connected to zone 'zc1' pts/6] ?Oracle Corporation SunOS 5.11 11.2 April 2015 You have new mail. root@vzsmash1:~# su - applvis Oracle Corporation SunOS 5.11 11.2 April 2015 You have new mail. -bash-4.1$ cd /global/ebs/VIS -bash-4.1$ -bash-4.1$ cat /global/ebs/VIS/fs2/inst/apps/VIS_smash-6/appl/admin/customVIS_smash-6.env export LD_PRELOAD_32=/usr/lib/secure/libschost.so.1 export LD_PRELOAD_64=/usr/lib/secure/64/libschost.so.1 export SC_LHOSTNAME=smash-6 -bash-4.1$ . /global/ebs/VIS/fs2/inst/apps/VIS_smash-6/appl/admin/customVIS_smash-6.env -bash-4.1$ uname -n smash-6 -bash-4.1$ -bash-4.1$ . EBSapps.env run E-Business Suite Environment Information ---------------------------------------- RUN File System : /global/ebs/VIS/fs2/EBSapps/appl PATCH File System : /global/ebs/VIS/fs1/EBSapps/appl Non-Editioned File System : /global/ebs/VIS/fs_ne DB Host: psmash1.us.oracle.com Service/SID: VIS Sourcing the RUN File System ... -bash-4.1$ cd $ADMIN_SCRIPTS_HOME -bash-4.1$ -bash-4.1$ ./adalnctl.sh start adalnctl.sh version 120.3.12020000.2 Checking for FNDFS executable. Starting listener process APPS_VIS. adalnctl.sh: exiting with status 0 adalnctl.sh: check the logfile \ /global/ebs/VIS/fs2/inst/apps/VIS_smash-6/logs/appl/admin/log/adalnctl.txt \ for more information ... -bash-4.1$ -bash-4.1$ ./adopmnctl.sh start You are running adopmnctl.sh version 120.0.12020000.2 Starting Oracle Process Manager (OPMN) ... adopmnctl.sh: exiting with status 0 adopmnctl.sh: check the logfile \ /global/ebs/VIS/fs2/inst/apps/VIS_smash-6/logs/appl/admin/log/adopmnctl.txt \ for more information ... -bash-4.1$ -bash-4.1$ ./adapcctl.sh start You are running adapcctl.sh version 120.0.12020000.6 Starting OPMN managed Oracle HTTP Server (OHS) instance ... adapcctl.sh: exiting with status 0 adapcctl.sh: check the logfile \ /global/ebs/VIS/fs2/inst/apps/VIS_smash-6/logs/appl/admin/log/adapcctl.txt for more information ... -bash-4.1$ -bash-4.1$ ./adnodemgrctl.sh start You are running adnodemgrctl.sh version 120.11.12020000.11 Enter the WebLogic Admin password: Starting the Node Manager... Refer /global/ebs/VIS/fs2/inst/apps/VIS_smash-6/logs/appl/admin/log/adnodemgrctl.txt for details adnodemgrctl.sh: exiting with status 0 adnodemgrctl.sh: check the logfile \ /global/ebs/VIS/fs2/inst/apps/VIS_smash-6/logs/appl/admin/log/adnodemgrctl.txt for more information ... -bash-4.1$ -bash-4.1$ ./adadminsrvctl.sh start You are running adadminsrvctl.sh version 120.10.12020000.9 Enter the WebLogic Admin password: Enter the APPS Schema password: Starting WLS Admin Server... Refer /global/ebs/VIS/fs2/inst/apps/VIS_smash-6/logs/appl/admin/log/adadminsrvctl.txt for details adadminsrvctl.sh: exiting with status 0 adadminsrvctl.sh: check the logfile \ /global/ebs/VIS/fs2/inst/apps/VIS_smash-6/logs/appl/admin/log/adadminsrvctl.txt for more information ... -bash-4.1$ -bash-4.1$ ./adadminsrvctl.sh stop You are running adadminsrvctl.sh version 120.10.12020000.9 Enter the WebLogic Admin password: Enter the APPS Schema password: Stopping WLS Admin Server... Refer /global/ebs/VIS/fs2/inst/apps/VIS_smash-6/logs/appl/admin/log/adadminsrvctl.txt for details adadminsrvctl.sh: exiting with status 0 adadminsrvctl.sh: check the logfile \ /global/ebs/VIS/fs2/inst/apps/VIS_smash-6/logs/appl/admin/log/adadminsrvctl.txt for more information ... -bash-4.1$ -bash-4.1$ ./adnodemgrctl.sh stop You are running adnodemgrctl.sh version 120.11.12020000.11 Enter the WebLogic Admin password: adnodemgrctl.sh: exiting with status 0 adnodemgrctl.sh: check the logfile \ /global/ebs/VIS/fs2/inst/apps/VIS_smash-6/logs/appl/admin/log/adnodemgrctl.txt for more information ... -bash-4.1$ -bash-4.1$ ./adapcctl.sh stop You are running adapcctl.sh version 120.0.12020000.6 Stopping OPMN managed Oracle HTTP Server (OHS) instance ... adapcctl.sh: exiting with status 0 adapcctl.sh: check the logfile \ /global/ebs/VIS/fs2/inst/apps/VIS_smash-6/logs/appl/admin/log/adapcctl.txt for more information ... -bash-4.1$ -bash-4.1$ ./adopmnctl.sh stop You are running adopmnctl.sh version 120.0.12020000.2 Stopping Oracle Process Manager (OPMN) and the managed processes ... adopmnctl.sh: exiting with status 0 adopmnctl.sh: check the logfile \ /global/ebs/VIS/fs2/inst/apps/VIS_smash-6/logs/appl/admin/log/adopmnctl.txt for more information ... -bash-4.1$ -bash-4.1$ ./adalnctl.sh stop adalnctl.sh version 120.3.12020000.2 Shutting down listener process APPS_VIS. adalnctl.sh: exiting with status 0 adalnctl.sh: check the logfile \ /global/ebs/VIS/fs2/inst/apps/VIS_smash-6/logs/appl/admin/log/adalnctl.txt for more information ... -bash-4.1$
On the Secondary Application Nodes (psmash1 and psmash2), manually start and stop the following services:
TNS Listener
Node Manager
Web Applications oacore
Web Applications oafm
Web Applications forms
Web Applications forms-c4ws
root@psmash1:~# su - applvis Oracle Corporation SunOS 5.11 11.2 April 2015 You have new mail. -bash-4.1$ cd /global/ebs/VIS -bash-4.1$ . EBSapps.env run E-Business Suite Environment Information ---------------------------------------- RUN File System : /global/ebs/VIS/fs2/EBSapps/appl PATCH File System : /global/ebs/VIS/fs1/EBSapps/appl Non-Editioned File System : /global/ebs/VIS/fs_ne DB Host: psmash1.us.oracle.com Service/SID: VIS Sourcing the RUN File System ... -bash-4.1$ cd $ADMIN_SCRIPTS_HOME -bash-4.1$ -bash-4.1$ ./adalnctl.sh start adalnctl.sh version 120.3.12020000.2 Checking for FNDFS executable. Starting listener process APPS_VIS. adalnctl.sh: exiting with status 0 adalnctl.sh: check the logfile \ /global/ebs/VIS/fs2/inst/apps/VIS_psmash1/logs/appl/admin/log/adalnctl.txt for more information ... -bash-4.1$ -bash-4.1$ ./adnodemgrctl.sh start You are running adnodemgrctl.sh version 120.11.12020000.11 Enter the WebLogic Admin password: Starting the Node Manager... Refer /global/ebs/VIS/fs2/inst/apps/VIS_psmash1/logs/appl/admin/log/adnodemgrctl.txt for details adnodemgrctl.sh: exiting with status 0 adnodemgrctl.sh: check the logfile \ /global/ebs/VIS/fs2/inst/apps/VIS_psmash1/logs/appl/admin/log/adnodemgrctl.txt for more information ... -bash-4.1$ -bash-4.1$ ./admanagedsrvctl.sh start oacore_server2 -msimode You are running admanagedsrvctl.sh version 120.14.12020000.10 Setting MS_INDEPENDENT_MODE to Y Enter the WebLogic Admin password: Calling txkChkEBSDependencies.pl to perform dependency checks for oacore_server2 *** ALL THE FOLLOWING FILES ARE REQUIRED FOR RESOLVING RUNTIME ERRORS *** Log File = \ /global/ebs/VIS/fs2/inst/apps/VIS_psmash1/logs/appl/rgf/TXK/txkChkEBSDependencies_Fri_Jun_5_07_34_45_2015/ \ txkChkEBSDependencies_Fri_Jun_5_07_34_45_2015.log Perl script txkChkEBSDependencies.pl got executed successfully Starting oacore_server2... admanagedsrvctl.sh: exiting with status 0 admanagedsrvctl.sh: check the logfile \ /global/ebs/VIS/fs2/inst/apps/VIS_psmash1/logs/appl/admin/log/adoacorectl.txt for more information ... -bash-4.1$ -bash-4.1$ ./admanagedsrvctl.sh start oafm_server2 -msimode You are running admanagedsrvctl.sh version 120.14.12020000.10 Setting MS_INDEPENDENT_MODE to Y Enter the WebLogic Admin password: Calling txkChkEBSDependencies.pl to perform dependency checks for oafm_server2 *** ALL THE FOLLOWING FILES ARE REQUIRED FOR RESOLVING RUNTIME ERRORS *** Log File = \ /global/ebs/VIS/fs2/inst/apps/VIS_psmash1/logs/appl/rgf/TXK/txkChkEBSDependencies_Fri_Jun_5_07_40_32_2015/ \ txkChkEBSDependencies_Fri_Jun_5_07_40_32_2015.log Perl script txkChkEBSDependencies.pl got executed successfully Starting oafm_server2... admanagedsrvctl.sh: exiting with status 0 admanagedsrvctl.sh: check the logfile \ /global/ebs/VIS/fs2/inst/apps/VIS_psmash1/logs/appl/admin/log/adoafmctl.txt for more information ... -bash-4.1$ -bash-4.1$ ./admanagedsrvctl.sh start forms_server2 -msimode You are running admanagedsrvctl.sh version 120.14.12020000.10 Setting MS_INDEPENDENT_MODE to Y Enter the WebLogic Admin password: Calling txkChkEBSDependencies.pl to perform dependency checks for forms_server2 *** ALL THE FOLLOWING FILES ARE REQUIRED FOR RESOLVING RUNTIME ERRORS *** Log File = \ /global/ebs/VIS/fs2/inst/apps/VIS_psmash1/logs/appl/rgf/TXK/txkChkEBSDependencies_Fri_Jun_5_07_43_24_2015/ \ txkChkEBSDependencies_Fri_Jun_5_07_43_24_2015.log Perl script txkChkEBSDependencies.pl got executed successfully Starting forms_server2... admanagedsrvctl.sh: exiting with status 0 admanagedsrvctl.sh: check the logfile /global/ebs/VIS/fs2/inst/apps/VIS_psmash1/logs/appl/admin/log/adformsctl.txt \ for more information ... -bash-4.1$ -bash-4.1$ ./admanagedsrvctl.sh start forms-c4ws_server2 -msimode You are running admanagedsrvctl.sh version 120.14.12020000.10 Setting MS_INDEPENDENT_MODE to Y Enter the WebLogic Admin password: Calling txkChkEBSDependencies.pl to perform dependency checks for forms-c4ws_server2 *** ALL THE FOLLOWING FILES ARE REQUIRED FOR RESOLVING RUNTIME ERRORS *** Log File = \ /global/ebs/VIS/fs2/inst/apps/VIS_psmash1/logs/appl/rgf/TXK/txkChkEBSDependencies_Fri_Jun_5_07_45_14_2015/ \ txkChkEBSDependencies_Fri_Jun_5_07_45_14_2015.log Perl script txkChkEBSDependencies.pl got executed successfully Starting forms-c4ws_server2... admanagedsrvctl.sh: exiting with status 0 admanagedsrvctl.sh: check the logfile /global/ebs/VIS/fs2/inst/apps/VIS_psmash1/logs/appl/admin/log/adforms-c4wsctl.txt \ for more information ... -bash-4.1$ -bash-4.1$ ./admanagedsrvctl.sh stop forms-c4ws_server2 -msimode You are running admanagedsrvctl.sh version 120.14.12020000.10 Setting MS_INDEPENDENT_MODE to Y Enter the WebLogic Admin password: Stopping forms-c4ws_server2... Refer /global/ebs/VIS/fs2/inst/apps/VIS_psmash1/logs/appl/admin/log/adforms-c4wsctl.txt for details admanagedsrvctl.sh: exiting with status 0 admanagedsrvctl.sh: check the logfile /global/ebs/VIS/fs2/inst/apps/VIS_psmash1/logs/appl/admin/log/adforms-c4wsctl.txt \ for more information ... -bash-4.1$ -bash-4.1$ ./admanagedsrvctl.sh stop forms_server2 -msimode You are running admanagedsrvctl.sh version 120.14.12020000.10 Setting MS_INDEPENDENT_MODE to Y Enter the WebLogic Admin password: Stopping forms_server2... Refer /global/ebs/VIS/fs2/inst/apps/VIS_psmash1/logs/appl/admin/log/adformsctl.txt for details admanagedsrvctl.sh: exiting with status 0 admanagedsrvctl.sh: check the logfile \ /global/ebs/VIS/fs2/inst/apps/VIS_psmash1/logs/appl/admin/log/adformsctl.txt for more information ... -bash-4.1$ -bash-4.1$ ./admanagedsrvctl.sh stop oafm_server2 -msimode You are running admanagedsrvctl.sh version 120.14.12020000.10 Setting MS_INDEPENDENT_MODE to Y Enter the WebLogic Admin password: Stopping oafm_server2... Refer /global/ebs/VIS/fs2/inst/apps/VIS_psmash1/logs/appl/admin/log/adoafmctl.txt for details admanagedsrvctl.sh: exiting with status 0 admanagedsrvctl.sh: check the logfile \ /global/ebs/VIS/fs2/inst/apps/VIS_psmash1/logs/appl/admin/log/adoafmctl.txt for more information ... -bash-4.1$ -bash-4.1$ ./admanagedsrvctl.sh stop oacore_server2 -msimode You are running admanagedsrvctl.sh version 120.14.12020000.10 Setting MS_INDEPENDENT_MODE to Y Enter the WebLogic Admin password: Stopping oacore_server2... Refer /global/ebs/VIS/fs2/inst/apps/VIS_psmash1/logs/appl/admin/log/adoacorectl.txt for details admanagedsrvctl.sh: exiting with status 0 admanagedsrvctl.sh: check the logfile \ /global/ebs/VIS/fs2/inst/apps/VIS_psmash1/logs/appl/admin/log/adoacorectl.txt for more information ... -bash-4.1$ -bash-4.1$ ./adnodemgrctl.sh stop You are running adnodemgrctl.sh version 120.11.12020000.11 Enter the WebLogic Admin password: adnodemgrctl.sh: exiting with status 0 adnodemgrctl.sh: check the logfile \ /global/ebs/VIS/fs2/inst/apps/VIS_psmash1/logs/appl/admin/log/adnodemgrctl.txt for more information ... -bash-4.1$ -bash-4.1$ ./adalnctl.sh stop adalnctl.sh version 120.3.12020000.2 Shutting down listener process APPS_VIS. adalnctl.sh: exiting with status 0 adalnctl.sh: check the logfile \ /global/ebs/VIS/fs2/inst/apps/VIS_psmash1/logs/appl/admin/log/adalnctl.txt for more information ... -bash-4.1$ Note - The following commands were executed on node psmash2. root@psmash2:~# su - applvis Oracle Corporation SunOS 5.11 11.2 April 2015 -bash-4.1$ cd /global/ebs/VIS -bash-4.1$ . EBSapps.env run E-Business Suite Environment Information ---------------------------------------- RUN File System : /global/ebs/VIS/fs2/EBSapps/appl PATCH File System : /global/ebs/VIS/fs1/EBSapps/appl Non-Editioned File System : /global/ebs/VIS/fs_ne DB Host: psmash2.us.oracle.com Service/SID: VIS Sourcing the RUN File System ... -bash-4.1$ cd $ADMIN_SCRIPTS_HOME -bash-4.1$ ./adalnctl.sh start adalnctl.sh version 120.3.12020000.2 Checking for FNDFS executable. Starting listener process APPS_VIS. adalnctl.sh: exiting with status 0 adalnctl.sh: check the logfile \ /global/ebs/VIS/fs2/inst/apps/VIS_psmash2/logs/appl/admin/log/adalnctl.txt for more information ... -bash-4.1$ -bash-4.1$ ./adnodemgrctl.sh start You are running adnodemgrctl.sh version 120.11.12020000.11 Enter the WebLogic Admin password: Starting the Node Manager... Refer /global/ebs/VIS/fs2/inst/apps/VIS_psmash2/logs/appl/admin/log/adnodemgrctl.txt for details adnodemgrctl.sh: exiting with status 0 adnodemgrctl.sh: check the logfile \ /global/ebs/VIS/fs2/inst/apps/VIS_psmash2/logs/appl/admin/log/adnodemgrctl.txt for more information ... -bash-4.1$ -bash-4.1$ ./admanagedsrvctl.sh start oacore_server3 -msimode You are running admanagedsrvctl.sh version 120.14.12020000.10 Setting MS_INDEPENDENT_MODE to Y Enter the WebLogic Admin password: Calling txkChkEBSDependencies.pl to perform dependency checks for oacore_server3 *** ALL THE FOLLOWING FILES ARE REQUIRED FOR RESOLVING RUNTIME ERRORS *** Log File = \ /global/ebs/VIS/fs2/inst/apps/VIS_psmash2/logs/appl/rgf/TXK/txkChkEBSDependencies_Fri_Jun_5_07_43_10_2015/ \ txkChkEBSDependencies_Fri_Jun_5_07_43_10_2015.log Perl script txkChkEBSDependencies.pl got executed successfully Starting oacore_server3... admanagedsrvctl.sh: exiting with status 0 admanagedsrvctl.sh: check the logfile \ /global/ebs/VIS/fs2/inst/apps/VIS_psmash2/logs/appl/admin/log/adoacorectl.txt for more information ... -bash-4.1$ -bash-4.1$ ./admanagedsrvctl.sh start oafm_server3 -msimode You are running admanagedsrvctl.sh version 120.14.12020000.10 Setting MS_INDEPENDENT_MODE to Y Enter the WebLogic Admin password: Calling txkChkEBSDependencies.pl to perform dependency checks for oafm_server3 *** ALL THE FOLLOWING FILES ARE REQUIRED FOR RESOLVING RUNTIME ERRORS *** Log File = \ /global/ebs/VIS/fs2/inst/apps/VIS_psmash2/logs/appl/rgf/TXK/txkChkEBSDependencies_Fri_Jun_5_07_48_50_2015/ \ txkChkEBSDependencies_Fri_Jun_5_07_48_50_2015.log Perl script txkChkEBSDependencies.pl got executed successfully Starting oafm_server3... admanagedsrvctl.sh: exiting with status 0 admanagedsrvctl.sh: check the logfile \ /global/ebs/VIS/fs2/inst/apps/VIS_psmash2/logs/appl/admin/log/adoafmctl.txt for more information ... -bash-4.1$ -bash-4.1$ ./admanagedsrvctl.sh start forms_server3 -msimode You are running admanagedsrvctl.sh version 120.14.12020000.10 Setting MS_INDEPENDENT_MODE to Y Enter the WebLogic Admin password: Calling txkChkEBSDependencies.pl to perform dependency checks for forms_server3 *** ALL THE FOLLOWING FILES ARE REQUIRED FOR RESOLVING RUNTIME ERRORS *** Log File = \ /global/ebs/VIS/fs2/inst/apps/VIS_psmash2/logs/appl/rgf/TXK/txkChkEBSDependencies_Fri_Jun_5_07_51_49_2015/ \ txkChkEBSDependencies_Fri_Jun_5_07_51_49_2015.log Perl script txkChkEBSDependencies.pl got executed successfully Starting forms_server3... admanagedsrvctl.sh: exiting with status 0 admanagedsrvctl.sh: check the logfile \ /global/ebs/VIS/fs2/inst/apps/VIS_psmash2/logs/appl/admin/log/adformsctl.txt for more information ... -bash-4.1$ ./admanagedsrvctl.sh start forms-c4ws_server3 -msimode You are running admanagedsrvctl.sh version 120.14.12020000.10 Setting MS_INDEPENDENT_MODE to Y Enter the WebLogic Admin password: Calling txkChkEBSDependencies.pl to perform dependency checks for forms-c4ws_server3 *** ALL THE FOLLOWING FILES ARE REQUIRED FOR RESOLVING RUNTIME ERRORS *** Log File = \ /global/ebs/VIS/fs2/inst/apps/VIS_psmash2/logs/appl/rgf/TXK/txkChkEBSDependencies_Fri_Jun_5_07_56_23_2015/ \ txkChkEBSDependencies_Fri_Jun_5_07_56_23_2015.log Perl script txkChkEBSDependencies.pl got executed successfully Starting forms-c4ws_server3... admanagedsrvctl.sh: exiting with status 0 admanagedsrvctl.sh: check the logfile \ /global/ebs/VIS/fs2/inst/apps/VIS_psmash2/logs/appl/admin/log/adforms-c4wsctl.txt for more information ... -bash-4.1$ -bash-4.1$ ./admanagedsrvctl.sh stop forms-c4ws_server3 -msimode You are running admanagedsrvctl.sh version 120.14.12020000.10 Setting MS_INDEPENDENT_MODE to Y Enter the WebLogic Admin password: Stopping forms-c4ws_server3... Refer /global/ebs/VIS/fs2/inst/apps/VIS_psmash2/logs/appl/admin/log/adforms-c4wsctl.txt for details admanagedsrvctl.sh: exiting with status 0 admanagedsrvctl.sh: check the logfile \ /global/ebs/VIS/fs2/inst/apps/VIS_psmash2/logs/appl/admin/log/adforms-c4wsctl.txt for more information ... -bash-4.1$ -bash-4.1$ ./admanagedsrvctl.sh stop forms_server3 -msimode You are running admanagedsrvctl.sh version 120.14.12020000.10 Setting MS_INDEPENDENT_MODE to Y Enter the WebLogic Admin password: Stopping forms_server3... Refer /global/ebs/VIS/fs2/inst/apps/VIS_psmash2/logs/appl/admin/log/adformsctl.txt for details admanagedsrvctl.sh: exiting with status 0 admanagedsrvctl.sh: check the logfile \ /global/ebs/VIS/fs2/inst/apps/VIS_psmash2/logs/appl/admin/log/adformsctl.txt for more information ... -bash-4.1$ -bash-4.1$ ./admanagedsrvctl.sh stop oafm_server3 -msimode You are running admanagedsrvctl.sh version 120.14.12020000.10 Setting MS_INDEPENDENT_MODE to Y Enter the WebLogic Admin password: Stopping oafm_server3... Refer /global/ebs/VIS/fs2/inst/apps/VIS_psmash2/logs/appl/admin/log/adoafmctl.txt for details admanagedsrvctl.sh: exiting with status 0 admanagedsrvctl.sh: check the logfile \ /global/ebs/VIS/fs2/inst/apps/VIS_psmash2/logs/appl/admin/log/adoafmctl.txt for more information ... -bash-4.1$ -bash-4.1$ ./admanagedsrvctl.sh stop oacore_server3 -msimode You are running admanagedsrvctl.sh version 120.14.12020000.10 Setting MS_INDEPENDENT_MODE to Y Enter the WebLogic Admin password: Stopping oacore_server3... Refer /global/ebs/VIS/fs2/inst/apps/VIS_psmash2/logs/appl/admin/log/adoacorectl.txt for details admanagedsrvctl.sh: exiting with status 0 admanagedsrvctl.sh: check the logfile \ /global/ebs/VIS/fs2/inst/apps/VIS_psmash2/logs/appl/admin/log/adoacorectl.txt for more information ... -bash-4.1$ -bash-4.1$ ./adnodemgrctl.sh stop You are running adnodemgrctl.sh version 120.11.12020000.11 Enter the WebLogic Admin password: adnodemgrctl.sh: exiting with status 0 adnodemgrctl.sh: check the logfile \ /global/ebs/VIS/fs2/inst/apps/VIS_psmash2/logs/appl/admin/log/adnodemgrctl.txt for more information ... -bash-4.1$ -bash-4.1$ ./adalnctl.sh stop adalnctl.sh version 120.3.12020000.2 Shutting down listener process APPS_VIS. adalnctl.sh: exiting with status 0 adalnctl.sh: check the logfile \ /global/ebs/VIS/fs2/inst/apps/VIS_psmash2/logs/appl/admin/log/adalnctl.txt for more information ... -bash-4.1$
On the Secondary Applications Nodes (vzsmash1b and vzsmash2b), manually start and stop the following services:
TNS Listener
Concurrent Manager
root@vzsmash1b:~# su - applvis Oracle Corporation SunOS 5.11 11.2 April 2015 -bash-4.1$ cd /global/ebs/VIS -bash-4.1$ . EBSapps.env run E-Business Suite Environment Information ---------------------------------------- RUN File System : /global/ebs/VIS/fs2/EBSapps/appl PATCH File System : /global/ebs/VIS/fs1/EBSapps/appl Non-Editioned File System : /global/ebs/VIS/fs_ne DB Host: psmash1.us.oracle.com Service/SID: VIS Sourcing the RUN File System ... -bash-4.1$ -bash-4.1$ cd $ADMIN_SCRIPTS_HOME -bash-4.1$ ./adalnctl.sh start adalnctl.sh version 120.3.12020000.2 Checking for FNDFS executable. Starting listener process APPS_VIS. adalnctl.sh: exiting with status 0 adalnctl.sh: check the logfile \ /global/ebs/VIS/fs2/inst/apps/VIS_vzsmash1b/logs/appl/admin/log/adalnctl.txt for more information ... -bash-4.1$ -bash-4.1$ ./adcmctl.sh start cp wait parameter passed with value: N You are running adcmctl.sh version 120.19.12020000.4 Enter the APPS username : apps Enter the APPS password : Starting concurrent manager for VIS ... Starting VIS_0612@VIS Internal Concurrent Manager Default printer is noprint adcmctl.sh: exiting with status 0 adcmctl.sh: check the logfile \ /global/ebs/VIS/fs2/inst/apps/VIS_vzsmash1b/logs/appl/admin/log/adcmctl.txt for more information ... -bash-4.1$ -bash-4.1$ ./adcmctl.sh abort cp wait parameter passed with value: N You are running adcmctl.sh version 120.19.12020000.4 Enter the APPS username : apps Enter the APPS password : Aborting concurrent managers for VIS ... ORACLE Password: Submitted request 7443008 for CONCURRENT FND ABORT adcmctl.sh: exiting with status 0 adcmctl.sh: check the logfile \ /global/ebs/VIS/fs2/inst/apps/VIS_vzsmash1b/logs/appl/admin/log/adcmctl.txt for more information ... -bash-4.1$ -bash-4.1$ ./adalnctl.sh stop adalnctl.sh version 120.3.12020000.2 Shutting down listener process APPS_VIS. adalnctl.sh: exiting with status 0 adalnctl.sh: check the logfile \ /global/ebs/VIS/fs2/inst/apps/VIS_vzsmash1b/logs/appl/admin/log/adalnctl.txt for more information ... -bash-4.1$ Note - The following commands were executed on the zone cluster node vzsmash2b. root@vzsmash2b:~# su - applvis Oracle Corporation SunOS 5.11 11.2 April 2015 -bash-4.1$ cd /global/ebs/VIS -bash-4.1$ . EBSapps.env run E-Business Suite Environment Information ---------------------------------------- RUN File System : /global/ebs/VIS/fs2/EBSapps/appl PATCH File System : /global/ebs/VIS/fs1/EBSapps/appl Non-Editioned File System : /global/ebs/VIS/fs_ne DB Host: psmash1.us.oracle.com Service/SID: VIS Sourcing the RUN File System ... -bash-4.1$ cd $ADMIN_SCRIPTS_HOME -bash-4.1$ ./adalnctl.sh start adalnctl.sh version 120.3.12020000.2 Checking for FNDFS executable. Starting listener process APPS_VIS. adalnctl.sh: exiting with status 0 adalnctl.sh: check the logfile \ /global/ebs/VIS/fs2/inst/apps/VIS_vzsmash2b/logs/appl/admin/log/adalnctl.txt for more information ... -bash-4.1$ -bash-4.1$ ./adcmctl.sh start cp wait parameter passed with value: N You are running adcmctl.sh version 120.19.12020000.4 Enter the APPS username : apps Enter the APPS password : Starting concurrent manager for VIS ... Starting VIS_0612@VIS Internal Concurrent Manager Default printer is noprint adcmctl.sh: exiting with status 0 adcmctl.sh: check the logfile \ /global/ebs/VIS/fs2/inst/apps/VIS_vzsmash2b/logs/appl/admin/log/adcmctl.txt for more information ... -bash-4.1$ -bash-4.1$ ./adcmctl.sh abort cp wait parameter passed with value: N You are running adcmctl.sh version 120.19.12020000.4 Enter the APPS username : apps Enter the APPS password : Aborting concurrent managers for VIS ... ORACLE Password: Submitted request 7443009 for CONCURRENT FND ABORT adcmctl.sh: exiting with status 0 adcmctl.sh: check the logfile \ /global/ebs/VIS/fs2/inst/apps/VIS_vzsmash2b/logs/appl/admin/log/adcmctl.txt for more information ... -bash-4.1$ -bash-4.1$ ./adalnctl.sh stop adalnctl.sh version 120.3.12020000.2 Shutting down listener process APPS_VIS. adalnctl.sh: exiting with status 0 adalnctl.sh: check the logfile \ /global/ebs/VIS/fs2/inst/apps/VIS_vzsmash2b/logs/appl/admin/log/adalnctl.txt for more information ... You have mail in /var/mail/applvis -bash-4.1$
Before creating resources of type ORCL.ebs you must create the following symbolic links so that the Primary Applications Node can be interposed with the logical hostname (smash-6).
root@psmash1:~# ln -s /usr/cluster/lib/libschost.so.1 /usr/lib/secure/libschost.so.1 root@psmash1:~# ln -s /usr/cluster/lib/sparcv9/libschost.so.1 /usr/lib/secure/64/libschost.so.1
The Oracle Solaris Cluster resources of type ORCL.ebs require the WebLogic Administrator and APPS user passwords. Hence, you will need to save those passwords within the Global Cluster and Zone Clusters.
root@psmash1:~# /usr/cluster/bin/clpstring create -b VIS -t resource VIS_APPS Enter string value: Enter string value again: root@psmash1:~# /usr/cluster/bin/clpstring create -b VIS -t resource VIS_WLS Enter string value: Enter string value again: root@psmash1:~# root@vzsmash1:~# /usr/cluster/bin/clpstring create -b VIS -t resource VIS_APPS Enter string value: Enter string value again: root@vzsmash1:~# /usr/cluster/bin/clpstring create -b VIS -t resource VIS_WLS Enter string value: Enter string value again: root@vzsmash1:~# root@vzsmash1b:~# /usr/cluster/bin/clpstring create -b VIS -t resource VIS_APPS Enter string value: Enter string value again: root@vzsmash1b:~# /usr/cluster/bin/clpstring create -b VIS -t resource VIS_WLS Enter string value: Enter string value again: root@vzsmash1b:~#
Register ORCL.ebs within the global cluster and zone clusters.
root@psmash1:~# clresourcetype register ORCL.ebs root@psmash1:~# clresourcetype register -Z zc1 ORCL.ebs root@psmash1:~# clresourcetype register -Z zc2 ORCL.ebs
The Primary Applications Node (smash-6) can failover between the Oracle Solaris Zone Cluster nodes (vzsmash1 and vzsmash2). To accomplish that, a failover resource group ebs-fo1-rg will be created with resources to manage the following services:
OPMN
Oracle HTTP Server
TNS Listener
Node Manager
WebLogic Admin Server
root@psmash1:~# zlogin zc1 [Connected to zone 'zc1' pts/3] Oracle Corporation SunOS 5.11 11.2 February 2015 You have new mail. root@vzsmash1:~# root@vzsmash1:~# clresourcegroup create ebs-fo1-rg root@vzsmash1:~# clreslogicalhostname create -g ebs-fo1-rg \ -h smash-6 ebs-fo1-lh-rs root@vzsmash1:~# clresource create -g ebs-fo1-rg \ -t ORCL.ebs \ -p base_dir=/global/ebs/VIS \ -p interpose_logical_hostname=smash-6 \ -p service_group=web_entry \ -p service=opmn \ -p pmf_managed=true \ -p resource_dependencies=ebs-fo1-lh-rs \ -p resource_dependencies_offline_restart=hasp-rs \ -d ebs-fo1-opmn-rs root@vzsmash1:~# root@vzsmash1:~# clresource create -g ebs-fo1-rg \ -t ORCL.ebs \ -p base_dir=/global/ebs/VIS \ -p interpose_logical_hostname=smash-6 \ -p service_group=web_entry \ -p service=ohs \ -p resource_dependencies=ebs-fo1-lh-rs,ebs-fo1-opmn-rs \ -p resource_dependencies_offline_restart=hasp-rs \ -d ebs-fo1-ohs-rs root@vzsmash1:~# root@vzsmash1:~# clresource create -g ebs-fo1-rg \ -t ORCL.ebs \ -p base_dir=/global/ebs/VIS \ -p interpose_logical_hostname=smash-6 \ -p service_group=web_admin \ -p service=tns_apps \ -p resource_dependencies_offline_restart=hasp-rs \ -p resource_dependencies=ebs-fo1-lh-rs \ -p pmf_managed=true \ -d ebs-fo1-tns-rs root@vzsmash1:~# root@vzsmash1:~# clresource create -g ebs-fo1-rg \ -t ORCL.ebs \ -p base_dir=/global/ebs/VIS \ -p interpose_logical_hostname=smash-6 \ -p service_group=root \ -p service=node_manager \ -p resource_dependencies_offline_restart=hasp-rs \ -p resource_dependencies=ebs-fo1-lh-rs \ -d ebs-fo1-nm-rs root@vzsmash1:~#
root@psmash1:~# clresource create -Z zc1 -g ebs-fo1-rg \
-t ORCL.ebs \
-p base_dir=/global/ebs/VIS \
-p interpose_logical_hostname=smash-6 \
-p service_group=web_admin \
-p service=admin_server \
-p resource_dependencies_offline_restart=hasp-rs \
-p resource_dependencies=ebs-fo1-lh-rs,ebs-fo1-tns-rs,ebs-fo1-nm-rs,global:oep-rs \
-d ebs-fo1-admin-rs
root@psmash1:~#
root@vzsmash1:~# clresourcegroup online -eM ebs-fo1-rg
root@vzsmash1:~# clresource status
=== Cluster Resources ===
Resource Name Node Name State Status Message
------------- --------- ----- --------------
hasp-rs vzsmash2 Online Online
vzsmash1 Online Online
ebs-fo1-admin-rs vzsmash2 Online Online - Service is online.
vzsmash1 Offline Offline
ebs-fo1-nm-rs vzsmash2 Online Online - Service is online.
vzsmash1 Offline Offline
ebs-fo1-tns-rs vzsmash2 Online Online - Service is online.
vzsmash1 Offline Offline
ebs-fo1-ohs-rs vzsmash2 Online Online - Service is online.
vzsmash1 Offline Offline
ebs-fo1-opmn-rs vzsmash2 Online Online - Service is online.
vzsmash1 Offline Offline
ebs-fo1-lh-rs vzsmash2 Online Online - LogicalHostname online.
vzsmash1 Offline Offline
root@vzsmash1:~#
Test a switch over to vzsmash1 of ebs-fo1-rg. From another terminal on either vzsmash1 or vzsmash2, you can issue the clresource status command to see the resources stopping and starting.
root@vzsmash1:~# clresourcegroup switch -n vzsmash1 ebs-fo1-rg
root@vzsmash1:~# clresource status
=== Cluster Resources ===
Resource Name Node Name State Status Message
------------- --------- ----- --------------
hasp-rs vzsmash2 Online Online
vzsmash1 Online Online
ebs-fo1-admin-rs vzsmash2 Offline Offline
vzsmash1 Online Online - Service is online.
ebs-fo1-nm-rs vzsmash2 Offline Offline
vzsmash1 Online Online - Service is online.
ebs-fo1-tns-rs vzsmash2 Offline Offline
vzsmash1 Online Online - Service is online.
ebs-fo1-ohs-rs vzsmash2 Offline Offline
vzsmash1 Online Online - Service is online.
ebs-fo1-opmn-rs vzsmash2 Offline Offline
vzsmash1 Online Online - Service is online.
ebs-fo1-lh-rs vzsmash2 Offline Offline - LogicalHostname offline.
vzsmash1 Online Online - LogicalHostname online.
root@vzsmash1:~#
Create a multi-master resource group on the Global Cluster nodes (psmash1 and psmash2) for the following resources:
TNS Listener
Node Manager
Web Applications oacore
Web Applications oafm
Web Applications forms
Web Applications forms-c4ws
root@psmash1:~# clresourcegroup create -S ebs-mm-rg
root@psmash1:~#
root@psmash1:~# clresource create -g ebs-mm-rg \
-t ORCL.ebs \
-p base_dir=/global/ebs/VIS \
-p service_group=web_applications \
-p service=tns_apps \
-p resource_dependencies_offline_restart=hasp-rs \
-p pmf_managed=true \
-d ebs-mm-tns-rs
root@psmash1:~#
root@psmash1:~# clresource create -g ebs-mm-rg \
-t ORCL.ebs \
-p base_dir=/global/ebs/VIS -p service_group=root \
-p service=node_manager \
-p resource_dependencies_offline_restart=hasp-rs \
-d ebs-mm-nm-rs
root@psmash1:~#
root@psmash1:~# clresource create -g ebs-mm-rg \
-t ORCL.ebs \
-p base_dir=/global/ebs/VIS \
-p service_group=web_applications \
-p service=oacore \
-p resource_dependencies=ebs-mm-tns-rs,ebs-mm-nm-rs,oep-rs \
-p resource_dependencies_offline_restart=hasp-rs \
-d ebs-mm-oacore-rs
root@psmash1:~#
root@psmash1:~# clresource create -g ebs-mm-rg \
-t ORCL.ebs \
-p base_dir=/global/ebs/VIS \
-p service_group=web_applications \
-p service=oafm \
-p resource_dependencies=ebs-mm-tns-rs,ebs-mm-nm-rs,oep-rs \
-p resource_dependencies_offline_restart=hasp-rs \
-d ebs-mm-oafm-rs
root@psmash1:~#
root@psmash1:~# clresource create -g ebs-mm-rg \
-t ORCL.ebs \
-p base_dir=/global/ebs/VIS \
-p service_group=web_applications \
-p service=forms \
-p resource_dependencies=ebs-mm-tns-rs,ebs-mm-nm-rs,oep-rs \
-p resource_dependencies_offline_restart=hasp-rs \
-d ebs-mm-forms-rs
root@psmash1:~#
root@psmash1:~# clresource create -g ebs-mm-rg \
-t ORCL.ebs \
-p base_dir=/global/ebs/VIS \
-p service_group=web_applications \
-p service=forms-c4ws \
-p resource_dependencies=ebs-mm-tns-rs,ebs-mm-nm-rs,oep-rs \
-p resource_dependencies_offline_restart=hasp-rs \
-d ebs-mm-forms-c4ws-rs
root@psmash1:~#
root@psmash1:~# clresourcegroup online -eM ebs-mm-rg
root@psmash1:~# clresource status -g ebs-mm-rg
=== Cluster Resources ===
Resource Name Node Name State Status Message
------------- --------- ----- --------------
ebs-mm-forms-c4ws-rs psmash2 Online Online - Service is online.
psmash1 Online Online - Service is online.
ebs-mm-forms-rs psmash2 Online Online - Service is online.
psmash1 Online Online - Service is online.
ebs-mm-oafm-rs psmash2 Online Online - Service is online.
psmash1 Online Online - Service is online.
ebs-mm-oacore-rs psmash2 Online Online - Service is online.
psmash1 Online Online - Service is online.
ebs-mm-nm-rs psmash2 Online Online - Service is online.
psmash1 Online Online - Service is online.
ebs-mm-tns-rs psmash2 Online Online - Service is online.
psmash1 Online Online - Service is online.
root@psmash1:~#
Create a multi-master resource group within the zone cluster zc2 (vzsmash1b and vzsmash2b) for the following resources:
TNS Listener
Concurrent Manager
root@vzsmash1b:~# clresourcegroup create -S ebs-mm-rg root@vzsmash1b:~# clresource create -g ebs-mm-rg -t ORCL.ebs \ -p base_dir=/global/ebs/VIS \ -p service_group=batch \ -p service=tns_apps \ -p resource_dependencies_offline_restart=hasp-rs \ -d ebs-mm-tns-rs root@vzsmash1b:~#
root@psmash1:~# clresource create -Z zc2 -g ebs-mm-rg -t ORCL.ebs \
-p base_dir=/global/ebs/VIS -p service_group=batch -p service=concmgr \
-p resource_dependencies=ebs-mm-tns-rs,global:oep-rs \
-p resource_dependencies_offline_restart=hasp-rs \
-d ebs-mm-concmgr-rs
root@psmash1:~#
root@vzsmash1b:~# clresourcegroup online -eM ebs-mm-rg
root@vzsmash1b:~# clresource status
=== Cluster Resources ===
Resource Name Node Name State Status Message
------------- --------- ----- --------------
hasp-rs vzsmash2b Online Online
vzsmash1b Online Online
ebs-mm-concmgr-rs vzsmash2b Online Online - Service is online.
vzsmash1b Online Online - Service is online.
ebs-mm-tns-rs vzsmash2b Online Online - Service is online.
vzsmash1b Online Online - Service is online.
root@vzsmash1b:~#