Skip Headers
Oracle® Enterprise Manager Cloud Control Advanced Installation and Configuration Guide
12c Release 1 (12.1.0.1)
Part Number E24089-15
Go to Documentation Home
Home		 Go to Book List
Book List		 Go to Table of Contents
Contents		 Go to Index
Index		 Go to Feedback page
Contact Us
Go to previous page
Previous		 Go to next page
Next
PDF · Mobi · ePub

E Troubleshooting

This appendix describes how to troubleshoot issues that you might encounter while working with Enterprise Manager Cloud Control.

Troubleshooting Configuration Assistant Failures

This section describes the log files you must review and the actions you must take when the following configuration assistants fail:

Plugins Prerequisites Check Configuration Assistant

Log Files

Review the following log files:

  • $<OMS_HOME>/cfgtoollogs/cfgfw/CfmLogger_<timestamp>.log

  • $<OMS_HOME>/cfgtoollogs/pluginca/configplugin_prereq_check_<timestamp>.log

Workaround Steps

Run the following command:

$<OMS_HOME>/oms/bin/pluginca -action prereqCheck -oracleHome <oms_home_path> -middlewareHome <middleware_home_path> -plugins <plugin_id>=<plugin_version>

Note:

For multiple plug-ins, separate the plug-in details with a comma. For example, -plugins <plugin_id>=<plugin_version>, <plugin_id>=<plugin_version>

Repository Configuration Assistant

Log Files

Review the following log files:

  • $<OMS_HOME>/cfgtoollogs/cfgfw/CfmLogger_<timestamp>.log

  • $<OMS_HOME>/sysman/log/schemamanager/m_<timestamp>/m_<timestamp>.<ACTION>/

Note:

<ACTION> refers to any of the schema actions, for example, CREATE, TRANSX, MY_ORACLE_SUPPORT, and so on.

Workaround Steps

Follow these steps:

  1. Resolve the cause of the issue.

  2. Clean up the Management Repository by running the following command:

    $<OMS_HOME>/sysman/admin/emdrep/bin/RepManager <repository_database_host> <repository_database_port> <repository_database_sid> -action dropall -dbUser <repository_database_user> -dbPassword <repository_database_password> -dbRole <repository_database_user_role> -mwHome <middleware_home> -mwOraHome <oms_oracle_home> -oracleHome <oms_oracle_home>

    Note:

    • For Microsoft Windows, invoke RepManager.bat.

    • RepManager 12.1 and 11.1 from the OMS home support -action dropall (drops SYSMAN as well as SYSMAN_MDS) and -action drop (drops only SYSMAN).

    • RepManager 10.2.0.5 supports -action drop (drops only SYSMAN).

    • The action dropall might not drop all the repository objects. For learn more about this issue and the workaround to be used, see My Oracle Support note 1365820.1.

  3. Rerun the configuration assistant.

    If you are installing in graphical mode, then return to the Enterprise Manager Cloud Control Installation Wizard and click Retry.

    If you accidentally exit the installer before clicking Retry, then do NOT restart the installer to reach the same screen; instead, invoke the runConfig.sh script (runConfig.bat on Microsoft Windows) from the OMS home:

    $<OMS_HOME>/oui/bin/runConfig.sh ORACLE_HOME=<oms_home_path> MODE=perform ACTION=configure COMPONENT_XML={encap_oms.1_0_0_0_0.xml}

    If you are installing in silent mode, then rerun the runConfig.sh script from the OMS home:

    $<OMS_HOME>/oui/bin/runConfig.sh ORACLE_HOME=<oms_home_path> MODE=perform ACTION=configure COMPONENT_XML={encap_oms.1_0_0_0_0.xml}

    Note:

    For Microsoft Windows, run runConfig.bat.

MDS Schema Configuration Assistant

Log Files

Review the following log file:

$<OMS_HOME>/cfgtoollogs/cfgfw/emmdscreate_<timestamp>.log

For more information, review the following log files:

  • <OMS_HOME>/sysman/log/schemamanager/m_<timestamp>/m_<timestamp>.CREATE/mds.log

  • $<OMS_HOME>/sysman/log/schemamanager/m_<timestamp>/m_<timestamp>.CREATE/rcu.log

Workaround Steps

Follow these steps:

  1. Drop the MDS schema by running the following command from the OMS home:

    $<OMS_HOME>/sysman/admin/emdrep/bin/mdsschemamanager.pl -action=-dropRepository -connectString=<database_connect_string> -dbUser= <database_user> -dbPassword=<database_password> -oracleHome=<OMS_oracle_home> -mwHome=<middleware_home>

    Where <database_connect_string> must be in the following format:<database_host>:<database_port>:<database_sid>

  2. Rerun the Configuration Assistant.

    If you are installing in graphical mode, then return to the Enterprise Manager Cloud Control Installation Wizard and click Retry.

    If you accidentally exit the installer before clicking Retry, then do NOT restart the installer to reach the same screen; instead, invoke the runConfig.sh script (runConfig.bat on Microsoft Windows) from OMS home:

    $<OMS_HOME>/oui/bin/runConfig.sh ORACLE_HOME=<oms_home_path> MODE=perform ACTION=configure COMPONENT_XML={encap_oms.1_0_0_0_0.xml}

    If you are installing in silent mode, then rerun the runConfig.sh script (runConfig.bat on Microsoft Windows) from the OMS home:

    $<OMS_HOME>/oui/bin/runConfig.sh ORACLE_HOME=<oms_home_path> MODE=perform ACTION=configure COMPONENT_XML={encap_oms.1_0_0_0_0.xml}

    Note:

    For Microsoft Windows, run runConfig.bat.

OMS Configuration Assistant

Log Files

Review the following log files:

  • If the installer fails BEFORE the OMS configuration assistant starts running, then review the following log file:

    $<OMS_HOME>/cfgtoollogs/cfgfw/CfmLogger_<timestamp>.log

  • If the installer fails AFTER the OMS configuration assistant starts running, then review the following log file:

    $<OMS_HOME>/cfgtoollogs/omsca/omsca_<timestamp>.log

Workaround Steps

Follow these steps:

  1. Check whether any Java processes are running from the middleware home. To do so, run the following command from the host where the OMS is running:

    ps -ef | grep java | grep <Oracle_Middleware_Home>

  2. Kill all the running processes, except for installer-related Java processes, by the running the following command. The installer-related Java processes run from the temp directory, so you can ignore the processes from that directory.

    kill -9 <process_id>

  3. Remove the Oracle Management Service Instance Base by running the following command:

    rm -rf <OMS_Instance_Home>

  4. Rerun the Configuration Assistant.

    If you are installing in graphical mode, then return to the Enterprise Manager Cloud Control Installation Wizard and click Retry.

    If you accidentally exit the installer before clicking Retry, then do NOT restart the installer to reach the same screen; instead, invoke the runConfig.sh script (runConfig.bat on Microsoft Windows) from the OMS home:

    $<OMS_HOME>/oui/bin/runConfig.sh ORACLE_HOME=<oms_home_path> MODE=perform ACTION=configure COMPONENT_XML={encap_oms.1_0_0_0_0.xml}

    If you are installing in silent mode, then rerun the runConfig.sh script (runConfig.bat on Microsoft Windows) from the OMS home:

    $<OMS_HOME>/oui/bin/runConfig.sh ORACLE_HOME=<oms_home_path> MODE=perform ACTION=configure COMPONENT_XML={encap_oms.1_0_0_0_0.xml}

    Note:

    For Microsoft Windows, run runConfig.bat.

Plugins Deployment and Configuration Configuration Assistant

Log Files

Review the following log files:

  • $<OMS_HOME>/cfgtoollogs/cfgfw/CfmLogger_<timestamp>.log

  • $<OMS_HOME>/cfgtoollogs/pluginca/configplugin_deploy_<timestamp>.log

Workaround Steps

Run the following command:

$<OMS_HOME>/oms/bin/pluginca -action deploy -oracleHome <oms_home_path> -middlewareHome <middleware_home_path> -plugins <plugin_id>=<plugin_version>

Note:

For multiple plug-ins, separate the plug-in details with a comma. For example, -plugins <plugin_id>=<plugin_version>, <plugin_id>=<plugin_version>

Start Oracle Management Service Configuration Assistant

Log Files

Review the following log file:

$<OMS_HOME>/cfgtoollogs/cfgfw/CfmLogger_<timestamp>.log

Workaround Steps

Run the following command:

$<OMS_HOME>/bin/emctl start oms

Plugins Inventory Migration Configuration Assistant

Log Files

Review the following log file:

$<OMS_HOME>/cfgtoollogs/cfgfw/CfmLogger_<timestamp>.log

Workaround Steps

Follow these steps:

  1. Resolve the cause of the issue.

  2. Rerun the configuration assistant.

    If you are installing in graphical mode, then return to the Enterprise Manager Cloud Control Installation Wizard and click Retry.

    If you accidentally exit the installer before clicking Retry, then do NOT restart the installer to reach the same screen; instead, invoke the runConfig.sh script (runConfig.bat on Microsoft Windows) from the OMS home:

    $<OMS_HOME>/oui/bin/runConfig.sh ORACLE_HOME=<oms_home_path> MODE=perform ACTION=configure COMPONENT_XML={encap_oms.1_0_0_0_0.xml}

    If you are installing in silent mode, then rerun the runConfig.sh script from the OMS home:

    $<OMS_HOME>/oui/bin/runConfig.sh ORACLE_HOME=<oms_home_path> MODE=perform ACTION=configure COMPONENT_XML={encap_oms.1_0_0_0_0.xml}

    Note:

    For Microsoft Windows, run runConfig.bat.

Oracle Configuration Manager Repeater Configuration Assistant

Log Files

Review the following log file:

$<OMS_HOME>/cfgtoollogs/cfgfw/CfmLogger_<timestamp>.log

Workaround Steps

Follow these steps:

  1. Resolve the cause of the issue.

  2. Rerun the configuration assistant.

    If you are installing in graphical mode, then return to the Enterprise Manager Cloud Control Installation Wizard and click Retry.

    If you accidentally exit the installer before clicking Retry, then do NOT restart the installer to reach the same screen; instead, invoke the runConfig.sh script (runConfig.bat on Microsoft Windows) from the OMS home:

    $<OMS_HOME>/oui/bin/runConfig.sh ORACLE_HOME=<oms_home_path> MODE=perform ACTION=configure COMPONENT_XML={encap_oms.1_0_0_0_0.xml}

    If you are installing in silent mode, then rerun the runConfig.sh script (runConfig.bat on Microsoft Windows) from the OMS home:

    $<OMS_HOME>/oui/bin/runConfig.sh ORACLE_HOME=<oms_home_path> MODE=perform ACTION=configure COMPONENT_XML={encap_oms.1_0_0_0_0.xml}

    Note:

    For Microsoft Windows, run runConfig.bat.

OCM Configuration for OMS Configuration Assistant

Log Files

Review the following log file:

$<OMS_HOME>/cfgtoollogs/cfgfw/CfmLogger_<timestamp>.log

Workaround Steps

Follow these steps:

  1. Resolve the cause of the issue.

  2. Rerun the configuration assistant.

    If you are installing in graphical mode, then return to the Enterprise Manager Cloud Control Installation Wizard and click Retry.

    If you accidentally exit the installer before clicking Retry, then do NOT restart the installer to reach the same screen; instead, invoke the runConfig.sh script (runConfig.bat on Microsoft Windows) from the OMS home:

    $<OMS_HOME>/oui/bin/runConfig.sh ORACLE_HOME=<oms_home_path> MODE=perform ACTION=configure COMPONENT_XML={encap_oms.1_0_0_0_0.xml}

    If you are installing in silent mode, then rerun the runConfig.sh script (runConfig.bat on Microsoft Windows) from the OMS home:

    $<OMS_HOME>/oui/bin/runConfig.sh ORACLE_HOME=<oms_home_path> MODE=perform ACTION=configure COMPONENT_XML={encap_oms.1_0_0_0_0.xml}

    Note:

    For Microsoft Windows, run runConfig.bat.

Agent Configuration Assistant

Log Files

Review the following log files:

  • $<AGENT_HOME>/cfgtoollogs/cfgfw/CfmLogger_<timestamp>.log

  • If secure fails, then review the following log file:

    $<AGENT_HOME>/sysman/log/secure.log

  • In the log file, search for the following statement:

    SEVERE:Plugin configuration has failed.

    If you find this statement, then review the following log file:

    $<AGENT_INSTANCE_HOME>/install/logs/agentplugindeploy_<timestamp>.log

Workaround Steps

Follow these steps:

  1. Resolve the cause of the issue.

  2. Rerun the configuration assistant.

    If you are installing in graphical mode, then return to the Enterprise Manager Cloud Control Installation Wizard and click Retry.

    If you accidentally exit the installer before clicking Retry, then do NOT restart the installer to reach the same screen; instead, invoke the runConfig.sh script (runConfig.bat on Microsoft Windows) from the OMS home:

    $<AGENT_HOME>/oui/bin/runConfig.sh ORACLE_HOME=<agent_home_path> MODE=perform ACTION=configure COMPONENT_XML={encap_oms.1_0_0_0_0.xml}

    Note:

    For Microsoft Windows, run runConfig.bat.

    If you are installing in silent mode, then run the following command from the Management Agent home:

    $<AGENT_HOME>/sysman/install/agentDeploy.sh OMS_HOST=<oms_host_name> EM_UPLOAD_PORT=<oms_upload_https_port> AGENT_REGISTRATION_PASSWORD=<agent_reg_password>

    Note:

    Enter the HTTPS port (secure port) for the EM_UPLOAD_PORT argument.

Agent Upgrade Configuration Assistant

Log Files

If the agent upgrade configuration assistant fails, then review the following log file:

$<AGENT_HOME>/cfgtoollogs/cfgfw/CfmLogger_<timestamp>.log

Workaround Steps

Resolve the cause of the issue, and rerun the configuration assistant from the Jobs page of the Enterprise Manager Cloud Control console.

Note:

The Jobs page referred to here is the page within the earlier release of the Enterprise Manager Cloud Control console.

Repository Upgrade Configuration Assistant

Log Files

Review the following log files:

$<OMS_HOME>/cfgtoollogs/cfgfw/emmdscreate_<timestamp>.log

$<OMS_HOME>/sysman/log/schemamanager/m_<timestamp>/m_<timestamp>.<ACTION>/

Note:

(<ACTION> refers to any of the schema actions, for example, PREUPGRADE, UPGRADE, TRANSX, and so on.)

Workaround Steps

Follow these steps:

  1. Resolve the cause of the issue.

  2. Rerun the configuration assistant.

    If you are installing in graphical mode, then return to the Enterprise Manager Cloud Control Installation Wizard and click Retry.

    If you accidentally exit the installer before clicking Retry, then do NOT restart the installer to reach the same screen; instead, invoke the runConfig.sh script (runConfig.bat on Microsoft Windows) from the OMS home:

    $<OMS_HOME>/oui/bin/runConfig.sh ORACLE_HOME=<oms_home_path> MODE=perform ACTION=configure COMPONENT_XML={encap_oms.1_0_0_0_0.xml}

    If you are installing in silent mode, then rerun the runConfig.sh script (runConfig.bat on Microsoft Windows) from the OMS home:

    $<OMS_HOME>/oui/bin/runConfig.sh ORACLE_HOME=<oms_home_path> MODE=perform ACTION=configure COMPONENT_XML={encap_oms.1_0_0_0_0.xml}

    Note:

    For Microsoft Windows, run runConfig.bat.

Troubleshooting ADP and JVMD Failures

This section discribes how to troubleshoot the errors encountered while deploying ADP/JVMD Managers, and ADP/JVMD Agents:

ADP Manager Name Conflict

Error Message

When you deploy ADP Manager to an existing managed server whose instance (for example: EMGC_ADPMANAGER2) has not been completely removed, then the new deployment of ADP manager with the same name fails on the unzip step with the following error:

@ Are you sure you haven't deployed adp manager to a managed server with name  
@ <ADP_managed_server> already?

Workaround Steps

To remove the existing managed server completely, perform the following steps:

  1. Follow the steps listed in Chapter 19 to remove the ADP Manager application and the managed server to which the ADP application is deployed.

  2. Connect to the host machine where the managed server was present, and navigate to the following location to manually delete the managed server (EMGC_ADPMANAGER2):

    $DOMAIN_HOME/<ADP_managed_server>

Where, $DOMAIN_HOME is the location of the Cloud Control domain

Failure to Deploy ADP Agent On a Target

Error Message

While deploying the ADP Agent, the deployment job may fail on the Deploy ADP Agent On Target step, with the following error:

Failed to connect to https://<host>:<port>/HttpDeployer/HttpDeployerServlet

Also, if you check the output of the Deploy HttpDeployer OnTarget (the previous step), then you will see a message as follows:

Operation is pending and will be activated or cancelled when the ongoing edit session is activated or cancelled.

Workaround Steps

To correct this error, perform the following steps:

  1. Log into WebLogic Administration Console of the domain where the ADP Agent was to be deployed.

  2. On the Administration home page, click Save Changes or Discard Changes, and start deploying the ADP agent afresh.

SSL Handshake Failure Agent Deployment Errors

Error Message

If the WebLogic Domain is SSL enabled using a demo certificate, then the agent deployment may fail due to an SSL Handshake Failure. The following error normally occurs because the demo certificate is not present in AgentTrust.jks:

Certificate chain received from myhost.acme.com - 123.34.11.11 was not trusted causing SSL handshake failure. Check the certificate chain to determine if it should be trusted or not. If it should be trusted, then update the client trusted CA configuration to trust the CA certificate that signed the peer certificate chain. If you are connecting to a WLS server that is using demo certificates (the default WLS server behavior), and you want this client to trust demo certificates, then specify -Dweblogic.security.TrustKeyStore=DemoTrust on the command line for this client.

Note: If the WebLogic Domain is using a production certificate, then this issue will not occur as AgentTrust.jks has trusted certificates from all well known CA's.

Workaround Steps

To correct the error, import WebLogic demo certificate to Management Agent keystore as follows:

  1. Export WebLogic Demo certificate from cacerts file. This file is present under the WebLogic home of the Middleware installation at the following location:

    keytool -export -keystore $WEBLOGIC_HOME/server/lib/cacerts -alias certgencab -file mycert.cer

    Press Enter when prompted for a password.

  2. Import WebLogic Demo certificate to TrustStore of Oracle Management Agent as follows:

    keytool -import -keystore $ORACLE_HOME/core/12.1.0.0.0/stage/sysman/config/montrust/AgentTrust.jks -alias wlscertgencab -file mycert.cer

    Enter the password welcome when prompted, and press Enter.

To check if the certificate has been imported correctly, run the following command:

keytool -list -keystore $ORACLE_HOME/core/12.1.0.0.0/stage/sysman/config/montrust/AgentTrust.jks

Where, $ORACLE_HOME is Oracle Management Agent home.

Press Enter when prompted for password, a certificate with the name wlscertgencab is generated with the current date.

Copying ADP Agent Zip or Javadiagnosticagent Ear Step Failure

Error Message

If the users who installed the OMS, and the Management Agent are not in the same group, then the job fail on Copying ADP Agent Zip step for an ADP agent, and Copy Javadiagnosticagent Ear step for a JVMD agent, with the following error:

oracle.sysman.emSDK.emd.comm.RemoteOperationException: Error while streaming
JobReader:java.io.IOException: Broken pipe

Workaround Steps

To correct the error, either install the Enterprise Manager Agent using OMS host user credentials.

OR

Enable sudo or Powerbroker settings for the agent host, so that the job runs as if run by an OMS host user.

To set the sudo, or Powerbroker settings, do the following:

  1. In Cloud Control, from the Setup menu, select Security, and then click Privilege Deligation.

  2. On the Manage Privilege Delegation Settings page, do the following:

    1. Select the Sudo or PowerBroker from the type menu.

    2. Enter the host name, or alternatively select the name from the list of host targets. Ensure that the host selected corresponds to the EM Agent; this agent must be the one monitoring the WebLogic Domain where the ADP/JVMD agents have to be deployed.

    3. Click Go.

Troubleshooting Deinstallation Failures

While deinstalling the Shared Agent as described in Deinstalling Shared Agent, you might see the following error:

SEVERE:The home <AGENT_HOME> cannot be deinstalled. Please deinstall all referenced home(s) <REFERENCE_HOME>

For example,

SEVERE:The home /tmp/agt_install/core/12.1.0.1.0 cannot be deinstalled. Please deinstall all referenced home(s) /tmp/agt_install/plugins

If you see the error, then deinstall the Shared Agent following these steps:

  1. Identify the dependent plug-ins and the sbin home to be detached from the Central Inventory:

    1. On the host where the Shared Agent is installed, open the following file from the Central Inventory:

      <absolute_path>/oraInventory/ContentsXML/inventory.xml

    2. Make a note of the dependent plug-ins listed within the <REFHOMELIST> and </REFHOMELIST> tags.

      For example,

      <HOME NAME="nfs5515" LOC="/home/john/software/oracle/agent/core/12.1.0.0.0" TYPE="O" IDX="1">
<REFHOMELIST>
<REFHOME LOC="/home/john/software/oracle/agent/plugins/oracle.sysman.oh.discovery.plugin_12.1.0.0.0"/>
<REFHOME LOC="/home/john/software/oracle/agent/plugins/oracle.sysman.db.discovery.plugin_12.1.0.0.0"/>
<REFHOME LOC="/home/john/software/oracle/agent/plugins/oracle.sysman.emas.discovery.plugin_12.1.0.0.0"/>
<REFHOME LOC="/home/john/software/oracle/agent/plugins/oracle.sysman.oh.agent.plugin_12.1.0.0.0"/>
</REFHOMELIST>
</HOME>

    3. Make a note of the sbin directory listed within the <REFHOMELIST> and </REFHOMELIST> tags.

      For example,

      <HOME NAME="nfs5515" LOC="/home/john/software/oracle/agent/core/12.1.0.0.0" TYPE="O" IDX="1">
<REFHOMELIST>
<REFHOME LOC="home/john/software/oracle/agent/sbin"/>
</REFHOMELIST>

    4. Detach the dependent plug-ins you identified in Step 1 (b) from the Central Inventory. To do so, run the following command from the Master Agent home that is visible on the host where your Shared Agent is installed:

      $<AGENT_HOME>/oui/bin/runInstaller -detachHome -silent -waitForCompletion -invPtrLoc <absolute_path>/oraInst.loc ORACLE_HOME=<plug-in_home> -nogenerateGUID

      For example,

      /home/john/software/oracle/agent/core/12.1.0.1.0/oui/bin/runInstaller -detachHome -silent -waitForCompletion -invPtrLoc /home/john/software/oracle/agent/core/12.1.0.1.0/oraInst.loc ORACLE_HOME=/home/john/software/oracle/agent/plugins/oracle.sysman.emas.discovery.plugin_12.1.0.1.0 -nogenerateGUID

      Note:

      This step detaches only one plug-in at a time. Therefore, if you have multiple plug-ins, repeat this step to detach every other dependent plug-in.

    5. Detach the sbin home you identified in Step 1 (c) from the Central Inventory. To do so, run the following command from the Master Agent home that is visible on the host where your Shared Agent is installed:

      $<AGENT_HOME>/oui/bin/runInstaller -detachHome -silent -waitForCompletion -invPtrLoc <absolute_path>/oraInst.loc ORACLE_HOME=<sbin_home> -nogenerateGUID

      For example,

      /home/john/software/oracle/agent/core/12.1.0.1.0/oui/bin/runInstaller -detachHome -silent -waitForCompletion -invPtrLoc /home/john/software/oracle/agent/core/12.1.0.1.0/oraInst.loc ORACLE_HOME=/home/john/software/oracle/agent/sbin -nogenerateGUID

  2. Deinstall the Shared Agent. To do so, run the following command from the Master Agent home that is visible on the host where your Shared Agent is installed:

    $<AGENT_HOME>/perl/bin/perl <AGENT_HOME>/sysman/install/NFSAgentDeInstall.pl AGENT_INSTANCE_HOME=<absolute_path_to_agent_instance_home> ORACLE_HOME=<absolute_path_to_agent_home>

    For example,

    /home/john/software/oracle/agent/core/12.1.0.1.0/perl/bin/perl /home/john/software/oracle/agent/core/12.1.0.1.0/sysman/install/NFSAgentDeInstall.pl AGENT_INSTANCE_HOME=/home/john/software/oracle/agent/agent_inst ORACLE_HOME=/home/john/software/oracle/agent/core/12.1.0.1.0

Go to previous page
Previous		 Go to next page
Next
Go to Documentation Home
Home		 Go to Book List
Book List		 Go to Table of Contents
Contents		 Go to Index
Index		 Go to Feedback page
Contact Us