test

Sun Java Enterprise System 2005Q4 Installation Guide for UNIX

Chapter 9 Troubleshooting

This chapter provides suggestions on how to resolve Sun JavaTM Enterprise System (Java ES) installation and uninstallation problems.

This chapter includes the following sections:

Troubleshooting Techniques

This section provides general guidelines for analyzing and identifying the source of problems during installation and uninstallation of Java ES.

This section contains the following subsections:

Examine Installation Log Files

If a problem occurs during installation or uninstallation, check the appropriate log file in the logs directory:

Solaris OS: /var/sadm/install/logsLinux: /var/opt/sun/install/logs

Examining the uninstall and installer log files (along with the Java ES configuration log and component logs) can help locate the source of problems. For example, you can compare the packages listed in the installation log to the packages listed in the uninstallation log.

Most logs have two versions:

The following table lists the formats of the log files.

Table 9–1 Java ES Log File Name Formats

Logged Entity 

Log File Name Format 

Installer: components 

Java_Enterprise_System_install.Atimestamp

Java_Enterprise_System_install.Btimestamp

Java_Enterprise_System_Config_Log.id

uninstaller 

Java_Enterprise_System_uninstall.Atimestamp

Java_Enterprise_System_uninstall.Btimestamp

Java_Enterprise_System_Config_Log.id

Installation summary 

Java_Enterprise_System_Summary_Report_install. timestamp

JavaES_Config_log.timestamp

JavaES_PanelFlow_log.timestamp

JavaES_MasterLog_log.timestamp

Java_Enterprise_System_Summary_Report_ uninstall. timestamp

To use the log files for troubleshooting, attempt to isolate the first problem that occurred. Often, the first problem leads to successive problems.

ProcedureTo Use Log Files for Troubleshooting

The log files can give you clues that determine your next steps, such as these:

Steps

  1. Review the installation summary file, which provides a high-level description of what was installed and configured.

    If a problem occurred, see what component caused the problem. If multiple problems occurred, isolate the first.

  2. Review the detailed log files.

    1. Look for the first error or warning that occurred and attempt to resolve it. Sometimes resolving one error resolves a number of seemingly unrelated errors that follow.

    2. Find the name of the component or package that caused the problem.

Examine Component Log Files

If a problem occurs starting a component, examine its log files. Locations of many component log files are listed in Component Troubleshooting Tips.

Verify Product Dependencies

A number of components have installation-time interdependencies. Problems that affect one component can affect other components. First, you should familiarize yourself with the information in Sun Java Enterprise System 2005Q4 Installation Planning Guide

In addition to component interdependencies, some components depend on the existence of Solaris packages that might not be installed on the host, and their absence could cause installation failures. Read the “Software Requirements” section of the Release Notes for details.

Check Resources and Settings

The following host-level issues can cause installation problems.

Check Postinstallation Configuration

If you are having problems starting components, verify that the procedures outlined in Chapter 6, Configuring Components After Installation were done correctly.

Check the Distribution Media

If you are installing from a DVD or CD, examine the media for dirt or damage. Dirty discs can result in installation problems.

Check Directory Server Connectivity

If you are installing a component that relies on Directory Server, problems can be caused by one of these problems:

Remove Web Server Files and Directory

To prevent the overwriting of customized files, such as edited configuration files, Web Server cannot be installed into a directory that contains files.

If you are reinstalling Web Server, check the installation directories to ensure that they are empty. If they are not empty, archive the files elsewhere and retry the installation.

Verify Passwords

The installer requires that you enter a number of passwords for components. If you are installing different components on different hosts, it is important to ensure that you supply matching passwords on each host.

To resolve password problems, you might need to uninstall and then reinstall. If the uninstall fails, refer to Installation Fails Due to Leftover Files During Uninstallation.

Examine the Installed or Uninstalled Components

If you have installed components but are having problems and cannot reinstall or uninstall, check the packages installed using the Solaris pkginfo or the Linux rpm command. Compare the results with the Java ES packages listed in Chapter 5, List of Installable Packages, in Sun Java Enterprise System 2005Q4 Installation Reference uninstalled. Additional information is in Installation Fails Due to Leftover Files During Uninstallation.

Tip –

On Solaris 9 and Solaris 10, you can also use the prodreg tool which provides a graphical interface to the product registry that indexes both components and their packages, superseding the pkg utilities. To invoke prodreg, type the command name at the command line. For more information, refer to the prodreg(1) man page.

Verify Administrator Access

During uninstallation, you might need to grant administrator access to the uninstaller, as described in Granting Administrator Access for the Uninstaller.

Installation Problems

This section addresses the following problems you might encounter during installation.

Installation Fails Due to Leftover Files During Uninstallation

Uninstallation can leave behind components or packages. In such a case, you must manually remove the components or packages before you reinstall Java ES. You might discover this problem in the following ways:

ProcedureTo Clean up a Partial Installation

Steps

  1. Use the following command to determine whether any packages were partially installed.

    For Solaris OS:


    pkginfo -p

    For Linux:


    rpm -qa |grep sun | xargs rpm -V

    The command output lists any partially installed packages. Using the package names returned, refer to Chapter 5, List of Installable Packages, in Sun Java Enterprise System 2005Q4 Installation Reference to discover what component the packages belong to.

  2. Remove components or packages.

    • On Solaris 9 or 10, use the prodreg tool.

      The prodreg tool manages the package-based components on your host. You can view components and their packages, with full information, including interdependencies. You can use the prodreg tool to safely uninstall components and remove packages. Once you have removed a component with the prodreg tool, you can reinstall.

      • On Solaris 8, use the pkgrm command.

        The pkgrm command requires that you remove components one package at a time. This command does not update the product registry. Depending on what has happened, you can restore the archived product registry file or manually edit the product registry file so that it no longer refers to the removed components.

        To edit the product registry file, open the file /var/sadm/install/productregistry . This XML file describes each component. Each component description opens with a <compid\> tag and closes with a </compid\> tag. Delete the entire entry for the component.

      • On Linux, use the rpm -e command.

        To edit the product registry file, open the file /var/opt/sun/install/productregistry. This XML file describes each component. Each component description starts with a <compid\> tag and ends with a </compid\> tag. Delete the entire entry for the component.

  3. Clean the /opt, /etc/opt and /var/opt directories.

  4. Run the installer again.

Installation Fails Due to Removed Shared Components in Product Registry After Uninstallation

As of the Java ES 2005Q4 release, shared components are listed in the product registry file after installation.

The Java ES uninstaller removes selectable components from the system but does not remove shared components. After an uninstallation, the product registry still contains entries for the shared components. If you manually remove any Java ES shared components after an uninstallation, these components are not removed from the product registry. Thus, the next Java ES 2005Q4 installation fails because the installer assumes that the manually deleted shared components are present (because they still have entries in the product registry file).

Tip –

Avoid manually removing Java ES shared components from your system.

Suggested Fix. Either remove the corresponding entries from the product registry file or remove the product registry file itself. Removing entries from the product registry file can cause the file to become corrupted, so you might prefer to remove the whole product registry. Before doing this, verify that products other than Java ES components are not using the product registry file.

On Linux: There is no equivalent of the graphical product registry file on Linux, so if you removed such rpm files by mistake, you must manually edit the product registry file.

Cannot Configure IBM WebSphere as the Portal Server Web Container

WebSphere might not be running, or you might have specified a WebSphere value that does not match the WebSphere native configuration. There are two approaches to troubleshooting this issue.

Check the Configuration

One approach is to check the configuration of your WebSphere instance.

ProcedureTo Check the WebSphere Configuration

Steps

  1. Ensure that WebSphere is running.

  2. Examine the values for the following installer fields:

    • WebSphere Virtual Host (PS_IBM_VIRTUAL_HOST in the state file)

    • Application Server Name (PS_IBM_APPSERV_NAME in the state file)

  3. Use the WebSphere tools to check the configuration to make sure it matches the values you are entering.

  4. Try again.

Create New Instances

Another approach is to create new instances of the WebSphere entities.

ProcedureTo Create New Instances of WebSphere Entities

Steps

  1. Use the adminclient.sh to start the WebSphere console.

  2. Create a new virtual host instance and a new Application Server instance name.

  3. Click the entry under Nodes (typically the host name), and select Regen WebServer Plugin.

    This process saves the new entries into the plugin configuration file, which the installer checks for the legal names.

  4. Return to the installer and enter the values you just created.

Unexpected External Error Occurs

A power failure or system failure might have occurred, or you might have entered CTRL/C to stop the installer process.

Suggested Fix. If the failure occurred during the installation or configuration process, you are probably left with a partial installation. Run the uninstaller. If the uninstaller fails, follow the instructions under Uninstallation Fails, Leaving Behind Files

Graphical Installer Seems Unresponsive

The installer sometimes creates an image on the screen before the image is ready for input. You cannot repeatedly click Next in the installation wizard without waiting.

Suggested Fix. The button that represents the default choice includes a blue rectangle. This rectangle sometimes appears after the button itself appears. Wait until you see the blue rectangle before clicking a button.

Silent Installation Fails: “State File is Incompatible or Corrupted”

If you are using a state file that was created on the same platform on which you are using it, the problem might be due to an unknown file corruption error. There are two approaches to troubleshooting this issue.

Generate a New State File

Create a New Platform-Appropriate ID

If the platform on which you created the state file is not the same as the platform on which you are running the silent installation, create a new, platform-appropriate ID for the file. For instructions on how to do this, refer to Creating a Platform-Appropriate State File ID.

Silent Installation Fails

If you edited the state file, you might have introduced errors. Check the following and regenerate the state file as described in Creating a State File.

Man Pages Do Not Display

The most likely reason for this is that your MANPATH environment variable is not set correctly for the components you installed. Refer to MANPATH Setup.

Uninstallation Problems

This section addresses the following problems you might encounter during uninstallation.

Cannot Find Uninstaller

The Java ES installation program places the uninstaller on your system at the following location:

If the uninstaller is not in this directory, one of the following might have occurred:

Suggested Fix. Manually clean up your system as described in Uninstallation Fails, Leaving Behind Files.

Uninstallation Fails, Leaving Behind Files

If manual cleanup is necessary because the uninstaller left behind files or processes, perform the following procedure to remove packages from your system.

ProcedureTo Manually Clean Up Packages

Steps

  1. Determine which packages you want to remove.

    Compare the packages on your system with the Java ES packages listed in Chapter 5, List of Installable Packages, in Sun Java Enterprise System 2005Q4 Installation Reference. You can use the Solaris pkginfo or prodreg utility or the Linux rpm command to determine which packages are installed. (See Installation Fails Due to Leftover Files During Uninstallation

  2. Stop all running processes for Java ES components.

    Brief instructions for stopping processes are contained in Chapter 6, Configuring Components After Installation component documentation.

  3. Back up all custom configuration and user data you plan to use in subsequent installations.

    Reviewing Uninstallation Behavior for Java ES Components provides some information on configuration and user data that should be backed up. For more information, refer to the component documentation for each component.

  4. Use the pkgrm or rpm -e command to remove Java ES component packages.

  5. Remove any remaining component directories and their content that you do not plan to use in subsequent installations. If you do plan to use these directories later, move them elsewhere.

  6. Update the product registry file, which is located here:

    On Solaris OS: /var/sadm/install/productregistryOn Linux: /var/opt/sun/install/productregistry

    The uninstaller uses this registry to determine which components are installed on a host. Both the installer and uninstaller update the product registry upon completion of an installation or uninstallation.

    Note –

    If you manually remove packages rather than using the uninstaller, then you must edit the product registry so it correctly reflects the software installed on your system.

  7. Clean up the log files for your system, which are located here:

    Solaris OS: /var/sadm/install/logsLinux: /var/opt/sun/install/logs

    The log files might not correctly reflect the state of your system after you manually remove packages.

Product Registry Is Corrupted

During uninstallation, the uninstaller uses the product registry file to determine what needs to be uninstalled:

On Solaris OS: /var/sadm/install/productregistryOn Linux: /var/opt/sun/install/productregistry

Common Agent Container Problems

This section addresses the following problems that might arise in relation to the common agent container shared component:

Port Number Conflicts

The common agent container inside Java ES occupies the following port numbers by default:

If your installation already reserves any of these port numbers, change the port numbers occupied by the common agent container as follows.

For further information on the common agent container cacaoadm command, see the cacaoadm man page. If you cannot see this man page at the command line, verify that your MANPATH is set correctly. Refer to MANPATH Setup.

Checking Port Numbering

ProcedureTo Verify Solaris Port

Steps

  1. As root, stop the common agent container management daemon:


    # /opt/SUNWcacao/bin/cacaoadm stop

  2. Change the port number using the following syntax:


    # /opt/SUNWcacao/bin/cacaoadm set-param param=value

    For example, to change the port occupied by the SNMP Adaptor from the default 10161 to 10165:


    # /opt/SUNWcacao/bin/cacaoadm set-param snmp-adaptor-port=10165

  3. Restart the common agent container management daemon:


    # /opt/SUNWcacao/bin/cacaoadm start

ProcedureTo Verify Linux Port

Steps

  1. As root, stop the common agent container management daemon:


    # /opt/sun/cacao/bin/cacaoadm stop

  2. Change the port number using the following syntax:


    # /opt/sun/cacao/bin/cacaoadm set-param param=value

    For example, to change the port occupied by the SNMP Adaptor from 10161 to 10165:


    # /opt/sun/cacao/bin/cacaoadm set-param snmp-adaptor-port=10165

  3. Restart the common agent container management daemon:


    # /opt/sun/cacao/bin/cacaoadm start

Compromised Security Around the Root Password

It might be necessary to regenerate security keys on a host running Java ES. For example, if there is a risk that a root password has been exposed or compromised, you should regenerate security keys. The keys used by the common agent container services are stored in the following locations:

Solaris OS: /etc/opt/SUNWcacao/securityLinux: /etc/opt/sun/cacao/security

Under normal operation, these keys can be left in their default configuration. If you need to regenerate the keys due to a possible key compromise, you can regenerate the security keys using the following procedure.

Security Key Problems

ProcedureTo Generate Keys for Solaris OS

Steps

  1. As root, stop the common agent container management daemon.


    # /opt/SUNWcacao/bin/cacaoadm stop

  2. Regenerate the security keys.


    # /opt/SUNWcacao/bin/cacaoadm create-keys --force

  3. Restart the common agent container management daemon.


    # /opt/SUNWcacao/bin/cacaoadm start
    Note –

    In the case of Sun Cluster software, you must propagate this change across all nodes in the cluster. For more information, see How to Finish a Rolling Upgrade to Sun Cluster 3.1 8/05 Software in Sun Cluster Software Installation Guide for Solaris OS.

ProcedureTo Generate Keys for Linux

Steps

  1. As root, stop the common agent container management daemon.


    # /opt/sun/cacao/bin/cacaoadm stop

  2. Regenerate the security keys.


    # /opt/sun/cacao/bin/cacaoadm create-keys --force

  3. Restart the common agent container management daemon.


    # /opt/sun/cacao/bin/cacaoadm start

    For more information on the cacaoadm(1M) command, see the cacaoadm man page.

Error Notification About Lock File

When you issue a cacaoadm subcommand, it is possible that another user issued a command at exactly the same time. However, only one cacaoadm subcommand can be run at a time.

On Solaris OS, the following error message is generated:

If cacaoadm daemon is running, it is busy executing another command.
Otherwise remove lock file /var/opt/SUNWcacao/run/lock

On Linux, the following error message is generated:

If cacaoadm daemon is running, it is busy executing another command.
Otherwise remove lock file /var/opt/sun/cacao/run/lock.

The first recommended action when you receive this notification message is to wait a few moments and retry.

If you receive the same notification message when you retry, then it is possible that a lock file has not been removed by the common agent container management daemon. This can happen in the case of a crash. The lock file prevents further cacaoadm subcommands from being run.

Remove the lock file from the location indicated in the error message.

Component Troubleshooting Tips

This section provides various quick tips on components, with references to useful documentation.

This section contains the following subsections:

Access Manager Troubleshooting Tips

Table 9–2 Access Manager Troubleshooting Tips

Topic 

Details 

Configuration File

AMConfig.properties

Solaris OS: /etc/opt/SUNWam/config

Linux: /etc/opt/sun/identity/config

Log and Debug Files

Log file directory: 

  • Solaris OS: /var/opt/SUNWam/logs

  • Linux: /var/opt/sun/identity/logs

    Debug file directory:

  • Solaris OS: /var/opt/SUNWam/debug

  • Linux: /var/opt/sun/identity/debug

Debug Mode

Refer to the Auditing Features chapter in the Sun Java System Access Manager 7 2005Q4 Developer’s Guide.

Administration Server Troubleshooting Tips

Table 9–3 Administration Server Troubleshooting Tips

Topic 

Details 

Log Files

Installation log directory:

Troubleshooting

Refer to the . 

Application Server Troubleshooting Tips

Table 9–4 Application Server Troubleshooting Tips

Topic 

Details 

Log Files

Log file directory: 

Solaris OS: /var/sadm/install/logs/

Linux: /var/opt/sun/install/logs/

Application Server instance log directory (default location for the initially created instance): 

Solaris OS: /var/opt/SUNWappserver/domains/domain1/logs

Linux: /var/opt/sun/appserver/domains/domain1/logs

Message log file name: 

server.log, for each server instance

Configuration Files

Configuration file directory: /var

Troubleshooting

Refer to the Sun Java System Application Server Enterprise Edition 8.1 2005Q2 Troubleshooting Guide.

Calendar Server Troubleshooting Tips

Table 9–5 Calendar Server Troubleshooting Tips

Topic 

Details 

Log Files

Administration Service (csadmind): admin.logDistributed

Database Service (csdwpd): dwp.logHTTP Service (cshttpd): http.log

Notification Service (csnotifyd): notify.logCalendar

Backup Service (csstored): store.log

Default log directory: /var/opt/SUNWics5/logs

For more information, refer to Sun Java System Calendar Server 6 2005Q4 Administration Guide.

Configuration File

/opt/SUNWics5/cal/config/ics.conf

Debug Mode

To use debug mode, a Calendar Server administrator sets the logfile.loglevel configuration parameter in the ics.conf file. For example:

logfile.loglevel = "debug"

For more information, refer to Sun Java System Calendar Server 6 2005Q4 Administration Guide.

Troubleshooting

Refer to Sun Java System Calendar Server 6 2005Q4 Administration Guide.

Communications Express Troubleshooting Tips

Table 9–6 Communications Express Troubleshooting Tips

Topic 

Details 

Log Files

Default log files: uwc-deployed-path/logs/uwc.log

Troubleshooting

Refer to the Chapter 6, Troubleshooting, in Sun Java System Communications Express 6 2005Q4 Administration Guide.

Delegated Administrator Troubleshooting Tips

Table 9–7 Delegated Administrator Troubleshooting Tips

Topic 

Details 

Log Files

Runtime log file: /opt/SUNWcomm/log

Troubleshooting

Refer to Appendix C, Debugging Delegated Administrator, in Sun Java System Communications Services 6 2005Q4 Delegated Administrator Guide.

Directory Proxy Server Troubleshooting Tips

Table 9–8 Directory Proxy Server Troubleshooting Tips

Topic 

Details 

Log Files

Default log file: DirectoryProxyServer-base/dps -hostname/logs/fwd.log

For more information, refer to the Sun Java System Directory Proxy Server 5 2005Q1 Administration Guide.

Troubleshooting

Refer to the Sun Java System Directory Proxy Server 5 2005Q1 Administration Guide.

Directory Server Troubleshooting Tips

Table 9–9 Directory Server Troubleshooting Tips

Topic 

Details 

Log Files

Installation log file: 

Solaris OS: /var/sadm/install/logs

Linux: /var/opt/sun/install/logs

Configuration log files: 

Directory_Server_install.Atimestamp

Directory_Server_install.Btimestamp

For information on managing log files, refer to the Sun Java System Directory Server 5 2005Q1 Administration Guide.

Troubleshooting

Refer to the Sun Java System Directory Server 5 2005Q1 Administration Guide.

Instant Messaging Troubleshooting Tips

For information on troubleshooting Instant Messaging, refer to the client online help and the Sun Java System Instant Messaging 7 2005Q1 Administration Guide.

Message Queue Troubleshooting Tips

Table 9–10 Messaging Server Troubleshooting Tips

Topic 

Details 

Troubleshooting

Refer to the Troubleshooting Problems chapter of the Sun Java System Message Queue Administration Guide and the MQ Forum, at: http://swforum.sun.com/jive/forum.jspa?forumID=24.

Performance

Refer to “Analyzing and Tuning a Message Service” Sun Java System Message Queue 3 2005Q4 Administration Guide.

Messaging Server Troubleshooting Tips

Table 9–11 Messaging Server Troubleshooting Tips

Topic 

Details 

Executable Location

/opt/SUNWmsgsr/sbin

Log Files

MessagingServer-base/data/log

Troubleshooting

Refer to the Sun Java System Messaging Server 6 2005Q4 Administration Guide.

Portal Server Troubleshooting Tips

Portal Server uses the same log files and debug files as Access Manager.

Table 9–12 Portal Server Troubleshooting Tips

Topic 

Details 

Debug Files

Solaris OS: /var/opt/SUNWam/debug

Linux: /var/opt/sun/identity/debug

Log Files

Solaris OS: /var/opt/SUNWam/logs

Linux: /var/opt/sun/identity/logs

Troubleshooting

Refer to the Sun Java System Portal Server 6 2005Q4 Administration Guide.

Portal Server uses the same log files and debug files as Access Manager.

Tip –

The dpadmin, par, rdmgr , and sendrdm Portal Server command line utilities have options to generate debugging messages. They are described in the Portal Server Administration Guide.

Portal Server Secure Remote Access Troubleshooting Tips

Portal gateway debug logs are located in the following directories:

Note –

Logs for Portal Server services (such as NetFile) are in /var/opt/SUNWam/debug when logging is turned on from Access Manager Administration Console.

Service Registry Troubleshooting Tips

Table 9–13 Service Registry Troubleshooting Tips

Topic 

Details 

Log Files

Application Server instance log:  

Solaris OS: /var/opt/SUNWsoar/domains/registry/logs/server.log

Linux: /var/opt/sun/SUNWsoar/domains/registry/logs/server.log

Troubleshooting

Refer to the Service Registry 3 2005Q4 Administration GuideService Registry 3 2005Q4 Administration Guide.

Sun Cluster Software Troubleshooting Tips

Table 9–14 Sun Cluster Software Troubleshooting Tips

Topic 

Details 

Log Files

Default log directory: /var/cluster/logs/install

Error messages: /var/adm/messages

Troubleshooting

Refer to the Sun Cluster Software Installation Guide for Solaris OS.

Web Server Troubleshooting Tips

Table 9–15 Web Server Troubleshooting Tips

Topic 

Details 

Log Files

There are two types of Web Server log files: the errors log file and the access log file, both located in the following directories:

  • Solaris OS: /opt/SUNWwbsvr/https-instancename/logs

  • Linux: /opt/sun/webserver/https-instancename/logs

The errors log file lists all the errors a server has encountered. The access log records information about requests to the server and the responses from the server. For more information, refer to the Sun Java System Web Server 6.1 SP4 Administrator’s Guide.

Troubleshooting

Refer to the Sun Java System Web Server 6.1 SP4 Installation and Migration Guide.

Configuration File Directory

/opt/SUNWwbsvr/https-instance-name /config

Debug Mode

The following options are available: 

Web Proxy Server Troubleshooting Tips

Table 9–16 Web Proxy Server Troubleshooting Tips

Topic 

Details 

Log Files

Default log location: /opt/SUNWproxy/proxy-instancename/logs

For more information, refer to the Sun Java System Web Proxy Server 4.0.2 Administration Guide.

Configuration File Directory

/opt/SUNWproxy/proxy-instancename /config

Debug Mode

You can set the value of the loglevel attribute of the LOG element in the /server-root/proxy-instance-name /config/server.xml file: info, fine, finer, finest.

Additional Troubleshooting Information

The following information in this guide is also useful for troubleshooting: