Skip Headers
Oracle® Fusion Applications Administrator's Guide
11g Release 5 (11.1.5)

Part Number E14496-07
Go to Documentation Home
Home
Go to Book List
Book List
Go to Table of Contents
Contents
Go to Feedback page
Contact Us

Go to previous page
Previous
Go to next page
Next
PDF · Mobi · ePub

11 Diagnosing the Oracle Fusion Applications Middle Tier Performance

This chapter describes how to diagnose Java applications in the middle tier using Oracle Enterprise Manager Cloud Control (Cloud Control):

This chapter includes the following topics:

11.1 Introduction to Java Diagnostics in the Middle Tier

Mission critical Java applications often suffer from availability and performance problems. Developers and IT administrators spend a lot of time diagnosing the root cause of these problems. Many times, the problems occurring in production environments either cannot be reproduced or may take too long to reproduce in other environments. This can cause severe impact on the business.

Oracle Enterprise Manager Cloud Control (Cloud Control) enables you to diagnose performance problems in Java applications in the production environment. By eliminating the need to reproduce problems, it reduces the time required to resolve these problems. This improves application availability and performance. Using Java Virtual Machine (JVM) diagnostics, you can identify the root cause of performance problems in the production environment without having to reproduce them in the test or development environment. It does not require complex instrumentation or restarting of the application to get in-depth application details. Application administrators will be able to identify Java problems or Database issues that are causing application downtime without any detailed application knowledge.

To configure your environment for JVM Diagnostics, see the "Using JVM Diagnostics" chapter in the Oracle Enterprise Manager Getting Started with Fusion Middleware Management.

11.2 Diagnosing the Oracle Fusion Applications Middle Tier

This section describes how to diagnose Java applications in the middle tier using Cloud Control:

11.2.1 Viewing JVM Pool Summary Information on a Domain

To get started with monitoring Java Virtual Machine (JVM) Pool on a Domain using Cloud Control:

  1. From the Targets menu, choose Targets > Middleware.

    The Middleware target home page displays.

  2. Search for the Oracle WebLogic Domains:

    1. From the Search area, click Advanced Search.

    2. From the Type list, select Oracle WebLogic Domain and deselect the other options.

    3. Click Search.

  3. Select a domain which has the JVM Diagnostics Agent deployed on it:

    1. From the Target Navigation area, select Java Virtual Machine Pools and expand it.

      Note:

      All the WebLogic Domains that have a JVM Diagnostics Agent deployed on it appear under this folder.

  4. From the WebLogic Domain, choose Diagnostics > Java Virtual Machine Pool Home.

    The JVM Pool Home page displays.

    Description of jvmpoolhome.gif follows
    Description of the illustration jvmpoolhome.gif

  5. Take note of the following:

    • In the Summary section, Poll indicates if polling of that domain has been enabled. Polling Interval denotes the time interval (in milli seconds) at which the domain is polled.

    • In the Availability section, the JVMs in that pool are listed along with their availability status.

    • In the Realtime Thread States section, view the overall state of the threads including locks.

    • In the Incident section, the servers in the domain whose target status is Down are listed. The incidents will be automatically cleared when the underlying issues are resolved.

    1. From the WebLogic Domain menu, choose Diagnostics > JVM Performance Diagnostics.

      The JVM Pool Performance Diagnostics page displays. This page provides information for the pool of JVMs in the domain for the selected time period. You can also modify the time period using Edit Date and Time option at the top of the page.

      The following figure shows the JVM Pool Performance Diagnostics page for the domain:

      Description of jvmpoolperfdiag_domain.png follows
      Description of the illustration jvmpoolperfdiag_domain.png

    2. View the various charts:

      Server State Charts For Selected Period section

      This section displays the Active Threads, CPU Utilization, and Heap Utilization of IO, CPU, lock, and network resources during the selected time. The number of Java threads (daemon and non-daemon) that are currently running in the virtual machine for this Oracle WebLogic Domain:

      • Active Threads by State: This chart displays the number of Java threads that are currently running in the domain or server. It is color-coded by thread state.

      • JVM CPU Utilization (%): This chart shows the CPU utilization across the JVMs in the pool.

      • JVM Heap Utilization (%): This chart shows the heap utilization across the JVMs in the pool.

      Filter Options section

      This section displays various options by which you can filter the JVMs in the pool

      Top Activities section

      This section displays the top activities in the pool:

      • Top Methods: This chart shows the most expensive Java methods in the selected time period.

      • Top Requests: This chart shows the top page requests in the selected time period.

      • Top DBWait Events: This chart shows the cross-tier correlation with the database.

      • Top SQLs: This chart displays the list of SQL calls ordered by their cost (the number of samples).

      • Top Databases: This chart shows where the pool of JVM is spending in each area.

      JVMs In Pool section

      This section displays the Active Threads, CPU Utilization, and JVM Heap Utilization of IO, CPU, lock, and network resources during the selected time.

      • Active Threads by State: This chart displays the number of Java threads that are currently running in the domain. It is color-coded by thread state.

      • CPU Utilization (%): This chart shows the CPU utilization across the JVMs in the pool.

      • JVM Heap Utilization (%): This chart shows the heap utilization across the JVMs in the pool.

      • Garbage Collections (Invocations/min): This chart shows the number of times the JVM garbage collector was invoked in the time period. It includes both major and minor garbage collections.


      Note:

      The Compared with feature enables you to compare the diagnostics across two specified periods of time.

11.2.2 Viewing JVM Summary Information on a Managed Server

To get started with monitoring Java Virtual Machine (JVM) on a Managed Server within a domain using Cloud Control:

  1. From the Targets menu, choose Targets > Middleware.

    The Middleware target home page displays.

  2. Search for the Oracle WebLogic Domains:

    1. From the Search area, click Advanced Search.

    2. From the Type list, select Oracle WebLogic Domain and deselect the other options.

    3. Click Search.

  3. Select a domain which has the JVM Diagnostics Agent deployed on it:

    1. From the Target Navigation area, select Java Virtual Machine Pools and expand it.

      Note:

      All the WebLogic Domains and Servers that have JVM Diagnostics Agents deployed on them appear under this folder.

  4. Expand the WebLogic Domain and select a Managed Server.

  5. From the WebLogic Server menu, choose Diagnostics > Java Virtual Machine Home.

    The JVM Home page displays.

    Description of jvmhome.gif follows
    Description of the illustration jvmhome.gif

  6. Take note of the following:

    • In the Summary section, the details of the JVM are displayed. The details contain the following information:

      • JVM Pool

      • Host machine

      • Operating System (OS) running on the host machine

      • JVM Vendor

      • JVM Version

      • Maximum JVM Heap Size

      • Minimum JVM Heap Size

      • JVMD Agent Optimization Level

      • JVMD Agent Log Level

      • JVMD Agent Build Number

      • WebLogic Server

    • In the Availability section, the availability status of the JVM is listed.

    • In the Realtime Thread States section, view the overall state of the threads including locks.

    • In the Incident section, the JVM corresponding to the server whose target status is Down is listed. This incident will be automatically cleared when the underlying issue is resolved.

    • In the Active Threads (Last 24 Hours) section, view a graph analyzing the active threads in the JVM in the last 24 hours.

    1. From the WebLogic Server menu, choose Diagnostics > JVM Performance Diagnostics.

      The JVM Performance Diagnostics page displays. This page provides information for a single JVM for the selected time period. You can also modify the time period using Edit Date and Time option at the top of the page.

      The following figure shows the JVM Performance Diagnostics page for a single JVM:

      Description of jvmperfdiag_wlserver.png follows
      Description of the illustration jvmperfdiag_wlserver.png

    2. View the various charts:

      Server State Charts For Selected Period section

      This section displays the Active Threads, CPU Utilization, and Heap Utilization of IO, CPU, lock, and network resources during the selected time. The number of Java threads (daemon and non-daemon) that are currently running in the virtual machine for this Oracle WebLogic Server:

      • Active Threads by State: This chart displays the number of Java threads that are currently running in the server. It is color-coded by thread state.

      • CPU Utilization (%): This chart shows the CPU utilization for the JVM.

      • Heap Utilization (%): This chart shows the heap utilization for the JVM.

      • Garbage Collections (Invocations/min): This chart shows the number of times the JVM garbage collector was invoked in the time period. It includes both major and minor garbage collections.

      Filter Options section

      This section displays various options by which you can filter the JVM.

      General tab

      This tab displays data from the JVM:

      • Active Threads by State: This chart displays the number of Java threads that are currently running in server. It is color-coded by thread state.

      • Top Requests: This chart shows the top page requests in the selected time period.

      Threads tab

      This tab displays data from the JVM.

      • Threads State Transition: This chart shows how the threads have transitioned from one state to the other in the selected period. You can change the time interval and move it to a different time period by using the quick time selection control at the top of the page. You can hover over the colored bars to see the transition changes from one state to the other, for example from Runnable to Not Active or to Runnable. Click a bar graph in the State column to view a detailed analysis on the state of the thread. This feature allows you to analyze each sample (JVM snapshot at a specific time) in the monitored data.

      • Metric By Active States: This chart shows how long each of the threads have been in the various states.


      Note:

      The Compared with feature enables you to compare the diagnostics across two specified periods of time.

11.2.3 Viewing JVM Pool Summary Information on a JVM

To get started with monitoring a Java Virtual Machine (JVM) in a Pool using Cloud Control:

  1. From the Targets menu, choose Targets > Middleware.

    The Middleware target home page displays.

  2. Search for the Oracle WebLogic Domains:

    1. From the Search area, click Advanced Search.

    2. From the Type list, select Oracle WebLogic Domain and deselect the other options.

    3. Click Search.

  3. Select a domain which has the JVM Diagnostics Agent deployed on it:

    1. From the Target Navigation area, select Java Virtual Machine Pools and expand it.

      Note:

      All the WebLogic Domains and Servers that have JVM Diagnostics Agents deployed on them appear under this folder.

      Note:

      The WebLogic Domain is suffixed with _jvmpool and the WebLogic Servers are suffixed with _jvm.

    2. Select a WebLogic Domain or WebLogic Server under this folder.

  4. When you select a WebLogic Domain, select Java Virtual Machine Pool Home from the Java Virtual Machine Pool menu.

    The JVM Pool Summary page displays.

    Description of jvmpoolsummary_domain.png follows
    Description of the illustration jvmpoolsummary_domain.png

  5. Take note of the following:

    • In the Summary section, Poll indicates if polling of that JVM Pool has been enabled. Polling Interval denotes the time interval (in milli seconds) at which the JVM Poll is polled.

    • In the Availability section, the availability status of all the JVMs is listed.

    • In the Realtime Thread States section, view the overall state of the threads including locks.

    • In the Incident section, the servers in the domain whose target status is Down are listed. The incidents will be automatically cleared when the underlying issues are resolved.

    1. From the Java Virtual Machine Pool menu, choose JVM Performance Diagnostics.

      The JVM Pool Performance Diagnostics page displays. This page provides information about all the JVMs in the pool for the selected time period. You can also modify the time period using Edit Date and Time option at the top of the page.

      The following figure shows the JVM Pool Performance Diagnostics page for the domain:

      Description of jvmpoolperfdiag_jvm_domain.png follows
      Description of the illustration jvmpoolperfdiag_jvm_domain.png

    2. View the various charts:

      Server State Charts For Selected Period section

      This section displays the Active Threads, CPU Utilization, and Heap Utilization of IO, CPU, lock, and network resources during the selected time. The number of Java threads (daemon and non-daemon) that are currently running in the virtual machine for this Oracle WebLogic Domain:

      • Active Threads by State: This chart displays the number of Java threads that are currently running in the server. It is color-coded by thread state.

      • CPU Utilization (%): This chart shows the CPU utilization across the JVM.

      • Heap Utilization (%): This chart shows the heap utilization across the JVM.

      • Garbage Collections (Invocations/min): This chart shows the number of times the JVM garbage collector was invoked in the time period. It includes both major and minor garbage collections.

      Filter Options section

      This section displays various options by which you can filter the JVMs in the pool

      Top Activities section

      This section displays the top activities in the pool:

      • Top Methods: This chart shows the most expensive Java methods in the selected time period.

      • Top Requests: This chart shows the top page requests in the selected time period.

      • Top DBWait Events: This chart shows the cross-tier correlation with the database.

      • Top SQLs: This chart displays the list of SQL calls ordered by their cost (the number of samples).

      • Top Databases: This chart shows where the pool of JVM is spending in each area.

      JVMs In Pool section

      This section displays the Active Threads, CPU Utilization, and JVM Heap Utilization of IO, CPU, lock, and network resources during the selected time.

      • Active Threads by State: This chart displays the number of Java threads that are currently running in the domain. It is color-coded by thread state.

      • CPU Utilization (%): This chart shows the CPU utilization across the JVMs in the pool.

      • JVM Heap Utilization (%): This chart shows the heap utilization across the JVMs in the pool.

      • Garbage Collections (Invocations/min): This chart shows the number of times the JVM garbage collector was invoked in the time period. It includes both major and minor garbage collections.


      Note:

      The Compared with feature enables you to compare the diagnostics across two specified periods of time.

  6. When you select a WebLogic Server, select Java Virtual Machine Home from the Java Virtual Machine menu.

    The JVM Summary page displays.

    Description of jvmsummary_jvm_server.png follows
    Description of the illustration jvmsummary_jvm_server.png

  7. Take note of the following:

    • In the Summary section, the details of the JVM are displayed. The details contain the following information:

      • JVM Pool

      • Host machine

      • Operating System (OS) running on the host machine

      • JVM Vendor

      • JVM Version

      • Maximum JVM Heap Size

      • Minimum JVM Heap Size

      • JVMD Agent Optimization Level

      • JVMD Agent Log Level

      • JVMD Agent Build Number

      • WebLogic Server

    • In the Availability section, the availability status of the JVM is listed.

    • In the Realtime Thread States section, view the overall state of the threads including locks.

    • In the Incident section, the JVM corresponding to the server whose target status is Down is listed. This incident will be automatically cleared when the underlying issue is resolved.

    • In the Active Threads (Last 24 Hours) section, view a graph analyzing the active threads in the JVM in the last 24 hours.

    1. From the Java Virtual Machine menu, choose JVM Performance Diagnostics.

      The JVM Performance Diagnostics page displays. This page provides information for a single JVM for the selected time period. You can also modify the time period using Edit Date and Time option at the top of the page.

      The following figure shows the JVM Performance Diagnostics page for the JVM:

      Description of jvmperfdiag_jvm_server.png follows
      Description of the illustration jvmperfdiag_jvm_server.png

    2. View the various charts:

      Server State Charts For Selected Period section

      This section displays the Active Threads, CPU Utilization, and Heap Utilization of IO, CPU, lock, and network resources during the selected time. The number of Java threads (daemon and non-daemon) that are currently running in the virtual machine for this Oracle WebLogic Server:

      • Active Threads by State: This chart displays the number of Java threads that are currently running in the server. It is color-coded by thread state.

      • CPU Utilization (%): This chart shows the CPU utilization for the JVM.

      • Heap Utilization (%): This chart shows the heap utilization for the JVM.

      • Garbage Collections (Invocations/min): This chart shows the number of times the JVM garbage collector was invoked in the time period. It includes both major and minor garbage collections.

      Filter Options section

      This section displays various options by which you can filter the JVM.

      General tab

      This tab displays data from the JVM:

      • Active Threads by State: This chart displays the number of Java threads that are currently running in server. It is color-coded by thread state.

      • Top Requests: This chart shows the top page requests in the selected time period.

      Threads tab

      This tab displays data from the JVM:

      • Threads State Transition: This chart shows how the threads have transitioned from one state to the other in the selected period. You can change the time interval and move it to a different time period by using the quick time selection control at the top of the page. You can hover over the colored bars to see the transition changes from one state to the other, for example from Runnable to Not Active or to Runnable. Click a bar graph in the State column to view a detailed analysis on the state of the thread. This feature allows you to analyze each sample (JVM snapshot at a specific time) in the monitored data.

      • Metric By Active States: This chart shows how long each of the threads have been in the various states.


      Note:

      The Compared with feature enables you to compare the diagnostics across two specified periods of time.

11.2.4 Finding the Top Java Methods

If you have a slow-running application, locate the Java method causing the potential issue.

To find the top Java methods with Cloud Control:

  1. From the Targets menu, choose Targets > Middleware.

    The Middleware target home page displays.

  2. Search for the Oracle WebLogic Server domains:

    1. From the Search area, click Advanced Search.

    2. From the Type list, select Oracle WebLogic Domain or Oracle WebLogic Server; deselect the other options.

    3. Click Search.

  3. Click a domain or one of its servers which has JVM Diagnostics agents deployed. For more information about installing JVM Diagnostics, see the Oracle Enterprise Manager Cloud Control Basic Installation Guide.

    The WebLogic Server Domain Home page or WebLogic Server Home page displays.

  4. From the WebLogic Domain menu or WebLogic Server menu, choose Diagnostics > JVM Performance Diagnostics.

    The JVM Pool Performance Diagnostics page displays for an Oracle WebLogic Domain and the JVM Performance Diagnostics page displays for a Managed Server.

  5. In the Top Methods section, review the list of methods ordered by their cost (the number of samples).

  6. In the Top Methods section, click a method to add it as a filter.

  7. In the Method Stack Tree dialog, click the plus sign next to the method to investigate further.

  8. The Method Stack Tree dialog displays with a call stack that you can traverse.

  9. In the Method Stack Tree dialog, select the method, and then click OK.

    The Filter Options section auto-fills the information on the method and the charts update to reflect that method, for example:

    • Heavy use of IO, CPU, lock, and network resources (Active Threads chart)

    • Request causing it to be invoked (Top Requests chart)

    • SQL or database state it causes (Top DBStates and Top SQLs charts)

  10. After you are done with viewing the method, in Filter Options section, clear out the Method text box filter and click anywhere to remove the filter.

11.2.5 Finding the Top SQL Queries

If you suspect a slow SQL query is causing a network requests or IO issue, find the slowest SQL queries.

To find the top SQL calls using JVM diagnostics with Cloud Control:

  1. From the Targets menu, choose Targets > Middleware.

    The Middleware target home page displays.

  2. Search for the Oracle WebLogic Server domains:

    1. From the Search area, click Advanced Search.

    2. From the Type list, select Oracle WebLogic Domain or Oracle WebLogic Server; deselect the other options.

    3. Click Search.

  3. Click a domain or one of its servers which has JVM Diagnostics agents deployed. For more information about installing JVM Diagnostics, see the Oracle Enterprise Manager Cloud Control Basic Installation Guide.

    The WebLogic Server Domain Home page or WebLogic Server Home page displays.

  4. From the WebLogic Domain menu or WebLogic Server menu, choose Diagnostics > JVM Performance Diagnostics.

    The JVM Pool Performance Diagnostics page displays for an Oracle WebLogic Domain and the JVM Performance Diagnostics page displays for a Managed Server.

  5. In the Top SQLs section, review the list of SQL calls ordered by their cost (the number of samples).

  6. In the Top SQLs section, click a SQL call to view the charts for that call.

    The Filter Options section auto-fills the information on the method and the charts update to reflect that method. Adding the statement as a filter enables you to see everything related to that SQL call, for example:

    • Methods that invoke it (Top Methods chart)

    • Request causing it to be invoked (Top Requests chart)

    • Database state it causes (Top Databases chart)

  7. After you are done viewing the method, in Filter Options section, clear out the SQL field and click anywhere to remove the filter.

11.2.6 Analyzing Live Stuck Threads

If application users report a spinning status indication after clicking in the application, investigate the live stuck threads. Follow the procedure given below to find and analyze the live stuck threads.

To find and analyze the live stuck threads:

  1. From the Targets menu, choose Targets > Middleware.

    The Middleware target home page displays.

  2. Search for the Oracle WebLogic Server domains:

    1. From the Search area, click Advanced Search.

    2. From the Type list, select Oracle WebLogic Domain or Oracle WebLogic Server; deselect the other options.

    3. Click Search.

  3. Click a domain or one of its servers which has JVM Diagnostics agents deployed. For more information about installing JVM Diagnostics, see the Oracle Enterprise Manager Cloud Control Basic Installation Guide.

    The WebLogic Server Domain Home page or WebLogic Server Home page displays.

  4. From the WebLogic Domain menu, choose Diagnostics > Live Thread Analysis.

    The Live Thread Analysis page displays.

    Description of livethreadanalysis.png follows
    Description of the illustration livethreadanalysis.png

  5. In the JVMs section, select a thread to display details in the JVM Threads section.

  6. In the JVM Threads section, look for a thread having the prefix [STUCK THREAD] and click it.

  7. In the Thread Info and Thread Stack sections, look at the Current Call, File Name, Line, and State for the thread.

    This information provides you with the key information on how to locate the code that is causing the problem:

    • Current Call: This field displays the name of the method call where the code is stuck.

    • File Name: This column identifies the file with the problem.

    • Line: This column identifies the line number in the file where the problematic code is.

    • State: This column displays the state of the thread (for example, CPU, IO, Network, DB Wait, Lock, and so on).

  8. Look for the Lock Held in the Thread Info section.

  9. If the stuck thread is in the DB Wait state, then click the link and go directly to the database session to see what that thread is doing in the database, or use the technique described in Section 11.2.8.

11.2.7 Analyzing Stuck Threads from Specific Time Periods

The procedure listed in this section allows you to find and analyze the stuck threads in the historical context.

To find the stuck threads in the historical context:

  1. In Target Navigation area, expand Java Virtual Machine Pools > domain_name_jvmpool.

  2. Select a Java Virtual Machine.

  3. From the Java Virtual Machine menu, choose JVM Performance Diagnostics. Description of jvmperfdiagnostics.png follows
    Description of the illustration jvmperfdiagnostics.png

  4. In the Filter Options, enter [STUCK]% in the Thread Name field.

  5. In the Threads sub-tab, drag the pointer to select the timeline.

    Note:

    Scroll left and right to select the appropriate date. After you select the date, select the required duration.

11.2.8 Drilling Down from JVM Diagnostics to SQL Instances

If you issue an SQL query and it does not return, then analyze the SQL statement.

To analyze SQL from Cloud Control:

  1. From the Targets menu, choose Targets > Middleware.

    The Middleware target home page displays.

  2. Search for the Oracle WebLogic Server domains:

    1. From the Search area, click Advanced Search.

    2. From the Type list, select Oracle WebLogic Domain or Oracle WebLogic Server; deselect the other options.

    3. Click Search.

  3. Click a domain or one of its servers which has JVM Diagnostics agents deployed. For more information about installing JVM Diagnostics, see the Oracle Enterprise Manager Cloud Control Basic Installation Guide.

    The WebLogic Server Domain Home page or WebLogic Server Home page displays.

  4. From the WebLogic Domain menu or WebLogic Server menu, choose Diagnostics > JVM Performance Diagnostics.

    The JVM Pool Performance Diagnostics page displays for an Oracle WebLogic Domain and the JVM Performance Diagnostics page displays for a Managed Server.

  5. In the Top SQLs section, click a SQL call to view the charts for that call.

  6. In Filter Options section, in the SQL field, copy the ID of the SQL call.

  7. Click Databases in secondary navigator.

  8. Select the relevant target database.

  9. Click the Performance tab.

  10. In the Additional Instance Monitoring Links section, click Search SQL.

  11. Paste the ID of the SQL call into the relevant field with any other choices you may need and then click Search.

  12. Analyze the SQL.

11.2.9 Analyzing Potential Memory Leaks

To find and analyze memory leaks, you can use Cloud Control to take and analyze snapshots of the heap.

Analyzing heap requires a large amount of free space in the Oracle Database tablespace being used. As a standard practice, ensure you have five times the size of heap dump file being loaded in the tablespace. Since you know the size of your dump file, make sure that there is adequate space to accommodate the dump file before it is loaded into the database.

To use heap snapshot to analyze memory leaks:

Task 1   Review Metrics for a Potential Memory Leak

To create a snapshot of the heap for later loading and examination for leaks:

  1. From the Targets menu, choose Targets > Middleware.

    The Middleware target home page displays.

  2. Search for the Oracle WebLogic Server domains:

    1. From the Search area, click Advanced Search.

    2. From the Type list, select Java Virtual Machine; deselect the other options.

    3. Click Search.

  3. Click a Java Virtual Machine with JVM Diagnostics agents deployed. For more information about installing JVM Diagnostics, see the Oracle Enterprise Manager Cloud Control Basic Installation Guide.

    The Java Virtual Machine Home page displays.

  4. From the Java Virtual Machine menu, choose Performance Summary.

    The Performance Summary page displays.

  5. Review the following metrics for any periods of time where the Warning Thresholds or Critical Thresholds were reached:

    JVM GC Overhead

    This metric shows the percentage of CPU the JVM is using for garbage collections in relation to total CPU usage including servicing application workload (the lower, the better). This metric and its trending can help determine when the garbage collector is making the CPU spin on garbage collection instead of on application workload.

    JVM Heap Usage (%)

    This metric shows the heap utilization for the JVM. This metric provides an indicator of heap size as they fluctuate between garbage collections.

    JVM Heap Used After GC

    This metric shows the percent of heap utilization used after garbage collection. This metric and its trend over time can provide a good indication that there is a leak. For example, if the chart trending up while the application load is stable, then it is possible there is a leak.


    If any of the metrics exceed the Warning Thresholds or Critical Thresholds, it could indicate memory is a factor in the JVM performance and availability. It could mean there is a memory leak or that the JVM heap configuration is too small for the application load. If the heap configuration is correct, assume there is a leak and investigate the cause.

  6. If any of the metrics exceed the Warning Thresholds or Critical Thresholds, proceed to Task 2.

Task 2   Perform a Live Heap Analysis

To create a snapshot of the heap for later loading and examination for leaks:

  1. From the Java Virtual Machine menu, choose Live Heap Analysis.

    The Live Heap Analysis page displays.

  2. Review the top portion of the page to the analyze the heap and the number of objects added to the garbage collector; review the JVM Class Detail table to review the largest-size objects in the heap.

    For more information about using this page, see the topic "Viewing the Real-Time Heap Data" in the Cloud Control online help.

Task 3   Create a Heap Snapshot

To create a snapshot of the heap for later loading and examination for leaks:

  1. On the Live Heap Analysis page, click Create Heap Snapshot.

    The Heap Snapshot page displays.

  2. Provide the settings for your environment.

    Notice the Heap Snapshot Type under Heap Snapshot Only option enables you to pick either Oracle's JVMD format or a HROFF for use with other tools.For more information about using this page, see the topic "Taking a Heap Snapshot" in the Cloud Control online help.

  3. If you selected Heap Snapshot Only option, click Take Snapshot.

    The heap snapshot is generated and the file name in which it is stored is displayed. You can upload the heap snapshot and analyze it using appropriate options from the Heap Snapshots menu.

  4. From the Java Virtual Machine menu, choose Heap Snapshots.

    The Available Heap Snapshots page displays.

  5. Select the heap you created from the table, and then click Detail.

    The Heaps > Roots page displays. The Roots tab displays the objects reachable by roots, which are objects that are directly reachable from the JVM itself.

    Description of heapdumps.gif follows
    Description of the illustration heapdumps.gif

  6. Click a root name to drill down and view the objects that consume a lot of memory.

    The Top 40 Objects page displays.

  7. In the Heaps > Roots page, click Compare with to compare the current heap with another previously taken heap dump.

    When comparing heaps, load the bigger one first. Otherwise you may see negative deltas.

  8. In the Select a heap record dialog, select the second heap, and then click OK.

  9. Compare both the heaps. Compare the number of objects (Objects) and the occupied memory size (Adjusted Memory) in each heap dump. This measure indicates the objects that are growing over the period of time when the snapshots were taken.

  10. Drill down into the root which had the largest delta in order to find the biggest memory leak.