| Oracle® Load Testing Load Testing User's Guide Version 9.10 for Microsoft Windows (32-Bit) Part Number E15484-03 |
|
|
View PDF |
| Oracle® Load Testing Load Testing User's Guide Version 9.10 for Microsoft Windows (32-Bit) Part Number E15484-03 |
|
|
View PDF |
Oracle Load Testing lets you evaluate the performance of your Web application in real time using Performance Statistics and graphs on the View Run Graphs tab. You can create custom graphs on the Create Reports tab for post-run analysis for sessions where data has been saved. The following default reports and graphs are available on the View Run Graphs tab:
Performance Statistics - shows a summary of performance statistics data generated by running virtual users.
Performance Vs. Users - shows the average run time of the script for each running virtual user in each profile. If you have multiple profiles in the running Scenario, the Performance Vs. Users graph shows separate bars for each scenario profile running in the Autopilot. For example, if you run 100 VUs and ramp 10 at a time, you will see the average response time plotted at 10 VUs, 20 VUs, 30 VUs, etc. up to 100 VUs.
Users Vs. Time - shows the relative time when the virtual users for each profile started running. The graph represents the Autopilot ramp up times and the number of virtual users ramped up for each profile.
Performance Vs. Time - shows the average virtual user run time over a period of time. If you have multiple profiles in the running Scenario the Performance Vs. Time graph shows separate plot lines for each scenario profile running in the Autopilot.
Statistics Vs. Time - shows averages for virtual user hits, pages, transactions, and Kilobytes per second over time. The Average Statistic values are a graphical representation of the Average Value data from the Performance Statistics over time. The plot points are updated while the Autopilot runs the virtual users.
Errors Vs. Time - shows the number of failed transactions-per-second for virtual user over a period of time. If you have multiple profiles in the running Scenario the Errors Vs. Time graph shows separate plot lines for each scenario profile running in the Autopilot. The failed transactions-per-second depends upon the number of virtual users being run by individual profiles and the number of server requests (page, image, frame, etc.) that fail during the Oracle Load Testing session.
Errors Vs. Users - the number of failed transactions-per-second for each virtual user profile. If you have multiple profiles in the running Scenario the Errors Vs. Users graph shows separate plot lines for each scenario profile running in the Autopilot. The failed transactions-per-second depends upon the number of virtual users being run by individual profiles and the number server requests (page, image, frame, etc.) that fail during the Oracle Load Testing session.
The graph adds plot points based upon the number of running virtual users as the Autopilot ramps up to the total number of virtual users for all scenario profiles.
Performance, Users vs. Time - this graph combines the Performance vs. Time and the Users vs. Time graphs.
Trans/sec, Users vs. Time - this graph combines the transactions per second statistic from the Statistics vs. Time graph and the Users vs. Time graph.
Note:
For OpenScript scripts, steps run in the Initialize and Finish sections do not contribute to the overall script execution time reported in Oracle Load Testing reports. The time taken for the Initialize and Finish sections are not included in the script times so as not to skew the average time when the script runs for multiple iterations.You can view the graphs while the virtual users are running or after they have been stopped or have finished. The performance data is reported at the conclusion of each iteration. When the running virtual users complete the first iteration, the first set of performance data is captured. The graphs and performance statistics that you see are updated in real time based on the Graph refresh interval setting in Reports Options to give you a snapshot of the load test results. However, there is a small amount of processing time required to generate the graphs/statistics and print them to the screen. The default refresh is 15 seconds. If you run long or over night tests, you should increase the refresh interval to 60 seconds or longer.
If you run a very quick Autopilot session, the View Run Graphs tab may not have enough time to update the screen with the real time data. However, if you use the Session Start/Stop options to save the data for reporting, the data is stored in the database.
In addition to real-time data shown, Oracle Load Testing can generate a summary report and save data to the database for post-testing analysis. The Latest Load Session reports let you generate a summary of performance and error statistics data for the virtual user session. You can use the Create Reports tab to generate a variety of reports and graphs from the data stored in the database.
To set the Oracle Load Testing Report options:
Select Options from the Tools menu.
Select Start and Stop.
Set the Save data for reporting option to either Yes or Ask.
Select Reporting to set additional options.
Intervals - the Intervals options are as follows:
Reporting data collection interval - specifies how often the aggregate Oracle Load Testing agent performance data is collected for reporting to the Oracle Load Testing database.
User Interface refresh interval - specifies how often to refresh the user interface including the VU grid, ServerStats Display, and Sync Point Status.
Graph refresh interval - specifies how often to redisplay graphs in the View Run Graphs tab.
VU Display auto display interval - specifies how often to refresh the virtual user display when Auto mode is being used.
VU Grid - the VU Grid options are as follows:
Maximum number of rows per page - specifies the maximum number of rows to display on a page on the Watch VU Grid tab. The value must be between 10 and 100, inclusive.
VU Display - the VU Display options are as follows:
Maximum total storage size - specifies the maximum amount of data, in bytes, to send to the VU Display. Indicates the maximum number of bytes the Virtual User Display log file (.XML) will store for all items in the history list. The default value is 10 MB for each session. The size of the log file is affected by the size of the Web pages. The HTML source for each page is stored in the log file.
Maximum number of rows per page - specifies the maximum number of rows per page to display in the VU display. The value must be between 10 and 100, inclusive.
Timer name format - specifies the format of page timer names for reporting purposes when Auto Generate Timers For All Pages is selected. The following options are available:
Default - the default naming convention, e.g. MyScript.Page[2]. This setting disables the other four options.
URL resource name - the base file name, e.g. home.html is added.
Frame name - the HTML frame name, e.g. top, is added.
Page number - the page number, e.g. Page[2] is added.
Profile name - the profile name, e.g. MyScript is added.
Performance Statistics and Session Report - the Performance Statistics and Session Report options are as follows:
Enter the how often you want data to be collected in the Reporting data collection interval field.
Enter the how often you want to refresh the user interface in the User interface refresh interval field. This includes the VU grid, ServerStats Status Display, and the Sync Point Status display.
Enter the how often you want to refresh the report display in the Graph refresh interval field.
Specify how you want timer names to be displayed.
Specify whether to include think time in the profile time.
Specify the maximum number of data series to include per graph.
Click OK.
Start an Oracle Load Testing Autopilot session.
If you set the Save data for reporting option to Ask, Oracle Load Testing opens a dialog box for selecting the Oracle Load Testing session name and indicating whether you want to save the data.
The View Run Graphs tab is where you can view runtime reports. These graphs are only available while the load test is running. Use the Create Reports tab to view reports and graphs after the load test has finished running.
The View Run Graphs tab is refreshed according to what is set in the Graph Refresh Interval setting in the reporting options.
To stop the display from being refreshed, click the Pause button.
To resume refreshing the display, click the Resume button. Note that exiting the tab and returning to the tab will also resume refreshing the display.
Reports & Graphs - displays options for creating a new graph and viewing default graphs.
New Graph - displays a new tab with filters for customizing the graph. The tab label is the name you enter in the Graph Name field in the Filters section.
Overview - shows a thumbnail view of all graphs. Click on a thumbnail to enlarge it and display it in the Default Graphs tab. A toolbar is also displayed for saving, printing, and emailing the selected graph when you mouse over a graph.
Default Graphs - displays the default graphs in a larger format than the Overview tab. you can switch between the default graphs using the View pull down menu. You can also select the time range to display.
Custom graph tabs have the following options:
Remove Graph - deletes the selected graph.
Session - displays the session that is running.
Available Data Series - shows a list of session data generated by Oracle Load Testing and ServerStats. The data series listed is a subset of all of the available data series. Click Show All to display all available data series.
Default Graphs - select a graph and click Add Data Series to view a default graph.
Session Counters - the counters that are available for the overall session.
<profiles> - the counters that are available for each Oracle Load Testing virtual user profile.
Profile Nodes - list the counters for virtual user profiles available to include in the report graphs. The profile is the name of the virtual user profile(s) that were run in the Autopilot session. Select the counter(s) and click the Add Data Source button or double-click to add counters(s) to the Selected Data Series list.
Timer Nodes - list the page timers available to include in the report graphs. Timers correspond to the individual pages of the Visual Script(s) run by the virtual user profile. They allow you to view the performance of a specific page download within a test run, allowing you to identify bottlenecks. The timer is the name of the virtual user profile(s) that were run by the Autopilot session. The timers consist of the virtual user profile name/Visual Script name and the page number of the Visual Script. The timers are added to the session data when you select the Auto generate timers for all resources check box in Options from the Tools menu then selecting Scenario Defaults. Select the timer(s) and click the arrow button or double-click with the mouse to add timer(s) to the Selected Data Series list.
ServerStats Nodes - list the Oracle Load Testing ServerStats counters available to include in the report graph. The ServerStats counters are based upon the data source(s) and counters that were included in the ServerStats Data Source configuration when the Oracle Load Testing session was run. Select the counter(s) and click the Add Data Series button or double-click with the mouse to add counter(s) to the Selected Data Series list.
ServerStats Monitors - shows the ServerStats counter configuration.
Add Data Series - adds the selected data series to the graph.
Open - displays the Open Graph Query dialog box for selecting a query to use.
Edit - displays the Edit Graph Options dialog box for naming the graph, removing data series from the graph, and specifying X and Y-axis parameters.
Save - displays the Save Graph Query dialog box for saving the current query.
Clear - removes all data series from the graph.
X-Scale - the X-Scale shows the following information:
Absolute Time - when selected, the generated graph is based upon the actual start and end date and times of the profile/timer.
Relative Time - when selected, the generated graph is based upon relative time. Profiles/timers are graphed from a shared zero point.
Users - when selected, the generated graph is based upon users.
You can view the Performance Statistics report by selecting Performance Statistics from the dropdown list on the Reports tab on the Create Reports tab for sessions for which data has been saved, or by clicking on the Performance Statistics icon in the Overview tab on the View Run Graphs tab when you start an Oracle Load Testing session.
Detail Level - lets you specify the amount of detail shown in the report. This field is only displayed for the Performance Statistics report when viewed in the View Run Graphs tab.
The statistics show the values for the following performance categories:
Active Virtual Users - the number of virtual users currently running in the Autopilot. Clicking the link opens a Users vs. Time graph in a new sub-tab.
Virtual Users with Errors - the number of virtual users with errors. Clicking the link opens a Errors vs. Users graph in a new sub-tab.
Transactions Per Second - the number of times the virtual user played back the Visual Script per second. Clicking the link opens a Trans/sec, Users vs. Time graph in a new sub-tab.
Pages Per Second - the number of pages returned by the server per second. A "page" consists of all of the resources (i.e. page HTML, all images, and all frames) that make up a Web page. Clicking the link opens a Pages/sec, Users vs. Time graph in a new sub-tab.
Hits Per Second - the number of resource requests to the server per second. Each request for a page, individual images, and individual frames is counted as a "hit" by Oracle Load Testing. If Oracle Load Testing does not request images from the server (as specified in the Download Manager), images are not included in the hit count. The Hits Per Second and Pages Per Second counts will be the same if images are not requested and there are no frames in the page. Clicking the link opens a Hits/sec, Users vs. Time graph in a new sub-tab.
Kilobytes Per Second - the number of kilobytes transferred between the server and browser client per second. Clicking the link opens a KB/sec, Users vs. Time graph in a new sub-tab.
<Session Name> Totals
Transactions - the total number of times the virtual user played back the virtual user profile.
Transactions with Errors - the total number of virtual user profile iterations that had errors.
Pages - the total number of number of pages returned by the server.
Hits - the total number of resource requests to the server.
Kilobytes - the total number of kilobytes transferred between the server and browser client.
Performance by Profile and Timer
<Profile Name> - the latest, minimum, maximum, and average performance for the virtual user profile in seconds.
<Timer Name> - the latest, minimum, maximum, and average performance for the server response timers in seconds. Server Response timers are added to Visual Scripts using Oracle Functional Testing.
Min - the minimum performance for the virtual user profile or server response timer in seconds.
Max - the maximum performance for the virtual user profile or server response timer in seconds.
Avg - the average performance for the virtual user profile or server response timer in seconds.
Pass - the number that passed.
Fail - the number that failed.
Std Dev - the number of seconds that the performance of virtual user profiles or server response timers deviated from the mean (average value).
90th % - shows the number of seconds that the performance of ninety percent of the virtual users or server response timers was at or below.
The Load graphs lets you view real-time performance, statistical, and error information about the virtual users being run by the Autopilot. The default Oracle Load Testing graphs automatically start and consist of the following types of runtime graphs:
Performance Vs. Users
Errors Vs. Users
Performance Vs. Time
Errors Vs. Time
Users Vs. Time
Statistics Vs. Time
To view runtime statistics:
Click the View Run Graphs tab. The Overview tab is displayed showing a small view of the default graphs. This is useful for getting an at-a-glance view of all of the run graphs.
When you place your mouse over a graph in the Overview tab the following toolbar is displayed:
Save this image - displays the Save dialog box for saving the image.
Print this image - displays the Print dialog box for printing the image.
Send this image in email - displays the Send Pictures via Email dialog box for emailing the image.
Open my pictures folder - opens the My Pictures folder.
Click the graph you want to view to enlarge it and display it in the Default Graphs tab. You can switch between Load Graphs using the selector list at the top of the screen.
To create a custom graph:
Click Graph.
In the Available Data Series section, select the data you want to view. Use Ctrl-click and Shift-click to select multiple data series. If you do not see the data series you are looking for, click Show All to display all available data series.
Click Add Data Series.
Click Edit to display the Edit Graph Options dialog box for changing the graph name and specifying how to plot the graph.
Graph Node
Name - enter the name of the graph. This name is displayed in the tab in the Reports & graphs section.
Delete - deletes the selected data series from the graph.
Axis - displays the axis on which the data series will be graphed.
Data Series - displays the data series in the graph.
Name - displays the name of the data series that is displayed when you place the mouse over the data series in the graph.
Label - displays the label displayed in the legend.
Secondary Y-Axis - when checked, displays the selected data series on the secondary y-axis.
X-Axis Scale
Absolute Time - when selected, the generated report tables and graphs are based upon the actual start and end date and times of the profile/timer.
Relative Time - when selected, the generated report tables and graphs are based upon relative time. Profiles/Timers are graphed from a shared zero point.
Users - when selected, the generated report tables and graphs are based upon users.
X-Axis Range
Automatic - automatically creates the scale for the X axis.
Minimum - enter the minimum X-axis value. This field is only displayed when Automatic is not selected.
Maximum - enter the maximum X-axis value. This field is only displayed when Automatic is not selected.
Session Details
Start Times - displays the date and time that the session started.
End Time - displays the date and time that the session ended.
Duration - displays the length of the session.
Y-Axis and Secondary Y-Axis Scale
Linear - displays the Y-axis linearly.
Logarithmic -displays the Y-axis logarithmically.
Y-Axis and Secondary Y-Axis Range
Automatic - automatically creates the scale for the Y axis.
Minimum - enter the minimum X-axis value. This field is only displayed when Automatic is not selected.
Maximum - enter the maximum X-axis value. This field is only displayed when Automatic is not selected.
Y-Axis and Secondary Y-Axis Threshold Line - displays a threshold line on the graph at the configured location.
Value - enter the value of the threshold line, that is, the point on the Y-axis at which you want the line to be displayed.
Label - enter the label to display in the legend.
Enter a name for the graph.
Select how to plot the graph in the X-Axis and Y-Axis nodes.
Click OK. Each custom report is displayed under a separate tab so that you can select the one you want to view. Click Remove Graph to delete the graph and its tab.
This graph plots the average run time for the number of active virtual users.
If you have multiple profiles in the running Scenario the Performance Vs. Users graph shows separate plot lines for each scenario profile running in the Autopilot.
The Average Performance values are a graphical representation of the Average Value data for the Elapsed time entries shown in the Performance Statistics view. The graph adds plot points based upon the number of running virtual users as the Autopilot ramps up to the total number of virtual users for all scenarios.
The plot points are added in the same manner as the Elapsed time entries in the Performance Statistics report.
This graph plots the number of failed transactions-per-second for each Virtual User profile.
If you have multiple profiles in the running Scenario the Errors Vs. Users graph shows separate plot lines for each scenario profile running in the Autopilot.
The failed transactions-per-second depends upon the number of virtual users being run by individual profiles and the number server requests (page, image, frame, etc.) that fail during the Oracle Load Testing session.
This graph plots the average run time for virtual users over a period of time.
If you have multiple profiles in the running Scenario the Performance Vs. Time graph shows separate plot lines for each scenario profile running in the Autopilot.
The Average Run Time values are a graphical representation of the Average Value data for the Elapsed time entries shown in the Performance Statistics report that are plotted over time.
This graph plots the number of failed transactions per second for virtual users profiles over time.
If you have multiple profiles in the running Scenario the Errors Vs. Time graph shows separate plot lines for each scenario profile running in the Autopilot.
The failed transactions-per-second depends upon the number of virtual users being run by individual profiles and the number server requests (page, image, frame, etc.) that fail during the Oracle Load Testing session.
This graph plots the number of active virtual users over a period of time.
If you have multiple profiles in the running Scenario the Users Vs. Time graph shows separate plot lines for each scenario profile running in the Autopilot.
This graph plots the average hits, transactions and kilobytes per second over a period of time.
The Average Statistic values are a graphical representation of the Average Value data from the Performance Statistics tab over time. The plot points are updated while the Autopilot runs the virtual users.
Oracle Load Testing automatically generates a set of counters for Oracle Load Testing virtual user data that can be selected in the Available Data Series field in the Filters section. The Oracle Load Testing data includes overall data for the session at the top of the list followed by a folder for each Virtual User profile included in the Configure parameters of the scenario list of the Build Scenarios tab, similar to the following:
Oracle Load Testing also generates counters for each ServerStats monitor in the selected ServerStats configuration. You can create a new graph to monitor any of the counters in the list during the Load Test to view both VU performance and ServerStats monitor performance.
The Virtual User profile folders contain the data counters and page timer folders for the specific profile in the load testing Scenario.
You can create a new ServerStats chart to monitor any of the counters in the list during the Load Test.
The page timer folders contain the performance data for the individual pages of Visual Scripts used as a Virtual User profile, similar to the following:
You can create a new ServerStats chart to monitor any of the timers in the list during the Load Test.
The Create Reports tab is where you can view historical reports and graphs for sessions for which you have saved data for reporting. This tab has the following options:
Reports & Graphs - displays default and custom graphs, and gives options for exporting graphs.
New Graph - opens a blank tab and displays the filter options for creating a new graph.
Overview - displays a thumbnail view of each created graph.
Reports - displays the Session Performance Report. These reports can be exported to CSV or printed.
Graph <#> - displays custom graphs that you have created. These graphs can be exported in CSV, Excel, PDF, or JPG format.
The Reports tab has the following options:
Session - lets you select the session for which you want to view the session report.
Report - if you have created custom report templates, they are listed here so that you can select them and display a report using the template. Refer to Creating Report Templates later in this chapter for instructions on how to create a report template. The default is the session report.
Delete - deletes the selected template.
Generate - generates the report based on the session and report template selected.
Export to CSV - opens the data in a separate browser window in comma separated value format.
Print Friendly - opens the session report in a separate browser window. From there you can either print the report or save it in HTML format.
Include Think Times in Profile timers - specifies whether to include think time in session reports. This setting only applies for tests run using Thin or Java Agent.
Custom graph tabs have the following options:
Remove Graph - deletes the selected graph.
Session - lets you select the session for which you want to view data series.
Available Data Series - shows a list of session data generated by Oracle Load Testing and ServerStats. The data series listed is a subset of all of the available data series. Click Show All to display all available data series.
Default Graphs - select a graph and click Add Data Series to view a default graph.
Session Counters - the counters that are available for the overall session.
<profiles> - the counters that are available for each Oracle Load Testing virtual user profile.
Profile Nodes - list the counters for virtual user profiles available to include in the report graphs. The profile is the name of the virtual user profile(s) that were run in the Autopilot session. Select the counter(s) and click the Add Data Source button or double-click to add counters(s) to the Selected Data Series list.
Timer Nodes - list the page timers available to include in the report graphs. Timers correspond to the individual pages of the Visual Script(s) run by the virtual user profile. They allow you to view the performance of a specific page download within a test run, allowing you to identify bottlenecks. The timer is the name of the virtual user profile(s) that were run by the Autopilot session. The timers consist of the virtual user profile name/Visual Script name and the page number of the Visual Script. The timers are added to the session data when you select the Auto generate timers for all resources check box in Options from the Tools menu then selecting Scenario Defaults. Select the timer(s) and click the arrow button or double-click with the mouse to add timer(s) to the Selected Data Series list.
ServerStats Nodes - list the ServerStats counters available to include in the report graph. The ServerStats counters are based upon the data source(s) and counters that were included in the ServerStats Data Source configuration when the Oracle Load Testing session was run. Select the counter(s) and click the Add Data Series button or double-click with the mouse to add counter(s) to the Selected Data Series list.
ServerStats Monitors - shows the ServerStats counter configuration.
Add Data Series - adds the selected data series to the graph.
Open - displays the Open Graph Query dialog box for selecting a query to use.
Edit - displays the Edit Graph Options dialog box for naming the graph, removing data series from the graph, and specifying X and Y-axis parameters.
Save - displays the Save Graph Query dialog box for saving the current query.
Clear - removes all data series from the graph.
X-Scale - provides the following information:
Absolute Time - when selected, the generated graph is based upon the actual start and end date and times of the profile/timer.
Relative Time - when selected, the generated graph is based upon relative time. Profile/timers are graphed from a shared zero point.
Users - when selected, the generated graph is based upon users.
Export to CSV - opens the data in a separate browser window in comma separated value format.
Export to Excel - opens the data in a separate browser window in Excel format.
Export to PDF - opens the graph in a separate browser window in portable document format.
Export to JPG - opens the graph in a separate browser window in JPG format.
You can quickly view session data by creating custom graphs.
Click the Create Reports tab. A blank tab is displayed for creating a new graph.
Select the session you want to graph.
Select the data you want to view in the Available Data Series field. Use Ctrl-click and Alt-Click to select multiple data series.
Click Add Data Series.
Repeat for all of the data series you want to graph.
Click Edit to display the Edit Graph Options for naming the graph and selecting how to plot the graph.
Click OK.
Each custom report is displayed under a separate tab so that you can select the one you want to view. Click the Remove Graph button located on the graph's tab to delete the graph and its tab. Click Export to CSV to save the graph as a CSV file. Click Export to Excel to save the graph as a CSV file. Click Export to PDF to save the graph as a PDF file. Click Export to JPG to save the graph as a JPG file.
You can save this query as described later in this chapter for later use against another session.
When you export generated data from a report, Oracle Load Testing creates a comma separated value (.csv) file containing the raw data used to generate reports. The first line of the file contains the field names separated by commas. Each additional line contains the data values separated by commas. The following is an example of a .csv file from a Performance vs. Time report:
Time,Entire Job,tutor1,tutor4, 04-09-2001 15:59:48,,.6,, 04-09-2001 16:00:00,,,.13, 04-11-2001 17:08:04,,1.15,, 04-11-2001 17:08:29,1.39,,.24, 04-11-2001 17:09:19,,.98,, 04-11-2001 17:09:25,,,.12,
This example includes the following fields:
Time Entire Job tutor1 tutor4
The additional lines of the .csv file list the actual data (the time values followed by the number of seconds).
The .csv file for each type of report will contain the type of data specific to the report type.
You can export the raw data used to generate reports to a comma separated value (.csv) file. To export generated report data:
Create a report.
Click Export to CSV. The File Download dialog box is displayed.
Click Open to open the file in Excel in CSV format. Click Save to save the file in CSV format.
If you chose to save the file, the Save As dialog box is displayed. Enter a new name for the file or accept the default, select the location to save to, and click Save.
To export as an Excel Workbook file:
Create a report.
Click Export to Excel. The File Download dialog box is displayed.
Click Open to open the chart in Excel. Click Save to save the chart in Excel format.
If you choose to save the file, the Save As dialog box is displayed. Enter a name for the file or accept the default, select the location to save the file, and click Save.
You can export reports to a PDF file. To export to a PDF file:
Generate a report.
Click Export to PDF.
The report is displayed in Adobe Acrobat Reader in a separate browser window.
Click the Save button on the Acrobat toolbar to open the Save As dialog box.
Enter a name for the file and click Save.
You can export reports to a JPG file. To export to a JPG file:
Generate a report.
Click Export to JPG.
The report is displayed in a separate browser window.
Move the mouse to the upper left corner of the screen to display the toolbar.
Click the Save button to open the Save As dialog box.
Enter a name for the file and click Save.
A graph query consists of the sessions, data series, and X and Y-axis settings. Once you select this information you can save it and reuse it later in the following ways:
save a graph of a single session and apply it to a new session to create a new graph.
save a graph of a baseline session and a run session and apply it to a new run session to create a new graph with the original baseline.
save a graph of a single session and apply it to a new session and add the counters to the current graph definition.
To save a graph query:
Select the sessions and data series that you want to graph.
Click Save in the graph toolbar.
<query list> - lists the existing saved queries.
Name - enter a name for the new query or select an existing query to overwrite it.
To create a new query, enter a name for the query and click OK. To overwrite an existing query, select the query and click OK, then click Yes when asked to confirm.
To run a saved query:
Click Open in the graph toolbar.
<Query List> - lists the existing queries. Select the query that you want to run.
Session - select the session against which you want to run the query.
Add to current graph - when selected, the new session data is added to the graph. When deselected, the graph is cleared and the new session data is displayed.
Select the query you want to use.
Select the session against which you want to run the query.
Select whether or not to add this session data to the current graph.
Click OK.
A warning message is displayed if some of the data series cannot be applied to the selected session. If this happens, click OK to continue.
The new graph is generated.
To edit a query:
Click Graphs from the Manage menu.
Edit - displays the Edit Graph Query dialog box.
Delete - deletes the selected query.
Clone - displays the Edit Graph Query dialog box with the configuration of the selected query. This lets you copy the selected query and edit it to create a new query.
Query Name - lists the existing queries.
Select the query you want to change and click Edit.
Make and changes and click OK.
Click Close to exit the Graph Query Manager dialog box.
You can create custom report templates that you can upload to Oracle Load Testing. These templates are shown on the Reports tab in the Create Reports tab. Once uploaded you can select a session, select the report template, and generate the report.
Report templates are created using the Oracle Load Testing Report Generator tool in Microsoft Word. This tool can be installed on any Windows machine that has Microsoft Word. Oracle Application Testing Suite does not have to be installed to use the tool.
Once installed, report templates are created in Microsoft Word and then uploaded to Oracle Load Testing. Then generated reports are displayed in Microsoft Word.
To install the Report Generator tool:
Close Microsoft Word.
Run the OLTOfficeToolbarInstaller.exe program located in the OracleATS/OFT folder in the Oracle Application Testing Suite installation directory.
The Insert OLT Data button is added to the toolbar in Microsoft Word.
You can now create report templates. Report templates can contain text, graphics, Oracle Load Testing graphs and session data. In addition, you can include custom Java code. To create a report template:
Click the Insert OLT Data button to display the following dialog box.
This dialog box has the following options:
Graphs - lists the default Oracle Load Testing graphs or a custom list of graphs if you have created a template.properties file.
Optional Settings - leave these settings blank to use the defaults.
Title - enter a title for the graph.
Height - enter a height for the graph.
Width - enter a width for the graph.
Session data - select the session data that you want to display, session name, overview, page data, or profile data. The generated data is comma-separated so that you can easily convert it to a table by selecting Convert from the Table menu then select Text to Table.
Custom code - this section can be used to create Java code using the methods that are available in the Report Generator API. Documentation for this API can be accessed from the online help table of contents.
Note:
To move to the next line use CTRL-Enter not Enter. Enter exits the dialog box.Select the graph or session data that you want to display or enter custom code.
Click Insert. A field code is inserted into the document and it is displayed as a comment. To edit the field code, select it, right-click on it and select Edit Field.
In the template, press Enter to move to the next line.
When you are finished creating the template, click Close to exit the Insert Oracle Load Testing Reference dialog box.
Click Save from the File menu. Enter a name for the file and save it as file type .rtf. The file can be saved to any location.
You can now upload the file to Oracle Load Testing and start generating reports. To upload the file:
In Oracle Load Testing, select Upload File from the Tools menu.
In the Type field, select Report Template.
Click Browse.
Select the report template and click Open.
Click Upload.
Click Close. The template will be listed on the Reports tab in the report list.
To generate a report, select the session, select the template, and click Generate. The report is generated and displayed in Word.
You can change the list of graphs and session data that is available in the Insert OLT Reference dialog box by creating a template.properties file in the OracleATS/OFT folder. If this file exists, the graphs and session data listed in it are used. If it does not exist, the defaults are used. This file lists the graphs and session data that you want to make available. For example:
[GRAPH]
Performance vs. Time@<%out.write(session.getGraph('Performance vs. Time'))%>
Errors vs. Time@<%out.write(session.getGraph('Errors vs. Time'))%>
Statistics vs. Time@<%out.write(session.getGraph('Statistics vs. Time'))%>
[SESSION]
Session Name@<%=session.getName()%>
Overview@<%=session.getOverview()%>
You can generate summary reports containing statistical information about the last data collection and reporting session and the Scenario Profile settings.
On the Create Reports tab, select the Reports tab and then select the session for which you want to view reports. The Session Performance report is displayed followed by the Oracle Load Testing Scenario report.
Scenario Report - displays a summary of Scenario settings and options that were used to run virtual users.
Session Report - displays a summary of performance and error statistics data for the virtual user session.
The following sections explain more about the summary reports.
The generated report file is the same name as the Scenario in Oracle Load Testing (i.e. the Scenario Description field of the Scenario tab).
To save the report, click Print Friendly. The report is displayed in a separate browser window. Select Save As from the File menu to save the report in HTML or text format.
You can print the report by clicking Print Friendly. The report is displayed in a new browser window. Select Print from the File menu. A print dialog box opens for setting the printer options. The available options are specific to the type of printer. Set the options and click the appropriate OK or Print button.
To save the Scenario as a different name:
Select Save As from the Scenario menu.
Enter a new Name in the Name field of the Save Scenario dialog box.
Select the workspace to save the report in and click OK.
To save the report, click Print Friendly. The report is displayed in a separate browser window. Select Save As from the File menu to save the report in HTML or text format.
You can print the report by clicking Print Friendly. Select Print from the File menu. A print dialog box opens for setting the printer options. The available options are specific to the type of printer. Set the options and click the appropriate OK or Print button.
To delete session data from the database or edit your session file names and descriptions:
Select Sessions from the Manage menu to display the Session Manager.
This dialog box lets you manage session data in the database.
Edit - displays the Edit Session dialog box for changing the name and description of the session.
Delete - deletes the entire selected session data from the database. To select more than one session, hold down the CTRL key.
Delete VU Display Data - deletes only the VU display data for the selected sessions. To select more than one session, hold down the CTRL key.
Session Name - the names of the virtual user sessions run by the Oracle Load Testing Autopilot. Oracle Load Testing lets you specify a name for the session data when you start the Autopilot to play back virtual users.
Start Time - shows the date and time of day the virtual user session was started.
End Time - shows the date and time of day the virtual user session ended.
Description - shows the status of the session. One of the following status entries may appear:
[Blank] - the session data was stored to the database successfully.
start of session - the session database is currently being accessed by an Oracle Load Testing session.
end of session - the data for the session has been committed to the database and is ready for reporting.
saving data - session data is being saved.
VU Data - indicates whether VU data was saved for this session.
Select the Session Name to delete. To select more than one session, hold down the CTRL key.
Click Delete to delete the session or click Delete VU Display Data to delete the VU display log only.
|
 Copyright © 1997, 2010, Oracle and/or its affiliates. All rights reserved. Legal Notices |
|