Tests can be manual or automatic. Automatic Oracle OpenScript scripts can be run from Oracle Test Manager. For manual tests, you enter the individual test steps. When you run a manual test, a wizard guides you through each step, allowing you to enter the results.
Tests can be grouped together into branches for easy management. Once entered, they can be associated with the requirements they address or any issues that result from running the test.
When you run a test, you can specify the workstation to run it on. Workstations are configured using the Systems Manager. To run Oracle OpenScript tests on remote systems, you must also install the Oracle Application Testing Suite Remote Agent on the remote system and configure Remote Agent Service login credentials. See the "Installing the Oracle Load Testing Remote Agent" section in the Oracle Application Testing Suite Release Notes for additional information about installing the agent and configuring the login credentials.
In addition, tests can be scheduled to run once at a specified day and time, daily at a specified time, or weekly at a specified day and time.
Oracle OpenScript scripts can be added from the Web interface. To add an Oracle OpenScript test:
Select the Tests tab.
Click the Add button.
Enter a name for the test.
Select Oracle OpenScript in the Type field.
This dialog box has the following options:
Name - displays the test name.
Type - displays the type of test. The last type selected is displayed first in the list.
Manual Test - manual tests are entered, performed, and kept track of manually.
Test folder - high level descriptions for grouping tests together.
Oracle OpenScript - scripts created using Oracle OpenScript.
Test Group - a list of tests that are sequentially run together that can also be scheduled. In addition, the overall results are tracked and displayed.
3rd Party Test - use this option when you want to run an executable file and capture the results.
Repository - for OpenScript scripts, specifies the repository where the script is located. Click Find to display the Select Script dialog box for selecting the script file.
Workspace - for OpenScript scripts, specifies the workspace where the script is located. When you select a script using Find, the workspace will be filled in automatically.
OpenScript - specifies the OpenScript script file name. When you select a script using Find, the script name will be filled in automatically.
Owner - select the user that owns the test. Only users with read permission for this project are listed.
Functionality - for 3rd party tests, displays the regular expression that you want to match for a result of passed. For all other test types, displays the description of the functionality the test is designed to verify.
Priority - displays the priority of the test. These options can be changed by your system administrator.
Description - displays the test description.
Attachment - lets you add an attachment or link to this test.
File - lets you add an attachment to the Attachments section.
Browse - displays the Choose File dialog box for selecting the file to attach.
Capture - starts the Screen Capture utility for capturing a screen, saving it as either a .JPG or .BMP file, and populating the Attachment field. Refer to Appendix A for instructions on using the utility or select Contents from the Help menu in the utility.
Note:
The utility must be running in your system tray to use this option. If it is not running, a dialog box is displayed saying that the program could not be found. Click on theScreenCaptureInstall.exe link to download the utility.Link - lets you add a link to the Links section.
Title - enter a descriptive title for the link. This will be displayed in the Links section.
Link - enter the URL. For example, http://www.company.com. If a title is not entered, the URL is displayed in the links section.
Reset - clears the fields and returns the dialog box options to the starting state.
Click Find to display the Select Script dialog box.
Select the Repository and Workspace.
Select the Oracle OpenScript script that you want to add.
Click OK.
Select the owner and priority and enter any descriptive information in the Functionality and Description fields.
Click Save.
Note:
The fields and options available to you may be different than those shown in the following examples if your system has been customized by your system administrator.Tests are automatically numbered when you enter them. You can reorder them using the Move buttons. To add a manual test:
Select the Tests tab.
Click the Add button.
Enter the name of the test.
Select the Manual Test in the Type field.
This dialog box has the following options:
Name - displays the test name.
Type - displays the type of test.
Manual Test - manual tests are entered, performed, and kept track of manually.
Test folder - high level descriptions for grouping tests together.
Oracle OpenScript - scripts created using Oracle OpenScript.
Test Group - a list of tests that are sequentially run together that can also be scheduled. In addition, the overall results are tracked and displayed.
3rd Party Test - use this option when you want to run an executable file and capture the results.
Owner - select the user that owns the test. Only users with read permission for this project are listed.
Functionality - for 3rd party tests, displays the regular expression that you want to match for a result of passed. For all other test types, displays the description of the functionality the test is designed to verify.
Priority - displays the priority of the test. These options can be changed by your system administrator.
Description - displays the test description.
Attachment - lets you add an attachment or link to this test.
File - lets you add an attachment to the Attachments section.
Browse - displays the Choose File dialog box for selecting the file to attach.
Capture - starts the Screen Capture utility for capturing a screen, saving it as either a .JPG or .BMP file, and populating the Attachment field. Refer to Appendix A for instructions on using the utility or select Contents from the Help menu in the utility.
Note:
The utility must be running in your system tray to use this option. If it is not running, a dialog box is displayed saying that the program could not be found. Click on theScreenCaptureInstall.exe link to download the utility.Link - lets you add a link to the Links section.
Title - enter a descriptive title for the link. This will be displayed in the Links section.
Link - enter the URL. For example, http://www.company.com. If a title is not entered, the URL is displayed in the links section.
Reset - clears the fields and returns the dialog box options to the starting state.
Select the owner of the test.
Enter a description of the functionality to be tested.
Select the test priority.
Enter a description of the test.
Click Save.
Select Add/Edit in the Test Steps section of the right-hand pane.
This dialog box has the following options:
Add - adds a new row under the selected row. When you click the tab key the test in the Action, Expected Result, and Comment fields is added to the grid. Clicking Add again also populates the grid.
Delete - deletes the selected step.
Move Up - moves the selected step up one position in the list.
Move Down - moves the selected step down one position in the list.
First - display the first step.
Previous - displays the previous step.
Next - displays the next step.
Last - displays the last step.
# - displays the step number.
Action - displays the action to perform.
Expected Result - displays a description of what is expected to happen as a result of this step.
Comment - displays additional information about the step.
Add/Edit Attachments - displays the Add Attachment dialog box for adding an attachment associated with this test step. Attachments are listed in the Test Steps section of the right-hand pane.
Click Add.
Enter the information in the Action, Expected Result, and Comment fields for the step. The gird is populated when move to the next field or when you click Add.
Click Add/Edit Attachments to add an attachment associated with this step.
Click Add to add another step or OK to exit the dialog box when you are finished adding steps.
Folders are automatically numbered when you enter them. You can reorder them using the Move buttons. To add a test folder:
Select the Tests tab.
Click the Add button.
Enter a name for the test.
Select Test Folder in the Type field.
This dialog box has the following options:
Name - displays the test name.
Type - displays the type of test. The last type selected is displayed first in the last.
Manual Test - manual tests are entered, performed, and kept track of manually.
Test folder - high level descriptions for grouping tests together.
Oracle OpenScript - scripts created using Oracle OpenScript.
Test Group - a list of tests that are sequentially run together that can also be scheduled. In addition, the overall results are tracked and displayed.
3rd Party Test - use this option when you want to run an executable file and capture the results.
Owner - select the user that owns the test. Only users with read permission for this project are listed.
Functionality - for 3rd party tests, displays the regular expression that you want to match for a result of passed. For all other test types, displays the description of the functionality the test is designed to verify.
Priority - displays the priority of the test. These options can be changed by your system administrator.
Description - displays the test description.
Attachment - lets you add an attachment or link to this test.
File - lets you add an attachment to the Attachments section.
Browse - displays the Choose File dialog box for selecting the file to attach.
Capture - starts the Screen Capture utility for capturing a screen, saving it as either a .JPG or .BMP file, and populating the Attachment field. Refer to Appendix A for instructions on using the utility or select Contents from the Help menu in the utility.
Note:
The utility must be running in your system tray to use this option. If it is not running, a dialog box is displayed saying that the program could not be found. Click on theScreenCaptureInstall.exe link to download the utility.Link - lets you add a link to the Links section.
Title - enter a descriptive title for the link. This will be displayed in the Links section.
Link - enter the URL. For example, http://www.company.com. If a title is not entered, the URL is displayed in the links section.
Reset - clears the fields and returns the dialog box options to the starting state.
Enter a description of the functionality of the folder.
Select the owner and priority and enter any descriptive information in the Functionality and Description fields.
Click Save.
Once you have created a Test Group, you can add tests to it. Oracle OpenScript tests and manual test can be added to a Test Group. The same test can be added more than once. The tests in the group are run sequentially, and the group can also be scheduled. To add tests:
Click the Tests tab.
Select the Test Group to which you want to add tests.
In the right pane, click Add/Edit in the Test List area to display the Tests dialog box. There are two ways you can select tests. You can search for them or select them from the tree view.
To select tests by searching for them:
Click the Find tab.
Saved filters - lists the saved filter configurations. Select a saved filter to edit or delete it.
Save - displays the Save Criteria dialog box for saving the settings. Filters do not have to be saved.
Delete - deletes the selected saved filter.
Search for - displays whether you are searching requirements, tests, or issues.
that match - select how to apply the filtering criteria.
all - match all of the configured criteria. This setting places an AND between the criteria. For example, if you wanted to view all issues with a high priority that are assigned to you, use this option.
any - match any of the configured criteria. This setting places and OR between the criteria. For example, if you wanted to view all issues with either a high priority or a high severity, use this option.
a combination - this setting lets you combine AND and OR. For example, if you wanted to view all issues assigned to Mary or Caren with a high priority, use this option. This option lets you select how to group the criteria using parenthesis as required. For example:
(((Assigned to = Mary OR Assigned to = Caren) AND Priority = High) OR Severity = High)
<left parenthesis> - select the left parenthesis up to three.
Field - select the field that you want to use to select the items to display.
Operator
Equals - causes only items that match the value for the selected field to be displayed.
Not Equal to - causes only items that do not match the value for the selected field to be displayed.
Value - enter or select the value of the field that you want to use to select the items to display.
<right parenthesis> - select the right parenthesis up to three.
<operator> - select the operator to use, AND or OR.
<delete> - deletes the corresponding criteria.
<expression> - shows the filtering expression you are creating as you select criteria.
Results - displays the nodes that match the search criteria.
Select - places the selected nodes in the Selected Tests field.
Select All - places all nodes in the Results field in the Selected Tests field.
Selected Tests - displays the selected nodes.
<up arrow> - moves the selected test up one place.
<down arrow> - moves the selected test down one place.
Remove - removes the selected nodes from the Selected Tests field.
Remove All - removes all nodes from the Selected Tests field.
OK - closes the dialog box and saves changes.
Cancel - closes the dialog box without saving changes.
Enter the search criteria or select a saved filter and click Search.
Select the tests you want to add or click Select All to add them all.
Click OK.
To select tests using the tree view:
Click the TreeView tab.
<test list> - double click tests to add and delete them from the list of selected tests or select the tests you want to add and click Select.
Select - places the selected test in the Selected Tests field.
Select All - places all tests in the Results field in the Selected Tests field.
Selected Tests - displays the selected nodes.
Remove - removes the selected nodes from the Selected Tests field.
Remove All - removes all nodes from the Selected Tests field.
OK - closes the dialog box and saves changes.
Cancel - closes the dialog box without saving changes.
Select the tests you want to add or click Select All to add all tests.
To remove nodes from the Selected Tests field, select the nodes and click Remove or click Remove All to remove all nodes.
Click OK.
Note:
The fields and options available to you may be different than those shown in the following examples if your system has been customized by your system administrator.The 3rd party test lets you run an executable file and capture the results. Before creating the 3rd party test, create a batch or command file using a text editor such as Notepad. This file can contain anything that can be run from the command line.
Once you create the test, you can add test steps that use regular expressions to parse the test output to determine if the test was successful. If all test steps pass, the test result is passed. If one step fails, the test result is failed.
After the test has run, you can view the console output in the results report. To add a 3rd Party test:
Select the Tests tab.
Click the Add button.
Enter a name for the test.
Select 3rd Party Test in the Type field.
This dialog box has the following options:
Name - displays the test name.
Type - displays the type of test. The last type selected is displayed first in the last.
Manual Test - manual tests are entered, performed, and kept track of manually.
Test Folder - high level descriptions for grouping tests together.
Oracle OpenScript - scripts created using Oracle OpenScript.
Test Group - a list of tests that are sequentially run together that can also be scheduled. In addition, the overall results are tracked and displayed.
3rd Party Test - use this option when you want to run an executable file and capture the results.
Test File - for Oracle OpenScript tests, displays the script test file name. For 3rd Party tests, displays the file that will run. Click Browse to display the Select Script or Choose File dialog box for selecting the file.
Owner - select the user that owns the test. Only users with read permission for this project are listed.
Functionality - enter a description of the functionality being tested.
Priority - displays the priority of the test. These options can be changed by your system administrator.
Description - displays the test description.
Attachment - lets you add an attachment or link to this test.
File - lets you add an attachment to the Attachments section.
Browse - displays the Choose File dialog box for selecting the file to attach.
Capture - starts the Screen Capture utility for capturing a screen, saving it as either a .JPG or .BMP file, and populating the Attachment field. Refer to Appendix A for instructions on using the utility or select Contents from the Help menu in the utility.
Note:
The utility must be running in your system tray to use this option. If it is not running, a dialog box is displayed saying that the program could not be found. Click on theScreenCaptureInstall.exe link to download the utility.Link - lets you add a link to the Links section.
Title - enter a descriptive title for the link. This will be displayed in the Links section.
Link - enter the URL. For example, http://www.company.com. If a title is not entered, the URL is displayed in the links section.
Click Browse to display the Choose File dialog box.
Select the file that you want to run.
Select the owner and priority and enter any descriptive information in the Functionality and Description fields.
Click Save.
Select Add/Edit in the Test Steps section of the right-hand pane.
This dialog box has the following options:
Add - adds a new row under the selected row. When you click the tab key the test in the Action, Expected Result, and Comment fields is added to the grid. Clicking Add again also populates the grid.
Delete - deletes the selected step.
Move Up - moves the selected step up one position in the list.
Move Down - moves the selected step down one position in the list.
First - display the first step.
Previous - displays the previous step.
Next - displays the next step.
Last - displays the last step.
# - displays the step number.
Action - displays the description of the action.
Result Pattern - displays the regular expression that will be used to parse the output of the third party test, which will determine if the step passed or failed. Refer to Appendix B for more information on regular expressions.
Comment - displays additional information about the step.
Add/Edit Attachments - displays the Add Attachment dialog box for adding an attachment associated with this test step. Attachments are listed in the Test Steps section of the right-hand pane.
Click Add.
Enter the information in the Action, Result Pattern, and Comment fields for the step. The gird is populated when move to the next field or when you click Add.
Click Add/Edit Attachments to add an attachment associated with this step.
Click Add to add another step or OK to exit the dialog box when you are finished adding steps.
You can delete tests from the project. To delete a test or branch:
Select the test or branch that you want to delete.
Click the Delete button.
Click Yes when asked to confirm the deletion.
To delete multiple tests:
Select the tests you want to delete using SHIFT-click and CTRL-click.
Click Delete. The Delete Tests dialog box is displayed showing the selected tests.
Selected nodes - lists the nodes that you selected. Uncheck any nodes that you do not want to delete.
OK - deletes the selected nodes.
Reset - checks all of the nodes.
Deselect any nodes that you do not want to delete.
Click OK.
Note:
The fields and options available to you may be different than those shown in the following examples if your system has been customized by your system administrator.To edit tests:
Select the test you want to change.
Click Edit.
This dialog box has the following options:
Name - displays the test name.
Type - displays the type of test. The last type selected is displayed first in the last.
Manual Test - manual tests are entered, performed, and kept track of manually.
Test folder - high level descriptions for grouping tests together.
Oracle OpenScript - scripts created using Oracle OpenScript.
Test Group - a list of tests that are sequentially run together that can also be scheduled. In addition, the overall results are tracked and displayed.
3rd Party Test - use this option when you want to run an executable file and capture the results.
Repository - for OpenScript scripts, specifies the repository where the script is located. Click Find to display the Select Script dialog box for selecting the script file.
Workspace - for OpenScript scripts, specifies the workspace where the script is located. When you select a script using Find, the workspace will be filled in automatically.
Test File - for 3rd Party tests, displays the script test file name. Click Browse to display the Choose File dialog box for selecting the test file.
Owner - select the user that owns the test. Only users with read permission for this project are listed.
Functionality - displays the description of the functionality the test is designed to verify.
Priority - displays the priority of the test. These options can be changed by your system administrator.
Description - displays the test description.
Make any changes.
Click Save.
To edit test step page titles or comments, or to add an attachment to a test step click Add/Edit in the Test Steps section of the right-pane.
Make any changes.
Click OK.
You can edit several tests at the same time if you want to make the same change to them all. To edit multiple tests:
Select the tests you want to edit.
Select Edit Test from the right-click menu.
Selected nodes - lists the selected nodes. Deselect nodes that you do not want to edit.
Fields - the fields listed are determined by the type of node and whether there are any custom fields.
Check Box - select the check box to change the field's value. The change will be applied to all of the selected nodes.
Deselect any nodes that you do not want to change.
Select a field that you want to change.
Select or enter the new value. The change will be made to all of the selected nodes.
Repeat for all fields that you want to change.
Click Save.
To edit test steps for a manual test:
Select the test for which you want to edit test steps.
Select Add/Edit in the Test Steps section of the right-hand pane.
This dialog box has the following options:
Add - adds a new row under the selected row. When you click the tab key the test in the Action, Expected Result, and Comment fields is added to the grid. Clicking Add again also populates the grid.
Delete - deletes the selected step.
Move Up - moves the selected step up one position in the list.
Move Down - moves the selected step down one position in the list.
First - display the first step.
Previous - displays the previous step.
Next - displays the next step.
Last - displays the last step.
# - displays the step number.
Action - displays the action to perform.
Expected Result - displays a description of what is expected to happen as a result of this step.
Comment - displays additional information about the step.
Add/Edit Attachments - displays the Add Attachment dialog box for adding an attachment associated with this test step. Attachments are listed in the Test Steps section of the right-hand pane.
Make any changes.
Click OK.
You can convert manual test case nodes to Oracle OpenScript test case nodes. Oracle Test Manager maintains the test case definition and results and allows you to replace the manual test steps with Oracle OpenScript scripts. To convert a manual test:
Select the test you want to convert and click Edit. The Edit Test dialog box is displayed.
Select Oracle OpenScript in the Type field.
Select the test file that you want to use.
Click OK when asked if you are sure that you want to convert the test type. The Convert test type dialog box is displayed.
Save a copy of the selected Manual Test Case - saves both the converted test case and the original test case.
Save the prior results history with the new Oracle Functional Testing Test Case - saves the prior results history with the new test.
Select the options and click OK.
Click Save.
The Systems Manager lets you configure the systems on which you will be running tests. When you run or schedule a test, you can specify the workstation on which to run the test.
To add a system:
Select Systems from the Tools menu. The Systems Manager dialog box is displayed.
New - displays the Systems dialog box for adding a new system.
Edit - displays the Systems dialog box for editing the selected system.
Delete - deletes the selected system.
Name - lists the configured systems.
Click New.
Name - enter the system's name.
Host Name or IP - enter the system's host name or IP address.
Username - enter the user name for agent authentication. The Username is the user name specified for the agent Authentication Profile in the Oracle Load Testing Agent Authentication Manager. The username for the default agent Authentication Profile is JMSAdmin. To view other defined agent Authentication Profile Usernames, select Oracle Application Testing Suite from the Programs Start menu, then select Oracle Load Testing Agent Authentication Manager from the Tools submenu. Select an agent Authentication Profile to view the details.
Password - enter the password for agent authentication. The Password is the password specified for the agent Authentication Profile in the Oracle Load Testing Agent Authentication Manager. The password for the default agent Authentication Profile is blank. To change the password for a defined agent Authentication Profile Usernames, select Oracle Application Testing Suite from the Programs Start menu, then select Oracle Load Testing Agent Authentication Manager from the Tools submenu. Select an agent Authentication Profile to view the details and enter a new password.
Port - enter the port.
Test - attempts to access the system and displays a message stating whether the system is available.
Enter the system's name.
Enter the system's host name or IP address.
Specify the username and password for the agent Authentication Profile.
Change the default port, if necessary.
Click Test to see if the system is available.
Click OK to close the test result window.
Click OK.
To edit a system:
Select Systems from the Tools menu.
New - displays the Systems dialog box for adding a new system.
Edit - displays the Systems dialog box for editing the selected system.
Delete - deletes the selected system.
Name - lists the configured systems.
Select the system that you want to change.
Click Edit.
Name - enter the system's name.
Host Name or IP - enter the system's host name or IP address.
Username - enter the user name for agent authentication.
Password - enter the password for agent authentication.
Port - enter the port.
Test - attempts to access the system and displays a message stating whether the system is available.
Make any changes.
Click Test to see if the system is available.
Click OK to exit the test result window.
Click OK.
You can individually run manual tests, Oracle OpenScript functional tests, third party, or Test Groups.
To run automated tests:
Select the test you want to run.
Click Run this test in the Run History section of the right pane.
This dialog box has the following options:
System - select the system on which you want to run this test. Systems are configured using the Systems Manager.
Version - select the version of software you are using or select Other to enter a version that is not in the list.
Run Settings - specify any additional arguments or command line settings to use when running an Oracle OpenScript script. See the Oracle OpenScript User's Guide for additional information about using command line settings.
Note:
If your administrator has created Test Run custom fields, they will appear in this dialog box.Select the system on which you want to run the test.
Select the version number against which the test will run.
Specify any run settings and click Save. The script is started and plays back in the agent.
Click Refresh to show the results in the Run History section of the right pane. Click the date in the Run History field to display result parameters, summary and detail information. Click View Report in the Result Summary section to view the Results Report.
To run a manual test:
Select the test you want to run.
Click Run this test in the Run History section of the right pane.
This dialog has the following options:
Version - select the version of the software you are testing or select Other to enter a version that is not in the list.
Note:
If your administrator has created Test Run custom fields, they will appear in this dialog box.Enter or select the version number and click Save.
This dialog box appears for each step in the test. It has the following options:
First - displays the first step.
Previous - displays the previous step.
Next - displays the next step.
Last - displays the last step.
Minimize/Maximize - toggles the size of the dialog box.
Start Timer - starts the timer. When the timer is on, it keeps track of how long it took to run each step and the complete test. The Duration and Iteration Total Time fields in the Result Detail Section will be populated.
Stop Timer - stops the timer. The Duration field in the Result Detail Section will be populated for the steps that were completed.
Make All - sets the result of all steps to the selected status, either Passed, Failed, Warning, or any user-defined field configured for the Status field in the Administrator.
Action - displays the action to perform.
Expected Result - displays the expected result.
Comment - displays additional information about the step.
Attachments - lists the attachments associated with this step.
Result - select the outcome of the step after performing it.
Summary - enter additional information about the step.
Add Issue - automatically adds an issue stating that the test had a status of failed or warning. This option is only available when Failed or Warning is selected.
Save Run - saves the test run status and shows a result of In Progress in the Run History section for this test run. Click Resume this run to resume testing.
Click the Start Timer button if you want Oracle Test Manager to keep track of how long it takes to complete each step. If you are using the timer the Duration and Iteration Total Time fields in the Result Detail Section will be populated. If you stop the timer or save the run only the Duration field will be populated for the completed steps.
Perform each step and select the result or use Make All to set the same result for each step.
Click Save Run to save the results for the completed steps without finishing the test run or click Finish when you are done. You can continue testing by clicking Resume this run in the Run History section.
Result - enter the overall outcome of the test.
Summary - enter additional information about the test.
Enter the overall test result and any summary comments and click Finish.
When you run a Test Group, Oracle Test Manager runs the tests in the group in sequence.
To run a Test Group:
Select the Test Group and click Run this test in the right pane.
Select the system on which you want to run this test and click Save.
Enter the version number of the software you are testing.
The Run Test Group dialog box is displayed for monitoring progress.
When all tests are finished, the Group Test dialog box is displayed showing a summary of the results.
Click Close.
To run third party tests:
Select the test you want to run.
Click Run this test in the Run History section of the right pane.
This dialog box has the following options:
System - select the system on which you want to run this test. Systems are configured using the Systems Manager.
Version - select the version of software you are using or select Other to enter a version that is not in the list.
Note:
If your administrator has created Test Run custom fields, they will appear in this dialog box.Select the system on which you want to run the test.
Select the version number against which the test will run and click Save.
A message stating that the test is running is displayed. A command line window is displayed showing the batch file execution.
Click Refresh to show the results in the Run History section of the right pane.
Perform the following steps if the third party test fails to run on the remote machine:
Make sure that the Oracle Load Testing Agent Service is running on the remote machine.
Check the <installdir>\logs\agentmanager.log file on the remote machine to see if the agent service started correctly.
Test the communication port between Agent and Oracle Test Manager.
Check the agent manager log file to verify that the JavaAgent.exe was run when the third party test was started. It is possible to run the same JavaAgent.exe command line specified in the agentmanager.log file from a DOS console. Verify that the command line argument for the third party test package URL is correct. If there is no indication that a Java Agent startup request was issued, verify the Agent version and check the Oracle Test Manager server log.
If it looks like the Java Agent was started with the correct arguments, look in the remote machine's <installdir>\logs\agentmananger.log file for any exceptions. It may help to set the oracle.oats logging category in <installdir>\agent\log4jJavaAgentDebug.xml file to DEBUG. This will show more useful third party test execution details. The third party test Java Agent posts its results over HTTP to a servlet running on the Oracle Test Manager server.
If the agent.log file shows that the third party test ran and that the results were reported successfully to Oracle Test Manager, then the problem is on the Oracle Test Manager server side. Look in the Oracle Test Manager server log for exceptions.
You can set test results for one or more tests. To set test results:
Select the tests for which you want to set results.
Select Set test result from the right-click menu.
Selected tests - lists the test that you selected. By default, they are selected. Deselect any tests for which you do not want to set the test result.
Result - select the result that you want to apply to the selected tests.
Version - select the version that you are testing against.
Summary - enter any comments.
Deselect any tests for which you do not want to set the result.
Select the result that you want to apply to the selected tests.
Select the version you are testing against.
Enter any comments in the Summary field.
Click Save.
You can delete test results based on the date and time the test was run. To delete test results:
Select Delete Results from the Run History section in the right pane.
This dialog box displays a list of test results by date and time.
Select the results you want to delete. You can select more than one test result by clicking on each test result that you want to delete.
Click OK.
You can view the result details for each test run. To view test details:
Select the test for which you want to view details.
In the Run History section of the right pane, click the date of the test for which you want to view details.
The details of the test run expand and appear under the Run History section.
The Results report is displayed in a separate browser window and gives detailed information about the test run. To view the Results report:
Select the test for which you want to view the report.
In the Run History section of the right pane, click the date of the test for which you want to view the report.
Click View Report in the Result Summary section of the right pane.
There are two ways to associate tests with requirements. You can search for tests that contain designated values in one or more fields or you can select tests from a tree view.
To associate requirements with a test using search:
Select the test with which you want to associate requirements.
Select Add/Edit from the Associated Requirements section of the right pane.
Saved filters - lists the saved filter configurations. Select a saved filter to edit or delete it.
Save - displays the Save Criteria dialog box for saving the settings. Filters do not have to be saved.
Delete - deletes the selected saved filter.
Search for - displays whether you are searching requirements, tests, or issues.
that match - select how to apply the filtering criteria.
all - match all of the configured criteria. This setting places an AND between the criteria. For example, if you wanted to view all issues with a high-priority that are assigned to you, use this option.
any - match any of the configured criteria. This setting places and OR between the criteria. For example, if you wanted to view all issues with either a high priority or a high severity, use this option.
a combination - this setting lets you combine AND and OR. For example, if you wanted to view all issues assigned to Mary or Caren with a high priority, use this option. This option lets you select how to group the criteria, using parenthesis as required. For example:
(((Assigned to = Mary OR Assigned to = Caren) AND Priority = High) OR Severity = High)
<left parenthesis> - select the left parenthesis up to three.
Field - select the field that you want to use to select the items to display.
Operator
Equals - causes only items that match the value for the selected field to be displayed.
Not Equal to - causes only items that do not match the value for the selected field to be displayed.
Value - enter or select the value of the field that you want to use to select the items to display.
<right parenthesis> - select the right parenthesis up to three.
<operator> - select the operator to use, AND or OR.
<delete> - deletes the corresponding criteria.
<expression> - shows the filtering expression you are creating as you select criteria.
Results - displays the nodes that match the search criteria.
Select - places the selected nodes in the Associated Nodes field.
Select All - places all nodes in the Results field in the Associated Nodes field.
Associated Nodes - displays the selected nodes.
Remove - removes the selected nodes from the Associated Nodes field.
Remove All - removes all nodes from the Associated Nodes field.
OK - closes the dialog box and saves changes.
Cancel - closes the dialog box without saving changes.
Enter the search criteria or select a saved filter and click Search.
Select the requirements you want associated with this test or click Select All to associate all requirements that matched the search criteria.
Click OK. The requirements will be listed in the right pane under associated requirements.
To associate requirements with a test using the tree view:
Select the test with which you want to associate requirements.
Select Add/Edit from the Associated Requirements section of the right pane.
<test list> - double click tests to add and delete them from the list of associated tests or select the tests you want to add and click Select.
Select - places the selected test in the Associated Nodes field.
Select All - places all tests in the Results field in the Associated Nodes field.
Associated Nodes - displays the selected nodes.
Remove - removes the selected nodes from the Associated Nodes field.
Remove All - removes all nodes from the Associated Nodes field.
OK - closes the dialog box and saves changes.
Cancel - closes the dialog box without saving changes.
Select the requirements you want associated with this test or click Select All to associate all requirements that matched the search criteria.
To remove nodes from the Associated Nodes field, select the nodes and click Remove or click Remove All to remove all nodes.
Click OK. The requirements will be listed in the right pane under associated requirements.
There are two ways to associate issues with tests. You can search for issues that contain designated values in one or more fields or you can select issues from a tree view.
To associate issues with a test using search:
Select the test with which you want to associate issues.
Select Add/Edit from the Associated Issues section of the right pane.
Saved filters - lists the saved filter configurations. Select a saved filter to edit or delete it.
Save - displays the Save Criteria dialog box for saving the settings. Filters do not have to be saved.
Delete - deletes the selected saved filter.
Search for - displays whether you are searching requirements, tests, or issues.
that match - select how to apply the filtering criteria.
all - match all of the configured criteria. This setting places an AND between the criteria. For example, if you wanted to view all issues with a high-priority that are assigned to you, use this option.
any - match any of the configured criteria. This setting places and OR between the criteria. For example, if you wanted to view all issues with either a high priority or a high severity, use this option.
a combination - this setting lets you combine AND and OR. For example, if you wanted to view all issues assigned to Mary or Caren with a high priority, use this option. This option lets you select how to group the criteria, using parenthesis as required. For example:
(((Assigned to = Mary OR Assigned to = Caren) AND Priority = High) OR Severity = High)
<left parenthesis> - select the left parenthesis up to three.
Field - select the field that you want to use to select the items to display.
Operator
Equals - causes only items that match the value for the selected field to be displayed.
Not Equal to - causes only items that do not match the value for the selected field to be displayed.
Value - enter or select the value of the field that you want to use to select the items to display.
<right parenthesis> - select the right parenthesis up to three.
<operator> - select the operator to use, AND or OR.
<delete> - deletes the corresponding criteria.
<expression> - shows the filtering expression you are creating as you select criteria.
Results - displays the nodes that match the search criteria.
Select - places the selected nodes in the Associated Nodes field.
Select All - places all nodes in the Results field in the Associated Nodes field.
Associated Nodes - displays the selected nodes.
Remove - removes the selected nodes from the Associated Nodes field.
Remove All - removes all nodes from the Associated Nodes field.
OK - closes the dialog box and saves changes.
Cancel - closes the dialog box without saving changes.
Enter the search criteria or select a saved filter and click Search.
Select the issues you want associated with the test and click Select or click Select All to associate all issues that matched the search criteria.
Click OK. The issues will be listed in the right pane under associated issues.
To associate issues with a test using the tree view:
Select the test with which you want to associate issues.
Select Add/Edit from the Associated Issues section of the right pane.
<test list> - double click tests to add and delete them from the list of associated tests or select the tests you want to add and click Select.
Select - places the selected test in the Associated Nodes field.
Select All - places all tests in the Results field in the Associated Nodes field.
Associated Nodes - displays the selected nodes.
Remove - removes the selected nodes from the Associated Nodes field.
Remove All - removes all nodes from the Associated Nodes field.
OK - closes the dialog box and saves changes.
Cancel - closes the dialog box without saving changes.
Select the issues you want associated with the test and click Select or click Select All to associate all issues that matched the search criteria.
To remove nodes from the Associated Nodes field, select the nodes and click Remove or click Remove All to remove all nodes.
Click OK. The issues will be listed in the right pane under associated issues.
You can email a test to one or more people. For email to work, the SMTP server must be configured using the Oracle Test Manager Administrator. To email a test:
Click the Tests tab.
Select the test that you want to email and click Email.
Send to - enter the email addresses of the people to whom you want to email this test. Separate email addresses by a comma.
To - displays the Select Email recipients dialog box for selecting recipients from a list.
Subject - enter the text that you want to appear in the subject of the email. The default includes the name and id of the test.
Message - enter the text that you want to appear in the message.
Enter the recipient email addresses separated by a comma or click To to display the Select Email Recipients dialog box.
<recipient list> - lists users in you database that have email notification enabled.
Select - adds the selected recipients to the To field.
To - displays the selected recipients separated by a comma.
Select the recipients that you want to receive the test and click Select. Note that only users in your database that have email notification enabled are listed in the dialog box.
Click Done when you are finished.
Change the subject if necessary.
Enter a message if necessary.
Click OK.
You can schedule Oracle OpenScript tests to run once on a specified day and time, daily at a specified time, and weekly at a specified day and time.
To add a task to the schedule:
Click the Schedule button or right-click the test you want to schedule and select Schedule test. If you used the right-click menu, the New Task dialog box is displayed with the selected test in the Tests field, otherwise, the Schedule dialog box is displayed.
New Task - displays the New Task dialog box for adding a new task to the schedule.
System - select the system on which you want to run tasks.
Schedule Area - lists the tasks that are scheduled for the displayed week. The week is displayed from Sunday to Saturday and defaults to the current week.
Prev - displays the previous week.
Next - displays the next week.
Run Time - displays the time that the task is scheduled to run.
Task Name - displays the name of the task.
Status - displays the task's status.
Task Detail - click on a task name to display details about this task.
Navigate - displays the test in the right pane of the main window.
Preview - displays the test in a separate window.
Run Now - this button is available for tests that have not been executed. Runs the test immediately.
Edit - displays the Edit Task dialog box for changing the task.
Clone - displays the Edit Task dialog box with the same configuration as the selected task.
Delete - deletes the task from the schedule.
Calendars - shows the current and next month with the displayed week highlighted. Click on a day in the calendar to display that week.
Left arrow - moves the calendars back one month.
Right arrow - moves the calendars forward one month.
Select the day for which you want to schedule a task and click New task in the Day column or click New task in the top left of the screen.
Name - enter a name for this task.
System - select the system on which you want to run this task.
Description - enter a description of this task.
Start Date - select the date and time at which you want to start this task. Tasks can be scheduled on the hour, quarter past the hour, on the half our, and quarter to the hour.
Recurrence - lets you specify when and how often to run this task.
Run once - runs the task once at the specified date and time.
Run daily - runs the task every day at the specified time.
Run weekly - runs the task every week on the specified day and time.
<days> - these options are only displayed when you select Run weekly. Select the day on which you want to run the task.
End Date - specify the day on which you want this task to stop running.
Clear Date - blanks out the End Date field.
Conflict rules - specifies what Oracle Test Manager should do when a task is scheduled to start and another task is still running.
Wait indefinitely for current task to complete - waits for the running task to finish before starting the scheduled task.
Run immediately and abort current task - stops the running task and starts the scheduled task.
Wait <minutes> minutes, then abort current task - waits the specified number of minutes then stops the running task and starts the scheduled task.
Tests - displays the tests that are scheduled.
Add - displays the Test dialog box for selected tests.
Delete - deletes the selected test.
Move Up - moves the selected test up one spot in the list.
Move Down - moves the selected test down one spot in the list.
Run Parameters
Version - select the version of software you are testing.
Send report to - enter the email addresses of the people you want to send the report to after the schedule is executed or click the To button to display the Select Email Recipients dialog box for selecting email recipients in your database that have email notification enabled. Separate email address with a comma.
Enter a name for the task.
Select the system on which to run the task.
Enter a description of the task.
Select the start date and time, and how often you want to run the task.
Select what to do when a task is scheduled to run when another task is still running.
Click Add to add tests to the task. The same test can be added multiple times.
There are two ways to select tests. You can search for tests that contain designated values in one or more fields or you can select tests from a tree view.
Find Tab Fields
Saved filters - lists the saved filter configurations. Select a saved filter to edit or delete it.
Save - displays the Save Criteria dialog box for saving the settings. Filters do not have to be saved.
Delete - deletes the selected saved filter.
Search for - displays whether you are searching requirements, tests, or issues.
that match - select how to apply the filtering criteria.
all - match all of the configured criteria. This setting places an AND between the criteria. For example, if you wanted to view all issues with a high-priority that are assigned to you, use this option.
any - match any of the configured criteria. This setting places and OR between the criteria. For example, if you wanted to view all issues with either a high priority or a high severity, use this option.
a combination - this setting lets you combine AND and OR. For example, if you wanted to view all issues assigned to Mary or Caren with a high priority, use this option. This option lets you select how to group the criteria, using parenthesis as required. For example:
(((Assigned to = Mary OR Assigned to = Caren) AND Priority = High) OR Severity = High)
<left parenthesis> - select the left parenthesis up to three.
Field - select the field that you want to use to select the items to display.
Operator
Equals - causes only items that match the value for the selected field to be displayed.
Not Equal to - causes only items that do not match the value for the selected field to be displayed.
Value - enter or select the value of the field that you want to use to select the items to display.
<right parenthesis> -select the right parenthesis up to three.
<operator> - select the operator to use, AND or OR.
<delete> - deletes the corresponding criteria.
<expression> - shows the filtering expression you are creating as you select criteria.
Results - displays the tests that match the search criteria.
Select - places the selected tests in the Selected Test field.
Select All - places all tests in the Results field in the Selected Test field.
Tree View Fields
<test list> - double click tests to add and delete them from the list of selected tests or select the tests you want to add and click Select.
Select - places the selected test in the Selected Test field.
Select All - places all tests in the Results field in the Selected Test field.
Common Fields
Selected Tests - displays the selected tests.
<up arrow> - moves the selected test up one place.
<down arrow> - moves the selected test down one place.
Remove - removes the selected tests from the Selected Test field.
Remove All - removes all tests from the Selected Test field.
Select the tests that you want to schedule.
Click OK.
Use the Move Up and Move Down buttons to put the tests in the order in which you want them to run.
Click Save.
To test the task, click the task that you want to test, then click Run Now.
Click Close to exit the Schedule dialog box.
To edit a task:
Click the Schedule button.
Click the task that you want to edit. Details about the task are displayed.
Click the Edit button.
Make any changes.
Click Save.
To test the task, click the task that you want to test, then click Run Now.
Click Close to exit the Schedule dialog box.