7 Executing Tests

Tests can be grouped together into branches for easy management. Once entered, they can be associated with the requirements they address or any issues that result from running the test.

When you run a test, you can specify the workstation to run it on. Workstations are configured using the Systems Manager. To run Oracle OpenScript tests on remote systems, you must also install the Oracle Application Testing Suite Remote Agent on the remote system and configure Remote Agent Service login credentials. See the "Installing the Oracle Load Testing Remote Agent" section in the Oracle Application Testing Suite Release Notes for additional information about installing the agent and configuring the login credentials.

In addition, tests can be scheduled to run once at a specified day and time, daily at a specified time, or weekly at a specified day and time.

7.1 Adding Test Set Folders

Test Set Folders can be used to group test sets. Test Set Folders are automatically numbered when you enter them. You can reorder them using the Move buttons. To add a test folder:

  1. Select the Test Execution tab.

  2. Click the Add button.

  3. Enter a name for the test folder.

  4. Select Test Folder in the Type field.

    This dialog box has the following options:

    Name - displays the folder or test set name.

    Type - displays the type, as follows:

    • Test Folder - high level descriptions for grouping test sets together.

    • Test Set - a list of tests that are sequentially run together that can also be scheduled. In addition, the overall results are tracked and displayed.

    Owner - select the user that owns the folder. Only users with read permission for this project are listed.

    Functionality - enter a description of the functionality being tested.

    Priority - displays the priority of the folder. These options can be changed by your system administrator.

    Description - displays the folder description.

    Attachment - lets you add an attachment or link to this folder.

    File - lets you add an attachment to the Attachments section.

    • Browse - displays the Choose File dialog box for selecting the file to attach.

    • Capture - starts the Screen Capture utility for capturing a screen, saving it as either a .JPG or .BMP file, and populating the Attachment field. Refer to Appendix A for instructions on using the utility or select Contents from the Help menu in the utility.

      Note:

      The utility must be running in your system tray to use this option. If it is not running, a dialog box is displayed saying that the program could not be found. Click on the ScreenCaptureInstall.exe link to download the utility.

    Link - lets you add a link to the Links section.

    • Title - enter a descriptive title for the link. This will be displayed in the Links section.

    • Link - enter the URL. For example, http://www.company.com. If a title is not entered, the URL is displayed in the links section.

    Reset - clears the fields and returns the dialog box options to the starting state.

  5. Enter a description of the functionality of the folder.

  6. Select the owner and priority and enter any descriptive information in the Functionality and Description fields.

  7. Add any attachments.

  8. Click Save.

7.2 Adding Test Sets

Test Sets specify the tests to execute. Test Sets are automatically numbered when you enter them. You can reorder them using the Move buttons. To add a test set:

  1. Select the Test Execution tab.

  2. Click the Add button.

  3. Enter a name for the test set.

  4. Select Test Set in the Type field.

    This dialog box has the following options:

    Name - displays the test name.

    Type - displays the type, as follows:

    • Test Folder - high level descriptions for grouping test sets together.

    • Test Set - a list of tests that are sequentially run together that can also be scheduled. In addition, the overall results are tracked and displayed.

    Owner - select the user that owns the test set. Only users with read permission for this project are listed.

    Functionality - enter a description of the functionality being tested

    Priority - displays the priority of the test set. These options can be changed by your system administrator.

    Description - displays the test set description.

    Attachment - lets you add an attachment or link to this test set.

    File - lets you add an attachment to the Attachments section.

    • Browse - displays the Choose File dialog box for selecting the file to attach.

    • Capture - starts the Screen Capture utility for capturing a screen, saving it as either a .JPG or .BMP file, and populating the Attachment field. Refer to Appendix A for instructions on using the utility or select Contents from the Help menu in the utility.

      Note:

      The utility must be running in your system tray to use this option. If it is not running, a dialog box is displayed saying that the program could not be found. Click on the ScreenCaptureInstall.exe link to download the utility.

    Link - lets you add a link to the Links section.

    • Title - enter a descriptive title for the link. This will be displayed in the Links section.

    • Link - enter the URL. For example, http://www.company.com. If a title is not entered, the URL is displayed in the links section.

    Reset - clears the fields and returns the dialog box options to the starting state.

  5. Enter a description of the functionality of the folder.

  6. Select the owner and priority and enter any descriptive information in the Functionality and Description fields.

  7. Add any attachments.

  8. Click Save.

7.3 Adding Tests to a Test Set

Once you have created a Test Set, you can add tests to it. Oracle OpenScript tests and manual test can be added to a Test Set. The same test can be added more than once. The tests in the group are run sequentially, and the group can also be scheduled. To add tests:

  1. Click the Test Execution tab.

  2. Select the Test Set to which you want to add tests.

  3. In the right pane, click Add/Edit in the Test List area to display the Tests dialog box. There are two ways you can select tests. You can search for them or select them from the tree view.

To select tests by searching for them:

  1. Click the Find tab.

    Saved filters - lists the saved filter configurations. Select a saved filter to edit or delete it.

    Save - displays the Save Criteria dialog box for saving the settings. Filters do not have to be saved.

    Delete - deletes the selected saved filter.

    Search for - displays whether you are searching requirements, tests, or issues.

    that match - select how to apply the filtering criteria.

    • all - match all of the configured criteria. This setting places an AND between the criteria. For example, if you wanted to view all issues with a high priority that are assigned to you, use this option.

    • any - match any of the configured criteria. This setting places and OR between the criteria. For example, if you wanted to view all issues with either a high priority or a high severity, use this option.

    • a combination - this setting lets you combine AND and OR. For example, if you wanted to view all issues assigned to Mary or Caren with a high priority, use this option. This option lets you select how to group the criteria using parenthesis as required. For example:

      (((Assigned to = Mary OR Assigned to = Caren) AND Priority = High) OR Severity = High)
      

    <left parenthesis> - select the left parenthesis up to three.

    Field - select the field that you want to use to select the items to display.

    Operator

    • Equals - causes only items that match the value for the selected field to be displayed.

    • Not Equal to - causes only items that do not match the value for the selected field to be displayed.

    Value - enter or select the value of the field that you want to use to select the items to display.

    <right parenthesis> - select the right parenthesis up to three.

    <operator> - select the operator to use, AND or OR.

    <delete> - deletes the corresponding criteria.

    <expression> - shows the filtering expression you are creating as you select criteria.

    Results - displays the nodes that match the search criteria.

    • Select - places the selected nodes in the Selected Tests field.

    • Select All - places all nodes in the Results field in the Selected Tests field.

    Selected Tests - displays the selected nodes.

    • <up arrow> - moves the selected test up one place.

    • <down arrow> - moves the selected test down one place.

    • Remove - removes the selected nodes from the Selected Tests field.

    • Remove All - removes all nodes from the Selected Tests field.

    OK - closes the dialog box and saves changes.

    Cancel - closes the dialog box without saving changes.

  2. Enter the search criteria or select a saved filter and click Search.

  3. Select the tests you want to add or click Select All to add them all.

  4. Click OK.

To select tests using the tree view:

  1. Click the TreeView tab.

    <test list> - double click tests to add and delete them from the list of selected tests or select the tests you want to add and click Select.

    • Select - places the selected test in the Selected Tests field.

    • Select All - places all tests in the Results field in the Selected Tests field.

    Selected Tests - displays the selected nodes.

    • Remove - removes the selected nodes from the Selected Tests field.

    • Remove All - removes all nodes from the Selected Tests field.

    OK - closes the dialog box and saves changes.

    Cancel - closes the dialog box without saving changes.

  2. Select the tests you want to add or click Select All to add all tests.

  3. To remove nodes from the Selected Tests field, select the nodes and click Remove or click Remove All to remove all nodes.

  4. Click OK.

7.4 Configuring Systems

The Systems Manager lets you configure the systems on which you will be running tests. When you run or schedule a test, you can specify the workstation on which to run the test.

7.4.1 Adding Systems

To add a system:

  1. Select Systems from the Tools menu. The Systems Manager dialog box is displayed.

    New - displays the Systems dialog box for adding a new system.

    Edit - displays the Systems dialog box for editing the selected system.

    Delete - deletes the selected system.

    Name - lists the configured systems.

  2. Click New.

    Name - enter the system's name.

    Host Name or IP - enter the system's host name or IP address.

    Username - enter the user name for agent authentication. The Username is the user name specified for the agent Authentication Profile in the Oracle Load Testing Agent Authentication Manager. The username for the default agent Authentication Profile is JMSAdmin. To view other defined agent Authentication Profile Usernames, select Oracle Application Testing Suite from the Programs Start menu, then select Oracle Load Testing Agent Authentication Manager from the Tools submenu. Select an agent Authentication Profile to view the details. On Linux machines, use:

    <instdir>/jdk/jre/bin/javaw -jar <instdir>/agentmanager/AMAuthManager.jar 
    

    to start the Oracle Load Testing Agent Authentication Manager.

    Password - enter the password for agent authentication. The Password is the password specified for the agent Authentication Profile in the Oracle Load Testing Agent Authentication Manager. The password for the default agent Authentication Profile is blank. To change the password for a defined agent Authentication Profile Usernames, start the Oracle Load Testing Agent Authentication Manager and select an agent Authentication Profile to view the details and enter a new password.

    Port - enter the port.

    Test - attempts to access the system and displays a message stating whether the system is available.

  3. Enter the system's name.

  4. Enter the system's host name or IP address.

  5. Change the default port, if necessary.

  6. Click Test to see if the system is available.

  7. Click OK to close the test result window.

  8. Click OK.

7.4.2 Editing Systems

To edit a system:

  1. Select Systems from the Tools menu.

    New - displays the Systems dialog box for adding a new system.

    Edit - displays the Systems dialog box for editing the selected system.

    Delete - deletes the selected system.

    Name - lists the configured systems.

  2. Select the system that you want to change.

  3. Click Edit.

    Name - enter the system's name.

    Host Name or IP - enter the system's host name or IP address.

    Username - enter the user name for agent authentication.

    Password - enter the password for agent authentication.

    Port - enter the port.

    Test - attempts to access the system and displays a message stating whether the system is available.

  4. Make any changes.

  5. Click Test to see if the system is available.

  6. Click OK to exit the test result window.

  7. Click OK.

7.4.3 Deleting Systems

To delete a system:

  1. Select Systems from the Tools menu.

  2. Select the system you want to delete.

  3. Click Delete.

  4. Click Yes when asked to confirm the deletion.

7.5 Running Tests

You can individually run manual tests, Oracle OpenScript functional tests, third party, JUnit, or Test Sets. You can run individual tests in the Tests tab using the Quick Run option on the right-click shortcut menu. You can run groups of tests in a Test Set in the Test Execution tab after creating a Test Set and adding one or more tests to the Test Set.

7.5.1 Running Oracle OpenScript Functional Tests

To run an individual Oracle OpenScript test:

  1. Make sure you have added an OpenScript test to the test tree. See Section 6.1, "Adding Oracle OpenScript Scripts" for additional information about adding OpenScript tests.

  2. Select the Test tab.

  3. Select the test you want to run.

  4. Select Quick Run from the right-click shortcut menu.

    This dialog box has the following options:

    System - select the system on which you want to run this test. Systems are configured using the Systems Manager.

    Run Name - specify a name to use to identify this test run.

    Version - select the version of software you are using or select Other to enter a version that is not in the list.

    Command line run settings - specify any additional arguments or command line settings to use when running an Oracle OpenScript script. See the Oracle OpenScript User's Guide for additional information about using command line settings.

    Note:

    If your administrator has created Test Run custom fields, they will appear in this dialog box.
  5. Select the system on which you want to run the test.

  6. Change or update the Run Name.

  7. Select the version number against which the test will run.

  8. Specify any run settings and click Run. The script is started and plays back in the agent.

  9. Click Refresh to show the results in the Run History section of the right pane. Click the date in the Run History field to display result parameters, summary and detail information. Click View Report in the Result Summary section to view the Results Report.

7.5.2 Running Manual Tests

To run an individual manual test:

  1. Make sure you have added a manual test to the test tree. See Section 6.2, "Adding Manual Tests" for additional information about adding manual tests.

  2. Select the Test tab.

  3. Select the test you want to run.

  4. Click Quick Run from the right-click shortcut menu.

    This dialog has the following options:

    Run Name - specify a name to use to identify this test run.

    Version - select the version of the software you are testing or select Other to enter a version that is not in the list.

    Note:

    If your administrator has created Test Run custom fields, they will appear in this dialog box.
  5. Change or update the Run Name.

  6. Enter or select the version number and click Run.

    This dialog box appears for each step in the test. It has the following options:

    First - displays the first step.

    Previous - displays the previous step.

    Next - displays the next step.

    Last - displays the last step.

    Minimize/Maximize - toggles the size of the dialog box.

    Start Timer - starts the timer. When the timer is on, it keeps track of how long it took to run each step and the complete test. The Duration and Iteration Total Time fields in the Result Detail Section will be populated.

    Stop Timer - stops the timer. The Duration field in the Result Detail Section will be populated for the steps that were completed.

    Make All - sets the result of all steps to the selected status, either Passed, Failed, Warning, or any user-defined field configured for the Status field in the Administrator.

    Action - displays the action to perform.

    Expected Result - displays the expected result.

    Comment - displays additional information about the step.

    Attachments - lists the attachments associated with this step.

    Result - select the outcome of the step after performing it.

    Summary - enter additional information about the step.

    Add Issue - automatically adds an issue stating that the test had a status of failed or warning. This option is only available when Failed or Warning is selected.

    Save Run - saves the test run status and shows a result of In Progress in the Run History section for this test run. Click Resume this run to resume testing.

  7. Click the Start Timer button if you want Oracle Test Manager to keep track of how long it takes to complete each step. If you are using the timer the Duration and Iteration Total Time fields in the Result Detail Section will be populated. If you stop the timer or save the run only the Duration field will be populated for the completed steps.

  8. Perform each step and select the result or use Make All to set the same result for each step.

  9. Click Save Run to save the results for the completed steps without finishing the test run or click Finish when you are done. You can continue testing by clicking Resume this run in the Run History section.

    Result - enter the overall outcome of the test.

    Summary - enter additional information about the test.

  10. Enter the overall test result and any summary comments and click Finish.

7.5.3 Running Test Sets

When you run a Test Set, Oracle Test Manager runs the tests in the set in sequence. The same test can be added multiple times.

To run a Test Set:

  1. Make sure you have added a Test Set to the test tree and have added the tests you want to run to the Test Set. See Section 7.2, "Adding Test Sets" for additional information about adding Test Sets. See Section 7.3, "Adding Tests to a Test Set" for additional information about adding test to run to a Test Set.

  2. Select the Test Execution tab.

  3. Select the Test Set and click Execute Test Set at the top of the right pane.

  4. Select the system on which you want to run this test and click Save.

  5. Change or update the Run Name.

  6. Enter the version number of the software you are testing.

  7. The Run Test Set dialog box is displayed for monitoring progress.

  8. When all tests are finished, the Test Set dialog box is displayed showing a summary of the results.

  9. Click Close.

7.5.4 Running Third-Party Tests

To run third-party tests:

  1. Make sure you have added a third-party test to the test tree. See Section 6.4, "Adding Third Party Tests" for additional information about adding third party tests.

  2. Select the Test tab.

  3. Select the test you want to run.

  4. Select Quick Run from the right-click shortcut menu.

    This dialog box has the following options:

    System - select the system on which you want to run this test. Systems are configured using the Systems Manager.

    Run Name - specify a name to use to identify this test run.

    Version - select the version of software you are using or select Other to enter a version that is not in the list.

    Note:

    If your administrator has created Test Run custom fields, they will appear in this dialog box.
  5. Select the system on which you want to run the test.

  6. Change or update the Run Name.

  7. Select the version number against which the test will run and click Run.

  8. A message stating that the test is running is displayed. A command line window is displayed showing the batch file execution.

  9. Click Refresh to show the results in the Run History section of the right pane.

7.5.5 Running JUnit Tests

To run a JUnit test:

  1. Make sure you have added a JUnit test to the test tree. See Section 6.5, "Adding JUnit Tests" for additional information about adding JUnit tests.

  2. Select the Test tab.

  3. Select the test you want to run.

  4. Select Quick Run from the right-click shortcut menu.

    This dialog box has the following options:

    System - select the system on which you want to run this test. Systems are configured using the Systems Manager.

    Run Name - specify a name to use to identify this test run.

    Version - select the version of software you are using or select Other to enter a version that is not in the list.

    Note:

    If your administrator has created Test Run custom fields, they will appear in this dialog box.
  5. Select the system on which you want to run the test.

  6. Change or update the Run Name.

  7. Select the version number against which the test will run and click Run.

  8. A message stating that the test is running is displayed. A command line window is displayed showing the file execution.

  9. Click Refresh to show the results in the Run History section of the right pane.

7.5.6 Troubleshooting Third Party Tests

Perform the following steps if the third party test fails to run on the remote machine:

  1. Make sure that the Oracle Load Testing Agent Service is running on the remote machine.

  2. Check the <installdir>\logs\agentmanager.log file on the remote machine to see if the agent service started correctly.

  3. Test the communication port between Agent and Oracle Test Manager.

  4. Check the agent manager log file to verify that the JavaAgent.exe was run when the third party test was started. It is possible to run the same JavaAgent.exe command line specified in the agentmanager.log file from a DOS console. Verify that the command line argument for the third party test package URL is correct. If there is no indication that a Java Agent startup request was issued, verify the Agent version and check the Oracle Test Manager server log.

  5. If it looks like the Java Agent was started with the correct arguments, look in the remote machine's <installdir>\logs\agentmananger.log file for any exceptions. It may help to set the oracle.oats logging category in <installdir>\agent\log4jJavaAgentDebug.xml file to DEBUG. This will show more useful third party test execution details. The third party test Java Agent posts its results over HTTP to a servlet running on the Oracle Test Manager server.

  6. If the agent.log file shows that the third party test ran and that the results were reported successfully to Oracle Test Manager, then the problem is on the Oracle Test Manager server side. Look in the Oracle Test Manager server log for exceptions.

7.6 Setting Test Results

You can set test results for one or more tests. To set test results:

  1. Select the Tests tab.

  2. Select the tests for which you want to set results.

  3. Select Set test result from the right-click menu.

    Selected tests - lists the test that you selected. By default, they are selected. Deselect any tests for which you do not want to set the test result.

    Result - select the result that you want to apply to the selected tests.

    Version - select the version that you are testing against.

    Summary - enter any comments.

  4. Deselect any tests for which you do not want to set the result.

  5. Select the result that you want to apply to the selected tests.

  6. Select the version you are testing against.

  7. Enter any comments in the Summary field.

  8. Click Save.

7.7 Deleting Test Results

You can delete test results based on the date and time the test was run. To delete test results:

  1. Select Delete Results from the Run History section in the right pane.

    This dialog box displays a list of test results by date and time.

  2. Select the results you want to delete. You can select more than one test result by clicking on each test result that you want to delete.

  3. Click OK.

7.8 Viewing Test Details

You can view the result details for each test run. To view test details:

  1. Select the test for which you want to view details.

  2. In the Run History section of the right pane, click the date of the test for which you want to view details.

    The details of the test run expand and appear under the Run History section.

7.9 Viewing the Results Report

The Results report is displayed in a separate browser window and gives detailed information about the test run. To view the Results report:

  1. Select the test for which you want to view the report.

  2. In the Run History section of the right pane, click the date of the test for which you want to view the report.

  3. Click View Report in the Result Summary section of the right pane.

7.10 Associating Requirements With Test Sets

There are two ways to associate test sets with requirements. You can search for test sets that contain designated values in one or more fields or you can select tests from a tree view.

To associate requirements with a test using search:

  1. Select the test set with which you want to associate requirements.

  2. Select Add/Edit from the Associated Requirements section of the right pane.

    Saved filters - lists the saved filter configurations. Select a saved filter to edit or delete it.

    Save - displays the Save Criteria dialog box for saving the settings. Filters do not have to be saved.

    Delete - deletes the selected saved filter.

    Search for - displays whether you are searching requirements or issues.

    that match - select how to apply the filtering criteria.

    • all - match all of the configured criteria. This setting places an AND between the criteria. For example, if you wanted to view all issues with a high-priority that are assigned to you, use this option.

    • any - match any of the configured criteria. This setting places and OR between the criteria. For example, if you wanted to view all issues with either a high priority or a high severity, use this option.

    • a combination - this setting lets you combine AND and OR. For example, if you wanted to view all issues assigned to Mary or Caren with a high priority, use this option. This option lets you select how to group the criteria, using parenthesis as required. For example:

      (((Assigned to = Mary OR Assigned to = Caren) AND Priority = High) OR Severity = High)
      

    <left parenthesis> - select the left parenthesis up to three.

    Field - select the field that you want to use to select the items to display.

    Operator

    • Equals - causes only items that match the value for the selected field to be displayed.

    • Not Equal to - causes only items that do not match the value for the selected field to be displayed.

    Value - enter or select the value of the field that you want to use to select the items to display.

    <right parenthesis> - select the right parenthesis up to three.

    <operator> - select the operator to use, AND or OR.

    <delete> - deletes the corresponding criteria.

    <expression> - shows the filtering expression you are creating as you select criteria.

    Results - displays the nodes that match the search criteria.

    • Select - places the selected nodes in the Associated Nodes field.

    • Select All - places all nodes in the Results field in the Associated Nodes field.

    Associated Nodes - displays the selected nodes.

    • Remove - removes the selected nodes from the Associated Nodes field.

    • Remove All - removes all nodes from the Associated Nodes field.

    OK - closes the dialog box and saves changes.

    Cancel - closes the dialog box without saving changes.

  3. Enter the search criteria or select a saved filter and click Search.

  4. Select the requirements you want associated with this test set or click Select All to associate all requirements that matched the search criteria.

  5. Click OK. The requirements will be listed in the right pane under associated requirements.

To associate requirements with a test set using the tree view:

  1. Select the test with which you want to associate requirements.

  2. Select Add/Edit from the Associated Requirements section of the right pane.

    <test list> - double click tests to add and delete them from the list of associated tests or select the tests you want to add and click Select.

    • Select - places the selected test in the Associated Nodes field.

    • Select All - places all tests in the Results field in the Associated Nodes field.

    Associated Nodes - displays the selected nodes.

    • Remove - removes the selected nodes from the Associated Nodes field.

    • Remove All - removes all nodes from the Associated Nodes field.

    OK - closes the dialog box and saves changes.

    Cancel - closes the dialog box without saving changes.

  3. Select the requirements you want associated with this test or click Select All to associate all requirements that matched the search criteria.

  4. To remove nodes from the Associated Nodes field, select the nodes and click Remove or click Remove All to remove all nodes.

  5. Click OK. The requirements will be listed in the right pane under associated requirements.

7.11 Associating Issues With Test Sets

There are two ways to associate issues with test sets. You can search for issues that contain designated values in one or more fields or you can select issues from a tree view.

To associate issues with a test set using search:

  1. Select the test set with which you want to associate issues.

  2. Select Add/Edit from the Associated Issues section of the right pane.

    Saved filters - lists the saved filter configurations. Select a saved filter to edit or delete it.

    Save - displays the Save Criteria dialog box for saving the settings. Filters do not have to be saved.

    Delete - deletes the selected saved filter.

    Search for - displays whether you are searching requirements or issues.

    that match - select how to apply the filtering criteria.

    • all - match all of the configured criteria. This setting places an AND between the criteria. For example, if you wanted to view all issues with a high-priority that are assigned to you, use this option.

    • any - match any of the configured criteria. This setting places and OR between the criteria. For example, if you wanted to view all issues with either a high priority or a high severity, use this option.

    • a combination - this setting lets you combine AND and OR. For example, if you wanted to view all issues assigned to Mary or Caren with a high priority, use this option. This option lets you select how to group the criteria, using parenthesis as required. For example:

      (((Assigned to = Mary OR Assigned to = Caren) AND Priority = High) OR Severity = High)
      

    <left parenthesis> - select the left parenthesis up to three.

    Field - select the field that you want to use to select the items to display.

    Operator

    • Equals - causes only items that match the value for the selected field to be displayed.

    • Not Equal to - causes only items that do not match the value for the selected field to be displayed.

    Value - enter or select the value of the field that you want to use to select the items to display.

    <right parenthesis> - select the right parenthesis up to three.

    <operator> - select the operator to use, AND or OR.

    <delete> - deletes the corresponding criteria.

    <expression> - shows the filtering expression you are creating as you select criteria.

    Results - displays the nodes that match the search criteria.

    • Select - places the selected nodes in the Associated Nodes field.

    • Select All - places all nodes in the Results field in the Associated Nodes field.

    Associated Nodes - displays the selected nodes.

    • Remove - removes the selected nodes from the Associated Nodes field.

    • Remove All - removes all nodes from the Associated Nodes field.

    OK - closes the dialog box and saves changes.

    Cancel - closes the dialog box without saving changes.

  3. Enter the search criteria or select a saved filter and click Search.

  4. Select the issues you want associated with the test and click Select or click Select All to associate all issues that matched the search criteria.

  5. Click OK. The issues will be listed in the right pane under associated issues.

To associate issues with a test using the tree view:

  1. Select the test set with which you want to associate issues.

  2. Select Add/Edit from the Associated Issues section of the right pane.

    <test list> - double click tests to add and delete them from the list of associated tests or select the tests you want to add and click Select.

    • Select - places the selected test in the Associated Nodes field.

    • Select All - places all tests in the Results field in the Associated Nodes field.

    Associated Nodes - displays the selected nodes.

    • Remove - removes the selected nodes from the Associated Nodes field.

    • Remove All - removes all nodes from the Associated Nodes field.

    OK - closes the dialog box and saves changes.

    Cancel - closes the dialog box without saving changes.

  3. Select the issues you want associated with the test and click Select or click Select All to associate all issues that matched the search criteria.

  4. To remove nodes from the Associated Nodes field, select the nodes and click Remove or click Remove All to remove all nodes.

  5. Click OK. The issues will be listed in the right pane under associated issues.

7.12 Emailing Test Sets

You can email a test set to one or more people. For email to work, the SMTP server must be configured using the Oracle Test Manager Administrator. To email a test:

  1. Click the Test Execution tab.

  2. Select the test set that you want to email and click Email.

    Send to - enter the email addresses of the people to whom you want to email this test. Separate email addresses by a comma.

    To - displays the Select Email recipients dialog box for selecting recipients from a list.

    Subject - enter the text that you want to appear in the subject of the email. The default includes the name and id of the test.

    Message - enter the text that you want to appear in the message.

  3. Enter the recipient email addresses separated by a comma or click To to display the Select Email Recipients dialog box.

    <recipient list> - lists users in you database that have email notification enabled.

    Select - adds the selected recipients to the To field.

    To - displays the selected recipients separated by a comma.

  4. Select the recipients that you want to receive the test and click Select. Note that only users in your database that have email notification enabled are listed in the dialog box.

  5. Click Done when you are finished.

  6. Change the subject if necessary.

  7. Enter a message if necessary.

  8. Click OK.

7.13 Scheduling Tests

You can schedule Oracle OpenScript tests to run once on a specified day and time, daily at a specified time, and weekly at a specified day and time.

7.13.1 Adding Tasks to the Schedule

To add a task to the schedule:

  1. Click the Schedule button or right-click the test you want to schedule and select Schedule test. If you used the right-click menu, the New Task dialog box is displayed with the selected test in the Tests field, otherwise, the Schedule dialog box is displayed.

    New Task - displays the New Task dialog box for adding a new task to the schedule.

    System - select the system on which you want to run tasks.

    Schedule Area - lists the tasks that are scheduled for the displayed week. The week is displayed from Sunday to Saturday and defaults to the current week.

    • Prev - displays the previous week.

    • Next - displays the next week.

    • Run Time - displays the time that the task is scheduled to run.

    • Task Name - displays the name of the task.

    • Status - displays the task's status.

    Task Detail - click on a task name to display details about this task.

    • Navigate - displays the test in the right pane of the main window.

    • Preview - displays the test in a separate window.

    • Run Now - this button is available for tests that have not been executed. Runs the test immediately.

    • Edit - displays the Edit Task dialog box for changing the task.

    • Clone - displays the Edit Task dialog box with the same configuration as the selected task.

    • Delete - deletes the task from the schedule.

    Calendars - shows the current and next month with the displayed week highlighted. Click on a day in the calendar to display that week.

    • Left arrow - moves the calendars back one month.

    • Right arrow - moves the calendars forward one month.

  2. Select the day for which you want to schedule a task and click New task in the Day column or click New task in the top left of the screen.

    Name - enter a name for this task.

    System - select the system on which you want to run this task.

    Description - enter a description of this task.

    Start Date - select the date and time at which you want to start this task. Tasks can be scheduled on the hour, quarter past the hour, on the half our, and quarter to the hour.

    Recurrence - lets you specify when and how often to run this task.

    • Run once - runs the task once at the specified date and time.

    • Run daily - runs the task every day at the specified time.

    • Run weekly - runs the task every week on the specified day and time.

    • <days> - these options are only displayed when you select Run weekly. Select the day on which you want to run the task.

    End Date - specify the day on which you want this task to stop running.

    Clear Date - blanks out the End Date field.

    OpenScript tests - specifies how the command line settings are use when running OpenScript tests.

    • Command line run settings - specifies the OpenScript command line options to use.

    • Override - when selected, the specified command line options will override the command line run settings specified in for any particular OpenScript test specified in Oracle Test Manger.

    • [commands] - specifies the command line options. See the Appendix A of the OpenScript User Guide for additional information about command line options.

    Tests - displays the tests that are scheduled.

    • Add - displays the Test dialog box for selected tests.

    • Delete - deletes the selected test.

    • Move Up - moves the selected test up one spot in the list.

    • Move Down - moves the selected test down one spot in the list.

    Run Parameters

    • Run Name - specifies a name to associate with the scheduled test run.

    • Version - select the version of software you are testing.

    • Send report to - enter the email addresses of the people you want to send the report to after the schedule is executed or click the To button to display the Select Email Recipients dialog box for selecting email recipients in your database that have email notification enabled. Separate email address with a comma.

  3. Enter a name for the task.

  4. Select the system on which to run the task.

  5. Enter a description of the task.

  6. Select the start date and time, and how often you want to run the task.

  7. Click Add to add tests to the task. The same test can be added multiple times.

    There are two ways to select tests. You can search for tests that contain designated values in one or more fields or you can select tests from a tree view.

    Find Tab Fields

    Saved filters - lists the saved filter configurations. Select a saved filter to edit or delete it.

    Save - displays the Save Criteria dialog box for saving the settings. Filters do not have to be saved.

    Delete - deletes the selected saved filter.

    Search for - displays whether you are searching requirements, tests, or issues.

    that match - select how to apply the filtering criteria.

    • all - match all of the configured criteria. This setting places an AND between the criteria. For example, if you wanted to view all issues with a high-priority that are assigned to you, use this option.

    • any - match any of the configured criteria. This setting places and OR between the criteria. For example, if you wanted to view all issues with either a high priority or a high severity, use this option.

    • a combination - this setting lets you combine AND and OR. For example, if you wanted to view all issues assigned to Mary or Caren with a high priority, use this option. This option lets you select how to group the criteria, using parenthesis as required. For example:

      (((Assigned to = Mary OR Assigned to = Caren) AND Priority = High) OR Severity = High)
      

    <left parenthesis> - select the left parenthesis up to three.

    Field - select the field that you want to use to select the items to display.

    Operator

    • Equals - causes only items that match the value for the selected field to be displayed.

    • Not Equal to - causes only items that do not match the value for the selected field to be displayed.

    Value - enter or select the value of the field that you want to use to select the items to display.

    <right parenthesis> -select the right parenthesis up to three.

    <operator> - select the operator to use, AND or OR.

    <delete> - deletes the corresponding criteria.

    <expression> - shows the filtering expression you are creating as you select criteria.

    Results - displays the tests that match the search criteria.

    • Select - places the selected tests in the Selected Test field.

    • Select All - places all tests in the Results field in the Selected Test field.

    Tree View Fields

    <test list> - double click tests to add and delete them from the list of selected tests or select the tests you want to add and click Select.

    • Select - places the selected test in the Selected Test field.

    • Select All - places all tests in the Results field in the Selected Test field.

    Common Fields

    Selected Tests - displays the selected tests.

    • <up arrow> - moves the selected test up one place.

    • <down arrow> - moves the selected test down one place.

    • Remove - removes the selected tests from the Selected Test field.

    • Remove All - removes all tests from the Selected Test field.

  8. Select the tests that you want to schedule.

  9. Click OK.

  10. Use the Move Up and Move Down buttons to put the tests in the order in which you want them to run.

  11. Click Save.

  12. To test the task, click the task that you want to test, then click Run Now.

  13. Click Close to exit the Schedule dialog box.

7.13.2 Editing Tasks

To edit a task:

  1. Click the Schedule button.

  2. Click the task that you want to edit. Details about the task are displayed.

  3. Click the Edit button.

  4. Make any changes.

  5. Click Save.

  6. To test the task, click the task that you want to test, then click Run Now.

  7. Click Close to exit the Schedule dialog box.

7.13.3 Deleting Tasks

To delete a task:

  1. Click the Schedule button.

  2. Click the task you want to delete.

  3. Click Delete.

  4. Click Yes when asked to confirm the deletion.