1. Testing Business Applications Guide
  2. About Report Generation

About Report Generation

You can control whether or not to generate reports and capture screenshots and test results during test script execution – for more information, see Functionality for Report Generation.

Reports are generated in both HTML and JSON format for each test script that is run individually (Unit Mode) or as part of a Master Suite (Batch Mode). The following table shows the report files that are generated in HTML and JSON format.

Format Report Files Location

JSON

  • <Test Script>timestamp.json

  • <Test Set>timestamp.json

  • <Master Suite>timestamp.json

\Reports\<MasterSuite>timestamp\logs\json

JSON

  • Report.html (uses Report.js and webresources folder)

  • Report.js (aggregation of json files)

\Reports\<MasterSuite>timestamp\logs

HTML

  • <Test Script>timestamp.html

  • <Test Set>timestamp.html.

  • <Master Suite>timestamp.html

\Reports\<MasterSuite>timestamp>\logs

A single report (Report.html) is automatically generated which provides a consolidated snapshot across test script, test set, and Master Suite data along with a detailed failure analysis of results. You can also manually generate a combined results report using multiple Report.html files - for more information, see Generating a Combined Report.

Report.html provides the following key information:

  • A consolidated view of a batch run with data from JSON report files.

  • A Test Summary showing Pass, Fails, Pass%, and Not Executed results at Master Suite level.

  • A Test Set result summary and consolidated failure analysis across all test scripts.

  • A Failure Analysis summary which:

    • Lists unique error log messages across all results, ranking them by number of test scripts failed in descending order.

    • Contains links to the test script where the error occurred.

    • For data-driven tests, shows the iteration where the error occurred in brackets.

Report.html depends on the following:

  • The webresources folder under ...\DesktopintSiebelAgent\plugins\SiebelTestAutomation, which contains the following: css, fonts and img folders.

  • Report.js, which wraps the data from individual JSON files. Report.js must be in the same folder as Report.html.