5.5.3 Use and Execute the Data Quality Reporting Engine Process

Use this Run Pipeline (Process) to generate and view the Data Quality report for any of the Data Quality run execution. The Data Quality Reporting Engine Pipeline uses the 'As of Date' and the 'Run Identifier' parameters to generate the Data Quality reports for run executions which are in 'Completed' status either for a passed or a failed run execution.

Note:

Once the DQ Report has been generated for the failed DQ run pipeline, post the execution of this PMF, users must provide the Process Instance ID of the failed DQ run to the public API to view the DQ Groups that are breaching the threshold limit. For more information, see API User Guide.

To use and execute the Data Quality Reporting Engine Pipeline in the Process Orchestration, do the following:

1. To access the Data Quality Reporting Engine Pipeline, on the Home Page, select the Process Orchestration. The Process Modeller Page is displayed.
2. On the Process Modeller Page, search and select the Data Quality Reporting Engine Pipeline. The Process Flow page is displayed.
3. To view the details of any Widget, double-click on the Widget and the details related to its Activity, Transition, and Notification are displayed. On the drawing canvas, you can select and see the Definition, Data Fields, and Application Rule details.
4. To execute the Run, you can select the Run Parameter Values using the Execution Button on the Process Flow Page or on the Process Modeller Page.
   Go to the Process Modeller Page to execute the Run. Click the Menu Button corresponding to the Data Quality Reporting Engine Pipeline that needs to be executed. Click Execute Run. The Execution Page is displayed.
5. On the Execution Page, to execute the Run with parameters, select With Parameters in the Execution Type List. Select the required Run Identifier, Run Purpose, and the As of Date for which the Data Quality Reporting Engine pipeline must be processed. Click the Execute button to initiate the Run Pipeline execution.

   Note:

   User must select a valid Data Quality run under the Run Identifier drop-down during run execution.

   Note:

   The execution of the Run Pipeline is triggered using the selected Extraction Date.

   See the Process Orchestration Section for more details about the Process Orchestration Framework.

6. To verify the Run Execution of the Data Quality Reporting Engine Pipeline, do the following:
   1. To open the Process Monitor Page, on the Process Modeller Page, click the Process Monitor Button or select Process Flow Monitor on the Process Modeller Menu.
   2. The Process Monitor Page is displayed, which lists all the Run Instances corresponding to the Data Quality Reporting Engine Pipeline. On the Process Monitor Page, search by the Process ID, or by the Data Quality Reporting Engine Pipeline, and select the Process Instance for the required Run Pipeline (Process) that was executed
7. The Process Flow Page is displayed with the Run Execution Status on each Node of the Data Quality Reporting Engine Pipeline.
8. To verify the Run Execution Logs, do the following:
   1. On the Process Monitor Page, click the required Process Instance for which you need to verify the Execution Logs. The Process Flow Page is displayed with the Run Execution Status on each Node.
   2. To see the Execution Status details of a Node, double-click on that Node. The Execution Status details Page is displayed. Click Execution Logs. The Log Viewer Page is displayed, which lists all the Logs related to the Process Instance. To see the details of a log entry, click the Show More Button. Click outside the Log Viewer Page to close it.

   Note:

   If the run selected does not pertain to Data Quality or if the selected Data Quality run does not get result details for the selected filter condition (As of Date and Data Source) during the execution, "Data Quality report is not applicable for this run" message is displayed.