4.5.2 Use and Execute the Source Data Quality Check Process

Use this Run Pipeline (Process) to perform the Data Quality Checks on source records for various data elements.

To use and execute the Source Data Quality Check Process in the Process Orchestration, do the following:

1. To access the Source Data Quality Check Process Pipeline, on the Home Page, select the Process Orchestration. The Process Modeller Page is displayed.
2. On the Process Modeller Page, search and select the Source Data Quality Check Process. The Process Flow Page is displayed. This Process Flow is designed on the Drawing Canvas using the Transition, Activity, and Widgets Components available in the floating toolbar. RUN DQ RULE Widgets representing Data Quality Groups are set up in parallel to each other. A Data Service Widget called as Data Quality Reporting Engine is added at the end meant for reporting Data Quality Checks.
3. To view the details of any Widget, double-click on the Widget and the details related to its Activity, Transition, and Notification are displayed. On the drawing canvas, you can select and see the Definition, Data Fields, and Application Rule details.
4. To execute the Run, you can select the Run Parameter Values using the Execution Button on the Process Flow Page or on the Process Modeller Page.
   Go to the Process Modeller Page to execute the Run. Click the Menu Button corresponding to the Source Data Quality Check Process that needs to be executed. Click Execute Run. The Execution Page is displayed.
5. On the Execution Page, to execute the Run with parameters, select With Parameters in the Execution Type List. Select the required As of Date for which the Data Quality Checks need to be processed. Click the Apply Button to initiate the Run Pipeline execution.

   Note:

   The execution of the Run Pipeline is triggered using the selected Extraction Date.

   See the Process Orchestration Section for more details about the Process Orchestration Framework.

6. To verify the Run Execution of the Source Data Quality Check Process, do the following:
   1. To open the Process Monitor Page, on the Process Modeller Page, click the Process Monitor Button or select Process Flow Monitor on the Process Modeller Menu.
   2. The Process Monitor Page is displayed, which lists all the Run Instances corresponding to the Source Data Quality Check Process. On the Process Monitor Page, search by the Process ID, or by the Process Name Source Data Quality Check Process, and select the Process Instance for the required Run Pipeline (Process) that was executed
7. The Process Flow Page is displayed with the Run Execution Status on each Node of the Source Data Quality Check Process.
8. To verify the Run Execution Logs, do the following:
   1. On the Process Monitor Page, click the required Process Instance for which you need to verify the Execution Logs. The Process Flow Page is displayed with the Run Execution Status on each Node.
   2. To see the Execution Status details of a Node, double-click on that Node. The Execution Status details Page is displayed. Click Execution Logs. The Log Viewer Page is displayed, which lists all the Logs related to the Process Instance. To see the details of a log entry, click the Show More Button. Click outside the Log Viewer Page to close it.