1.6.2.4.1.3 RUN DQ RULE
To configure this widget, complete the following steps:
- On the Process Flow page, expand Widget section in the LHS menu and drag this widget on to the canvas.
- Double-click the widget on the canvas to open the configuration window with the Activity tab selected.
- Under Dynamic Parameters, configure the settings described in the below table.
- Select the check mark icon to save your changes. To close the configuration window, click anywhere outside the window on the canvas.
Table 1-6 Dynamic Parameters for RUN DQ RULE Description
Property | Description |
---|---|
Datastore Name | Refers to the name of the Information Domain.
By default, the Information Domain to which you are connected is selected. |
DQ Group Name | Select the required DQ group. The unique identifier name
for the groups.
The name should start with alphabet and should not be more than 50 characters. |
Rejection Threshold | Inserts for previous tables will not be reverted.
The Rejection Threshold is applied to each target table individually within a batch. By default, the Rejection Threshold is considered as 100 when no input is added. When the Rejection Threshold is set as 100 or blank, the whole data file will be loaded irrespective of the number of errors. Note: The Rejection Threshold value should be a number which is considered as percentage of records. For example, if you have entered the value as 10, it is considered as 10 % of the entire records.Note: The Threshold limit is not applicable for duplicate Data Quality Check. |
Additional Parameters | Enter any additional parameters for the Run DQ Rule
filtering criteria in the following format:
Key#Data type#Value;
Key#Data type#Value; and so on.
Note: If these additional parameters are not specified, the default value will be set to NULL. Except for the standard placeholders $MISDATE and $RUNSKEY, all additional parameters for DQ execution must be enclosed in single quotes. For example: P_CODE =
'$EMPCODE' |
Fail if Threshold Breaches | By default, the Fail If Threshold Breaches option
is set to TRUE when no input is provided.
If the threshold is breached and the Fail If Threshold Breaches field is set to TRUE, the job will abort, and the failure records will not be inserted into the DQ Result tables. If the threshold is breached and the Fail If Threshold Breaches field is set to FALSE, the job will continue, and the failure records will be inserted into the DQ Result tables. |
Stop Insert on Threshold Breach | This is applicable only when Fail if Threshold Breaches is set to FALSE. When Stop Insert on Threshold Breach is set to Y, only the invalid records based on rejection threshold are inserted in the DQ Result tables. If set to N, all the invalid records are inserted. By default, it is set to N. |
Rule Execution Connection | To establish a connection for DQ execution, enter the Rule Execution Connection as STAGE. |
Result Store Connection | To store the Data Quality execution results, enter the Result Store Connection as PREPROCESS. |
Batch on Fail | Leave this parameter blank. |
Micro service Id | Enter the Micro Service ID. |