14.6.2.4.1.1.2 RUN DQ RULE

To configure this widget, complete the following steps:

  1. On the Process Flow page, from the LHS menu, expand Widget and drag and drop this widget on to the canvas.
  2. Double-click the widget on the canvas. The configuration window is displayed with the Activity tab selected.
  3. Under Dynamic Parameters, configure the settings described in the following table.
  4. Click the tick mark icon to save your changes. To close the configuration window, click anywhere outside the window on the canvas.

Table 14-6 Dynamic Parameters for RUN DQ RULE Description

Property Description
Datastore Name

Refers to the name of the Information Domain.

By default, the Information Domain to which you are connected is selected.

DQ Group Name Select the required DQ group.
Rejection Threshold

Enter the maximum number of errors in absolute value that a Data File can have despite which the Data Load will be marked successful. This is part of the property specification for the load to table option.

When the erroneous record count exceeds the Rejection Threshold value, the data loading task will fail and the inserted values will be rolled back for that table.

Inserts for the previous tables will not be reverted.

Rejection Threshold will be applied to each of the target tables individually in a batch.

Note:

The Rejection Threshold value should be a number which is considered as percentage of records. For example, if you have entered the value as 10, it is considered as 10 % of the entire records.

Note:

The Threshold limit is not applicable for duplicate Data Quality Check.

By default, the Rejection Threshold is considered as 100 when no input is added.

When the Rejection Threshold is set as 100 or blank, the whole data file will be loaded irrespective of the number of errors.

Additional Parameters

Enter any additional parameters for the Run DQ Rule filtering criteria for execution in the pattern:

Key#Data type#Value; Key#Data type#Value; and so on.

NOTE: In case these additional parameters are not specified, the default value is taken as NULL. Except the standard place holders $MISDATE and $RUNSKEY, all additional parameters for DQ execution should be mentioned in single quotes.

For example, STG_EMPLOYEE.EMP_CODE = '$EMPCODE'.

Fail if Threshold Breaches By default, the Fail If Threshold Breaches is considered as TRUE when no input is added.

When threshold breaches and the Fail If Threshold Breaches field is set to TRUE, the job will abort and the failure records are not inserted in the DQ Result tables.

When threshold breaches and the Fail If Threshold Breaches is set to FALSE, the job will proceed further and the failure records will be inserted in the DQ Result tables.
Stop Insert on Threshold Breach This is applicable only when Fail if Threshold Breaches is set to FALSE. When Stop Insert on Threshold Breach is set to Y, only the invalid records based on rejection threshold are inserted in the DQ Result tables. If set to N, all the invalid records are inserted. By default, it is set to N.
Rule Exec Connection To establish a connection for DQ execution, enter the Rule Execution Connection as STAGE.
Result Store Connection To store the Data Quality execution results, enter the Result Store Connection as PREPROCESS.
Batch on Fail Leave this parameter blank.
Micro service Id Enter the Micro Service ID.