DataQualityGroups

In the Process Flow window, click the DataQualityGroups icon in Widget from the toolbar and drag and drop it onto the canvas. Double-click the widget to display the Activity window.

Figure 8-5 Dynamic Parameters for RUN DQ RULE


This image displays the Dynamic Parameters for RUN DQ RULE.

Table 8-4 Dynamic Parameters for RUN DQ RULE Description

Property Description
DQ Group Name Refers to the Data Quality Groups consisting of associated Data Quality Rule definition(s). Select the required DQ Group from the drop-down list.
Rejection Threshold Specify the percentage of the Rejection Threshold (%) limit in numeric value. This refers to the maximum percentage of records that can be rejected in a job. If the percentage of failed records exceeds the Rejection Threshold, the job fails. If the field is left blank, the default value is set to 100%.
Additional Parameters

Specify the Additional Parameters as filtering criteria for execution in the pattern Key#Data type#Value; Key#Data type#Value;…etc.

Here the Data type of the value should be “V” for Varchar/Char, or “D” for Date with “MM/DD/YYYY” format, or “N” for numeric data. For example, if you want to filter some specific region codes, you can specify the Additional Parameters value as $REGION_CODE#V#US;$CREATION_DATE#D#07/06/1983;$ACCOUNT

_BAL#N#10000.50;

Note: In case the Additional Parameters are not specified, the default value is fetched from the corresponding table in the configuration schema for execution.

Fail if Threshold Breaches

Select Yes or No from the drop-down list. If Yes is selected, execution of the task fails if the threshold value is breached. If No is selected, the execution of the task continues.

Note: For Custom Check type DQ Rules in Hive Infodoms, the execution of the task does not fail even if the threshold is breached. This is a limitation.

Parameters

Select the Data Fields you want to pass as parameters for the selected Data Mapping definition.

For information on creating Data Fields, see the Data Fields section.