10.1 DQ Checks and Controls
Controls are defined on data elements based on the defined DQ rules. The effectiveness of these controls can be automatically assessed based on the DQ execution facts.
To view an issue and create an action, the user must be mapped to the following issue and action groups: ACTNANLST, ISSUEADMN, ISSUEANLST, ISSASR, ACTASR, ACTVIEWER, ISSAPR in addition to other Control related groups.
The following are the types of Data Quality Checks and their definitions:
Table 10-3 Data Quality Checks
Data Quality Check | Definition |
---|---|
Blank Value Check | Identifies if the base column is empty considering the blank space. |
Column Reference/Specific Value Check | Compares the base column data with another column of the base table or with a specified direct value by using a list of pre-defined operators. |
Data Length Check | Checks for the length of the base column data by using a minimum and maximum value, and identifies if it falls outside the specified range |
Duplicate Check | Is used when a combination of the column is unique and identifies all duplicate data of a base table in terms of the columns selected for the duplicate check |
List of Value Check | It can be used to verify values where a dimension/master table is not present. This check identifies if the base column data does not match with a value or specified code in a list of values. |
NULL Value Check | Identifies if ‘NULL’ is specified in the base column. |
Referential Integrity Check | Identifies all the base column data that has not been referenced by the selected column of the referenced table. Here, the user specifies the reference table and columns. |
Range Check | Identifies if the base column data falls outside a specified range of a Minimum and Maximum value. |
The controls are specific to reports. The DQs are defined in the DQ_CHECK_MASTER and
DQ_GROUP_MAPPING tables.
Note:
The DQ rules are defined based on the Stage Table and Column mapped to a particular report.