1. Analytical Application Infrastructure User Guide
  2. Data Management Framework
  3. Data Quality Framework
  4. Data Quality Rules
  5. Creating a Data Quality Rule

Creating a Data Quality Rule

You can create a Data Quality Rule definition by specifying the DQ Definition details along with the type of validation check on the required table and defining the required validation conditions to query and correct the transformed data. Data Quality Rules can be defined on entities of Infodom as well as on Data sources that are defined from the Data Sources window. Before defining DQ Rule on a Data Source, the Source Model Generation should have been done.

Note:

  • Data Quality Rules can be defined only on the DI Sources whose underlying schema resides in the same database, where OFSAAI METADOM or atomic schema exists.
  • If you are defining Data Quality check on a Data Management Source, only the quality check will be done; data correction will not be done since it is an external source.
  • When creating a Data Quality Rule, it is supported to a maximum of 8 primary key columns.
To create a Data Quality Rule:
  1. Click Add in the Data Quality Rules window. The Add button is disabled if you have selected any checkbox in the grid.
    The Data Quality Definition window is displayed.
  2. In the DQ definition section:
    • Enter the Name by which you can identify the DQ definition.
    • Enter a Description or related information about the definition.
    • Select the On DI Source checkbox if you want to define data quality check on a Data Source. This is optional. ⎯ Select the required Data Source from the drop-down list. The Source drop-down list displays sources created on Oracle DB and Hive DB if it is RDBMS Information Domain or sources created on Hive DB if it is Hive Information Domain.
    • Select the Folder (available for selected Information Domain) from the drop-down list.
    • Select the Access Type as either Read Only or Read/Write. The Read Only option enables only the creator to modify the rule details. Other users can only view the DQ rules. The Read/Write option enables all users to view, modify any fields (including Access Type), and delete the DQ rule.
  3. Select the Check Type from the drop-down list. The options are Specific Check, Generic Check, and Control Total Check.