Associating DQ Rules to a Data Mapping Definition

Data Quality Rules can be associated to Data Mapping definitions so that Data Quality(DQ) checks are done on the source and Data Correction (DC) is done while loading to the target table. Thus, DC is segregated from DQ checks. This is supported for both RDBMS and HIVE based Data Mapping definitions. However, DC on DQ Generic Check is not supported in T2H, H2T, and H2H. Additionally, associating DQ Rules to Data Mapping is not supported for H2T OLH (Oracle Loader for Hadoop) mode. If we associate DQ Rules with T2T and execute the batch, both T2T and all the DQ rules defined on the Source table are executed. You have an option to include or exclude the Associated DQ rules. If we exclude a DQ check and execute the batch, then only T2T operation is performed and not the DQ.

• De-select the Allow Correction on DI Source checkbox from the Configuration window. For more information, see the Updating Others tab section.
• The DI Source should exist as an information domain.

To associate DQ rules to Data Mapping definition:

1. Click button in the Associated DQ Rules toolbar. The Data Quality Rule Association window is displayed.
2. All DQ Rules defined on the source table are displayed.
3. Select the Exclude checkboxes corresponding to the DQ rules to exclude them being executed along with the T2T operation.
4. Enter the sequence in which the selected DQ Rules should get executed in the Sequence column.
5. Click Save.

   Note:

   When a DQ rule is associated with a T2T mapping and the Allow Correction on DI Source checkbox is not selected in the System Configuration> Configuration > Others tab, DQ rule checking is done on source, but data correction is done while loading to the target table.