Incremental Data Quality Remediation and Support for Incremental Application Object Model (AOM) Parameters for Selected Processes

Allows user to run DQ checks on multiple times incrementally throughout the day. By introducing a new parameter called "Watermark" which keeps increasing with each data load. The DQ service will be enhanced to track the last processed "Watermark" and use it as a filter for subsequent incremental runs.

Some parameters may be applicable only for certain processes E.g. DQ Incremental parameters. If any custom process requires the additional to be available during execution, there is an API to insert that process into parameter tables. 

Provides a mechanism to run DQ checks only on newly ingested data since the last execution thereby improving performance when there are multiple transaction files arriving throughout the day.

Allows additional parameters to be presented for execution of only relevant processes. 

Steps to enable and configure

You don't need to do anything to enable this feature.