Creating DQ Rule

You can create a Data Quality Rule Definition by specifying the DQ Definition details along with the entity details and the type of data quality check to be performed on the selected base table. You can also define the required search conditions to query and correct the transformed data.

  1. To create a DQ Rule, click Add Rule on the DQ Rules Summary.
    The Data Quality Rules page with DQ Group Details and DQ Rules Mapping tab is displayed.
  2. Click Start, to enter the following basic details for the new DQ Rule.
    • Name - The unique identifier name for the rule.

      The name should start with alphabet and should not be more than 50 characters.

      Blank space ( ), Underscore (_) and Hyphen (-) are allowed as special characters.

    • Description - The description/details for the rule.

      The description should start with alphabet and should not be more than 250 characters.

    • Folder - Select the folder present in the current environment, to be associated with the rule.
    • Check Type - Select one of the following check types for the rule.
    • Access-type - Select one of the following Access types.
      • Read-only - only the creator can edit the rule. Other users can only view the rule.
      • Read-Write - all users can view, modify any fields (including Access Type), and also delete the DQ Rule.
    • Check Auto DQ Group Required option, to create a new DQ group, for this Rule.

      The new group will be associated only with the created DQ rule. The group name will be set as <DQ_Rule_Name_group>, and this group will have only Read-only access.

    • Check Auto Assignment, to execute the rule, and also perform the assignment.

      Note:

      The Auto Assignment is applicable only to the Auto DQ Group.
    • Click Continue to proceed with the Entity Selection page.
  3. Enter/select the following entities:
    • Table - Select the basic table on which the rule is executed.
    • If the rule is a single-column rule, select the Base Column, to be included for the rule execution. Base column will not be present for Multi-Column rule.

      You can search table based on physical and logical names.

    • Select the Identifier Columns required to execute the rule.
      • To select multiple columns, click Edit.
      • Select the required columns from the Available Members pane and move them to Selected Members pane.
    • Click Edit, to include the filter expression.

      The Specify Expression page is displayed. For more information refer to Creating Expressions.

      • Select the entities to be included in the filter expression and click OK.
  4. Click Continue, to proceed with the Data Check Definitions.
  5. Select the required Data Check Definitions, to validate the data.
    Enter/select the required information for each Data Check Definition. For more information about each Data check type, refer to Data Check Definitions.
  6. Click Submit, to submit the new DQ Rule for approval.

    The DQ Rule is saved with the status Pending for Approval, in the Rules Summary and a confirmation message is displayed.

    While creating the DQ Rule, you can also click Save As Draft, to save the new incomplete DQ Rule at any point of time and resume the process at a later point. A confirmation message is displayed, after the draft is saved successfully.

    The new Rule added to the DQ Rules Summary, and is set to Draft Status in the DQ Rules Summary.

    Note:

    If the user has DQAUTOAUTH Role assigned, the Rule will be auto-approved.