2.1 Create a Rule

You can define a Data Quality (DQ) Rule by specifying the necessary details in the DQ Definition.

Supported Capabilities:

• Create three types of custom DQ rules: Mandatory, Range, and Comparison.
• Edit custom DQ rules in Draft, Returned, and Published statuses.
• Delete custom DQ rules in Draft or Returned statuses.

Note:

• A rule can only be created for an action that is in New or Returned status.
• The Action ID is automatically populated.
• The Range option is only supported for attributes of numeric and date types.
• The Comparison option only allows attributes of the same type to be compared.
  • When comparing alphanumeric or character-type attributes, only the equal sign (=) operator is supported.
• The Mandatory rule is defined as follows:
  • For alphanumeric or character-type attributes: It checks for both Null and Blank values.
  • For all other attribute types: It performs a Null Value Check only.

Ensure that the issue is categorized under Data Accuracy, with the Source set to Catalog and the Action Type set to Data Accuracy.

Steps to Create a Data Quality Rule:

Access the Control Extensions Menu

1. From the Inbox page, select the action for which you want to create a DQ rule.
2. Click Control Extensions from the left-hand side (LHS) menu.

   Initiate Rule Creation

3. Click Create Rule to open the rule creation window.
4. Enter Rule Details:
   • Provide a Description of the rule.
   • Add Comments if needed.

   Select Entity and Attribute

5. Choose the relevant Entity Name from the drop-down list. This will populate associated attributes in the Attribute Name list.
6. Select the desired Attribute Name.
7. Select one of the available Rule Types: Mandatory, Range, or Comparison.
8. Depending on the selected Rule Type, additional fields will appear. Enter the required details accordingly.

   Define a Data Quality Rule Filter

9. Click Add to configure a Data Quality Rule Filter. The filter configuration window will open.
10. Click the Add Filter icon, enter a name for the filter, and click + Condition to specify the filter conditions.
11. The selected conditions will be displayed in the Expression field. Click Save to confirm.
    Custom DQ Filter Behavior:

    • Mapping a filter to a custom DQ rule is optional; a rule can be saved and published with or without a filter.
    • Filters can be reused across multiple custom DQ rules.
    • A filter cannot be edited or deleted if it is mapped to an existing custom DQ rule.
    • A filter can only be changed or unmapped from a custom DQ rule if the rule is in Draft, Returned, or Published state.

    Filter Condition Rules:

    • Filter conditions can only be defined on attributes of the entity where the filter is applied.
    • For text-based columns, only the following operators are supported:
      • Equals (=), Not Equals (!=), IN, and NOT IN (when compared against values).
    • The Value field in filter conditions for text-based columns can only contain these special characters:
      • Hyphen (-), Comma (,), Underscore (_), and Full Stop (.).
    • The Filter Name must be unique within an entity and can only include these special characters:
      • Hyphen (-), Comma (,), Underscore (_), and Full Stop (.).
    • The maximum supported length for a filter expression without a dimension entity reference is 3,800 characters.
12. Click Save to finalize the rule.
13. The system will generate a Rule Code, and the rule will appear in the Control Extensions page.