2.6.1.1 Create a Rule

You can create a Data Quality Rule definition by specifying the DQ Definition details.

The following capabilities are supported:

• Ability to create three types of Custom DQ rules: Mandatory, Range, Comparison.
• Ability to edit Custom DQ rules in Draft, Returned and Published status.
• Ability to delete Custom DQ Rules in Draft or Returned status.

Mandatory

Custom DQ Mandatory rule is a combination of Null Value and Blank Value. Check for alphanumeric or character type of base attribute and it is Null Value Check for other types of base attribute.

Range

The Range option is supported only for attributes of numeric and date types.

Comparison

• The comparison check allows you to compare the attributes with the following options:
  • Specific Value- This option allows you to compare the base attribute with a specific value based on the type of base attribute selected.

    Note:

    Single quote special character is not allowed in the value field.
  • Another attribute- This option allows you to compare the Comparison Base Attribute with the Comparison Attribute, where the Comparison Base Attribute and Comparison Attribute are the attributes of the base entity or of the associated dimensions that are referenced by the base entity.
  To compare using another attribute option, enter information in the following fields:
  • Comparison Base Entity- This dropdown lists the base entity along with the associated dimensions that are referenced by the base entity. By default, this field is populated with base entity.
  • Comparison Base Attribute- This dropdown lists all the attributes of the entity selected in the Comparison Base Entity field. By default, this field is populated with base attribute.
  • Operator- Select the appropriate value from the dropdown list.
  • Comparison Entity- This dropdown lists the base entity along with the associated dimensions that are referenced by the base entity.
  • Comparison Attribute- This dropdown lists all the attributes of the entity selected in the Comparison Entity field.
• The comparison option allows you to compare the attributes which are only compatible to be compared. When you use this option with alphanumeric or character type of Comparison Base Attribute, equal sign operator alone is supported.

Ensure the Issue is created with the Category as Data Accuracy and Source as Catalog and the Action Type as Data Accuracy.

To create a Data Quality Rule, complete the following steps:

1. From the Inbox page, click the action for which you want to create a DQ rule.
   Now click Control Extensions from the LHS menu.

   Note:

   You can create a rule only from the action which is in New or Returned status.
2. Click Create Rule.
   The Create Rule window is displayed.

   Note:

   The Action ID is populated by default.
3. Enter a Description or related information about the rule definition.
4. Add Comments, if required.
5. Select the entity for the rule from the Entity Name drop-down list.
   Based on this selection, the associated attributes are populated in the Attribute Name list.
6. Select the attribute from the Attribute Name drop-down list.
7. Select the Rule Type. The options are Mandatory, Range, and Comparison.
8. Based on the Rule Type selected, additional fields are displayed. Provide the required information.
9. Click Add button to add or select the Data Quality Rule Filter. The Data Quality Rule Filter screen is displayed.
   Click Add Filter icon and enter the name for the filter. Click + Condition button to enter the filter conditions. The selected conditions are displayed in the Expression field and click Save.
   Custom Data Quality framework supports defining advanced filters on referred dimensional attributes of the base entity on which the data quality check is being defined. To define the filter referencing dimensions, in the Comparison Entity drop-down, select the reference/ base entity and in the Comparison Attribute drop-down, select the attribute of comparison entity. Comparison attribute can be compared against the specific value or attribute of the base entity based on the radio button selection.
   Users may define filters to compare attributes of comparison entity to base entity attributes as well as to a specific value or list of values (using IN/NOT IN operators).

   Note:

   Following are the behavior of the Custom DQ Filters:

   • Mapping a filter to a custom DQ rule is not mandatory. So, a custom DQ rule can be saved and published with or without filter.
   • Filters can be reused across custom DQ rules.
   • Filter cannot be edited or deleted if it is mapped to a custom DQ rule.
   • You can only change or un-map a filter from a custom DQ rule, whenever a custom DQ rule is in Draft, Returned or Published state.
   • Filter conditions can only be defined on the attributes of an entity on which filter is defined.
   • Filter conditions defined on text columns only supports Equals , Not Equals, IN, and NOT IN operator when compared against value(s).
   • The value field of filter conditions defined on text based columns can only contain following special characters: hyphen, comma, underscore and full stop.
   • The filter name should be unique throughout an entity and can only contain following special characters: hyphen, comma, underscore and full stop.
   • The maximum supported length for a filter expression having no dimension entity reference is 3800 characters.
10. Click Save.
    The Rule code is automatically populated, and the rule is displayed in the Control Extensions page.