19.6 OOTB Extract for Data Quality Error Report

For the Data Quality Error Records, there will be an extract definition Data Quality Error Report as an out-of-the-box extract.

To view or modify the extract definitions:

1. From the AFCS Home page, select Data Extraction.
   The Summary page is displayed with a list of data extraction definitions.
2. Select Data Quality Error Report by searching for it. Click to view details of this extract.

   Note:

   You cannot modify the Name, Description, Grain, and Entity.
3. User will have the option to apply a filter on Data Quality Error Records table.
4. Click Select Attributes. The following attributes are added in Computed section under Available Attributes.
   • Data Quality Error Record Identifier Name One
   • Data Quality Error Record Identifier Name Two
   • Data Quality Error Record Identifier Name Three
   • Data Quality Error Record Identifier Name Four
   • Data Quality Error Record Identifier Name Five
   • Data Quality Error Record Identifier Name Six
   • Data Quality Error Record Identifier Name Seven
   • Data Quality Error Record Identifier Name Eight
   • Data Quality Entity Name
   • Data Quality Entity Attribute Name
5. Click Describe File.
6. In Specify Data file names, enter the file name. This is a mandatory field.
   For example: test_file_data.txt

   Note:

   The file extension must be either .txt or .csv.
7. Select Column delimiter from the drop down list.
   For Example: Comma
8. Specify the Text qualifier.
   For Example: Double quotes can be used, prefixed, and suffixed with text.
9. Select the file format.
   For Example: Fixed Length or Delimited.
10. Select the Record delimiter.
    For Example: Unix
11. Toggle the Header button if you want a header to be displayed in the extracted file.
    This field is optional.

    Note:

    The extracted file will show Result, Dimension, Integration, and Staging tables. Currently, Processing layer tables are not supported.

    In case two physical entities contain the same logical name, the order of preference for the entity will be in the following order:

    • 1 - Result
    • 2 - Dimension
    • 3 - Integration
    • 4 - Staging
12. Toggle the Generate a control file button if you want to generate a control file. The control file provides verification/validation information for use with extracted data files.
    This field is optional.

    In the Specify control file name field, enter the file name. This is a mandatory field. The file extension must be either .txt or .csv.

    The parameters you entered for Specify Data file names are copied to the Control file properties. You can modify based on your requirements. By default, the name is added as < Specify Data file names >_control.csv/.txt . For more details on fields such as Select file format, Select Column delimiter, Select Record delimiter, and Specify Text qualifier, see the above step.

    To add the controls, click Add button.

    • Add the control name in the text box.
    • Select the aggregation type from the drop-down. The supported options are Count, Avg, Sum, Min, and Max.
    • Select the attribute from the drop-down. The Attribute field is disabled when the aggregation type is selected as Count.

    You can add multiple controls to the file by clicking on Add button.

    The Control file is available in the Archived Extract file.

    Note:

    The following are the behavior of the Control file in this release:

    • There is no validations performed while generating a control file.
    • Header will not be generated in case of control file during data extraction and you will not have an option to add the header.
13. Click Save.
    The Data Quality Error Report definition is updated.
14. For this seeded connector, you must create a pipeline to execute.