19.1 Adding a Data Extraction
- From the AFCS Home page, select Data
Extraction.The Summary page is displayed with a list of data extraction definitions.
- Click Add.The Specify Details window appears.
- Enter the Name for the Data Extraction.For Example: Extract CASA.
- Enter the Description of the Data Extraction.This field is optional.
- Select the Grain from the drop-down list.For Example: Customer Account.
- Select the Entity from the drop-down list.For Example: Casa
- Enter the required filter expression for the Data Extraction. In addition, you
can also add Parameters.
This field is optional.
For Example: [Casa].[Account or Contract Number] is not null.
This filters out rows where the account or contract number is not null.
Note:
For filtering data on Dimension Codes, you can specify member values for dimension surrogate key attributes only for the result table entities. - Click Validate to verify the correctness of the SQL
Expression and click OK.The filter expression is displayed in the Expression text box.
- Navigate to the Select Attributes page.The Attributes list displays the list of attributes that can be associated with the Data Extraction. The attribute list shows the combined attributes for all the tables selected.
- Select the attributes and click OK.Select or unselect the attributes by clicking the respective icons. You can also drag and drop to rearrange the attributes in the Selected Attributes section.
Note:
You can select a maximum of 998 attributes.Note:
You can click Edit icon and rename the header attribute name, if required.Note:
Post upgrade, attributes of existing result entity extract connectors must be de-selected and selected again to auto rename attributes and validation on duplicate columns in selected attributes. For new connectors, attributes will be automatically renamed when selected. Auto-renaming of attributes to its corresponding dimension code attributes in the user interface is done only for Result table surrogate keys. - Navigate to the Describe File page.
- In Specify Data file names, enter the file name. This
is a mandatory field.For example: test_file_data.txt
Note:
The file extension must be either .txt or .csv. - Select Column delimiter from the drop down list.For Example: Comma
- Specify the Text qualifier.For Example: Double quotes can be used, prefixed, and suffixed with text.
- Select the file format.For Example: Fixed Length or Delimited.
- Select the Record delimiter.For Example: Unix
- Toggle the Header button if you want a header to be
displayed in the extracted file.This field is optional.
Note:
The extracted file will show Result, Dimension, Integration, and Staging tables. Currently, Processing layer tables are not supported.
In case two physical entities contain the same logical name, the order of preference for the entity will be in the following order:
- 1 - Result
- 2 - Dimension
- 3 - Integration
- 4 - Staging
- Toggle the Generate a control file button if you want to
generate a control file. The control file provides verification/validation
information for use with extracted data files.This field is optional.
In the Specify control file name field, enter the file name. This is a mandatory field. The file extension must be either .txt or .csv.
The parameters you entered for Specify Data file names are copied to the Control file properties. You can modify based on your requiements. By default, the name is added as < Specify Data file names >_control.csv/.txt . For more details on fields such as Select file format, Select Column delimiter, Select Record delimiter, and Specify Text qualifier, see the above step.
To add the controls, click Add button.
- Add the control name in the text box.
- Select the aggregation type from the dropdown. The supported options are Count, Avg, Sum, Min, and Max.
- Select the attribute from the drop-down. The Attribute field is disabled when the aggregation type is selected as Count. The numerical attributes supports the aggregation type Sum, Average, Min, and Max. The Date attribute supports the aggregation type Min and Max only.
You can add multiple controls to the file by clicking on Add button.
The Control file is available in the Archived Extract file.
Note:
The following are the behavior of the Control file in this release:
- There is no validations performed while generating a control file.
- Header will not be generated in case of control file during data extraction and you will not have an option to add the header.
- Click Save.The Data Extraction Definition is created.
Note:
The maximum extracted archive file size must be less than or equal to 7.5 GB. - After the Data Extraction is saved, the PMF process needs to be configured and
executed. For more details, see Executing Connector using Process
Modelling Framework
The Data Extraction file is created.
- Download the file from the File Operations screen. For more details, see File Operations.