Data Transformations
Data transformations are rules that you can use to cleanse, reshape, and process data before loading to target data assets.
Data Integration includes an interactive Data tab that displays a sampling of data, and updates the sampling as you apply transformation operations. With the Data tab you can also validate the impact of transformations, debug, and troubleshoot possible failures before you run a task.
You can access the Data tab when working in the Data Integration data flow designer, and in the configuration UI when you create a data loader task.
When you click an attribute name in the Data tab, Data Integration displays a profile panel where you can view the following profiles:
- Data profile: Displays a summary of primitive data, such as the total number of rows and attributes. A data profile is not available for complex data types.
- Attribute profile: Displays a summary of a selected attribute, such as the data type, minimum value, and maximum value. For a String data type, the maximum and minimum values are determined by lexicographic ordering. For a complex data type, a simplified structure of the data structure hierarchy is displayed.
The following pages provide more information about transformations and the types of transformations you can apply in Data Integration: