1. Analytical Application Infrastructure User Guide
  2. Data Management Framework
  3. Data Management Tools

Data Management Tools

Data Management Tools help users to transform and merge data.

Data Management Tools is based on the ETL (extract-transform-load) structure, which is used for data transformation and merging. The ETL structure eliminates the need for a separate ETL server, and the analytical rules facilitate to optimized performance, efficiency, and scalability.

Figure 8-1 Illustration of Data Management Tools


This image displays the Illustration of Data Management Tools.

The Data Management Tools is equipped with a set of automated tools and tested data integration methodologies that enable you to position the advanced N-tier web-based architecture and integrate the enterprise data sources from the mainframe to the desktop.

In Data Management Tools, you can standardize and integrate the various source system data into a single standard format for data analysis. You can also populate the warehouse in a defined period using the ETL process for data extraction, transformation, and loading.

Prerequisites while working with Data Management Tools:

  • Transform data using the options - Before load, While load or After Load.
  • For source system information, you can set the filenames as either fixed or delimited .
  • You can load RDBMS and Flat-Files into the system . For an RDBMS source type, ensure that the appropriate drivers are installed.
  • Ensure that you are aware of the process flow before you start with the extraction, transformation, and loading process.
As part of the 8.0.6.0.0 release, Data Management Tools User Interface is re-organized and OJET/ALTA theme is adapted for better usability. All metadata in DMT is now persisted in Database instead of XML files.

Note:

For migrating DMT metadata in previous versions to 8.0.6.0.0 version and above, see DMT Metadata Migration Guide.

Data Management Tools Components

  • Data Sources: Define Data Sources and generate data models of Source systems.
  • Data Mapping: Retrieve unstructured data from data sources for further data processing, storage, or migration.
  • Post Load Changes:Post Load Changes (PLC) refers to a rule describing the conversion of data from sources to Staging or from Staging to Processing (destination) tables.
  • User Defined Functions: Register Hive Permanent and Temporary User Defined Functions that can be used in Expression Builders in OFSAAI.
  • DMT Configurations: Configure Data Mapping definition or PLC definition.