Data Mapping

Data Mapping is the process of retrieving unstructured data from data sources for further data processing, storage, or migration.

After the intermediate extraction process in Data Mapping, you can perform data transformation and add metadata before exporting it to the staging area or to the Business Data Model.

The data movement can be from:

• RDBMS source to RDBMS target (T2T)
• RDBMS source to Flat File target(T2F)
• RDBMS source to HDFS-Hive target (T2H)
• HDFS-Hive source to RDBMS target(H2T)
• HDFS-Hive source to HDFS target (H2H)
• HDFS/Local-WebLog Source to HDFS Target (L2H)
• HDFS-Hive source to Flat File target (H2F)
• Flat File to RDBMS target (F2T)
• Flat File present in Local File System (LFS) to HDFS target or HDFS file to HDFS target(F2H)

Note:

You cannot load the File present in the HDFS system into the RDBMS target Infodom.

You can define F2T and F2H in Data Mapping .

Data movement between Hive and RDBMS can be enhanced using third-party tools like SQOOP and Oracle Loader for Hadoop (OLH). You must set the parameters in DMT Configurations. For details on the configurations for SQOOP and OLH, and for the configurations required to support WebLog ingestion (L2H) refer to the OFSAAI Administration Guide available in the OHC Documentation Library.

The following roles are mapped to Data Mapping :

• DMACCESS
• DMREAD
• DMWRITE
• DMPHANTOM
• DMAUTH
• DMADV

For all the roles, functions, and descriptions, see Appendix A.

To access Data Mapping:

1. Login to the OFSAA Application as a Business User.
   (Optional) <Enter a step example.>
2. Click the Hamburger icon on the OFSAA Landing Page, and then click Financial Services Enterprise Modeling>Data Management>Data Management Framework>Data Management Tools>Data Mapping to access Data Mappings.

   Figure 8-4 Data Mappings window

   
   

   

   
   
   The Data Mappings window displays the list of pre-defined Data Mapping definitions with Record Status as Executable and the following details:

   • Code
   • Name
   • Source Type
   • Created By
   • Creation Date
   • Version
   • Active

   You can manage the Data Mapping definitions, and make any version of a Data Mapping definition as the latest.
3. To sort the fields, navigate to the end of the column heading and select Click to sort ascending or click to sort descending.
4. To search for a Data Mapping definition, enter the details in Search and Filter based on Code, Name, Type (F2T, T2F, and T2T), Source, and Record status, and click Search.
   The options for Record Status are:

   • Executable - View all active versions of Data Mapping definitions and inactive versions of the same Data Mapping definition with distinct sources.
   • Active - View only the active version of all Data Mapping definitions.
   • Inactive - View all the inactive versions of Data Mapping definitions.
   • Deleted - View all the deleted Data Mapping definitions.