1. Analytical Application Infrastructure User Guide
  2. Data Management Framework
  3. Data Sources

Data Sources

Data Sources within the Data Management Tools of Infrastructure system facilitates you to define Data Sources and generate data models of the Source systems. While defining a Data Source itself, the source model generation happens. The Data Source type is classified as:

  • File based
    • HDFS
    • Flat File (Local to OFSAA or on a Remote Machine)
    • WebLog
  • Table based
    • HDFS (HIVE)
    • RDBMS (Oracle, MSSQL, DB2)

Note:

HDFS and WebLog based options are displayed only if the Big Data Processing license is enabled.

DMT Metadata are stored in the Database Tables, instead of the earlier approach of storing in XML and it is Infodom specific.

Since the Source Model generation is done for Flat file based Data Sources while defining a Data Source, there is no separate Data File Mapping window for creating mapping definition. In other words, F2T and F2H can be defined from the Data Mapping window itself.

If the Data Source is an OFSAA Infodom and model upload has already been done for the Infodom, there is no need to create another Data Source pointing to this Infodom. The Infodom can directly be used in the Data Mapping definition as a source. In addition, Dataset filters can be applied to this Infodom to get a further subset of Entities.

The roles mapped to Data Sources are as follows:

  • SRCACCESS
  • SRCREAD
  • SRCWRITE
  • SRCPHANTOM
  • SRCAUTH
  • SRCADV

For all the roles, functions, and descriptions, see Appendix A.

Figure 7-2 Data Sources window


This image displays the Data Sources window.

The Data Sources Summary window displays the list of pre-defined Data Sources with details such as Code, Name, Source Type, Upload Type, Created By, Creation Date, Version, and Active. You can add, view, modify, copy, authorize, delete, or purge Data Source definitions. You can make any version of a Data Source definition as the latest. For more information, see Versioning and Make Latest Feature.

For sorting the fields, mouse-over at the end of the Column heading and click to sort in the ascending order or click to sort the fields in the descending order.

You can search for a Data Source based on Code, Name, Source Type, and Record Status (Active, Inactive, or Deleted). In the Search and Filter pane, enter the details of the Data source you want to search in the respective fields and then click Search.