Creating a Data Source

Data Source refers to the physical structure or location of the source system. The Data Source can be a file, a table, or WebLogs.
  • In case of File, it can be a flat file that can be local to OFSAA or remote to OFSAA, or a file on HDFS.
  • In case of a table, it can be an RDBMS table or HDFS table.
  • In case of WebLogs, it can be in a local file system or in an HDFS cluster. If it is in the HDFS cluster, you must register a cluster with the required information from the DMT Configurations>Register Cluster window.
For tables, the connection and authentication details are defined in the System Configuration > Database Details section. Proper connection pooling must be done, if you have to create an external Data Source on a database without an Information Domain created on it. Applications access the data source using an FTP connection.

Note:

  1. Source creation implicitly does a source model generation.
  2. Defining the structure of a Flat File is mandatory during the creation of Flat File based sources.
  3. Data Sources cannot be defined on Configuration Schema. By default, OFSAA generates Data Sources on Configuration Schema and they can only be viewed; you cannot edit them.
To create a Data Source follow these steps:
  1. From the Data Sources window, click Add. The Data Source window is displayed.

    Figure 7-3 Data Sources window


    This image displays the Data Sources window.

    The ID will be automatically generated once you create a data source. The Folder field is not enabled.
  2. Enter a distinct Code to identify the Data Source. Ensure that the code is alphanumeric with a maximum of 50 characters in length and there are no special characters except underscore “_”.
  3. Enter the Name of the Data Source.
  4. Enter a Description for the Data Source.