Prerequisites for the Data Pipeline

The following prerequisites for the data pipeline must be executed before triggering the OFS MMG installer.
  1. Log in as a DB user(ex: fccmdb) in your DB server (For example: 1759).
  2. Create one directory with a preferred reference name (For example: datapipline) at the preferred location.
  3. Now execute the following commands in the putty session of the DB server:
    • mkdir -p ##location of dir created in step 2##/file_store/fs_list/logs # A directory by the external table to write the logs.
    • mkdir -p ##location of dir created in step 2##/file_store/fs_list/script # A directory to hold a pre-processor script used to list the files in a directory. This needs Read-Execute permissions.
    • mkdir -p ##location of dir created in step 2##/file_store/fs_list/control # A directory to hold files to control which directories can be listed. This needs Read permissions.
    • mkdir -p ##location of dir created in step 2##/file_store/fs_list/fccm-data # A directory to store the csv files.
  4. Log in to the DB server(For example: 1759) as a sysadmin( For example: sys), and then in sqldeveloper or any preferred application execute the following commands:
    • CREATE OR REPLACE DIRECTORY fs_list_logs_dir AS '##<location of dir created in step 2>##/file_store/fs_list/logs';
    • GRANT READ, WRITE ON DIRECTORY fs_list_logs_dir TO ##MMG Application Schema##;
    • CREATE OR REPLACE DIRECTORY fs_list_script_dir AS '##<location of dir created in step 2>##/file_store/fs_list/script';
    • GRANT READ, EXECUTE ON DIRECTORY fs_list_script_dir TO ## MMG Application Schema##;
    • CREATE OR REPLACE DIRECTORY fs_list_control_dir AS '##<location of dir created in step 2>##/file_store/fs_list/control';
    • GRANT READ ON DIRECTORY fs_list_control_dir TO ##MMG Application Schema##;
    • CREATE OR REPLACE DIRECTORY external_tables_dir AS '##<location of dir created in step 2>##/file_store/fs_list/fccm-data';
    • GRANT READ ON DIRECTORY external_tables_dir TO ## MMG Application Schema##;
    • GRANT CREATE TABLE TO ##MMG Application Schema##;
    Once the above steps are completed, trigger the installation of the build.

    Note:

    • If the new schema is residing on any-other DB server other than the one on which the above steps were performed then you must perform all the above steps on that respective server.
    • Once you have configured the DB server, if a new schema is created on it you must perform the above steps for the respective schema.