3.2.2.2 Instrument and Ledger Data Loaders

After the Data Files are uploaded to the Object Store, the Data Loaders are used to move the data from the files to the standing tables and then to processing tables.

File to Stage

To load the Data to Staging Tables:

  1. Define a new Batch and save it.
  2. Add the following Tasks to the above Batch:

    Table 3-4 Data Loader – File to Stage Data

    Task Code Task Name Component Parameters
    1 * Custom Task Name * Stage Data Loader

    Table Name: select the stage table name from the available list.

    Data File Specification: select the data file specification definition form the available list.

    File Name: free text where file name uploaded to the object store to be provided.

    Note:

    You can also zip the file and then upload. Ensure the file name in the zip file is inline with the Data File Specification.

* Task Code and Task Name in the above table are for illustration purpose only. You can name them as per your requirements.

Execute the Batch for the As-of-Date used in the Data File.

For detailed instructions on Creating a Batch, Defining a Task, Execute the Task, and Schedule a Batch, see the Scheduler Services User Guide.

Stage to Processing

To load the Data from Staging Tables to Processing:

  1. Define a new Batch and save it.
  2. Add the following Tasks to the above Batch:

    Table 3-5 Data Loader – Stage to Processing Data

    Task Code Task Name Component Parameters
    1 * Custom Task Name *

    Select the relevant Component depending on the Data that you want to process. The options are:

    • Instrument Data Loader
    • Ledger Data Loader
    • Transaction Summary Loader

    Stage Table: select the stage table name from the available list.

    Data File Specification: select the Data File Specification name from the available list.