3.2.2.2 Instrument and Ledger Data Loaders

After the Data Files are uploaded to the Object Store, the Data Loaders are used to move the data from the files to the standing tables and then to processing tables.

File to Stage

To load the Data to Staging Tables:

  1. Define a new Batch and save it.
  2. Add the following Tasks to the above Batch:

    Table 3-6 Data Loader – File to Stage Data

    Task Code Task Name Component Parameters
    1 * Custom Task Name * Stage Data Loader

    Table Name: select the stage table name from the available list.

    Data File Specification: select the data file specification definition from the available list.

    Data File Name: free text where file name uploaded to the object store to be provided. This is optional.

    • When the Data File Name is not provided, Stage Loader fetches the file from object store with the selected Data File Specification name.
    • If name of file is different from Data File Specification, then put exact file name including extension but excluding the prefix.

    Note:

    You can also zip the file and then upload. Ensure the file name in the zip file is inline with the Data File Name in the Task Parameters UI.

    * Task Code and Task Name in the above table are for illustration purpose only. You can name them as per your requirements.

    Table 3-7 Sample Data File Specification and File Name

    Data File Specification Data File Name in Task Parameters UI File in Object Store
    Asset_Loan.dat Asset_Loan_1.dat input_yyyymmdd_Asset_Loan_1.dat
    Asset_Loan.dat Not entered input_yyyymmdd_Asset_Loan.dat

    To upload multiple files using same Data File Specification, add separate tasks for each file within the batch.

  3. Execute the Batch for the As-of-Date used in the Data File.

    For detailed instructions on Creating a Batch, Defining a Task, Execute the Task, and Schedule a Batch, see Scheduler Services.

Profitability and Balance Sheet Management Cloud Service - Stage to Processing

To load the Data from Staging Tables to Processing:

  1. Define a new Batch and save it.
  2. Add the following Tasks to the above Batch:

    Table 3-8 Data Loader – Stage to Processing Data

    Task Code Task Name Component Parameters
    1 * Custom Task Name *

    Select the relevant Component depending on the Data that you want to process. The options are:

    • Instrument Data Loader
    • Ledger Data Loader
    • Transaction Summary Loader

    Stage Table: select the stage table name from the available list.

    Data File Specification: select the Data File Specification name from the available list.

Climate Change Analytics Cloud Service - Stage to Processing

CCACS is delivered with out-of-the-box seeded batches to load the data from Staging tables to Processing tables. The user can define custom batches using the following components.

For the list of seeded batches, see the MOS page 2930308.1.

  1. Add the following Tasks to the Batch:

    Table 3-9 Data Loader – Stage to Processing Data

    Task Code Task Name Component Parameters
    1 * Custom Task Name *

    Select the relevant Component depending on the Data that you want to process. The options are:

    • CCA Processing Loader

    For CCA Processing Loader: select the stage table name and data file name.