3.2.2.2 Instrument and Ledger Data Loaders
After the Data Files are uploaded to the Object Store, the Data Loaders are used to move the data from the files to the standing tables and then to processing tables.
File to Stage
To load the Data to Staging Tables:
- Define a new Batch and save it.
- Add the following Tasks to the above Batch:
Table 3-6 Data Loader – File to Stage Data
Task Code Task Name Component Parameters 1 * Custom Task Name * Stage Data Loader Table Name: select the stage table name from the available list.
Data File Specification: select the data file specification definition from the available list.
Data File Name: free text where file name uploaded to the object store to be provided. This is optional.
- When the Data File Name is not provided, Stage Loader fetches the file from object store with the selected Data File Specification name.
- If name of file is different from Data File Specification, then put exact file name including extension but excluding the prefix.
Note:
You can also zip the file and then upload. Ensure the file name in the zip file is inline with the Data File Name in the Task Parameters UI.* Task Code and Task Name in the above table are for illustration purpose only. You can name them as per your requirements.
Table 3-7 Sample Data File Specification and File Name
Data File Specification Data File Name in Task Parameters UI File in Object Store Asset_Loan.dat Asset_Loan_1.dat input_yyyymmdd_Asset_Loan_1.dat Asset_Loan.dat Not entered input_yyyymmdd_Asset_Loan.dat To upload multiple files using same Data File Specification, add separate tasks for each file within the batch.
- Execute the Batch for the As-of-Date used in the Data File.
For detailed instructions on Creating a Batch, Defining a Task, Execute the Task, and Schedule a Batch, see Scheduler Services.
Profitability and Balance Sheet Management Cloud Service - Stage to Processing
To load the Data from Staging Tables to Processing:
- Define a new Batch and save it.
- Add the following Tasks to the above Batch:
Table 3-8 Data Loader – Stage to Processing Data
Task Code Task Name Component Parameters 1 * Custom Task Name * Select the relevant Component depending on the Data that you want to process. The options are:
- Instrument Data Loader
- Ledger Data Loader
- Transaction Summary Loader
Stage Table: select the stage table name from the available list.
Data File Specification: select the Data File Specification name from the available list.
Climate Change Analytics Cloud Service - Stage to Processing
CCACS is delivered with out-of-the-box seeded batches to load the data from Staging tables to Processing tables. The user can define custom batches using the following components.
For the list of seeded batches, see the MOS page 2930308.1.
- Add the following Tasks to the Batch:
Table 3-9 Data Loader – Stage to Processing Data
Task Code Task Name Component Parameters 1 * Custom Task Name * Select the relevant Component depending on the Data that you want to process. The options are:
- CCA Processing Loader
For CCA Processing Loader: select the stage table name and data file name.