3.1.2.2.2.1 Ways of Data Loading
This section covers the following topics:
Full Refresh Data Loading
For full refresh data loading, first data is truncated and then new data is inserted. For example, suppose five records are loaded on Day 1. If new data is required on Day 2 based on the business keys defined on the DIS files, a full refresh data load can be done.
To do a full refresh data load, set load.fullrefresh to true in the
<OFSAAI Installed Directory>/bdf/config/BDF.xml path.
The time taken to do a full refresh data load is less than for an incremental load, although complete data must be provided every time.
Incremental (Delta) Data Loading
For incremental data loading, the following can be done:
- Data can be merged
- Existing data can be updated
- New data can be inserted
For example, suppose five records are loaded on Day 1. If four new records need to be inserted and one existing record needs to be updated based on the business keys defined on the DIS files, an incremental data load can be done.
To do an incremental data load, set load.fullrefresh to false in the
<OFSAAI Installed Directory>/bdf/config/BDF.xml path.
Note:
The time taken to do an incremental data load is more than for a full refresh data load, although there is no need to give complete data every time. Only updated or new data is required.