7 Extract, Transform, and Load Data

This chapter describes the steps to run the Extract, Transform, and Load (ETL) process using the Oracle Data Integrator Studio and Oracle Data Integrator Console.

The following table illustrates some of the terms along with the name of the Load Plan that has been used to refer the different types of ETL in the later sections of this chapter:

Table 7-1 Describing ETL Types

Type of ETL Description Name of the Load Plan

Initial ETL

The Initial ETL process involves full load of data from Oracle Argus Safety and DLP to Oracle Argus Mart. It can be described as the first ETL run that is executed for a fresh setup.

LP_INI_AM

Incremental ETL

The Incremental ETL brings changed case data, from last ETL run till start of current ETL run, from Oracle Argus Safety and DLP. The LM/CFG data is reloaded only if any change in record(s) is identified. Dictionary data is always reloaded in case of an Incremental ETL.

If a new enterprise is added, the Incremental ETL loads complete data of the new enterprise along with delta data of other enterprises.

LP_INC_AM

Incremental ETL with BI Clear Cache

The Incremental ETL brings changed case data, from last ETL run till start of current ETL run, from Oracle Argus Safety and DLP. The LM/CFG data is reloaded only if any change in record(s) is identified. Dictionary data is always reloaded in case of an Incremental ETL.

If a new enterprise is added, the Incremental ETL loads complete data of the new enterprise along with delta data of other enterprises and clears the BI cache.

LP_INC_AM_with_ClearCache

For more information, see: