Oracle® Argus Mart Administrator's Guide Release 1.0 E38589-01 |
|
|
PDF · Mobi · ePub |
This chapter describes the steps required to run the Incremental Extract, Transform, and Load (ETL) process using the Oracle Data Integrator Studio and Oracle Data Integrator Console.
This chapter comprises the following sub-sections:
Managing Incremental ETL Process: Oracle Data Integrator Studio
Managing Incremental ETL Process: Oracle Data Integrator Console
This section describes the steps required to manage the Incremental ETL process using the Oracle Database Integrator Studio.
This section comprises the following sub-sections:
To run the Incremental ETL, execute the following steps:
Open the Oracle Data Integrator Studio and click Connect to Repository. This displays the Oracle Data Integrator Login window, as depicted in the following figure:
In the Oracle Data Integrator Login window:
Select the ODI Work Repository name from the Login Name drop-down list.
Enter the name of the ODI user in the User field.
Enter the password for the ODI user in the Password field.
Click OK. This displays the Oracle Data Integrator Screen.
Select the Operator tab in the left pane.
Expand the Load Plans and Scenarios section, as highlighted in the following figure:
The LP_INC_AM option in this section represents the load plan for the Incremental ETL process for AM.
Right-click the LP_INC_AM option. This displays a menu, as shown in the following figure:
Click Execute. This displays the Start Load Plan window, as shown in the following figure:
In the Start Load Plan window:
Select CTX_ARGUSMART from the Context drop-down list.
Select LA_AM from the Logical Agent drop-down list.
Select the desired log level from the Log Level drop-down list.
Click OK. This displays the Information dialog box with the Load Plan Started confirmation message, as shown in the following figure:
Click OK.
You can verify the status of the ETL process by navigating to the Load Plan Executions section and expanding the Load Plan folder. You can view the status of the Load Plan in Green color with tilted s, which signifies that the ETL session is in progress, as highlighted in the following figure:
To stop the Incremental ETL, execute the following steps:
Right-click the Load Plan, which you want to stop, in the Load Plan folder of the Load Plan Executions section. This displays a menu, as shown in the following figure:
Select Stop Normal. This displays the Stop Load Plan dialog box, as depicted in the following figure:
Select PA_AM from the Physical Agent drop-down list.
Click OK. This stops the execution of the Load Plan.
You can verify the status of the ETL process by navigating to the Load Plan Executions section and expanding the Load Plan folder. You can view the status of the Load Plan in Red color with the X symbol, which signifies that the ETL session is not in progress, as highlighted in the following figure:
Restarting the Incremental ETL process enables you to start the ETL process from the last execution step where it was stopped or failed.
To restart the Incremental ETL, execute the following steps:
Right-click the Load Plan, which you want to restart, in the Load Plan folder of the Load Plan Executions section. This displays a menu, as shown in the following figure:
Click Restart. This displays the Restart Load Plan dialog box, as shown in the following figure:
Select PA_AM from the Physical Agent drop-down list.
Select the required log level from the Log Level drop-down list.
Click OK. This displays the Information dialog box with the Load Plan restarted message, as depicted in the following figure:
Click OK.
This adds another Load Plan, with the same name as that of the stopped ETL, in the Load Plan folder of the Load Plan Executions section. However, this instance of the ETL Process is in Green color with a tilted S, which signifies that the ETL is in progress, as highlighted in the following figure:
Once the ETL process is complete, the Load Plan is displayed in Green color with a completed symbol, as highlighted in the following figure:
If an ETL process fails, you have the option of continuing the process from the failed step or executing it again from the beginning of ETL.
This section explains the steps to continue a failed ETL from the failed step and to execute it again from the beginning of ETL.
This section comprises the following sub-sections:
The process to continue the failed Incremental ETL from the failed step is exactly the same as that of the process of restarting the Incremental ETL after stopping it.
See the Restarting the Incremental ETL section for the step-by-step procedure to continue the failed Incremental ETL from the failed step.
The process to restart the failed Incremental ETL from the beginning is exactly the same as that of the process of running the Incremental ETL.
However, before restarting the ETL, you must log on to the Oracle SQL Developer or SQLPlus (or SQL Prompt) using the Argus ETL User credentials and execute the following statements:
EXEC pkg_sm_stage_util.p_set_cmn_profile_value ('DATABASE', 'ODI_ETL_STATUS', '0');EXEC pkg_sm_stage_util.p_set_cmn_profile_value ('DATABASE', 'ETL_SM_ITERATION_NUMBER', NULL);
COMMIT;
To verify the successful execution of these statements, you can execute the following Select statements:
SELECT * FROM rm_cmn_profile_global WHERE KEY = 'ODI_ETL_STATUS';
The entry for the Value column must be 0 after executing this statement, as depicted in the following figure:
SELECT * FROM rm_cmn_profile_global WHERE KEY = 'ETL_SM_ITERATION_NUMBER';
The entry for the Value column must be blank after executing this statement, as depicted in the following figure:
See the Running the Incremental ETL section for the step-by-step procedure to restart the failed Incremental ETL from the beginning of ETL.
This section describes the steps required to manage the Incremental ETL process using the Database Integrator Console.
This section comprises the following sub-sections:
To run the Incremental ETL, execute the following steps:
Open the Oracle Data Integrator Console. This displays the Oracle Data Integrator Console Sign In window, as depicted in the following figure:
In the Oracle Data Integrator Sign In window:
Select the ODI Work Repository name from the Repository drop-down list.
Enter the name of the ODI user in the User Id field.
Enter the password for the ODI user in the Password field.
Click Sign In. This displays the Oracle Data Integrator Console Screen, as shown in the following figure:
Select the Management tab in the left pane.
Expand the Runtime folder and navigate to Runtime > Scenarios/Load Plans > LP_INC_AM, as highlighted in the following figure:
The LP_INC_AM option in this section represents the load plan for the Incremental ETL process for AM.
Click Execute, as highlighted in the following figure:
This displays the Execute Load Plan window, as shown in the following figure:
In the Execute Load Plan window:
Select LA_AM from the Logical Agent drop-down list.
Select CTX_ARGUSMART from the Context drop-down list.
Select the desired log level from the Log Level drop-down list.
Click Execute. This displays the Information dialog box with the Load Plan Execution submitted successfully confirmation message, as shown in the following figure:
Click OK.
You can verify the status of the ETL process by expanding the Load Plan Executions folder in the Sessions/Load Plan Executions section. You can view the status of the Load Plan in Green color with tilted s, which signifies that the ETL session is in progress, as highlighted in the following figure:
To stop the Incremental ETL, execute the following steps:
Select the Load Plan, which you want to stop, by expanding the Load Plan Executions folder of the Sessions/Load Plan Executions section and click Stop, as shown in the following figure:
This displays the Stop Load Plan Execution dialog box, as depicted in the following figure:
Select Normal from the Stop Type drop-down list.
Select OracleDIAgent from the Physical Agent drop-down list.
Click Stop. This displays the Information dialog box with the Load Plan was Stopped Successfully confirmation message, as depicted in the following figure:
Click OK.
You can verify the status of the ETL process by navigating to the Load Plan Executions folder in the Sessions/Load Plan Executions section. You can view the status of the Load Plan in Red color with the X symbol, which signifies that the ETL session is not in progress, as highlighted in the following figure:
Restarting the Incremental ETL process enables you to start the ETL process from the last execution step where it was stopped or failed.
To restart the Incremental ETL, execute the following steps:
Select the Load Plan, which you want to restart, in the Load Plan Executions folder of the Sessions/Load Plan Executions section and click Restart, as shown in the following figure:
This displays the Restart Load Plan Execution dialog box, as depicted in the following figure:
Select OracleDIAgent from the Physical Agent drop-down list.
Select the required log level from the Log Level drop-down list.
Click Restart. This displays the Information dialog box with the Load Plan restarted message, as depicted in the following figure:
Click OK.
This adds another Load Plan, with the same name as that of the stopped ETL, in the Load Plan Executions folder of the Sessions/Load Plan Executions section. However, this instance of the Load plan is in Green color with a tilted S, which signifies that the ETL is in progress.
If an ETL process fails, you have the option of continuing the process from the failed step or executing it again from the beginning of ETL.
This section explains the steps to continue a failed ETL from the failed step and to execute it again from the beginning of ETL.
This section comprises the following sub-sections:
The process to continue the failed Incremental ETL from the failed step is exactly the same as that of the process of restarting the Incremental ETL after stopping it.
See the Restarting the Incremental ETL section for the step-by-step procedure to continue the failed Incremental ETL from the failed step.
The process to restart the failed Incremental ETL from the beginning is exactly the same as that of the process of running the Incremental ETL.
However, you need to execute certain steps before restarting the Failed Incremental ETL, refer to the Restarting the Failed Incremental ETL section for the complete details.
See the Running the Incremental ETL section for the step-by-step procedure to restart the failed Incremental ETL from the beginning of ETL.