5 ETL

This chapter describes the steps required to run and work with the Initial ETL.

5.1 Running the Initial ETL

Before running the Initial ETL, ensure that Auto extend is set to ON for all the Data files in the database that are related to Staging and Mart. You should also be aware of the following:

• Because the initial ETL requires a huge amount of Temp space, set the Temp space to 100 GB to prevent data errors. After completing the Initial ETL reduce the temp space to 30 GB.

• After the Initial ETL completes, the balancing log may show differences between the Argus/Stage and MART table counts. This is because of the derivation rules applied to the datamart.

• The system may display the following message:

  Warning !!! - Could not locate MedDRA-J User in the Argus Database.

  Ignore this warning for all MedDRA tables.

• Do not run incremental ETL for more than 50,000 cases. Run the Initial ETL again if the number of cases exceeds 50,000.

Use the following procedure to run the initial ETL.

1. Log on to the Argus Insight Web Server as an Admin user.

2. Select Start > Programs > Oracle > Argus Insight > Schema Creation Tool.

   
   

3. When the system opens the Schema Creation Tool, click Initial ETL.

4. When the system opens the Oracle Database Connect dialog box, enter the APR_MART password and database name in their respective fields. Click OK.

   
   

5. When the system opens the Initial ETL Status dialog box, click Start ETL to start the Initial ETL process.

   
   

6. When the system opens the Initial ETL Configuration Check dialog box, click Yes if these items have already been configured.

   
   

7. The system presents a processing dialog box showing the ETL start time, current process in execution, and the progress bar while ETL is in progress.

   Stop ETL and Close buttons are also available.

   
   
   
   

   Note: Closing the Schema Creation Tool application does not impact the execution of ETL process. Ignore option is not available for stopped process. Click Stop ETL to halt the ETL process. Click Continue to continue the stopped ETL process.

   
   

   1. You can halt execution of Initial ETL process by clicking Stop ETL.

   2. Click Continue to continue the stopped ETL process.

   
   

8. When the system shows the Initial ETL process completes successfully with 100% displayed in the progress bar, click Balancing Logs.

   
   

9. When the system opens the Balancing Logs dialog box, click OK.

   
   

10. The system presents a command screen.

    
    

11. When the system opens the following dialog box showing the location of the balancing log reports generated with the report names, click OK.

    
    

12. Click Run ETL (from the Initial ETL Status dialog, as shown in Step 8) if you want to start the Initial ETL process from the beginning after confirmation message and APR_MART password input.

    1. Click Continue to continue the failed Initial ETL procedure.

    2. Ignore option is also available to ignore the failed Initial ETL process.

    3. Click Restart ETL to start the Initial ETL process from beginning after confirmation message and APR_MART password input.

5.1.1 Closing the Initial ETL Status dialog

Use the following procedure to close the Initial ETL Status dialog.

1. Click Close.

   
   

2. When the system opens the Close Application dialog box, click OK.

   
   

5.1.2 Stopping the Execution of ETL

Use the following procedure to halt the execution of the Initial ETL process:

1. Click Stop ETL.

   
   

2. When the system opens the Stop ETL confirmation dialog box, click OK.

   
   

3. The system redisplays the Initial ETL Status dialog box.

   
   

5.1.3 Run ETL

Use the following procedure to start the ETL process from the beginning.

1. Click Run ETL.

   
   

2. When the system opens the Run ETL dialog box, click OK.

   
   

3. The following dialog is displayed. Enter the APR_MART password and click OK.

   
   

4. The initial ETL process starts from the beginning.

5.1.4 Options available for a Failed ETL

1. You can choose any of the following options for the failed Initial ETL process.

   • Click Continue to continue the failed Initial ETL procedure.

   • Click Ignore to ignore the failed Initial ETL process.

   • Click Modify Attributes of ETL Data Exclusion if PRE_REQ_CHECK_FLAG switch is set to ABORT.

     
     

     Note: These modifications must be done before running the Initial ETL process.

     
     

5.1.5 Continuing the Failed Initial ETL Process

Use the following procedure to continue a failed ETL procedure. Execute the following steps to continue the Initial ETL process from the failed ETL procedure.

1. 
   

2. Double-click on the ETL error to view the Error Data dialog containing the details of that error. Click OK.

   
   

3. Right-click on the ETL Error and click Copy to copy the error data.

   
   

4. Click Continue to continue the failed ETL process.

5. When the system opens the Continue ETL dialog box, click OK.

   
   

6. The system continues with the ETL process (if no errors are found).

7. The system continues executing the initial ETL.

   
   

5.1.6 Ignoring the Failed Initial ETL Process

Use the following procedure to start the Initial ETL process by ignoring the failed Initial ETL procedure:

1. When the system opens the Initial ETL Status dialog box, click Ignore.

   
   

2. When the system opens the Ignore Error dialog box, click OK.

   
   

3. The system starts the Initial ETL from the next process.

   
   

5.1.7 Modifying the Attributes of ETL Data Exclusion

Use the following procedure to modify ETL Data Exclusion attributes. You must modify these attributes before ETL execution.

1. Log on to the Argus Insight Web Server as an Admin user.

2. Select Tools > List Maintenance > Profile Switches > ETL Data Exclusion.

   
   

3. Click Modify.

4. When the system opens the following dialog box do one of the following and click OK:

   
   

   • Enter IGNORE in the Value field if you want to continue the ETL process and skip cases with erroneous data.

   • Enter ABORT in the Value field if you want the ETL process to abort when it encounters cases with erroneous data.

5.1.8 Restart the Initial ETL Process

Use the following procedure to restart the the Initial ETL process starting from after the confirmation message and APR_MART password input:

1. When the system opens the following dialog box, click Restart ETL.

   
   

2. When the system opens the Restart ETL dialog box, click OK.

   
   

3. When the system opens the Oracle Database Connect dialog box:

   
   

   • Enter the APR_MART password in the Password field.

   • Enter the database name in the Database field.

   • Click OK.

4. When the system opens The Initial ETL Configuration Check dialog box, click Yes if the listed items have already been configured.

   
   

5. The system proceeds with the ETL process. When the system finishes the ETL process, click Close.