Loading Data

To successfully load data from an external source into Oracle Clinical tables you must perform all three batch data load stages, in order: Load, Prepare, and Transfer (see Batch Data Load Stages). You can choose to perform a single stage or multiple stages at a time. Performing a single stage allows you to check the error file just for that stage and takes less time.

1. Navigate to Conduct and, depending on the files you are loading, select either Batch Data Load or Out of Study Load. See Standard Batch Data Load and Out of Study Batch Data Load for details.
2. Select one of the following menu options to execute one or more of the Batch Load stages:
   • Load Batch Data
   • Prepare Batch Data
   • Transfer Batch Data
   • Load/Prepare Batch Data
   • Load/Prepare/Transfer Batch Data

   • Load/Prepare/Privileged Transfer

     • This option allows you to update locked data, and is available only for users that have access to the Oracle Clinical Feature/Menu "Load/Prepare/Privileged Transfer". For more information, refer to chapter Oracle Clinical Menu-Based Security in Oracle Clinical Administrator's Guide. If you select this option the system automatically updates locked data without prompts if updates to additional data are loaded.

   The appropriate Parameterized Submission (PSUB) form is displayed with the parameters required for the stage or stages you selected.

3. Enter values for the job's parameters. The parameters displayed depend on the stage or stages you selected.

   The complete list of parameters includes:

   Table 7-5 Standard and Out of Study Batch Data Load Parameters

   Stage	Parameter Name	Description
   Load	Datafile Group	ID of the data file group you want to load. A list of values is available.
   Load	Max No. of Bad Data Allowed During Load	Maximum number of bad records allowed before the system ends the entire process. If fewer than the maximum number of bad records are found, the batch load continues; the bad records are not loaded, but are reported in the log file.
   Prepare	OS File ID for Prepare	ID of the data file group you want to prepare. A list of values is available.
   Prepare	Max No. of Errors Allowed During Prepare	Maximum number of bad records allowed before the system ends the entire process. If fewer than the maximum number of bad records are found, the batch load continues; the bad records are not loaded, but are reported in the log file.
   Prepare	Prepare to Completion?	Whether to complete the Prepare phase or to accept a partial completion.
   Prepare	Spool Directory for Reloadable Data Files	If Prepare to Completion is Y, the system populates this field with the appropriate value for the user, according to the values of the BDL_ROOT and BDL_USERDIRS in the OCL_STATE local reference codelist, and the user's account name (minus "OPS$" if it contains OPS$.
   Transfer	Data File Group ID for Transfer	ID of the data file group you want to transfer. A list of values is available.
   Transfer	Transfer Mode	The mode in which the transfer should take place. Values include: INSERT - Transfer only pending insert records. UPDATE - Transfer only pending updates records. BOTH - Transfer both pending inserts and pending update records. If you are using Out of Study load and are loading DCIs with multiple DCMs, select BOTH for proper processing. The process sees the records in the first Received DCM in a Received DCI as inserts and the records in subsequent Received DCMs as updates to the existing Received DCI.

4. Click the Job Details button to display the Submission Details window and set the appropriate fields; see Oracle Clinical Getting Started for details. Then click Back to return to the Submission of Module window.
5. Click Submit Job.
6. Click the Job Status button to monitor progress of the batch job.

   If there is a problem loading the data, the load stops and an error message appears. To review details about why the load was aborted, look at the log file created during the batch load. See Troubleshooting Batch Validation.

   Note:

   After the Transfer stage you must indicate if you want to purge pending or bad updates or inserts by displaying the Maintain Batch Load Data File form.

   To delete inserted (new) records included in the batch file, select Purge Inserts from the Special menu. Update Status should be UPDATED, and Insert Status should be PENDING or BAD INSERT.

   To delete updates (additions to existing records), select Purge Updates from the Special menu. Insert Status should be INSERTED, and Update Status should be PENDING or BAD UPDATE.

7. If you have selected one of the steps that does not execute all three stages, repeat steps 2 through 6 for the remaining stages until the batch data load process is completed successfully.

You can use the Batch Job window to query on your job ID to see when it completes, or you can use the Maintain Batch Load Data File window or the Maintain Out of Study Batch Data Load File window to view the status of the batch job; the system automatically updates the Data File Status (DF Status) depending on your menu selection and the success of the current batch load stage.

In the Maintain Batch Load Data File window you can also change the comment text (only before processing starts) for a data file or purge either the pending inserts or pending updates, which are records of the data files not successfully inserted into the Temporary Batch Data Items, Temporary Batch DCIs, or Temporary Batch DCMs tables.

Purging Pending Inserts and Updates in the Maintain Batch Data Load Window

In the bottom part of this window, place the cursor on the data file group name with the appropriate data file status and then select either Purge Updates or Purge Inserts from the Special menu.

Purging Pending Inserts and Updates for Out of Study Load Files

To purge pending inserts or pending updates of Out of Study Load files:

1. Query for the data file in the Maintain Out of Study Batch Load Data File window.

   In the bottom half of the window the last part of each data file group name contains the study name for which the data was loaded. Note the study name and the data file group names for which you want to purge inserts and/or updates.

2. Navigate to the Maintain Batch Data Load Files window, select the appropriate study and query for the data file group name.

3. In the bottom part of this window, place the cursor on the data file group name with the appropriate data file status and then select either Purge Updates or Purge Inserts from the Special menu.