Skip Partially-Processed Upload Files in Conversion Load using SQL Loader

Previously, when the "Conversion - Load Data using SQL Loader" (K1-CNVLD) batch job was interrupted, some of the conversion upload files were already partially loaded and could not be rolled back. When the batch job resumed, the partially-loaded files were picked up again and re-uploaded, resulting in duplicate records for those records already uploaded before the interruption. 

Now a log entry is created for each upload file that is picked up for processing. When the batch job is interrupted and resumes, it skips any file that was logged as having been picked up, avoiding re-uploading the same records from files that were already picked up.

As a result of this update, you will not have duplicate records when then "Conversion - Load Data using SQL Loader" (K1-CNVLD) batch job is interrupted and resumes.

Steps to enable and configure

You don't need to do anything to enable this feature.

Tips and considerations

Note that some files may only have been partially-uploaded because of the interruption. The files will have a log entry that says "Upload of data file <filename> is skipped" but will not have a "Finished loading data file <filename>" log entry. You have to identify from those files which records were not uploaded and upload them separately.