Defining Incremental File Adapter Options

You specify incremental file adapter options to define or change the incremental file adapter parameters used to compare a source data file with a prior version of the source data file and identify new or changed records and then load only that data set.

To define incremental file adapter options:

  1. From the Data Integration home page, and then Actions, select Applications.

    From the Application page, click Image shows Select icon. to the right of the Oracle ERP Cloud data source application, and then select Application Details.

    From the Application Details page, click the Options tab.

  2. Source File shows the data file name that contains the data you are loading. It is read only.
  3. From Incremental Processing Options, select the method for sorting data in the source file. You can sort the initial source data file before making the comparison or provide a pre-sorted file for better performance.

    Available options:

    • Do not sort source file—Source file is compared as provided. This option assumes that the source file is generated in the same order each time. In this case, the system performs a file comparison, and then extracts the new and changed records. This option makes the incremental file load perform faster.

    • Sort source file—Source file is sorted before performing the file comparison for changes. In this option the source file is first sorted. The sorted file is then compared to the prior sorted version of this file. Sorting a large file consumes a lot system resources and performs slower.

      Note:

      If you have an integration that uses the Do Not Sort option and then switch to the Sort source file option, then the first load will have invalid results since the files are in different order. Subsequent runs load data correctly.

  4. The Last Process ID shows the last run ID for the original source data file.

    When the load is first run for the original data file, the Last Process ID shows the value of 0.

    When the load is run again, the Last Process ID shows the run number of the last load.

    If the newly created file comparison version and the original data file shows no differences, or the file is not found, the value of the Last Process ID is assigned to the last load ID that ran successfully.

    To reload all data, set the Last Process ID back to 0, and select a new source file to reset the baseline.

  5. Click Save.

Note:

You can also select the Source File, Incremental Processing Options, and Last Process ID options on the Filters tab on the Run Integration page.