1. Administering Data Management for Oracle Enterprise Performance Management Cloud
  2. Using Data Management
  3. Administration Tasks
  4. Registering Target Applications
  5. Loading Data Using an Incremental File Adapter

Loading Data Using an Incremental File Adapter

The Incremental File Adapter feature enables you to compare a source data file with a prior version of the source data file and identify new or changed records and then load only that data set. You can sort the initial source data file before making the comparison or provide a pre-sorted file for better performance.

To use this feature, you register an initial source data file as an incremental file adapter. The initial source data file is used as the template. Actual data loads are run from the file designated in the data rule where a file comparison is run between the initial source data file and a subsequent file. You can load once, twice or many times thereafter. The last run file becomes the basis against which the subsequent load is evaluated. The adapter loads only the differences, which leads to a faster load during the file import. The remaining data import processes stay the same as in a standard data load for a file.

Considerations:

  • The source data file must be a delimited data file.

  • Data files used must contain a one-line header, which describes the delimited columns.

  • Both numeric and non-numeric data can be loaded.

  • Any deleted records between the two files is ignored. In this case, you must handle the deleted records manually.

  • If the file is missing (or you change the last ID to a non-existent run), the load completes with an error.

  • Sort options determine the level of performance using this feature. Sorting increases the processing time. Pre-sorting the file makes the process faster.

  • Only single period data loads are supported for an incremental load. Multi-period loads are not supported.

  • Drill down is not supported for incremental loads since incremental files are loaded in Replace mode and only the last version of the file comparison is present in the staging table.

    As a workaround, you can load the same data file to another location using the full data load method. In this case, you should import data only and not export it to the target application.

  • Copies of the source data file are archived for future comparison. Only the last 5 versions are retained. Files are retained for a maximum of 60 days. If no incremental load is performed for more than 60 days, then set the Last Process ID to 0 and perform the load.

Watch this tutorial video to learn more about loading and calculating incremental workforce data:

video iconLoading and Calculating Incremental Workforce Data using Data Management.

Watch this tutorial video to learn more about calculating incrementally loaded data using Groovy rules:

video iconCalculating Incrementally Loaded Data in Data Management using Groovy Rules.