Factors Affecting Data Refresh Performance

The time required to refresh the data and all the resulting key metrics and dashboards depends on several factors.

These include:
  • Source system availability – If the source system is unavailable, the refresh will pause and wait. The system sends a notification. If the system can determine that the access issue was caused by invalid credentials, the Request History and Warehouse Refresh Statistics display whether the refresh was queued due to source availability.
  • Resource availability on the source system – If the source system resources are consumed by processes other than the Oracle Fusion Data Intelligence extraction process, it will cause delays in the Oracle Fusion Data Intelligence data refreshes. This is especially true for Oracle Fusion Cloud Applications.
  • Size and complexity of the source data – In general, the volume of data processed during a refresh is a good indicator of how long the refresh will take, though this isn’t always the case. The Warehouse Refresh Statistics includes the number of published records that can indicate the overall volume. See View the Warehouse Refresh Statistics.
  • Activated functional areas – In general, the more the functional areas, the more data to be processed and hence longer refreshes.
  • Custom SQL queries – If custom queries are running on Oracle Autonomous AI Lakehouse, they can consume resources needed by the pipeline, which may impact overall refresh performance.
  • Table locks by custom downstream processing - If any downstream processes acquire locks on the Oracle Fusion Data Intelligence tables and hold them for too long, that can cause delays in data refresh performed by Oracle Fusion Data Intelligence.
  • Customizations made on the source system objects – If the customizations require a full load for those objects, then refresh will take longer.
  • Source and target system maintenance – System maintenance activities such as patching can pause or delay pipeline processes, which may extend the overall refresh time.
  • Custom data pipelines – If complex transformation logic is used in the Data Augmentations Scripts for custom data pipelines, it may affect the overall refresh time.