Incremental Data Refresh
Incremental refresh updates the warehouse with changes since the previous refresh.
You can use these incremental refresh types:
- Scheduled Refresh – The system refreshes the data for all the modules and tables according to the schedule defined in the pipeline parameters. You can schedule this to run daily, weekly, or monthly according to your business needs. See About Pipeline Parameters.
- Prioritized Refresh – If you want to make certain data refreshed first even within the incremental refresh, you can select those warehouse tables for prioritized refresh. See Prioritize Datasets for Incremental Refresh (Preview).
- Functional Area Schedule Override - If some functional areas don’t need to be refreshed as often as others, you can override the schedule using the Functional Area Schedule Override option. This lets you stagger refreshes as needed and reduces the processing load from daily incremental pipeline refreshes. See Override Data Pipeline Schedules for Functional Areas (Preview)
- Refresh Data On-demand – If you need to incrementally refresh data for a module right away, you can run an on-demand (ad hoc) data refresh. You can perform on-demand refresh for functional areas, custom data configurations and data augmentations. See Refresh a Data Pipeline for a Functional Area.