Frequent Data Refresh Delta Tables and Lambda View Details (Preview)
The redesigned refresh mechanism utilizes “Delta” tables to store the data that has changes and “Lambda” views for data that incorporates base data from incremental data refresh and the changes up to the point when the Frequent Data Refresh happened
With Frequent Data Refresh V2, you'll see the following tables in the warehouse:
- Base Table – Data as of the last incremental refresh. This table is unchanged each time frequent data refresh runs.
- Delta Table – On each Frequent Data Refresh run, includes inserts and updates in source.
- Delta_Delete Table – On each Frequent Data Refresh run, includes deletes and updates in source.
- Lambda View = Base – Delta_Delete + Delta
Note:
The data fetched by the Lambda View is filtered by the "Oldest Data to Report" option set in Frequent Data Refresh V2 configuration. Lambda Views are only for viewing purposes; you must not use them for downstream integrations. See About Scheduling Frequent Data Refreshes Using a New Refresh Mechanism (Preview).