Frequent Data Refresh Delta Tables and Lambda View Details (Preview)
The redesigned refresh mechanism utilizes “Delta” tables to store the data that has changes and “Lambda” views for data that incorporates base data from incremental data refresh and the changes up to the point when the Frequent Data Refresh happened
With Frequent Data Refresh V2, you'll see the following tables in the warehouse. If you plan to use these tables directly for any downstream processing such as custom ETL, you'll need to understand the schema of these tables and what data they contain.
- Base Table – Data as of the last incremental refresh. This table is unchanged each time frequent data refresh runs.
- Delta Table – On each Frequent Data Refresh run, includes inserts and updates in source.
- Delta_Delete Table – On each Frequent Data Refresh run, includes deletes and updates in source.
- Lambda View = Base – Delta_Delete + Delta
Note:
The data fetched by the Lambda View is filtered by the "Oldest Data to Report" option set in Frequent Data Refresh V2 configuration. Lambda Views are only for viewing purposes; you must not use them for downstream integrations. See About Scheduling Frequent Data Refreshes Using a New Refresh Mechanism (Preview).