About Monitoring Data Refreshes
Monitoring data refreshes is critical to ensuring your business analysts and decision-makers are working with the most current information. Because data pipelines can take several hours to execute, proactive monitoring helps you plan downstream tasks, maintain data integrity, and troubleshoot performance issues before they impact reporting.
To monitor the status of data refreshes, you can use the following:
- Request History: To view the details of one-time and recurring refreshes in the Administration Console, use the Request History tab on the Data Configuration page. For example, to view status of activations or on-demand ad hoc refreshes that are executed immediately, use the One-Time tab. For scheduled incremental refresh or frequent data refresh that the system processes at schedule time, use the Recurring tab. In addition to completion times, Request History can help you understand why a refresh is queued or if there is any action required by you. See View Request History.
- Event Notifications with Oracle Cloud Infrastructure Events: To take downstream actions based on the status of different requests, use the Oracle Cloud Infrastructure events generated in Oracle Fusion Data Intelligence. For example, you can send an email notification, using the Oracle Cloud Infrastructure event generated for DataPublished, when the scheduled incremental data refresh process publishes the data. See Enable Event Notifications (Preview) and Event Types, Attributes, and Attribute Values for Event Rules.
- Warehouse Refresh Statistics: Oracle Fusion Data Intelligence populates certain tables in the warehouse that you can use to understand different statistics related to data refreshes. You can query these tables or create your own visualizations to answer questions about data refresh completion trends, factors affecting data refresh, and tables refreshed for a certain period. See View the Warehouse Refresh Statistics.
- Data Refresh Estimate: You can view the estimated refresh completion time for daily pipelines on the Pipeline Settings page in the Estimated Refresh Completion field. In addition, you can get notified of changes in data refresh estimates using the Oracle Cloud Infrastructure events. See “Data Refresh Estimate” .