8.2.5.1 Data Load Dashboard

The Data Load Dashboard provides insights into the status and quality of data loads. It ensures that the data loaded into DFCS is consistent with the source data by tracking key control measures.

Note: The effectiveness of the Data Load Dashboard relies on the initial setup of the Data Source Template, which provides the control information needed to run these validations and checks.

  • Before using the Data Load Dashboard, the Control Settings must be configured in the EDD setup for data file reconciliation.
  • These settings ensure that the data loaded into the system (DFCS) matches the source data.
  • Control settings manage the reconciliation process, comparing record counts or amounts between the source data and the data loaded into DFCS.
  • This reconciliation can be based on a threshold value defined as an absolute number or percentage.
  • Validation thresholds are applied to ensure that the data is accurate. These can be set as absolute values or as percentage-based checks to flag any discrepancies.
  • Control settings also manage whether the control file (which contains the validation rules) is included within the same file as the data or stored separately.

For more information, see Control Information Management.

To view Data Load Dashboard:

  1. Go to Shared Folders → Data Load Dashboard.
  2. Select Data Load Dashboard.
  3. Open the Data Load Dashboard report from the available list.

Below is the list of some of the important attributes displayed in Data Load Dashboard. Attributes are listed only when there is data available.

  • Start Time / End Time: Timestamp marking the beginning and end of the data load process.
  • Derived Entity Code: A unique code representing the derived data entity based on EDD.
  • Control Name: Name for control defined in EDD.
  • Aggregation Method: The method used to aggregate data (e.g., COUNT, SUM, Average).
  • Aggregation Column Name: The specific column where aggregation is applied.
  • Connector Name: The identifier of the connector used for the loading process.
  • Target Table Name: The database table receiving the loaded data.
  • Task Name: The name of the specific data load task.
  • Control Value: Expected value related to the defined control for validation or tracking.
  • Actual Value: Actual Value of defined Control. This is available post data load is complete.
Filter Options
  1. Click the three dots (ellipsis) in the upper right corner of the dashboard.
  2. The following options are displayed.
    • Keep Selected: Retain only the selected data rows for focused analysis.
    • Remove Selected: Exclude selected rows from the view.
    • Sort By: Organize data based on column values in ascending or descending order.
    • Drill to Attribute/Hierarchy: Dive deeper into specific attributes or hierarchical data structures.
    • Edit: Modify dashboard or column settings.
    • Export: Export the dashboard data to a file format like CSV or Excel.
    • Show Subtotal: Display subtotal values for numeric columns.