Set Up the Pipeline Parameters

Oracle Utilities Data Intelligence comes with pipeline parameters that apply to all functional areas. The parameters available include:

  • Data Refresh Schedule: Specify the frequency and when you want the incremental data load to happen. The incremental data refresh happens once a day for each connection. While specifying the timezone, the recommendation is to use city names to handle the daylight savings. For example, instead of selecting timezone such as EST or PST, select America/Los_Angeles. In this case, the data refresh process calculates the value mentioned in the Time field based on the local time irrespective of daylight savings.
  • Initial Extract Date: Initial extract date is used when you extract data for a full load. Transactional data created after the initial extract date processes and loads to the warehouse. It reduces the initial data load volume. After extracting the data for a functional area, avoid changing the initial extract date.

Set up the pipeline parameters for your data model file before running your data pipelines for the functional areas. You can set up and schedule the parameters independently of each other.

  1. Sign in to your service.
  2. In the Oracle Utilities Data Intelligence Admin Console, under Application Administration, click Data Configuration.
  3. On the Data Configuration page, click the Data Source menu. The menu displays a list of pipelines by functional area, such as Customer or Device.
  4. Select the functional area for which you want to set up pipeline parameters.
  5. Click Pipeline Settings.
  6. On the Pipeline Settings page, under Data Refresh Schedule, from the Interval list, select the frequency of the data refresh. Depending on the selected interval, specify the time, day, and month when you want the incremental data load to happen.

    Note:

    The Frequent Data Refresh Schedule and Frequent Refresh Tables actions are not supported in Oracle Utilities Data Intelligence.
  7. Under Global Parameters, from the Initial Extract Date, select the date from which to load the transaction data.