Basic Elements of Data Augmentation Scripts

Data Augmentation Scripts (DAS) simplifies the process of extracting, creating, transforming, and managing datasets.

Overview of Data Flow

This diagram illustrates the fundamental data flow, showing how data progresses from the source to the target dataset.


Description of dasrg-dataflow-diagram.png follows
Description of the illustration dasrg-dataflow-diagram.png

Key Components of Data Flow

The key components of the dataset are:

  • Source Data: The point of origin for all data processing.
  • Dataset1: The primary dataset created directly from the source. The schema is inferred from the source.
  • Dataset2: The secondary dataset that can be derived from Dataset1 or created directly from the source (shown as a dotted line).
  • Load Type: The refresh type for both tables using the full load or periodic refresh options.
  • Dataset Visibility: The visibility of the dataset, which can be public (for reporting purposes) or private (for internal processing only).

Note:

  • Although you can use the terms dataset and table interchangeably, in the context of Data Augmentation Scripts syntax a dataset or a table is referred to as a dataset.
  • You have the ability to override the schema.

Create the Connection Prerequisite

To use the source data, connect to the Data Augmentation Scripts data files from the Oracle Fusion Data Intelligence Administrator Console.

See Create a Connection for Data Augmentation Scripts.