Prerequisites for Creating a Custom Data Pipeline

Prior to creating a custom data pipeline for Data Augmentation Scripts (DAS), ensure that you create a connection to the data source.

  1. Create a connection to the source that you want to use in your Data Augmentation Scripts (DAS) application. See Create a Connection for Data Augmentation Scripts.
  2. After creating the connection, to complete the registration of the data, on the Manage Connections page, select the Actions menu for the Data Augmentation Scripts connection, and then select Refresh Metadata.

    Note:

    You can’t create augmentations using a specific source unless you perform a metadata extract.
  3. On the Data Configuration page, in Data Source, select the source for which you created a connection and set up the Data Augmentation Scripts pipeline parameters. See Set Up Pipeline Parameters for Data Augmentation Scripts.
  4. Create an augmentation because prior to creating a custom Data Augmentation Scripts (DAS) application, you must have at least one existing augmentation. See Create Augmentation for Data Augmentation Scripts.
  5. Create your custom Data Augmentation Scripts (DAS) application. See Create a Data Augmentation Scripts Application