Widgets in Data Pipelines

Depending on the pipeline type, specific widgets are available in the widgets pane of the pipeline.

The following table describes the widgets available in Data pipelines. For more information about the widgets available in Scenario Pipelines, see Widgets in Scenario Pipeline.

Table 4-1 Data Pipeline – Widgets and Descriptions

Widget	Name	Description
	Dataset	Use this widget to add a Dataset. Datasets correspond to the contents of a single database table which can be a staging table, business table, or a table that has been created by a data pipeline. A data pipeline must always begin with a Dataset widget.
	Filter	Use this widget to filter the data in the pipeline to use a subset of the data records which are available. On applying a filter, all data matching the filter conditions are obtained. This allows you to search and analyze behaviors of interest.
	Join	Use this widget to combine or group multiple tables using various join operators.
	Persist	Use this widget to write data to database tables so that it can be used in other pipelines.
	External Service	Use this widget to add an external service. External Services perform actions on the data, such as loading or moving the data, or performing a virus scan.