Using the Data Forge Widget

The Data Forge widget allows you to select the source(s) (Tables) which form the dataset to be further used in the pipeline.

Before adding or configuring a Data Forge, you must first have created the pipeline.
  1. In the Pipeline Designer page, select the pipeline where you want to add or modify the Data Forge. The Pipeline Canvas displays.
  2. To add a Data Forge to a Calendar, click Add To Add To icon, and then select Data ForgeData Transformation widget.
    • Alternately, you can right-click on the Canvas to display the list of widgets, select Data Forge and associate the Data Forge with the Calendar.
    • You can also use the hamburger menu on the left side to display the Node Picker, which lists any externalized data forges already created. Drag and drop the data forge to the pipeline as desired.
  3. Click Options Options iconthen click EditEdit icon. The Data Forge pane displays.
  4. Under Basic Configuration, provide the following details:
    1. Enter the Name for the Data Forge. This field allows only the following characters: A-Z a-z 0-9 '_' For example, Abc_123 or Abc 123
    2. Select the Type from the drop-down list.
    3. The Externalize selector allows you to externalize this data forge so that it can be used in additional pipelines. To access all externalized data forges, click the hamburger menu on the left side to display the Node Picker, which lists any externalized data forges already created.
    4. Select one or more Source Tables using the drop-down list. Use the search bar in the list to find specific tables easily.
      To remove a source table from the Data Forge, click Remove Remove icon beside the table name in the Source Tables field.
    5. The Connected Data Forges lists any data forges which are associated with this data forge.
    6. You can add a Runtime Parameter to the Data Forge by clicking Add Run Time Parameter Add Run Time Parameter icon. For more information about how to create run time parameters, see Creating Runtime Parameters.
  5. The Advanced Configuration tab displays any Joins and Filters associated with this Data Forge.

    Note:

    At least two sources (tables/dataforges) must be selected or connected for the join section to be enabled in the Advance Configuration tab.
    • Expand Joins to view or create Joins associated with this Data Forge. The Output box provides a summary of all current Joins, with the Join configurations listed in detail below. You can add new Joins using the steps in Creating Joins.
    • Expand Filters to view or create Filters associated with this Data Forge. The Output box provides a summary of all current Filters, with the Filter configurations listed in detail below. You can add new Filters using the steps in Creating Filters .
  6. Use the Mapped Columns tab to view and map columns within the Data Forge. To map additional columns, follow these steps:
    1. In the Mapped Columns tab, select a Source Table/Dataforge from the drop-down list. The available columns in this table display.
    2. Select a Column from the list. Use the search bar in the list to find specific tables easily.
    3. Click Map Map Column iconto map the column. The column displays in the Mapped Columns list. You can edit the Mapped Column Name, if desired.
    4. Alternately, click Add Expression Add expression iconto open the Expression Builder. The Expression Builder is used to define free flow text filter conditions. To use the Expression Builder, follow these steps:
    1. Click Exp. The Expression Builder dialog box is displayed.
    2. Select the required Dataset, Attribute and Runtime Parameters and operators. The resulting condition is displayed in the Condition field.
    3. Click Save Save iconto save the changes.
  7. When you have finished configuring your Data Forge, click Save.