About adding and editing source properties

After source data has been loaded into your implementation, you may need to perform some manipulations. The goal of this step is to create source records with the correct set of source properties, before any mapping occurs.

You can use a Perl manipulator component in your pipeline to add, edit, and remove source properties from your records during data processing. Using a Perl manipulator, you can perform a number of tasks, including (but not limited to) the following:

Remove a source property from each record
Reformat a source property on each record
Remove records with a particular source property
Perform left joins on records from two sources
Retrieve records matching a key from any number of data sources
Process records using a Perl subclass

This section of the Developer Studio Help provides basic information on implementing Perl manipulators. Detailed Perl manipulator information can be found in the Forge API Guide for Perl, which is available from Help menu in Developer Studio. The Forge API Guide for Perl provides descriptions for the classes and methods you can incorporate in a Perl manipulator. It also provides sample code for the most common Perl manipulator tasks.

Note: Because Perl manipulators only deal with source properties, they must always come before property mappers in a pipeline's data flow.