Working with Your Pipeline

About pipelines
A pipeline functions as the script for the entire data transformation process that occurs when you run the Forge program.
About the pipeline tab
The Project Explorer's Pipeline tab displays all of the pipeline components in your project, for both your baseline pipeline and your partial update pipeline.
About the Pipeline Diagram editor
The Pipeline Diagram editor depicts all of the components in your main pipeline and the relationship between them.
About pipeline components
A pipeline consists of components that perform specific functions during the transformation of your source data into Endeca records. These components are connected by links, giving the pipeline a sequential flow from inputs to outputs.
About adapters
Adapter components load and save data.
About manipulators
Manipulator components change the data associated with an Endeca record.
About property mappers
Property mappers connect source data to properties or dimensions.
About record assemblers
About Record Server Components
"Record server" is a general name for any component that can serve records to a downstream component.
About utility components
Utility components help you perform basic tasks such as logging and record caching.
Adding a pipeline component
Add new pipeline components from the Pipeline Diagram editor.
Editing a pipeline component
Select a component from the Pipeline Diagram editor to make modifications.
Deleting a pipeline component
Delete any pipeline components from the Pipeline Diagram editor.
Record Manipulators and Expressions
Writing Out Data for Diagnostic Purposes
Changing the Display of the Pipeline Diagram