Creating a Forge pipeline

A baseline-update pipeline can be used for sites that perform only full crawls (not incremental crawls). This section describes how to create and configure a simple Forge pipeline that runs a baseline update and also configure a record adapter to read and write from record store instances.

The goal of this section is to describe the Forge pipeline components that are specific to modifying records produced by crawling. Therefore, for simplicity, components that are common to non-crawler pipelines (dimension server, property mapper, indexer adapter, and so on) are not described here.

The high-level overview of a baseline-update pipeline is as follows:

  1. Create a record adapter to read the records that CAS produced (required).

  2. Map the record properties to Oracle Commerce properties and dimensions (required, but not documented in this guide. See Developer Studio Help.).

The following illustration shows a baseline-update pipeline with the components necessary to process records produced by crawling a data source. This includes the components common to any pipeline (dimension adapter, dimension server, and indexer adapter).

Baseline pipeline for a Web Crawler implementation.

Copyright © Legal Notices