The loader component initiates the data loading process, but the actual processing of the data is performed by a processor pipeline. The pipeline is invoked by a pipeline driver component to which the loader passes batches of log entries. The pipeline driver calls a pipeline manager component, which controls the pipeline. The processors in the pipeline perform such tasks as looking up dimensional data in the warehouse; looking up profile, catalog, and order data in repositories on the production site; and writing data about each item in an order to the warehouse.
The following table summarizes the data loaders, their pipeline drivers, and the processor chains they invoke:
Data Loader | Pipeline Driver | Processor Chain |
|---|---|---|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
See Appendix E: Pipeline Chains for information on these pipelines. For detailed information on working with pipelines, refer to the Processor Chains and the Pipeline Manager section.
Mapping Production Properties to Data Warehouse Properties
Individual product catalogs and user profile repositories can vary widely from one customer site to another. However, the Data Warehouse is a fixed structure; therefore, a map is required. The mapping is done using an XML file with the structure shown below, which allows you to map between any Core Commerce repository and the Data Warehouse for data loading purposes.
For information on mapping these properties, refer to the Configuring Fact Data Loading section of the Business Intelligence Installation and Configuration Guide.
