Adding a record cache

Use the options in the Record Cache editor to add and configure a record cache for each of your record sources.

To add a record cache for each record source that will feed the join:

  1. In the Pipeline Diagram editor, click New, and then choose Record > Cache. The Record Cache editor appears.
  2. In the Name text box, type a unique name for this record cache.
  3. (Optional) In the General tab, you may do the following:
    1. If the cache should load fewer than the total number of records from the record source, type the number of records to load in the Maximum Records text box. This features is provided for testing purposes.
    2. If you want to merge records with equivalent record index key values into a single record, check the Combine Records option. For one-to-many or many-to-many joins, leave Combine Records unchecked.
      Important: The Combine Records option can have unexpected results if you do not understand how it functions.
  4. In the Sources tab, select a record source and, optionally, a dimension source. If a component's record index contains dimension values, you must provide a dimension source. Generally, this is only the case if you are caching data that has been previously processed by Forge.
  5. In the Record Index tab, do the following:
    1. Specify which properties or dimensions you want to use as the record index for this component. Note that the record index you specify for a cache must match the join key that you will specify for that cache in the record assembler.
    2. Indicate whether you want to discard records with duplicate keys.
  6. (Optional) In the Comment tab, add a comment for the component.
  7. Click OK.
  8. Repeat these steps for all record sources that will be part of the join.