Using Workflow Modes

By default, the data load process in Data Management is designed with a well-defined process flow that provides a full audit of the data load process and the ability to drill down and view data in Workbench. However, a full data flow may contribute to lengthy processing times due to archiving of data for audit purposes. Workflow mode options provide scalable solutions when processing large volumes of data, or when an audit is not required, and performance is a key requirement.

The three workflow mode options are:

• Full
• Full (no archive)
• Simple

The Full option is the default flow for loading data. Data is loaded in the standard way between the staging tables, data can be viewed in Workbench, and drill down is supported.

The Full (no archive) option loads data in the same manner as the full mode, but data is deleted from the staging tables at the end of the data load process. Data can be viewed in the Workbench only after the import step. No drill down is available with the full (no archive) mode. This method is useful when you want to review and validate the data during load process but auditing or drill down is not a requirement. This method does not provide performance improvement but limits space usage since data is not persisted for future reference.

The Simple option limits data movement between the staging tables. No drill down is available, and the data cannot be viewed in the Workbench. This method provides performance improvement and is useful when you do not require auditing or drill down.

Note:

You can use import expression mapping or traditional dimension mapping for any of the Workflow modes.

Note:

If you use the Simple Workflow mode to load data (see Using Workflow Modes and you run a check rule with target intersections, then include a check entity group (see Creating Check Entity Groups). Otherwise the check rule fails. In addition, other than the Full workflow mode, no check reports are not available after the export step has completed.