14.6.2.4.1.1.1 SCD (Slowly Changing Dimensions)

Note:

If you have entered the Full Load parameter as YES, you can load snapshot data for master tables and execute SCD process with additional parameters.

In case, when you have entered the Full Load parameter as YES and if the load is incremental and does not contain all the nodes, those nodes are retired by default.

When entered as NO, you can load incremental data for master tables and execute SCD process with additional parameters. The incremental data load for master tables is supported.

The retired dimensions can be brought back as part of subsequent SCD load by updating the Closed Flag column to null or 'N'.

Note:

To enhance the performance of Slowly Changing Dimension execution process for high-volume data, a temporary processing table based on the processing with enhanced connection management has been implemented. The process is as follows:

1. The stage table volume for the given MISDATE is checked and if the data volume is above or equal to the configured threshold, then switch to MEDIUM connection.
2. By default, the SCD_MED_GRP_EXEC_THRESHOLD property is set to 30 million records. Users can configure the value of SCD_MED_GRP_EXEC_THRESHOLD entry in the AAI_DMT_CONFIG table in meta schema.
3. It is only applicable to SCD executions through PMF Orchestration Engine.
4. If an error occurs during this process of fetching the MEDIUM connection, then the connection falls back to low connection (i.e. default execution flow).

Current behavior of Disabled Nodes:

• The Closed Flag attribute is not supported for the Product Processor (PP) accounts.
• A new node in the Stage Master table with Closed Flag 'Y' is supported and will be ignored during SCD load.

To configure this widget, complete the following steps:

1. On the Process Flow page, from the LHS menu, expand Widget and drag and drop this widget on to the canvas.
2. Double-click the widget on the canvas. The configuration window is displayed with the Activity tab selected.
3. Under Dynamic Parameters, configure the settings described in the following table.
4. Click the tick mark icon to save your changes. To close the configuration window, click anywhere outside the window on the canvas.

Table 14-5 Dynamic Parameters for SCD Description

Property	Description
Datastore Name	Refers to the name of the Information Domain. By default, the Information Domain to which you are connected is selected.
Name	Select the name of the required dimension table.
Full Load	No input required.
Execution Venue	No input required.
Effective Date	No input required.