Using RDE for Dimension Loads (Gen 2 Architecture)

RDE can be used to integrate the foundation dimensions such as Product and Location hierarchies from Merchandising for initial setup of a new RAP environment. However, there are several manual steps you must take to perform this activity.

  • The AIF DATA ad hoc process RDE_EXTRACT_DIM_INITIAL_ADHOC must be configured and run. Enable all jobs in the process if you want to extract all foundation dimensions, or selectively disable jobs you do not wish to run. Restart your POM schedule and then execute the process. The process will extract data from Merchandising tables (replicated to RAP through Golden Gate Hub) and directly insert data to RAP foundation staging tables. For example, the job RDE_EXTRACT_DIM_P3_PRDHIERSDE_JOB will source data from Merchandising hierarchy tables like CLASS and DEPS and directly insert them into the W_PROD_CAT_DHS table in RAP.

  • Some dimension extracts support full or incremental extract options as parameters instead of database configurations. The jobs that support this will have parameters on the job such as rdeitemsupcountrydimext.ksh #SysOpt.rdeMMHOME I, where the last value is either I or F for incremental/full extraction logic. You have the option to switch between I and F as needed to change the extract logic. RDE_EXTRACT_CLRPRICESDE_XTERN_JOB and RDE_EXTRACT_DIM_P5_REPLSUPDIMSDE_JOB are two examples of jobs that support this parameter.

  • The AIF DATA ad hoc process RI_DIM_INITIAL_ADHOC will then be used to import the foundation data from the staging tables to the target tables. Before running the process, you must make sure all jobs are disabled relating to flat file loads, because you are bypassing those steps with the RDE jobs. Disable all jobs having a name with COPY, STG, STAGING, or SI in the job name. Following the same flow for product hierarchy data as in step 1, you need to disable these jobs relating to the product hierarchy flat file load:

    • COPY_SI_PRODUCT_JOB

    • STG_SI_PRODUCT_JOB

    • SI_W_PROD_CAT_DHS_JOB

The remaining job that is active for the product hierarchy load is W_PROD_CAT_DH_TYPE1_JOB, which loads the RDE data from W_PROD_CAT_DHS to the W_PROD_CAT_DH table.

  • Once you have disabled all flat file jobs, restart the POM schedule as needed and then run the RI_DIM_INITIAL_ADHOC process. This moves all Merchandising data from the RAP staging tables into the data warehouse internal tables. Once all jobs are complete, the remaining steps to move data to AIF and PDS are the same as documented in the Data Loads and Initial Batch Processing chapter.