Batch Control Samples

The following sections list samples of batch control processes.

batch_exec_list.txt

# unpack data file before data load
hook_pre_load | unpack      | rdf_hier.tar.gz 
hook_pre_load | unpack      | rdf_meas.tar.gz

# load custom measures after GA hier and measure load 
hook_pre_post_data_load | measload    | c_weeklyLoad

# calculate outlier indicator used in preprocess using custom rules
hook_ppsindicator | calc | c_outlier_calc

# calculate custom approval alerts after GA approval alerts
hook_frcst_alert07 | exec | c_calc_cust_alerts

# custom export
hook_post_export | measexport | c_export_promoeffects
c_calc_cust_alerts | calc |c_custalert1
c_calc_cust_alerts | calc |c_custalert2

batch_calc_list.txt

#outlier calculation
c_outlier_calc | G | GROUP | c_HBICalcTodayIdx
c_outlier_calc | G | GROUP | c_dataprocess
c_outlier_calc | G | GROUP | c_calc_outlier

#custom approval alerts calculation
c_custalert1 | G | GROUP | c_custalert1
c_custalert2 | G | GROUP | c_custalert2

batch_loadmeas_list.txt

# load custom measure
c_weeklyLoad | M | c_ActiveItem
c_weeklyLoad | M | c_DisContinue

batch_exportmeas_list.txt

# export custom measure
c_export_promoeffects|O|promoeffects.csv.dat
c_export_promoeffects|X|storsku_lprm
c_export_promoeffects|F|c_ExportMask
c_export_promoeffects|S|ftp
c_export_promoeffects|M|prmbldeff07

Below sections describe Batch Control details that are specific to MFP:

The following table describes the Custom Hooks available in the batch process if the customer is scheduling jobs directly through the OAT.

Table 9-5 Custom Hooks in the Batch Process to Directly Run from OAT

Hook	Description
hook_postbuild	This hook is added at the end of the postbuild batch, which runs after the initial domain build.
hook_postpatch	This hook is added at the end of the service patch process, which runs after the service patch.
hook_batch_daily_pre	This hook is added before the daily batch process.
hook_batch_daily_post	This hook is added at the end of the daily batch process before the dashboard build.
hook_batch_weekly_pre	This hook is added before the weekly batch process.
hook_batch_weekly_post	This hook is added at the end of the weekly batch process before the workbook refresh and segment build.

If the customer is using the JOS/POM flow schedule to schedule jobs in MFP, then the following hooks can be used. The MFP JOS/POM job flow is connected to use the same set names, like the hooks shown in the following table without hook_* in it and in turn calls each of the corresponding hooks. So the customer can easily customize their MFP batch flow based on their needs by simply changing the hooks or adding additional steps to the existing, pre-configured hooks.

The naming convention followed is:

• _RDX is used for any integration step using RDX.

• _OBS is used for any steps using Object Storage.

• _D is for jobs that run daily.

• _W is for jobs that run weekly.

Table 9-6 Custom Hooks in the Batch Process if JOS/POM is Used to Schedule the Flow

Hook	Description
hook_MFP_PRE_EXP_RDX_D	This hook is for the calling steps using the Daily Export Interfaces to RDX as soon as the batch starts.
hook_MFP_PRE_EXP_OBS_D	This hook is for the calling steps using the Daily Export Interfaces to Object Storage as soon as the batch starts.
hook_MFP_PRE_EXP_RDX_W	This hook is for calling steps using the Weekly Export Interfaces to RDX as soon as the batch starts.
hook_MFP_PRE_EXP_OBS_W	This hook is for the calling steps using the Weekly Export Interfaces to Object Storage as soon as the batch starts.
hook_MFP_COM_HIER_IM P_RDX_D	This hook is for the calling steps using any Daily Import of common hierarchies from RDX.
hook_MFP_COM_HIER_IM P_OBS_D	This hook is for the calling steps using any Daily Import of common hierarchies from Object Storage.
hook_MFP_COM_HIER_IM P_RDX_W	This hook is for the calling steps using any Weekly Import of common hierarchies from RDX.
hook_MFP_COM_HIER_IM P_OBS_W	This hook is for the calling steps using any Weekly Import of common hierarchies from Object Storage.
hook_MFP_COM_DATA_IM P_RDX_D	This hook is for the calling steps using any Daily Import of common data interfaces from RDX.
hook_MFP_COM_DATA_IM P_OBS_D	This hook is for the calling steps using any Daily Import of common data interfaces from Object Storage.
hook_MFP_COM_DATA_IM P_RDX_W	This hook is for the calling steps using any Weekly Import of common data interfaces from RDX.
hook_MFP_COM_DATA_IM P_OBS_W	This hook is for the calling steps using any Weekly Import of common data interfaces from Object Storage.
hook_MFP_HIER_IMP_RD X_D	This hook is for the calling steps using any Daily Import of application-specific hierarchies from RDX.
hook_MFP_HIER_IMP_OB S_D	This hook is for the calling steps using any Daily Import of application-specific hierarchies from Object Storage.
hook_MFP_HIER_IMP_RD X_W	This hook is for the calling steps using any Weekly Import of application-specific hierarchies from RDX.
hook_MFP_HIER_IMP_OB S_W	This hook is for the calling steps using any Weekly Import of application-specific hierarchies from Object Storage.
hook_MFP_PRE_DATA_IMP_RDX_D	This hook is for the calling steps using any Daily Import of application-specific data interfaces from RDX.
hook_MFP_PRE_DATA_IMP_OBS_D	This hook is for the calling steps using any Daily Import of application-specific data interfaces from Object Storage.
hook_MFP_PRE_DATA_IMP_RDX_W	This hook is for the calling steps using any Weekly Import of application-specific data interfaces from RDX.
hook_MFP_PRE_DATA_IMP_OBS_W	This hook is for the calling steps using any Weekly Import of application-specific data interfaces from Object Storage.
hook_MFP_BATCH_AGG_D	This hook is for the calling steps doing any regular daily batch aggregation after hierarchy and data loads.
hook_MFP_BATCH_AGG_ W	This hook is for the calling steps doing any regular weekly batch aggregation after hierarchy and data loads.
hook_MFP_POST_DATA_IM P_RDX_D	This hook is for the calling steps using any Daily Import of application-specific data interfaces from RDX after the calc steps.
hook_MFP_POST_DATA_IM P_OBS_D	This hook is for the calling steps using any Daily Import of application-specific data interfaces from Object Storage after the calc steps.
hook_MFP_POST_DATA_IM P_RDX_W	This hook is for the calling steps using any Weekly Import of application-specific data interfaces from RDX after the calc steps.
hook_MFP_POST_DATA_IM P_OBS_W	This hook is for the calling steps using any Weekly Import of application-specific data interfaces from Object Storage after the calc steps.
hook_MFP_POST_EXP_RD X_D	This hook is for the calling steps using any Daily Exports to RDX after the batch aggs.
hook_MFP_POST_EXP_OB S_D	This hook is for the calling steps using any Daily Exports to Object Storage after the batch aggs.
hook_MFP_POST_EXP_RD X_W	This hook is for the calling steps using any Weekly Exports to RDX after the batch aggs.
hook_MFP_POST_EXP_OB S_W	This hook is for the calling steps using any Weekly Exports to Object Storage after the batch aggs.
hook_MFP_WB_BUILD_D	This hook is for the calling steps specific to workbook refresh or build in the daily cycle.
hook_MFP_WB_BUILD_W	This hook is for the calling steps specific to workbook refresh or build in the weekly cycle.