The complete AIP batch processing is comprised of the following:
AIP RPAS batch processing
AIP Java/Oracle batch processing
Because the AIP solution resides on two platforms and needs to exchange information across both the platforms, the batches are executed on both the platforms.
The aip_batch.sh script is provided with the AIP installation, and it is used to run the entire RPAS daily batch process from a UNIX scheduler. The scripts called by aip_batch.sh may have multi-threaded process calls; however, all the scripts called directly by aip_batch.sh are run inline. The top level control script does not run any scripts in parallel. Therefore, it should be used only as a guide for individual script calls/jobs that function similarly, but can be scheduled to run in parallel.
The AIP RPAS batch script, aip_batch.sh, accepts a number of arguments that allow more control over what portion of the batch scripts are run. Step names have been defined, which may also be passed into the script as arguments that define exactly which steps and corresponding scripts should be run.
The following table provides descriptions of the aip_batch.sh arguments.
Argument | Description |
---|---|
-f | First AIP RPAS batch. A predetermined set of steps are run. All other flags can also be used with this flag to further limit the steps that are run. The predetermined skip-steps that should not be run during the first run AIP RPAS batch (as indicated by the -f) is not run, regardless of what arguments are passed. |
-s | Indicates that a starting step is defined. The step at which the batch should start must follow this flag. This flag can be used with all the other flags. However, only one batch step can follow the flag. This flag must be used along with the -e flag and its associated argument. |
-e | Indicates that an ending step is defined. The step after which the batch should end must follow this flag. This flag can be used with all the other flags. However, only one batch step can follow the flag. This flag must be used along with the -s flag and its associated parameter. |
Table 4-1 is a list of valid steps that can be used with the -s and -e flags. These steps can also be passed as parameters to the aip_batch.sh script, in the form of a list of steps (not flagged with -s and -e). Each step is described in detail in either the sections for "Initial Batch Run" or the "Daily Batch Run". Steps that are run during both the initial and daily batch runs are detailed in the Daily Batch Run column.
Table 4-1 describes the steps in the order that aip_batch.sh execute them.
Table 4-1 Execution Sequence of the AIP RPAS Batch Scripts
Step Name | Description of Action | Initial Batch Run | Daily Batch Run |
---|---|---|---|
set_implementation_parameters |
Sets all the AIP RPAS implementation parameters. |
Yes |
No |
check_process_external_data |
This is a wrapper script for _check_for_required_files.sh and process_external_data.sh. It first verifies the existence of all the required files as specified by the earlyfiles.config file, and then calls process_external_data.sh. |
Yes |
Yes |
create_empty_default_files |
This script creates empty hierarchy files necessary during the first run of the batch program, when the AIP Online data is not available. These empty files are later used for merging with the RMS hierarchy files during the daily batch run. |
Yes |
No |
prep_onl_data |
Prepares the daily export files from AIP Online for loading into the AIP RPAS platform. |
No |
Yes |
merge_hierarchies |
This script merges the hierarchy data from AIP Online with the hierarchy data from RMS. |
Yes |
Yes |
convert_hierarchies_for_loading |
Converts the hierarchies from RMS merged with AIP Online, for loading into the RPAS domains. |
Yes |
Yes |
reconfig_domain_partitions |
This script is a wrapper script to the RPAS_HOME/bin utility reconfigGlobalDomainPartitions, to be used within AIP. It checks for the existence of specific configuration files that trigger the addition or removal of partitions to the prod hierarchy. |
Yes |
Yes |
load_all_hierarchies |
Loads all the hierarchies in the AIP domain. This script uses environment variables to determine the domain paths. |
Yes |
Yes |
load_onl_data |
Loads the data extracted from the DM Online and OM Online (AIP Oracle) databases. |
No |
Yes |
load_rms_dm_data |
Preprocesses and loads all the DM measures that come from RMS. |
Yes |
Yes |
create_empty_archive_files |
This script creates new item alerts for all the items. |
Yes |
No |
create_alerts |
Calls load_one_newitem_alert_measure.sh for each new item alert measure, and then saves the hierarchy load files for the next time. |
Yes |
Yes |
load_non_rms_external |
This script looks for *.ovr files from a non-RMS external system, in the directory specified in the input parameter. The files are moved to the $DOMAIN/input directory, where loadmeasure runs on the files. |
Yes |
Yes |
auto_commit_wkbooks_batch |
This script commits all the workbooks (SRP and WRP) on the AIP RPAS platform. |
No |
Yes |
run_partial_dm_batch |
Runs the partial Data Management batch to create and assign profiles. |
Yes |
No |
run_dm_batch |
This script calls the scripts for the DM critical and noncritical paths of execution. |
No |
Yes |
export_dm_data |
Extracts all the DM hierarchy and measure data required to keep DM RPAS and DM Online in sync. |
Yes |
Yes |
check_import_online_schedule |
This script imports output from AIP-Online schedules into RPAS-side AIP domain. |
No |
Yes |
dmb_master_post |
This script executes dmb_master_post_local.sh on each of the local domains.dmb_master_post_local.sh in turn sequentially executes the rule groups to be run after importing the schedule from AIP-Online. |
No |
Yes |
check_load_forecast_data |
This script is basically a wrapper for load_non_rms_files.sh, as it pertains to the loading of the forecast data. It first verifies the existence of all the required files as specified by the forecastdata_from_external.config file. It then calls load_non_rms_files.sh. |
No |
Yes |
purge_low_variability_advance |
Purges and advances the effective date encoded measures along the time dimension, according to the command xml file, purgeLowVariabilityAdvance.xml. |
No |
Yes |
purge_truncate_history |
Purge and Truncate History of Selected Replenishment Measures. |
No |
Yes |
copy_sister_data |
Copies the sister store and warehouse data by running the command xml files, copySisterStore.xml and copySisterWarehouse.xml. |
No |
Yes |
check_process_inventory_data |
This script calls _check_for_required_files.sh and process_inventory_data.sh. It first verifies the existence of all the required files as specified by the latefiles.config file, and then calls process_inventory_data.sh. |
No |
Yes |
load_replenishment_data |
Preprocesses and loads all the SRP and WRP measures that come from RMS in the late data feed. |
No |
Yes |
run_replenishment |
Runs the replenishment and reconciliation actions, across the supply chain. |
No |
Yes |
export_replenishment_data |
Creates the replenishment plan extracts at the local domain level. |
No |
Yes |
send_replenishment_to_online |
Concatenates .dat files from an AIP domain's local domain output directories into combined export files that are located in the global domains. |
No |
Yes |
post_dcrp_import |
This script imports output from Cross Dock Constraint Receipt Plan(DCRP) into RPAS-side AIP domain. |
No |
Yes |
post_ocs_import |
Loads plan adjustments after Scaling is complete. |
No |
Yes |
run_replenishment_post_processing |
Executes the replenishment post-process by sequentially running the defined rule group. |
No |
Yes |
run_dm_alerts |
Executes the dmb_master20.sh ${AIPDOMAIN}'script to create alerts, if any. |
Yes |
Yes |
export_dm_alerts |
Data management alerts are exported to the AIP Online platform. |
Yes |
Yes |
run_srp_alerts |
Executes the generation of SRP alerts by running the defined SRP alert rule group. |
No |
Yes |
run_wrp_item_alerts |
Executes the generation of WRP alerts by running the defined WRP alert rule group. |
No |
Yes |
run_wrp_network_alerts |
Executes the generation of WRP network alerts by running the defined WRP network alert rule group. |
No |
Yes |
run_replenishment_alerts_post_ processing |
Finds generated WRP network alerts and runs post WRP network alerts for global history maintenance. |
No |
Yes |
auto_build_wkbooks_batch |
Builds all the SRP and WRP workbooks that have been configured for automatic builds. |
No |
Yes |
run_reports_calculation |
Runs all calculations required for OBIEE Reports. |
No |
Yes |
run_dashboard |
This script calculates data for AIP Dashboard. |
No |
Yes |
Table 4-2 lists example script calls and their actions.
Table 4-2 AIP RPAS Batch Example Script Calls
Command | Action |
---|---|
aip_batch.sh -f |
Runs a subset of the |
aip_batch.sh -s check_process_external_data -e load_non_rms_external |
Runs the aip_batch.sh steps, starting with check_process_external_data, and up to and including load_non_rms_external. |
aip_batch.sh run_dm_alerts |
Only runs the aip_batch.sh step listed which is run_dm_alert. |
aip_batch.sh run_dm_alerts run_srp_alerts auto_build_wkbooks_batch |
Results in the |