4.4.7 Using Wrapper Shell Script
You can execute the following jobs automatically using wrapper shell script (Wrapper_Run_ER.sh) for Entity Resolution in a specified sequence:
- Create Index and Load the Data
(
ER_Create_And_Load_Data_Into_Index.sh
) - Perform Matching
(
ER_Run_Bulk_Similarity_Job.sh
) - Data Survival
(
ER_Run_Data_Survival_Engine.sh
) - Load Data in FCC_ER_OUTPUT Table
(
ER_Run_Full_Data_Output.sh
)
Steps
- Navigate to
<COMPLIANCE_STUDIO_INSTALLATION_PATH>/deployed/ficdb/bin
. - Run the following
command:
nohup ./Wrapper_Run_ER.sh "<PIPELINE_ID>" "<ER_SCHEMA_WALLET_ALIAS>" "<LOAD_TYPE>" "<FIC_MIS_DATE>" "<FSDF_VERSION>" "<CURRENT_BATCH>" "<SOURCE_BATCH>" "<DATA_ORIGIN>" "<ER_SCHEMA_NAME>" "<RUN_TYPE>" &
Note:
- <CURRENT_BATCH> refers to the FCC_PROCESSING_GROUP table in the Compliance Studio schema.
- <SOURCE_BATCH> and <DATA_ORIGIN> are not relevant now as execution parameters and they are added for future use.
For example, you can use the following command for CSA_8128 version:nohup ./Wrapper_Run_ER.sh "CSA_8128" "ER_SCHEMA_PP_ALIAS" "FullLoad" "20151210" "8128" "CSA_812" "CSA_812" "US" "ER_SCHEMA_PP" "RUN" &
For more information about parameters, see the Parameters for Entity Resolution Job execution section.
- Validate to ensure Global party IDs are generated for the Entities in
the following Staging Output tables after executing the job:
STG_PARTY_MASTER
STG_PARTY_DETAILS
STG_PARTY_EMAIL_MAP
STG_PARTY_PHONE_MAP
STG_ADDRESS_MASTER
STG_PARTY_ADDRESS_MAP
STG_CUSTOMER_IDENTIFCTN_DOC
Cleanup Steps for Job termination
If job is terminated manually, see the following sections:
- For Create Index and Load Data job, see Cleanup Steps When the Create Index and Load Data Job Terminated Manually section.
- For Bulk Similarity job, see Cleanup Steps When the Bulk Similarity Job Terminated Manually section.
- For Data Survival job, see Cleanup Steps When the Data Survival Job Terminated Manually section.
- For Load Data in the FCC_ER_OUTPUT job, See Cleanup Steps When the Load Data in FCC_ER_OUTPUT Job Terminated Manually section.
For more information about parameters, see the Parameters for Entity Resolution Job execution section.
For example:
If the wrapper shell script is terminated manually during Bulk Similarity job execution, then you have to perform cleanup for the Bulk Similarity job. After completing the cleanup, execute the Bulk Similarity job and subsequent jobs manually.