7.12 Managing ETL Process for Scenario Tuning

For inserting and updating records into the KDD_TA_ML_DATA, KDD_TA_BC_DATA, and KDD_TA_TC_DATA tables, there are two shell scripts that are used to call the database procedures.

run_insert_ta_utility.sh

This script calls the P_TA_ML_INSERT_BREAKS, P_TA_BC_ INSERT_BREAKS, and P_TA_TC_INSERT_BREAKS procedures, which insert data into the KDD_TA_ML_DATA, KDD_TA_BC_DATA, and KDD_TA_TC_DATA tables, respectively, based on the CREAT_TS of the alerts in relation to the LAST_RUN_DT from KDD_TA_LAST_RUN (values for RUN_TYPE_CD are ML_I, BC_I, and TC_I).

run_update_ta_utility.sh

This script calls the P_TA_ML_UPDATE, P_TA_BC_UPDATE, and P_TA_TC_UPDATE procedures, which update QLTY_RTNG_CD in the KDD_TA_ML_DATA, KDD_TA_BC_DATA, and KDD_TA_TC_DATA tables, respectively, for any Review closed since the last run based on LAST_RUN_DT from KDD_TA_LAST_RUN (values for RUN_TYPE_CD are ML_U, BC_U, and TC_U). The CLS_CLASS_CD value from KDD_REVIEW is used as the new QLTY_RTNG_ CD.

Note:

• The log for these scripts is written in the run_stored_procedure.log file under the <OFSAAI Installed Directory>/database/db_tools/logs directory.
• The LAST_RUN_DT column in the KDD_TA_LAST_RUN table is only updated for inserts and updates if at least one or more records were inserted or updated. The LAST_RUN_DT column is not updated for significant errors that resulted in no records being updated. These scripts are a part of the database tools and reside in the <OFSAAI Installed Directory>/database/db_tools/bin directory.
• You can run this utility anytime, that is, it is not necessary to run this utility during specific processing activities.