E.5.3.2 Control Data Management

Control data uses a specific set of dates to ensure that all the OFSBD lock-stock scenarios are tested using this data.

The maximum lookback that control data considers is of 13 months, which is for change in behavior scenarios. The control data is spread over 25 different dates in 13 months. The dates (YYYYMMDD format) being used by control data are:

On all these dates, ingest the data and run the complete Behavior Detection batch for the respective date. Except for Behavior Detection and Post-Processing tasks, perform all other activities for the Control Data Management dates. Activities required during any Behavior Detection Framework business day are - START BATCH > DRM > DATA INGESTION > BEHAVIOR DETECTION > POST PROCESSING > END BATCH.

Prior to running Behavior Detection on the control data, you must complete the following procedures.

1. Copy all control data from the golden data directory in the database subsystem (/database/ golden_data directory) to the Ingestion Manager /inbox directory bdf /inbox.
2. Run ingestion for all the control Data Management dates. Refer to Ingestion Timeline - Intra-Day Ingestion Processing, for more information about the ingestion process.

Note:

You must adjust the partitions of the database tables as per the new dates, if you intend to process Control Data after the database upgrade to OFSBD.