5.2 Generating Experiment from Recommendation
OFSCA offers recommendations to tackle the identified deficiencies. A deficiency can be a low scenario performance or a high account/ channel vulnerability. The recommendations aim to tune the scenario with the highest chances of addressing the selected deficiency. To generate recommended thresholds for the scenario, OFSCA evaluates the performance of simulated TMS against multiple sets of candidate thresholds within proximity of the production (currently applied) values. A set of candidates is evaluated by using a combined metric analyzing both the percentage of episodes getting alerted and the average number of distinct alerts per episodes. OFSCA recommends the set that has performed optimally as per the metric. This section describes the process for generating experiments to assess the effectiveness of these recommendations.