Siebel Smart Answer Guide > Using the Siebel Smart Answer Administration Tool > Creating a Knowledge Base Model Using the Benchmark and Analyze Work Flow >

Benchmarking the Knowledge Base Model

The Knowledge Base benchmark is the most informative set of statistics to predict how well the Siebel Smart Answer system will perform in the Siebel Smart Answer run time. The Siebel Smart Answer Administration Tool will compute the expected accuracy of each category by randomly sampling the corpus and reserving 20% for testing and using the rest for training. It will repeat this process five different times and then average the scores.

Running a benchmark

1. Navigate to the Knowledge Base Benchmarking Tab and select Run Benchmark.

   NOTE:  The benchmarking process can take several hours for a large corpus.

2. Review the final scores shown in the Benchmarking report.
3. Review for each category the accuracy, the total incorrectly classified entries (Incorrect), the total of correctly classified entries (Correct), and the total number of entries that were not classified as the expected category (Missing).