Siebel Smart Answer Guide > Using the Siebel Smart Answer Administration Tool >

Querying the Knowledge Base Model


After the final knowledge base model is built, a good practice is to validate the knowledge base model by testing it on a small sample of emails for which the desired category is already known. There are two methods for doing this:

  • Single query mode
  • Batch query mode

Validate Your Knowledge Base Model with Single Query Mode

Single query mode is useful for dynamic validation of your knowledge base model. In this mode you can type in text or copy in email text to see how the knowledge base model will categorize it.

To validate your knowledge base model using single query mode

  1. Navigate to the Query - Single Query Tab.
  2. Type in or copy and paste the text of an email into the box labeled: Enter message to be analyzed here, and select Run Query.
  3. Review the category assignments and the confidence scores for your query in the results table at the bottom of the screen.
  4. Select Clear to enter another query.
  5. Repeat Step 1 through Step 4.

Validating Your Model with Batch Query Mode

If you have several test queries, they can be placed in a CSV file with at least two fields: Categories, and Body. The file can be thought of as a key or a test to see how well your knowledge base model does on new emails that were not part of the training set. For more information on the available fields, see Expected Format for a Bulk Import CSV file.

To validate your knowledge base model using batch query mode

  1. Navigate to the Query - Batch Query Tab.
  2. Select Load File and browse to your CSV file with the tests emails and their expected category assignments.
  3. Review the results of the batch query at the bottom of your screen. The format is the same as for the Knowledge Base Analysis Tab.

    For more information on the benchmarking process, see Benchmarking the Knowledge Base Model.

Siebel Smart Answer Guide Copyright © 2015, Oracle and/or its affiliates. All rights reserved. Legal Notices.