Suggested Input Reports

You can use the reports on the Insights page to understand whether users are clicking and accepting the suggested inputs.

The Insights page contains two reports, one for average precision and one for percentage accepted. You can select the time period to view reports for a particular time frame, like the last 24 hours, last week, last month, or last year. Both reports show how many predictions were served, how many were accepted, and how many weren’t accepted. Over time, when there’s more data for machine learning, the reports show a more accurate estimate of how the suggestions are performing.

Average Precision

Use the average precision report to view the percentage of suggestions that users selected, calculated based on the overall suggestions that were made and their ranking. The report provides more clarity on the quality of the suggestion rankings. The report takes in to account the number of times a user selected a suggestion and its ranking. For example, the average precision goes up if users always selected a suggestion that was ranked first.

Percentage Accepted

Use the percentage accepted report to view the percentage of suggestions that users selected out of the total suggestions displayed to them. The report uses the number of predictions served, accepted, and not accepted to show the percentage of suggestions that users accepted during the selected time range. Unlike the average precision report, this report gives the same weight to any accepted suggestion at any rank. Therefore, it provides a simple metric indicating whether users are getting a set of helpful suggestions or not.