Skip to main content

View detailed reports on your bot's performance

Overview

The Reports view contains the detailed reports for your bots performance metrics. This article outlines the individual reports, what they measure, and how the various filters work.

Available Reports

  • Agent Satisfaction Score - Shows the CSAT survey results for live agents.

  • Answer Performance - Shows the feedback your customers have given your answers via thumbs up/thumbs down. Calculated the total number of thumbs up and thumbs down reviews, divided by the total number of reviewable answers that were provided to chatters.

  • Answers Resulting in Handoff - Shows which answers most often preceded a chatter's request for a live agent. Within the report, the Handoff Rate column is calculated by the total number of handoffs, divided by the frequency of the answer being provided, and the Percent of Total Handoffs is calculated by the total handoffs for that answer, divided by the total handoffs for the entire bot.

  • Average Handle Time - Handle Time measures the time your chatter spends with Ada in each of three engagement states.

    • Avg Handle Time when Contained – The average time spent chatting with your bot.

    • Avg Handle Time before Escalation – The average time between the bot's first message and a chatter escalation event.

    • Avg Handle Time with Agents – Only available for Ada Glass integrations. The average time spent chatting with a live agent.

  • Article Performance - Shows the performance of your knowledge base articles suggested to chatters by Smart Search.

  • Clarification Rate - Shows the percent of conversations that contained at least one clarification.

  • Containment Rate - Shows how often chatters were able to self-serve instead of escalating to a live agent.

  • Conversational Messages Volume - Shows the number of bot, chatter, and agent messages per conversation.

  • Conversations Breakdown - Shows the breakdown of opens, conversations, and escalations for your bot.

  • Customer Satisfaction - Shows the results of your customer satisfaction survey if using our legacy Satisfaction Survey feature.

  • Engagement Rate - Shows how often your customers choose to chat with your bot.

  • Events Overview - Displays the data gathered from your tracked Events. Read about how to create and track events to learn more.

  • Link Click Performance - Shows click through rates for links presented using the Web and Link blocks.

  • Popular Answers - Shows which answers appear most often in conversations. Popular Answers report does not include Test User data by default.

  • Recognition Rate - Shows how often your bot was able to recognize and answer your customers questions.

  • Tags Overview - Shows Answers and Conversations volume by tag.

  • Total Answers - Shows the total number of answers your bot has served over time. Total Answers report includes Test User data by default.

  • Events help you track key customer actions that occur within conversations or on your website. To learn more about Events, see how to create and track events.

Upon clicking on a report title you will be taken to a page dedicated to that specific report. The report will take the form that makes the most sense for the data being delivered, including a bar graph, table, or line graph, and each will provide you with the ability to filter the results to best meet your data needs.

For more information on the filters available for you when reviewing your reports, please see below.

Filters

Date Filter

To filter a report by date:

  1. Click the date filter drop-down.

  2. Define your date range by one of the following:

    • Select a predefined range from the list on the left.

    • Type the filter start date in the Starting field. Type the filter end date in the Ending field.

    • Click the starting date on the calendar on the left, and the ending date on the calendar on the right.

  3. Click Apply.

The date filter dropdown provides you with the ability to specify the date range you want to filter the report's data by. You can select from a list of preset date ranges or select Custom… to specify your own by way of a calendar selector.

Additional Filters

The list of available filters differs for each report, depending on the data the report includes. Clicking the Add Filter drop-down menu gives you access to the filters relevant to the report you're viewing.

  • Previous Timeframe: Display the immediate past timeframe (same length) to compare against current selection. Graphs will also display a figure representing the delta (difference) between ranges (ie. how much did the bot’s volume rise or drop between timeframes)

  • Exclude Locked Answers: Graphs and tables will only display volumes for answers created after bot creation (for more details on locked answers, see “Answers That Don’t Need Training” here). This will remove volume for answers like “Greeting” and “Not Understood.”

  • Language (if Multilingual feature enabled): Include/exclude volume of different languages if your bot has content in other languages.

  • Platform: Isolate different platforms that your bot is visible in or interacts with (ex. Nuance, Zendesk, SMS, etc)

  • Browser: Isolate users from specific internet browsers (ex. Chrome, Firefox, etc)

  • Device: Isolate users from specific devices and operating systems (ex. Windows, iPhone, Android, etc.)

  • Answers: Isolate specific answer(s). This can be used to check the performance of an answer or multiple answers over time.

  • Interaction Type: Isolate answers that result from questions that were clicked (quick reply buttons) or typed.

  • Include Test User: Include conversations originating from the Ada dashboard test bot. Test bot conversations are excluded by default.

  • Filter by Variable: View only the conversations which include one or more variables. For each variable, you can define specific content the variable must contain, or simply whether the variable Is Set or Is Not Set with any data.

filtervariable_edited.png

Additional Information

  • Report data is updated approximately every hour.

  • Reports are in the time zone set in your profile.

Printing

Viewing your bot's data in the dashboard is recommended as it provides the best experience. If you need to print however, use the following recommendations to limit rendering issues.

  1. Set the Paper size to A3 (11-3/4 x 16-1/2 in) or Legal (8.5 x 14 inches).

  2. Set Margins to Minimum.

  3. Under Options, toggle on Background graphics.

  4. If your Destination is Save as PDF, click Save. If your Destination is a printer, click Print.

Have any questions? Contact your Ada team—or email us at help@ada.support.