Topic analysis

Reviewing and analyzing conversation topics data can provide insight into trends in your customers’ behavior. Understanding these trends helps you identify opportunities and come up with actions you can take to improve your AI Agent’s performance.

Understand how conversation topics work

Your AI Agent analyzes each conversation to assign a topic, which it can then use to group similar conversations.

By default, the list of topics you see is sorted by automated resolution (AR) opportunity, which represents the total opportunity that topic has to affect your overall automated resolution rate. Topics containing the largest number of unresolved conversations will have the greatest AR opportunity. You can drill into any topic and get even more details.

Review topic insights

To view all topics, on the Ada dashboard, go to Performance > Topics.

Review detailed insights for a specific topic

You can click any topic to view a more detailed breakdown of the data collected for that topic, then use this information to:

  • Explore volume, handoff, and customer satisfaction (CSAT) trends to help understand the topic’s performance

  • Review inquiry summaries to quickly get an understanding of the key points of a conversation

  • Uncover opportunities for AI Agent improvements based on unresolved inquiries related to this topic

  • Review conversations that meet specific criteria using the available filters

  • View top articles and actions used per topic, drill into relevant conversations

MetricDefinition
AR opportunityThe percentage of unresolved conversations that fall within this topic. Topics with a high AR opportunity give you insight into the areas of your knowledge base, actions, and Coaching where making refinements can most effectively improve your AI Agent’s performance.
ConversationsThe percentage of all conversations that fall within this topic.
Last conversationWhen the most recent conversation in this topic happened.
Containment rateThe percentage of conversations that did not result in a handoff to a human agent.
CSAT

The percentage of conversations customers reviewed positively, out of all conversations they reviewed.

Rating typeNegative reviewPositive review
Numeric (5-point scale)1, 2, or 34 or 5
Numeric (10-point scale)1, 2, 3, 4, 5, or 67, 8, 9, or 10
Emoji (5-point scale)😠, 🙁, or 😐🙂 or 😍
Thumbs up/down (binary)👎👍

Review conversations related to a specific topic

From an individual topic, you can review example conversations from the topic cluster, so you can better identify relevant actions to take to improve your AI Agent.

To see conversations related to a specific topic, from the relevant topic page, click See Conversations. You’ll be taken to the Conversations view, with the relevant filters applied so you only see conversations for that specific topic.

Manage topics

To help you manage and organize topics most relevant to your business, you can adjust topics and organize them into categories.

Toggle AI-generated topics on or off

By default, Ada will automatically generate new Topics based on conversation trends. If you’d prefer to only use manually created Topics, you can now turn AI-generated Topic creation off.

To turn off AI-generated Topics:

  1. On the Ada dashboard, go to Performance > Topics.
  2. In the upper-right corner, use the “Generate new topics automatically” toggle to disable generation.

When the toggle is off, Ada will:

  • Stop creating new AI-generated Topics.
  • Sort conversations that don’t match any of your active Topics into one of two system Topics:
    • Other Inquiries – Used when the customer’s intent is understood, but doesn’t match any Topic.
    • Unclear or Incomplete Inquiries – Used when the customer’s message is ambiguous or incomplete.

These system Topics are always active and cannot be renamed or set as inactive, to ensure that every conversation is captured in your reporting.

When the toggle is on, Ada will:

  • Continue generating new Topics when it detects emerging patterns.
  • Attempt to match conversations to both active and inactive Topics. If it finds a match in an inactive Topic, that Topic will be automatically reactivated.

Edit a topic

You can change the name or description of a topic. Moving forward, your AI Agent will take the updated name and description into account when assigning new conversations to that topic.

  1. On the dashboard, go to Performance > Topics.

  2. For the topic you want to rename, click the More options button , then click Edit. The editing dialog opens opens.

  3. Edit the topic’s name and description as required, then click Save.

Show or hide topics

If you no longer want to monitor a topic regularly, you can set it as inactive to hide it from the main view. Don’t worry, you can always set it as active again if you change your mind. Additionally, if your AI Agent detects new conversations that match the topic, the topic will automatically become active again for your review.

To set one or more topics as inactive:

  1. On the Ada dashboard, go to Performance > Topics.
  2. Select the topics you want to remove from your main Topics table.
  3. Click the Set as inactive button that appears.

If you have hidden topics, you’ll see a notification that tells you how many you have. To set one or more of those topics as active again and add them back to your Topics table:

  1. On the Ada dashboard, go to Performance > Topics.
  2. Click View (x) hidden topics to show a list of your AI Agent’s inactive topics.
  3. Select the topics you want to set as active again.
  4. Click the Set as active button that appears.

Create a topic category

You can create topic categories to group similar topics together. You can have up to a total of 40 active topics and categories, and each category can contain up to 40 topics.

  1. On the Ada dashboard, go to Performance > Topics.
  2. Click New Category. The Create a category dialog opens.
  3. Enter a Name and Description for the category, then click Save. Your AI Agent will take the name and description into account when assigning new conversations to a category and then to a topic within that category. The dialog closes and your new category appears in your Topics table, ready for you to move topics under it.

You can click any category to view a more detailed breakdown of the data collected for all the topics under that category. This page operates the same way as the individual topic insights page, but aggregates data for all the topics under that category.

Move topics between categories

You can move up to 40 topics under a given category.

  1. On the Ada dashboard, go to Performance > Topics.
  2. Select the topics you want to move under a category.
  3. Add or remove the selected topics from a category.
    • To add the topics to a category, click the Move to button that appears. In the window that opens, select a category, and click Move. The dialog closes and the selected topics appear in the category you chose.
    • To remove the topics from a category, click the Ungroup button that appears. The dialog closes and the selected topics appear outside of any categories.

Move a conversation between topics

You can move individual conversations out of an automatically assigned topic into one you think is more relevant.

You can only reassign conversations that your AI Agent has already assigned to a topic. You can’t change the topic for a conversation that your AI Agent hasn’t assessed.

  1. On the Ada dashboard, go to Conversations, then select the conversation you want to reassign to a different topic.
  2. In the conversation’s header, click the conversation’s current topic to open a list of your AI Agent’s existing topics, and select the one you want to assign instead.

Best practices when creating titles and descriptions for topics and categories

Creating effective titles and descriptions helps your AI Agent accurately assign conversations to the right topics. Follow these guidelines to improve topic assignment quality:

General Guidelines

  • Be Specific: Use clear and specific language in your topic and category descriptions. This helps the AI understand the intent behind user inquiries better.
  • Include Key Phrases: Incorporate key phrases or triggers that users might use when asking questions related to the topic. For example, for a topic on password resets, include phrases like “forgot my password” or “reset password”.
  • Sample Questions: Provide sample questions that users might ask. This can guide the AI in recognizing similar inquiries.
  • Macro to Micro Approach: Start with broader topics (macro) and then break them down into more specific sub-topics (micro) as needed. This hierarchical structure can help in organizing topics effectively.

Length and Detail

  • Description Length: Aim for a concise description (limit of 5,000 characters).
  • Use of Examples: Including examples in your descriptions can enhance the AI’s ability to match conversations to the correct topics.

Category and Topic Relationship

  • Nesting Topics: When defining categories, consider how topics will nest within them. Ensure that category descriptions are detailed enough to guide the system in matching conversations to the appropriate topics.
  • Product Names: If you have multiple products under a category, it may be beneficial to list product names in both the category and topic descriptions to improve matching accuracy.

Continuous Improvement

  • Monitor and Adjust: Regularly review the performance of your topics and adjust descriptions based on user interactions and feedback. If certain conversations are not being matched correctly, consider refining the topic descriptions to improve AI recognition.

When you edit a topic’s name or description, your AI Agent immediately starts using the updated information for new conversation assignments. Existing conversation assignments are not changed.

Export topics performance table

You can export the topics performance table to a CSV file. This exports the current view (including category aggregations), so if you’ve applied filters, the exported file reflects those changes.

Understand multilingual support for topics

Topics is a multilingual feature. It supports every language enabled for your AI Agent.

Example: Let’s say you have an AI Agent that supports French and Spanish, as well as English, and a topic called price is generated. In addition to the keyword price, prix and precio would also track the keyword in French and Spanish.

Though Conversation Topics offers multilingual support, topic labels, summaries, and descriptions are only in English.