Interactive Testing lets you engage with your AI Agent in real time, so you can experience exactly how it responds to your end users’ inquiries.
Interactive Testing differs from Simulations, which run saved test cases at scale with automated pass/fail evaluation against expected outcomes.
Use Interactive Testing for quick checks, multi-turn exploration, and qualitative validation.
Before deploying changes to end users, you can use Interactive Testing to validate your AI Agent’s behavior. The test chat simulates a real conversation, allowing you to verify responses, test different user scenarios, and confirm that your configuration works as expected.
With Interactive Testing, you can:
Interactive Testing supports the following workflows:
test_user variable to validate updates before publishing.Interactive Testing offers several capabilities for testing conversations and can be configured to match different scenarios.
The test chat provides options for flexible testing across different contexts.
To open the test chat in a new window or another browser, click the More options icon
.
Before you launch your AI Agent, share the test URL and get feedback from stakeholders across your organization!
If you’ve tailored your AI Agent’s content to different users based on Variables, you can set those variables in the test chat to simulate different end-user segments.
You can’t simulate user types using sensitive variables.
The test chat follows your configured persistence settings. When you reset the chat, it behaves according to these settings.
Get started with Interactive Testing in just a few steps. For detailed instructions, see Implementation & usage.
Start Interactive Testing, preview changes, simulate user types, and manage test sessions.
Once you’ve connected your knowledge base to your AI Agent, you can begin Interactive Testing.
To start a test session:
You can preview a change before exposing it to end users by restricting the change’s availability to test sessions.
To test a change before publishing:
test_user.test_user.You can set variables in the test chat to simulate different end-user segments and verify that responses are personalized correctly.
To impersonate a user type:
In the test chat, click the User icon beside the top of the test chat.
In the Set test variables window, set the variables corresponding to the user type you’d like to test, and start chatting with your AI Agent.
If you start typing a variable value, you can see a list of values from previous conversation data. For example, if you’re using the region variable, any values stored in region from previous conversations will appear as options. You can click one of these options to select it, or continue typing to enter a different value.
You can reset the test chat to start a new session or exit when finished.
To reset the test chat:
To end the test chat: