Release notes

An AI assistant connected over the MCP server can now compare a change set’s performance against baseline in one call. Baseline is the set of conversations your live AI Agent handles, not attributed to any change set.

The new compare_changeset_metrics tool takes a change set ID and a date range. It returns baseline and change set side-by-side for containment_rate, resolution_rate, csat_rate, and each enabled custom metric pass rate. Each metric row includes the absolute difference and the difference relative to baseline. Cohort conversation volume is included.

Before, an assistant called get_ada_metric twice per metric and aligned the results itself. One call now returns every metric for both cohorts with the difference computed.