get_test_runs

Retrieves test run results for an AI Agent. Use this to review pass/fail status, evaluation criteria outcomes, and rationale after triggering a test_run via edit_agent_config.

Test runs pinned to a change set are retrieved here too. By default, the tool returns the latest run per test case and change set, including live runs. The results can include several runs for the same test case.

Simulations shows each test case’s latest result across live and change set runs.

Example prompts

“Show me the latest test run results for each of my test cases.”
“Which test cases failed in the last run, and why?”
“Get the full details for test run abc123.”

Parameters

Parameter	Type	Description
`test_run_id`	string	Optional. Return full details for a single test run.
`status_filter`	string	Optional. Limit to runs with a specific status (for example, `passed`, `failed`).
`test_case_ids`	array	Optional. Restrict results to runs for specific test case IDs.
`changeset_ids`	array of strings or nulls	Optional. Omit or pass `[]` for live runs and all change sets. Pass `[null]` or `["baseline"]` for live runs only. Pass change set IDs to select specific change sets. Include `null` or `"baseline"` in the same list to also include live runs.
`include_history`	boolean	Optional. Defaults to `false`, returning the latest run per test case and change set. Set to `true` to include matching historical runs.
`cursor`	string	Optional. Pagination cursor for historical run listings.

Response

Returns per-run results including:

Test run ID, test case ID, and change set ID. Live runs have a null change set ID.
Overall pass/fail status.
Per-evaluation-criterion outcomes and rationale.
The simulated conversation transcript the evaluation was based on.
Timestamps and the user who triggered the run.