edit_agent_config

Creates, updates, enables, disables, or deletes an AI Agent’s settings, and triggers test runs. Changes apply immediately.

Settings are the entities that support measuring and testing an Agent rather than changing how it behaves. Edits to Agent behavior — knowledge articles, coaching, Playbooks, Actions, and custom instructions — are staged on a change set through edit_agent_behavior instead.

This tool was previously named propose_change. Behavior entities were moved to edit_agent_behavior so that changes affecting live conversations are staged and tested before going live.

Call get_improvement_guide before proposing changes so the assistant chooses the right entity type and follows Ada’s recommended improvement workflow.

Example prompts

“Create a test case from this failed conversation so we catch regressions on the refund flow.”
“Run tests for all my billing-related test cases.”
“Run my refund test cases against the change I just staged.”

Parameters

Parameter	Type	Description
`entity_type`	string	The entity to change.
`operation`	string	What to do. Valid operations depend on `entity_type`.
`entity_id`	string	Required for `update` and `delete`. The ID of the target entity.
`fields`	object	Omit to discover the fields available for an `entity_type` and `operation`. Required for operations that need field values. Keys must match the schema the tool returns.
`confirmed`	boolean	Omit or `false` to receive a preview of the change. Set to `true` only after the change has been explicitly approved.

Supported entity types

Entity type	Covers
`test_case`	Test cases used to evaluate Agent responses.
`test_run`	Execution of one or more test cases.
`topic`	Conversation topics.
`intent`	Intents.
`custom_metric`	Custom metrics.
`scorecard`	Scorecards.
`glossary_term`	Custom Glossary terms.

The entity types offered depend on which features are enabled for the Agent. Call the tool without fields to see the fields available for a given entity type and operation, and use send_feedback if a capability you need is missing.

Calling an unsupported entity_type and operation combination returns an explicit “not supported” error.

Test cases

Each test case describes how the AI Agent should respond to a specific scenario and what evaluation criteria determine a pass or fail.

Field	Type	Required	Description
`name`	string	Yes (create)	Descriptive name for the test case. Max 256 characters.
`user_message`	string	Yes (create)	The simulated user message sent to the Agent. Max 1024 characters.
`success_criteria`	array of strings	Yes (create)	Criteria used to evaluate the Agent’s response. At least one required. Each criterion is evaluated independently. Max 2048 characters per criterion.
`language`	string	Yes (create)	Language code for the test case (for example, `en`, `fr`).
`channel_id`	string	No	Channel ID to run the test on. Use `list_entities` with `entity_type='channels'` to find IDs.
`variables`	array	No	Variable overrides, as objects with `variable_id` and `value`. Use `list_entities` with `entity_type='variables'` to find IDs.
`scenario_goal`	string	Conditional	The end user’s goal for a multi-turn conversation (for example, “Return a jacket I bought last week”). When provided, the test simulates a full multi-turn exchange instead of a single-turn exchange. Requires the multi-turn simulations feature.

On update, every field is optional. Pass the test case ID via entity_id. On delete, no fields are needed — pass only entity_id.

Test runs

Creating a test_run triggers execution for the specified test case IDs. Use get_test_runs afterward to retrieve pass/fail status, evaluation criteria outcomes, and rationale.

Field	Type	Required	Description
`test_case_ids`	array of strings	Yes	IDs of the test cases to execute. Use `get_test_cases` to find existing test cases, or create them with this tool first.
`changeset_id`	string	No	Runs the tests against a change set instead of the live Agent. Every entity in the simulated conversation uses the staged values, so the test exercises the proposed Agent rather than the live one. Omit to test against the live Agent.

changeset_id belongs inside fields, alongside test_case_ids. One test run targets one change set. Find change set IDs with list_agent_changesets.

Test runs pinned to a change set do not appear on the Simulations page in the dashboard, which stays focused on live, user-initiated runs. Retrieve their results with get_test_runs.