edit_agent_config

Creates, updates, enables, disables, or deletes an AI Agent’s settings, and triggers test runs. Changes apply immediately.

Settings are the entities that support measuring and testing an Agent rather than changing how it behaves. Edits to Agent behavior — knowledge articles, coaching, Playbooks, Actions, and custom instructions — are staged on a change set through edit_agent_behavior instead.

This tool was previously named propose_change. Behavior entities were moved to edit_agent_behavior so that changes affecting live conversations are staged and tested before going live.

Call get_improvement_guide before proposing changes so the assistant chooses the right entity type and follows Ada’s recommended improvement workflow.

Example prompts

“Create a test case from this failed conversation so we catch regressions on the refund flow.”
“Run tests for all my billing-related test cases.”
“Run my refund test cases against the change I just staged.”
“Create a knowledge source called ‘HR Policies’ so I can file our SharePoint documents into it.”

Parameters

Parameter	Type	Description
`entity_type`	string	The entity to change.
`operation`	string	What to do. Valid operations depend on `entity_type`.
`entity_id`	string	Required for `update` and `delete`. The ID of the target entity.
`fields`	object	Omit to discover the fields available for an `entity_type` and `operation`. Required for operations that need field values. Keys must match the schema the tool returns.
`confirmed`	boolean	Omit or `false` to receive a preview of the change. Set to `true` only after the change has been explicitly approved.

Supported entity types

Entity type	Covers
`test_case`	Test cases used to evaluate Agent responses.
`test_run`	Execution of one or more test cases.
`topic`	Conversation topics.
`intent`	Intents.
`custom_metric`	Custom metrics.
`scorecard`	Scorecards.
`glossary_term`	Custom Glossary terms.
`knowledge_source`	Knowledge sources that group articles on the Knowledge page. Create only.

The entity types offered depend on which features are enabled for the Agent. Call the tool without fields to see the fields available for a given entity type and operation, and use send_feedback if a capability you need is missing.

Calling an unsupported entity_type and operation combination returns an explicit “not supported” error.

Test cases

Each test case describes how the AI Agent should respond to a specific scenario and what evaluation criteria determine a pass or fail.

Field	Type	Required	Description
`name`	string	Yes (create)	Descriptive name for the test case. Max 256 characters.
`user_message`	string	Yes (create)	The simulated user message sent to the Agent. Max 1024 characters.
`success_criteria`	array of strings	Yes (create)	Criteria used to evaluate the Agent’s response. At least one required. Each criterion is evaluated independently. Max 2048 characters per criterion.
`language`	string	Yes (create)	Language code for the test case (for example, `en`, `fr`).
`channel_id`	string	No	Channel ID to run the test on. Use `list_entities` with `entity_type='channels'` to find IDs.
`variables`	array	No	Variable overrides, as objects with `variable_id` and `value`. Use `list_entities` with `entity_type='variables'` to find IDs.
`scenario_goal`	string	Conditional	The end user’s goal for a multi-turn conversation (for example, “Return a jacket I bought last week”). When provided, the test simulates a full multi-turn exchange instead of a single-turn exchange. Requires the multi-turn simulations feature.

On update, every field is optional. Pass the test case ID via entity_id. On delete, no fields are needed — pass only entity_id.

Test runs

Creating a test_run triggers execution for the specified test case IDs. Use get_test_runs afterward to retrieve pass/fail status, evaluation criteria outcomes, and rationale.

Field	Type	Required	Description
`test_case_ids`	array of strings	Yes	IDs of the test cases to execute. Use `get_test_cases` to find existing test cases, or create them with this tool first.
`changeset_id`	string	No	Runs the tests against a change set instead of the live Agent. Every entity in the simulated conversation uses the staged values, so the test exercises the proposed Agent rather than the live one. Omit to test against the live Agent.

changeset_id belongs inside fields, alongside test_case_ids. One test run targets one change set. Find change set IDs with list_agent_changesets.

Simulations shows each test case’s latest result across live and change set runs. Retrieve their results with get_test_runs.

Knowledge sources

A knowledge source groups articles on the Sources tab of the Knowledge page. Create one here, then file articles into it with edit_agent_behavior by passing its id as knowledge_source_id. Articles authored without a knowledge_source_id land in the default source, Created in Ada.

Field	Type	Required	Description
`name`	string	Yes	Display name shown on the Knowledge page. Names are case-sensitive and unique per Agent — `HR Policies` and `hr policies` are two different sources. Check `list_entities` with `entity_type='knowledge_sources'` first to reuse an existing source instead of creating a near-duplicate.
`external_id`	string	No	Your own stable identifier for the source, 1–160 characters. This is the ID the Knowledge API addresses the source by. Defaults to the source’s Ada ID when omitted. A value another source on the Agent already uses is refused.
`metadata`	object	No	Arbitrary key/value pairs for your own bookkeeping. Ada does not read them.

The response returns the new source’s id, name, external_id, status, last_sync, and metadata. Use id with Ada MCP tools and external_id with the Knowledge API.

Only create is offered. Rename or delete a source through the Knowledge API. Deleting a source removes every article in it, so it is deliberately not exposed here.