Update Retell LLM
Update an existing Retell LLM Response Engine
Authorizations
Authentication header containing API key (find it in dashboard). The format is "Bearer YOUR_API_KEY"
Path Parameters
Unique id of the Retell LLM Response Engine to be updated.
"16b980523634a6dc504898cda492e939"
Query Parameters
Optional version of the API to use for this request. Default to latest version.
1
Body
Override properties for Retell LLM configuration in agent override requests.
Model settings for the response engine. type decides which models primary and backup accept. On update, each top-level key replaces the current one and omitted keys are kept; set backup to null to remove it. Changing type requires primary and clears backup, while temperature carries over. In agent_override, type is required whenever primary is set, and backup cannot be removed.
- Option 1
- Option 2
Deprecated, use model_config.primary. Ignored when model_config is set.
gpt-4.1, gpt-4.1-mini, gpt-5, gpt-5-mini, gpt-5-nano, gpt-5.1, gpt-5.2, gpt-5.4, gpt-5.4-mini, gpt-5.4-nano, gpt-5.5, gpt-5.6-terra, gpt-5.6-luna, gpt-6-astra, gpt-6-sol, gpt-6.1-sol, gpt-6-luna, claude-4.6-sonnet, claude-5-opus, claude-5.5-opus, claude-5-sonnet, claude-5.5-sonnet, claude-5.5-haiku, claude-4.5-haiku, gemini-3.0-flash, gemini-3.1-flash-lite, gemini-3.5-flash, gemini-3.5-flash-lite, gemini-3.6-flash, gemini-3.7-flash, gemini-3.8-flash, gemini-4-argon, null "gpt-5.6-terra"
Deprecated, use model_config with type s2s. Ignored when model_config is set.
gpt-realtime-2.1, gpt-realtime-2.1-mini, gpt-realtime-2, gpt-realtime-1.5, gpt-realtime, gpt-realtime-mini, null "gpt-realtime-1.5"
Deprecated, use model_config.temperature. Ignored when model_config is set.
0
Deprecated, use model_config.primary.tier fast. Ignored when model_config is set.
true
Deprecated, use model_config.primary.tier ultrafast. Ignored when model_config is set.
true
Whether to use strict mode for tool calls. Only applicable when using certain supported models.
true
A list of knowledge base ids to use for this resource.
Knowledge base configuration for RAG retrieval.
The speaker who starts the conversation. Required. Must be either 'user' or 'agent'.
user, agent If set, the AI will begin the conversation after waiting for the user for the duration (in milliseconds) specified by this attribute. This only applies if the agent is configured to wait for the user to speak first. If not set, the agent will wait indefinitely for the user to speak.
2000
First utterance said by the agent in the call. If not set, LLM will dynamically generate a message. If set to "", agent will wait for user to speak first.
"Hey I am a virtual assistant calling from Retell Hospital."
General prompt appended to system prompt no matter what state the agent is in.
- System prompt (with state) = general prompt + state prompt.
- System prompt (no state) = general prompt.
"You are ..."
A list of tools the model may call (to get external knowledge, call API, etc). You can select from some common predefined tools like end call, transfer call, etc; or you can create your own custom tool for the LLM to use.
- Tools of LLM (with state) = general tools + state tools + state transitions
- Tools of LLM (no state) = general tools
- Option 1
- Option 2
- Option 3
- Option 4
- Option 5
- Option 6
- Option 7
- Option 8
- Option 9
- Option 10
- Option 11
- Option 12
States of the LLM. This is to help reduce prompt length and tool choices when the call can be broken into distinct states. With shorter prompts and less tools, the LLM can better focus and follow the rules, minimizing hallucination. If this field is not set, the agent would only have general prompt and general tools (essentially one state).
Name of the starting state. Required if states is not empty.
"information_collection"
Default dynamic variables represented as key-value pairs of strings. These are injected into your Retell LLM prompt and tool description when specific values are not provided in a request. Only applicable for Retell LLM.
A list of MCPs to use for this LLM.
Whether this Retell LLM is used for warm transfer. Can only be set at creation, and is ignored on update.
false
Response
Successfully updated an Retell LLM Response Engine.
Override properties for Retell LLM configuration in agent override requests.
Unique id of Retell LLM Response Engine.
"oBeDLoLOeuAbiuaMFXRtDOLriTJ5tSxD"
Last modification timestamp (milliseconds since epoch). Either the time of last update or creation if no updates available.
1703413636133
Version of the Retell LLM Response Engine.
0
Whether the Retell LLM Response Engine is published.
false
Model settings for the response engine. type decides which models primary and backup accept. On update, each top-level key replaces the current one and omitted keys are kept; set backup to null to remove it. Changing type requires primary and clears backup, while temperature carries over. In agent_override, type is required whenever primary is set, and backup cannot be removed.
- Option 1
- Option 2
Deprecated, use model_config.primary. Ignored when model_config is set.
gpt-4.1, gpt-4.1-mini, gpt-5, gpt-5-mini, gpt-5-nano, gpt-5.1, gpt-5.2, gpt-5.4, gpt-5.4-mini, gpt-5.4-nano, gpt-5.5, gpt-5.6-terra, gpt-5.6-luna, gpt-6-astra, gpt-6-sol, gpt-6.1-sol, gpt-6-luna, claude-4.6-sonnet, claude-5-opus, claude-5.5-opus, claude-5-sonnet, claude-5.5-sonnet, claude-5.5-haiku, claude-4.5-haiku, gemini-3.0-flash, gemini-3.1-flash-lite, gemini-3.5-flash, gemini-3.5-flash-lite, gemini-3.6-flash, gemini-3.7-flash, gemini-3.8-flash, gemini-4-argon, null "gpt-5.6-terra"
Deprecated, use model_config with type s2s. Ignored when model_config is set.
gpt-realtime-2.1, gpt-realtime-2.1-mini, gpt-realtime-2, gpt-realtime-1.5, gpt-realtime, gpt-realtime-mini, null "gpt-realtime-1.5"
Deprecated, use model_config.temperature. Ignored when model_config is set.
0
Deprecated, use model_config.primary.tier fast. Ignored when model_config is set.
true
Deprecated, use model_config.primary.tier ultrafast. Ignored when model_config is set.
true
Whether to use strict mode for tool calls. Only applicable when using certain supported models.
true
A list of knowledge base ids to use for this resource.
Knowledge base configuration for RAG retrieval.
The speaker who starts the conversation. Required. Must be either 'user' or 'agent'.
user, agent If set, the AI will begin the conversation after waiting for the user for the duration (in milliseconds) specified by this attribute. This only applies if the agent is configured to wait for the user to speak first. If not set, the agent will wait indefinitely for the user to speak.
2000
First utterance said by the agent in the call. If not set, LLM will dynamically generate a message. If set to "", agent will wait for user to speak first.
"Hey I am a virtual assistant calling from Retell Hospital."
General prompt appended to system prompt no matter what state the agent is in.
- System prompt (with state) = general prompt + state prompt.
- System prompt (no state) = general prompt.
"You are ..."
A list of tools the model may call (to get external knowledge, call API, etc). You can select from some common predefined tools like end call, transfer call, etc; or you can create your own custom tool for the LLM to use.
- Tools of LLM (with state) = general tools + state tools + state transitions
- Tools of LLM (no state) = general tools
- Option 1
- Option 2
- Option 3
- Option 4
- Option 5
- Option 6
- Option 7
- Option 8
- Option 9
- Option 10
- Option 11
- Option 12
States of the LLM. This is to help reduce prompt length and tool choices when the call can be broken into distinct states. With shorter prompts and less tools, the LLM can better focus and follow the rules, minimizing hallucination. If this field is not set, the agent would only have general prompt and general tools (essentially one state).
Name of the starting state. Required if states is not empty.
"information_collection"
Default dynamic variables represented as key-value pairs of strings. These are injected into your Retell LLM prompt and tool description when specific values are not provided in a request. Only applicable for Retell LLM.
A list of MCPs to use for this LLM.
Whether this Retell LLM is used for warm transfer. Can only be set at creation, and is ignored on update.
false

