Voice Agent API

New Features

🤖 Expanded LLM Support

We’ve significantly expanded our LLM options across our two pricing tiers. The following LLMs are now available for use:

Standard Models

  • OpenAI GPT-4.1 mini
  • OpenAI GPT-4.1 nano
  • OpenAI GPT-4o mini
  • Anthropic Claude Haiku 3.5

Advanced Models

  • OpenAI GPT-4.1
  • OpenAI GPT-4o
  • Anthropic Claude Sonnet 4

For complete information about supported LLMs, visit our Voice Agent LLM Models documentation or try them out in our API Playground.

🌍 Spanish Language Support

Voice Agents now support Spanish conversations with the addition of Aura-2 Spanish TTS. Configure your agent’s language settings to enable Spanish voice interactions.

See our Voice Agent API documentation for implementation details.

💬 Conversation Context Feature

Introducing comprehensive conversation continuity with our new context feature:

Complete Context Awareness

  • Agents maintain conversation history across sessions
  • Seamless continuation of previous interactions

Enhanced User Experience

  • More natural conversations with historical context
  • Consistent interaction patterns across sessions

Flexible Implementation

  • Support for both conversational and function call history
  • Configurable history settings
Implementation

Use the agent.context object to provide conversation history when starting new sessions:

Conversational Messages:

{
"type": "History",
"role": "user" | "assistant",
"content": "message text"
}

Function Call Messages:

{
"type": "History",
"function_calls": [{
"id": "unique_id",
"name": "function_name",
"client_side": true/false,
"arguments": "json_string",
"response": "response_text"
}]
}

To disable function call history, set settings.flags.history to false in the Settings message.

Documentation

🔍 Enhanced Error Visibility

We’ve improved client-side visibility of LLM and TTS errors to provide better debugging and user experience.