Voice Agent API

New Features

🤖 Expanded LLM Support

We’ve significantly expanded our LLM options across our two pricing tiers. The following LLMs are now available for use:

Standard Models

  • OpenAI GPT-4.1 mini
  • OpenAI GPT-4.1 nano
  • OpenAI GPT-4o mini
  • Anthropic Claude Haiku 3.5

Advanced Models

  • OpenAI GPT-4.1
  • OpenAI GPT-4o
  • Anthropic Claude Sonnet 4

For complete information about supported LLMs, visit our Voice Agent LLM Models documentation or try them out in our API Playground.

🌍 Spanish Language Support

Voice Agents now support Spanish conversations with the addition of Aura-2 Spanish TTS. Configure your agent’s language settings to enable Spanish voice interactions.

See our Voice Agent API documentation for implementation details.

💬 Conversation Context Feature

Introducing comprehensive conversation continuity with our new context feature:

Complete Context Awareness

  • Agents maintain conversation history across sessions
  • Seamless continuation of previous interactions

Enhanced User Experience

  • More natural conversations with historical context
  • Consistent interaction patterns across sessions

Flexible Implementation

  • Support for both conversational and function call history
  • Configurable history settings
Implementation

Use the agent.context object to provide conversation history when starting new sessions:

Conversational Messages:

1{
2 "type": "History",
3 "role": "user" | "assistant",
4 "content": "message text"
5}

Function Call Messages:

1{
2 "type": "History",
3 "function_calls": [{
4 "id": "unique_id",
5 "name": "function_name",
6 "client_side": true/false,
7 "arguments": "json_string",
8 "response": "response_text"
9 }]
10}

To disable function call history, set settings.flags.history to false in the Settings message.

Documentation

🔍 Enhanced Error Visibility

We’ve improved client-side visibility of LLM and TTS errors to provide better debugging and user experience.