Deepgram LLMs overview
Deepgram-hosted LLMs for voice agents, served from the /v1/think endpoint. Early Access.
Deepgram LLMs are language models that Deepgram hosts for voice workloads. You send a conversation to POST https://agent.deepgram.com/v1/think and get the next assistant message back, either as a single JSON response or as a stream of server-sent events. They are in Early Access; read the terms below before you build.
Think-Fast is also available inside the Voice Agent API: select it with the deepgram think provider, or call it directly to use it in your own pipeline.
Models
See Models overview for how the models compare. To send your first request, see Getting started.
Early Access
Deepgram LLMs are in Early Access. Before you build on them, know what that means:
- Who can use them: current Deepgram contract customers whose projects are enrolled in the Early Access program. Talk to sales for access.
- What can change: request fields, response details, model IDs, and limits can change before general availability (GA), with little notice. Do not run production traffic on these models.
- Where they run: the global endpoint only. Regional endpoints are coming soon.
- SDKs: Deepgram SDKs do not support these models yet. SDK support is planned for GA. Call the endpoint with any HTTP client.
- Data: Think-Fast can only be used with the Model Improvement Program, so every Think-Fast request is stored for model training and abuse monitoring. phoneLLM mini requests can opt out. See Data retention and MIP.
- Price: free during Early Access.
Features
- Streaming and non-streaming responses. Set
stream: trueto receive tokens as server-sent events. - Function calling. Define function tools and pass tool-call history back across turns.
- Generation controls. Tune
temperatureandreasoning_effortper request. - Voice Agent and custom pipelines. Use the models inside the Voice Agent API or in your own STT, LLM, and TTS loop.