Speaker Diarization

Diarization Models

Deepgram offers versioned diarization models. Use the diarize_model parameter to select a specific version:

Choosing a Model

• New integrations: Use diarize_model=latest to always get the newest available diarizer.
• Pin a specific version: Use diarize_model=v1 or diarize_model=v2.
• Streaming: diarize_model is not accepted on streaming. Use diarize=true for streaming diarization (see Streaming below).

Enable Feature

Using diarize_model (recommended)

Use the diarize_model parameter to enable diarization and select the model version in a single parameter:

$
curl \
>
  --request POST \
>
  --header 'Authorization: Token YOUR_DEEPGRAM_API_KEY' \
>
  --header 'Content-Type: audio/wav' \
>
  --data-binary @youraudio.wav \
>
  --url 'https://api.deepgram.com/v1/listen?diarize_model=latest'

Using diarize (legacy)

The boolean diarize parameter continues to work and always routes to the v1 diarizer:

diarize=true

$
curl \
>
  --request POST \
>
  --header 'Authorization: Token YOUR_DEEPGRAM_API_KEY' \
>
  --header 'Content-Type: audio/wav' \
>
  --data-binary @youraudio.wav \
>
  --url 'https://api.deepgram.com/v1/listen?diarize=true'

Versioning Behavior

To use the new versioned diarizer on batch requests, switch your diarize=true requests to diarize_model (use latest for most cases). Don’t set both diarize and diarize_model — requests that set both are rejected.

Model Compatibility

Diarization is compatible with all Nova batch models (Nova-1, Nova-2, Nova-3) as well as enhanced and base. Whisper is not supported.

Streaming

diarize_model is not accepted on streaming requests and returns 400 regardless of value. For streaming diarization, use the legacy diarize=true parameter, which routes to the v1 streaming diarizer.

Analyze Response

When the file is finished processing, you’ll receive a JSON response. Let’s look more closely at the words object within the alternatives object within this response.

Pre-Recorded

When using diarization for pre-recorded audio, both speaker and speaker_confidence values will be returned:

1
...
2
"alternatives":[
3
  {
4
    ...
5
    "words": [
6
      {
7
        "word":"hello",
8
        "start":15.259043,
9
        "end":15.338787,
10
        "confidence":0.9721591,
11
        "speaker":0,
12
        "speaker_confidence":0.5853265
13
      },
14
    ...
15
    ]
16
  }
17
]

Live Streaming

When using diarization for live streaming audio, only the speaker value will be returned:

1
...
2
"alternatives":[
3
  {
4
    ...
5
    "words": [
6
      {
7
        "word":"hello",
8
        "start":15.259043,
9
        "end":15.338787,
10
        "confidence":0.9721591,
11
        "speaker":0
12
      },
13
    ...
14
    ]
15
  }
16
]

Format Response

To improve readability, you can use a JSON processor to parse the JSON. In this example, we use JQ and further improve readability by turning on Deepgram’s punctuation and utterances features:

$
curl \
>
  --request POST \
>
  --url 'https://api.deepgram.com/v1/listen?diarize_model=latest&punctuate=true&utterances=true' \
>
  --header 'Authorization: Token YOUR_DEEPGRAM_API_KEY' \
>
  --header 'content-type: audio/mp3' \
>
  --data-binary @Premier_broken-phone_numbers.mp3 | jq -r ".results.utterances[] | \"[Speaker:\(.speaker)] \(.transcript)\""

When the file is finished processing, you’ll receive the following response:

[Speaker:0] Hello, and thank you for calling premier phone service. Please be aware that this call may be recorded for quality and training purposes.
[Speaker:0] My name is Beth, and I will be assisting you today. How are you doing?
[Speaker:1] Not too bad. How are you today?
[Speaker:0] I'm doing well. Thank you. May I please have your name?
[Speaker:1] My name is Blake...

What’s Next

• Understanding When to Use the Multichannel and Diarization Features