Changelogs

Self Hosted

September 27, 2024

Container Images Release

Container Images (release 240927)

  • quay.io/deepgram/self-hosted-api:release-240927

    • Equivalent image to:
      • quay.io/deepgram/self-hosted-api:1.120.3
      • quay.io/deepgram/onprem-api:release-240927
      • quay.io/deepgram/onprem-api:1.120.3

  • quay.io/deepgram/self-hosted-engine:release-240927

    • Equivalent image to:

      • quay.io/deepgram/self-hosted-engine:3.74.3-6
      • quay.io/deepgram/onprem-engine:release-240927
      • quay.io/deepgram/onprem-engine:3.74.3-6

    • Minimum required NVIDIA driver version: >=525.60.13

  • quay.io/deepgram/self-hosted-license-proxy:release-240927

    • Equivalent image to:
      • quay.io/deepgram/self-hosted-license-proxy:1.7.0
      • quay.io/deepgram/onprem-license-proxy:release-240927
      • quay.io/deepgram/onprem-license-proxy:1.7.0

  • quay.io/deepgram/self-hosted-billing:release-240927

    • Equivalent image to:
      • quay.io/deepgram/self-hosted-billing:1.10.0
      • quay.io/deepgram/onprem-billing:release-240927
      • quay.io/deepgram/onprem-billing:1.10.0

This Release Contains The Following Changes

  • Improves efficiency of streaming diarization.

  • Adds multichannel support for Finalize message.

  • Adds broader support in Engine container for model auto-loading during runtime.

    • Filesystems that don’t support inotify, such as nfs/csi PersistentVolumes in Kubernetes, can now load and unload models during runtime without requiring a Pod restart.

  • Enables the keyword-boosting feature for streaming by default.

  • Improves opt-in beta entity recognition and entity formatting.

  • Reminder: The Deepgram image repositories have been updated to reflect our “self-hosted” naming. Images should now be pulled from the self-hosted-* Quay repositories. For the next eleven months, both onprem-* and self-hosted-* image repositories will receive identical image updates monthly, and we will announce image tags in the self-hosted repositories. Subsequently, we will only publish new images to self-hosted-* repos, deprecating onprem-* repository variants.

  • Keeps our software up-to-date.