For AI agents: a documentation index is available at the root level at /llms.txt and /llms-full.txt. Append /llms.txt to any URL for a page-level index, or .md for the markdown version of any page.
Ask AIPlaygroundLoginFree API Key
HomeAPI ReferenceVoice AgentSpeech-to-TextText-to-SpeechIntelligenceSelf-Hosted Deployments
HomeAPI ReferenceVoice AgentSpeech-to-TextText-to-SpeechIntelligenceSelf-Hosted Deployments
    • Introduction
    • Deployment Environments
  • Amazon SageMaker
  • Docker/Podman
      • Amazon Web Services
      • Google Cloud Platform
      • Oracle Cloud Infrastructure
      • Microsoft Azure
      • Bare-Metal Servers
    • Drivers and Container Orchestration Tools
  • Kubernetes
    • Securing Your Cluster
    • Troubleshooting
  • Deployment
    • Self Service Licensing & Credentials
    • Deploy STT Services
    • Deploy Flux Model (STT)
    • Deploy TTS Services
    • Deploy Voice Agent
    • Status Endpoint
    • Certificate Status
  • Partner Deployment
  • Scaling and Deployment Strategies
    • System Maintenance
    • Blue-Green Deployment
    • Auto-Scaling
    • Metrics Guide
    • Ingress Authentication
    • Redact Usage
    • Log Formats
    • Using Private Container Registries
  • Features
    • Smart Formatting
  • Self-Hosted Add Ons
    • License Proxy
    • Prometheus Integration
    • Deepgram UniMRCP Plugin
    • Using SDKs with Self-Hosted
LogoLogo
Ask AIPlaygroundLoginFree API Key
Docker/PodmanPlatform Options

Bare-Metal Servers

With Docker/Podman

Bare-metal servers are physical servers dedicated to a single tenant. Unlike shared hosting or virtualized servers, bare-metal servers provide exclusive access and control to the user, allowing full utilization of the server’s processing power, memory, and storage.

Bare-metal servers are often used for high-performance computing, machine learning, and big data analytics workloads that require a lot of resources and consistent performance. They are common in industries with strict compliance requirements as the exclusive access reduces potential security risks.

They eliminate the “noisy neighbor” issue prevalent in shared servers where other users’ activities can impact performance. Also, they offer consistent performance as there is no hypervisor layer, which in other server types manages the creation, running, and management of virtual machines.

For optimal performance, see our minimum recommended hardware specifications.

The overhead of managing a bare-metal server can be arduous, and the majority of our clients choose to use cloud-managed servers for this reason. If you do choose to manage a bare-metal server, make sure to complete the steps in the self-hosted introduction before proceeding, and install a recommended Linux distribution.

What’s Next

With your new server and Linux OS installed, we need to start configuring it for inference.

  • Drivers and Containerization Platforms
Was this page helpful?
Previous

Drivers and Container Orchestration Tools

With Docker/Podman

Next
Built with