Skip to main content

llm-d Infrastructure Providers

This directory contains documentation specific to each Kubernetes provider for deploying llm-d, as well as troubleshooting and known issues.

Other providers

To add a new infrastructure provider to our well-lit paths, we request the following support:

  • Documentation on configuring the platform to support one or more well-lit path guides
  • The appropriate configuration contributed to the guide to deal with provider-specific variations
  • An automated test environment that validates the supported guides
  • At least one documented platform maintainer who responds to GitHub issues and is available for regular discussion in the llm-d slack channel #sig-installation.