llm-d-infra

This repository includes examples, Helm charts, and release assets for llm-d-infra:

• Quickstarts for deploying infrastructure and a model
  • See quickstart/examples
• Quickstarts for interacting with a running deployment
  • See quickstart/interactive-pod
• Helm charts for deploying llm-d-infra
  • See charts/llm-d-infra/README.md
• Release assets for running llm-d
  • See release notes

License

This project is licensed under the Apache License 2.0. See the LICENSE file for details.

Content Source

This content is automatically synced from README.md in the llm-d-incubation/llm-d-infra repository.

📝 To suggest changes, please edit the source file or create an issue.