🎉 llm-d 0.10 is here! Operational hardening and production readiness: safer rollouts, signed release images, vLLM 0.30, and a published test matrix for every well-lit path. Read the docs →
This is documentation for llm-d v0.7, which is no longer actively maintained.
For up-to-date documentation, see the latest version (v0.10 (latest)).