June 3, 2025

llm-d Week 1+2 Project News Round-Up

Hey, the llm-d project team has been really busy after the launch on May 20.

We've hit 1000 ⭐️'s on GitHub

Here are some of the active design conversations:

Join our Google Group

We use Google Groups to share architecture diagrams and other content. Please join: llm-d-contributors Google Group

• 2025-06-01 [PUBLIC] llm-d KVTransfer Protocol
• Revisiting The InferenceModel API
• ModelService: Declarative Inference Serving on llm-d
• [External] Standardizing Large Model Server Metrics in Kubernetes
• [PUBLIC] LLM Workloads
• [Public] LLM-D Inference Scheduler Roadmap

Project links for those wanting to track us or get involved:

• Project Launch
• Contributor Guidelines
• Project Calendar
  • All SIG meetings
  • Weekly Community Meeting, every Wednesday @ 12:30pm Eastern Time
• Join the llm-d Google group - this is where all engineering drafts are shared. You must join the group to have access to project google docs.
• Join Slack
• llm-d Roadmap for Q2

Where to follow us on Social Media

• https://llm-d.ai
• LinkedIn
• @_llm_d_
• r/llm_d
• YouTube - coming soon