Well-Lit Paths

Well-lit paths are curated, end-to-end guides for llm-d's native inference patterns, intelligent routing algorithms, and runtime traffic regulation engines.

These guides are organized into three pillars:

Foundations

Individual functional features, sophisticated routing algorithms, and physical inference execution paths.

Models

Benchmarked, fully tuned production recipes for serving a state-of-the-art model on a specific accelerator, composing several foundations into one deployment.

Operations

Fleet operations that apply to any well-lit path — autoscaling, fast model actuation, flow control, multi-model routing, batch serving, and rollouts.