Run your own local models and agents using vLLM w/ Cedric Clyburn

Learn how to run open-weight AI models and power local agents, like AI coding tools, using vLLM, an open-source and high-performance inference engine. We’ll cover how to optimize models, expose them via OpenAI-compatible APIs, and tune runtime settings to maximize performance on constrained hardware. We’ll also run live benchmarks to inspect token throughput and balance latency trade-offs, which can be done using any AI serving tool.

Tune in to the full event

DEV Community is partnering to bring live events to the community. Join us or dismiss this billboard if you're not interested. ❤️