DEV Community

0 seconds of 46 minutes, 17 secondsVolume 90%
Press shift question mark to access a list of keyboard shortcuts
00:00
00:00
46:17
 
Jimmy Guerrero for Voxel51

Posted on

Computer Vision Meetup: Do It Yourself LLMs

In this talk, Charles Frye gives a guided tour through the components of a self-hosted LLM service, from hardware considerations to engineering tools like ‘evals,’ all the way to the application layer. We’ll consider the open weights models, open source software, and infrastructure that power LLM applications. He will heavily shill the open source vLLM project.

About the Speaker

Charles Frye builds applications of neural networks at Modal. He got his PhD at Berkeley for work on neural network optimization. He previously worked at Weights & Biases and Full Stack Deep Learning.

Top comments (0)

A Workflow Copilot. Tailored to You.

Pieces.app image

Our desktop app, with its intelligent copilot, streamlines coding by generating snippets, extracting code from screenshots, and accelerating problem-solving.

Read the docs

👋 Kindness is contagious

Please leave a ❤️ or a friendly comment on this post if you found it helpful!

Okay