DEV Community

0 seconds of 46 minutes, 17 secondsVolume 90%
Press shift question mark to access a list of keyboard shortcuts
00:00
00:00
46:17
 
Jimmy Guerrero for Voxel51

Posted on

Computer Vision Meetup: Do It Yourself LLMs

In this talk, Charles Frye gives a guided tour through the components of a self-hosted LLM service, from hardware considerations to engineering tools like ‘evals,’ all the way to the application layer. We’ll consider the open weights models, open source software, and infrastructure that power LLM applications. He will heavily shill the open source vLLM project.

About the Speaker

Charles Frye builds applications of neural networks at Modal. He got his PhD at Berkeley for work on neural network optimization. He previously worked at Weights & Biases and Full Stack Deep Learning.

Top comments (0)

A Workflow Copilot. Tailored to You.

Pieces.app image

Our desktop app, with its intelligent copilot, streamlines coding by generating snippets, extracting code from screenshots, and accelerating problem-solving.

Read the docs

👋 Kindness is contagious

Dive into an ocean of knowledge with this thought-provoking post, revered deeply within the supportive DEV Community. Developers of all levels are welcome to join and enhance our collective intelligence.

Saying a simple "thank you" can brighten someone's day. Share your gratitude in the comments below!

On DEV, sharing ideas eases our path and fortifies our community connections. Found this helpful? Sending a quick thanks to the author can be profoundly valued.

Okay