DEV Community

Damian Simon Peter
Damian Simon Peter

Posted on

Run LLMs Locally: No API, No Cloud

I recently experimented with on-device LLM, and the results were nothing short of amazing. I’m genuinely impressed and starting to believe this could be the future of AI.

You can check out the source code here and read more about it in my Medium publication.

Top comments (0)

A Workflow Copilot. Tailored to You.

Pieces.app image

Our desktop app, with its intelligent copilot, streamlines coding by generating snippets, extracting code from screenshots, and accelerating problem-solving.

Read the docs

👋 Kindness is contagious

Please leave a ❤️ or a friendly comment on this post if you found it helpful!

Okay