DEV Community

Cover image for everything-rag: LLMs with your data, locally
Astra Bertelli
Astra Bertelli

Posted on

everything-rag: LLMs with your data, locally

๐—”๐—น๐˜„๐—ฎ๐˜†๐˜€ ๐˜„๐—ฎ๐—ป๐˜๐—ฒ๐—ฑ ๐˜๐—ผ ๐—ฐ๐—ต๐—ฎ๐˜ ๐˜„๐—ถ๐˜๐—ต ๐˜†๐—ผ๐˜‚๐—ฟ ๐—ฝ๐—ฑ๐—ณ๐˜€ ๐—ถ๐—ป ๐—ฎ ๐˜€๐—ถ๐—บ๐—ฝ๐—น๐—ฒ ๐—ฎ๐—ป๐—ฑ ๐—ฒ๐—ฎ๐˜€๐—ถ๐—น๐˜†-๐—ฎ๐—ฐ๐—ฐ๐—ฒ๐˜€๐˜€๐—ถ๐—ฏ๐—น๐—ฒ ๐˜„๐—ฎ๐˜†?

Now you can! I am thrilled to introduce ๐—ฒ๐˜ƒ๐—ฒ๐—ฟ๐˜†๐˜๐—ต๐—ถ๐—ป๐—ด-๐—ฟ๐—ฎ๐—ด, your fully customizable and local chatbot assistant! ๐Ÿค–

๐—ง๐—Ÿ;๐——๐—ฅ:
You do not want to read this post but you want to start getting your hands dirty?

Check out the online HuggingFace space built for everything-rag!

With everything-rag, you can:

  • Use virtually any LLM you want
  • Use your own data: everything-rag can work with any pdf you provide, whether it's about data sciences or pallas' cats!๐Ÿˆ
  • Enjoy 100% local and 100% free functionality: no hosted APIs or pay-as-you-go services.
  • Exploit Retrieval Augmented Generation
  • Simple installation through Docker image

This is completely free to use and runs on your local computer!

Make sure to check out (and leave a little โญ if you please) the GitHub repo, have a look to my blog post about the importance of open-source LLMs and, also, do not forget to sponsor me on GitHub if you please!

Inspired by Jan.ai (for local LLM development) and Cheshire Cat AI (for the elegant dockerized installation workflow).

Shout-outs to Hugging Face (LLM support and Online space), Gradio (app interface), Langchain (retrieval architecture), Chroma (vectorized databases architecture), Docker and GitHub (docker image distribution and hosting) for having made everything-rag possible!

And stay tuned, more features are coming in the future!๐Ÿš€

Top comments (0)