DEV Community

Cover image for Top 10 Open-Source RAG Frameworks you need!! 🧌

Top 10 Open-Source RAG Frameworks you need!! 🧌

Rohan Sharma on March 12, 2025

The capabilities of Large Language Models (LLMs) are enhanced by Retrieval-Augmented Generation (RAG). Thus, RAG comes up with a super powerful tec...
Collapse
 
rohan_sharma profile image
Rohan Sharma • Edited

Let me know if you want a blog on a specific framework!!
Thank you for reading!

Follow me on GH: github.com/RS-labhub

Collapse
 
komsenapati profile image
K Om Senapati

Langchain

Collapse
 
fyodorio profile image
Fyodor

Basically, everyone is trying to build their own RAG pipeline for their specific use case and then market them as a side gig... And I believe this abundance create analysis paralysis and as a result — creating another new RAG tool instead of selecting existing one 😅

In fact, I worked with llamaindex and in result needed to (re)implement some of their TS APIs because they were lacking at the moment. So all in all, implementing your own dedicated and specialized RAG tool is not such a bad idea actually (and not such a big deal too, depending on use case).

Collapse
 
srbhr profile image
Saurabh Rai

Basically, everyone is trying to build their own RAG pipeline for their specific use case and then market them as a side gig

LangChain and GPTIndex started this way when ChatGPT was released first. And now they've grown bigger.

Collapse
 
rohan_sharma profile image
Rohan Sharma

+1

Collapse
 
rohan_sharma profile image
Rohan Sharma

You're right.

depending on use case

This factor decides a lot! But it's still great to use the pre-built tools to save time. If they are missing a specific feature, do contribute to that as they are open-source. 😉

Collapse
 
akashjana profile image
Akash Jana

Great post! I don't how many times i will return to reread it to check them out..

Collapse
 
rohan_sharma profile image
Rohan Sharma

save it for later.. Ehehe 😉

Collapse
 
srbhr profile image
Saurabh Rai

Nice and detailed article. However, LlamaIndex and JinaAI are not RAG frameworks. They serve their purpose in a RAG or AI project pipeline/stack.

Collapse
 
rohan_sharma profile image
Rohan Sharma

yes, but they help developers build production RAG pipelines. And this is much needed! So, I put them in the RAG framework. However, they are ultimately a RAG framework.

Collapse
 
saksham65 profile image
saksham65

Thanks for including us!
Just to clarify, “LLM-App” is actually a set of ready-to-run AI pipelines built on top of Pathway’s core engine (rather than a standalone framework). It’s Docker-friendly, uses YAML-based configuration to define sources and pipeline logic, and stays continuously in sync with SharePoint, S3, databases, etc. We also have built-in indexing (vector/hybrid/full-text) for real-time search and RAG use cases.

If you’re curious about how it compares to other RAG solutions, feel free to check our in-depth comparison at pathway.com/rag-frameworks. Let us know if you have any questions—we’re always happy to help!

Collapse
 
rohan_sharma profile image
Rohan Sharma

Thank you Saksham for sharing this with us. But every framework is different and there are pros and cons in all of them. 😉

Collapse
 
hassan_bhatti_1d5f7fe550e profile image
Hassan Bhatti

This post provides an excellent introduction to RAG (Retrieval-Augmented Generation) frameworks and highlights their importance in enhancing LLM capabilities. The simplified explanation using a toy analogy makes it accessible even for beginners, while the step-by-step breakdown of RAG’s workflow effectively demonstrates its functionality.

The list of top open-source RAG frameworks is a valuable resource, starting with LLMWare.ai, which stands out due to its enterprise-friendly features like LLM orchestration, document processing, vector database integration, and custom fine-tuning. Its scalability and security make it particularly appealing for businesses looking to deploy AI-powered applications.

Collapse
 
rohan_sharma profile image
Rohan Sharma

Thank you, Hassan!

Also, LLMWare.ai is one of the best RAG Frameworks. You can try it and let me know the feedback.

Collapse
 
anmolbaranwal profile image
Anmol Baranwal

Awesome work man. I can see some really new ones here. 🔥 That table recap is nice too.

Collapse
 
rohan_sharma profile image
Rohan Sharma

Thank you, Anmol. (and thank you for always helping me)

I thought a summarized table would be great as this blog was a little longer to read. I'm glad that you liked it! 🙈

Collapse
 
shelar1423 profile image
Digvijay Shelar

Amazing listicle !

Collapse
 
rohan_sharma profile image
Rohan Sharma

I'm glad you liked it!

Collapse
 
danshalev7 profile image
Dan Shalev
Collapse
 
rohan_sharma profile image
Rohan Sharma

Graph Rag.. That's cool!!

Collapse
 
nadeem_zia_257af7e986ffc6 profile image
nadeem zia

Amazing, keep it up

Collapse
 
rohan_sharma profile image
Rohan Sharma

Thank you!! I hope you enjoyed reading it. 😉

Collapse
 
komsenapati profile image
K Om Senapati

Wow mentioned so many projects

Very long listicle

Collapse
 
rohan_sharma profile image
Rohan Sharma

Yusss. A detailed one!

Collapse
 
thenikhilraj profile image
Nikhil Raj

Amazing!

Collapse
 
rohan_sharma profile image
Rohan Sharma

I hope you had a great read!

Collapse
 
faaizyahya profile image
­­

thanks bro

Collapse
 
rohan_sharma profile image
Rohan Sharma

My pleasure!!!

Collapse
 
julieana_andrade_1273e95d profile image
Julieana Andrade

very good

Collapse
 
rohan_sharma profile image
Rohan Sharma

Yuss. Thanks!!!