DEV Community

Urvesh
Urvesh

Posted on

RAG using Ollama

I want to create a LLM which is trained on several PDFs and can generates the answer based on the questions given by the end user. I do not have the Paid API Keys. I want to use Ollama to create my LLM. Can I use RAG with Ollama?

Top comments (2)

Collapse
 
mohsin_rashid_13537f11a91 profile image
Mohsin Rashid • Edited

Yes you can, I recently wrote an article on how to create a very basic RAG using OLLAMA, maybe it helps.

Collapse
 
cynicalheart profile image
CynicalHeart

Ollama(LLM) + RAG[ES store embedding] + langchain