DEV Community

Discussion on: Docker Can Run LLMs Locally. Wait, What!?

Collapse
 
mikegcoleman profile image
Mike Coleman

I'm not sure Ollama will give better perf since both Ollama and Docker Model Runner are running natively on the hardware.

Collapse
 
pradumnasaraf profile image
Pradumna Saraf

The performances are very similar (of course). One of our captains compared both in a blog, you can check it out: connect.hyland.com/t5/alfresco-blo....

Thanks for the comment!