DEV Community

Julien Simon
Julien Simon

Posted on • Originally published at julsimon.Medium on

SLM in Action: Arcee Nova 72B local inference on math and code with Open WebUI and Ollama

In this short video, I run Arcee Nova 72B locally on my Mac with Open WebUI and Ollama. This is the same 3-bit version I used in https://youtu.be/n42AMXecd_A.

I ask the model to explain what the gradient and the hessian are: first the intuition, then the math, then a Python code example. Just a basic one-line prompt. See the result for yourself.

Offline work. Full privacy. No inference cost. Remind me why I need ChatGPT again 🤣

We can help you tailor models like Nova and others to your business requirements. Please visit https://www.arcee.ai to learn more, and follow Arcee.ai on LinkedInto stay on top of the latest Small Language Model action!

Top comments (0)