DEV Community

Julien Simon
Julien Simon

Posted on • Originally published at julsimon.Medium on

SLM in Action: Arcee Nova 72B local inference on math and code with Open WebUI and Ollama

In this short video, I run Arcee Nova 72B locally on my Mac with Open WebUI and Ollama. This is the same 3-bit version I used in https://youtu.be/n42AMXecd_A.

I ask the model to explain what the gradient and the hessian are: first the intuition, then the math, then a Python code example. Just a basic one-line prompt. See the result for yourself.

Offline work. Full privacy. No inference cost. Remind me why I need ChatGPT again 🤣

We can help you tailor models like Nova and others to your business requirements. Please visit https://www.arcee.ai to learn more, and follow Arcee.ai on LinkedInto stay on top of the latest Small Language Model action!

AWS Security LIVE!

Tune in for AWS Security LIVE!

Join AWS Security LIVE! for expert insights and actionable tips to protect your organization and keep security teams prepared.

Learn More

Top comments (0)

A Workflow Copilot. Tailored to You.

Pieces.app image

Our desktop app, with its intelligent copilot, streamlines coding by generating snippets, extracting code from screenshots, and accelerating problem-solving.

Read the docs

👋 Kindness is contagious

Please leave a ❤️ or a friendly comment on this post if you found it helpful!

Okay