DEV Community

Julien Simon
Julien Simon

Posted on • Originally published at julsimon.Medium on

SLM in Action: Arcee Nova 72B local inference on math and code with Open WebUI and Ollama

In this short video, I run Arcee Nova 72B locally on my Mac with Open WebUI and Ollama. This is the same 3-bit version I used in https://youtu.be/n42AMXecd_A.

I ask the model to explain what the gradient and the hessian are: first the intuition, then the math, then a Python code example. Just a basic one-line prompt. See the result for yourself.

Offline work. Full privacy. No inference cost. Remind me why I need ChatGPT again 🤣

We can help you tailor models like Nova and others to your business requirements. Please visit https://www.arcee.ai to learn more, and follow Arcee.ai on LinkedInto stay on top of the latest Small Language Model action!

Image of Timescale

🚀 pgai Vectorizer: SQLAlchemy and LiteLLM Make Vector Search Simple

We built pgai Vectorizer to simplify embedding management for AI applications—without needing a separate database or complex infrastructure. Since launch, developers have created over 3,000 vectorizers on Timescale Cloud, with many more self-hosted.

Read full post →

Top comments (0)

A Workflow Copilot. Tailored to You.

Pieces.app image

Our desktop app, with its intelligent copilot, streamlines coding by generating snippets, extracting code from screenshots, and accelerating problem-solving.

Read the docs