DEV Community

Nerav Doshi
Nerav Doshi

Posted on • Originally published at pipelineandprompts.com

Compared llama3.2:1b vs llama3.2:3b Memory Footprint

Context: The number in a model name like 1b or 3b refers to parameters — roughly, the tunable values inside the model that encode what it's learned. More parameters generally means better reasoning and more nuanced answers, at the cost of more memory and slower responses. One thing that trips people up early with Ollama: typing ollama run <model> drops you into an interactive chat session (marked by the >>> prompt), which is a different context from your regular shell. Commands like ollama ps only work back in a normal terminal prompt — typed inside the chat session, they get sent to the model as a question instead of running as a command.

Ran: Pulled llama3.2:3b (the 3-billion-parameter sibling of Entry 01's 1b model), loaded it into memory, and captured the same ollama ps / ps aux | grep ollama numbers for a direct comparison. Along the way, typed ollama ps inside the chat session by mistake — got a confused response from the model instead of the process table, a good real-world example of the shell-vs-chat distinction above. Then asked the same test question from Entry 02 ("how do I check the status of pods in my namespace?") — this time against the plain llama3.2:3b model, not the constrained oc-mentor build from Entry 02.

Result:

1b (Entry 01) 3b
ollama ps size 1.5 GB 2.5 GB
Process RSS ~1.24 GB ~2.47 GB
Parameters 1B 3B

Tripling the parameter count roughly doubled the memory footprint — not a 1:1 scaling, which is worth remembering when estimating resource requests for larger models.

On the question test: since this run used the plain 3b model rather than the oc-mentor Modelfile from Entry 02, the answer came back as a verbose, multi-option explanation using kubectl — not oc, and not the single-command format Entry 02 enforced. That's not a knock on the bigger model; it's a reminder that the constrained, single-command behavior from Entry 02 came from the system prompt, not from model size. A bigger base model without that constraint just reverts to its default training bias (which, unsurprisingly, leans kubectl over oc).

Takeaway: More parameters bought roughly 2x memory for 3x the parameter count — a useful data point for future sizing — but it didn't buy domain-specific behavior on its own. Getting oc-only, single-command answers still requires the system prompt from Entry 02, regardless of model size.

$ ollama ps
NAME           ID              SIZE      PROCESSOR    CONTEXT    UNTIL
llama3.2:3b    a80c4f17acd5    2.5 GB    100% GPU     4096       4 minutes from now

$ ps aux | grep ollama
flyers  94626  0.2  15.1  438021552  2531232  ??  S  llama-server --model ... -c 4096
flyers   1905  0.0   0.4  436904528    60864  ??  S  ollama serve
Enter fullscreen mode Exit fullscreen mode

Top comments (0)