Seven quantizations of a 30B model measured on a base MacBook Air, why a 3.1x speedup made it 60% slower, and how to wire a local model into a coding agent.
Daniel Paddubny
Posted on • Originally published at x.com
Everything You Wanted to Know About Local AI
For further actions, you may consider blocking this person and/or reporting abuse
Top comments (0)