DEV Community

Cover image for 8 open models, 77-85% smaller: what 2-bit quantization costs and what it keeps
Genrius AI
Genrius AI

Posted on Originally published at genrius-ai.github.io

8 open models, 77-85% smaller: what 2-bit quantization costs and what it keeps

Try it

Live chat with Qwen3.8-27B and Qwen3.5-2B v2 in your browser: https://huggingface.co/spaces/harshit-genrius/pingala8-qwen35-live

Originally published at https://genrius-ai.github.io/pingala8-llm/2-bit-quantization-8-models-cost.html

This article was written with the help of AI; every number comes from our measured logs and the paper.

Top comments (0)