DEV Community

sheephess9527
sheephess9527

Posted on

Show DEV: quantized.uk – a free "will it fit?" VRAM index for local LLMs

I kept re-doing the same math every time a new model dropped: which quant fits my card, how much context is left, will it spill to RAM. So I put it into a site: https://quantized.uk

  • VRAM calculator: pick model + quant (GGUF / AWQ / EXL2 / MXFP4...) + context length, get an estimate for weights + KV cache
  • 129 models across ~60 GPUs/Macs (RTX 30/40/50, RX 7000/9000, Apple M1–M5, DGX Spark...); each GPU has its own page listing what fits
  • Plus a quant picker, model comparison, and a llama.cpp / Ollama / vLLM command generator
  • Cookbook guides (8GB GPU starter, Ollama in Docker / WSL2)

Free, no signup, in English and Chinese. It's hand-maintained, so numbers will be off somewhere — if your real-world usage differs, tell me and I'll fix it.

Top comments (0)