DEV Community

Cover image for The 29GB that didn't add up in my Edge0-145B vs Opus video
InApp
InApp

Posted on Originally published at imapp.blogspot.com

The 29GB that didn't add up in my Edge0-145B vs Opus video

I spent last weekend recording a walkthrough comparing Edge0-145B against Opus on a benchmark where it supposedly scores 86.5. The headline number was impressive, but the model card claimed 29GB of VRAM and my test hardware disagreed by almost double. That mismatch is what made me hit record instead of just posting the score.

The video breaks down exactly where the 29GB figure comes from — it's not the weights alone but the KV cache allocation at full 128k context that pushes the total there. I show the actual nvidia-smi output during inference side-by-side with the spec sheet, and walk through why the quantized version changes the math but not the ceiling. Capturing the terminal output clearly took three takes and a lot of font-size adjustments.

What it cost me as the operator: roughly six hours of GPU rental time, plus local storage for the raw 4K footage before I cut it down to twelve minutes. The full walkthrough is at https://www.youtube.com/watch?v=_9mW_ZPwgMU if you want to see the VRAM discrepancy yourself.

Top comments (0)