Skip to content

DEV Community

Jahn

Inference performance engineering on NVIDIA Blackwell. Conatus AI.

Joined on Aug 25, 2026

Jahn

Aug 25

The sm_120 shared-memory cliff: why FP8 KV cache crashes vLLM on workstation Blackwell

#cuda #llm #gpu #performance

3 min read

Jahn

Aug 25

Did FP8 make the model dumber? A per-prompt regression check for quantized serving

#llm #machinelearning #performance #python

3 min read

Jahn

Aug 25

Qwen3-8B on workstation Blackwell: vLLM vs SGLang vs llama.cpp, plus an FP8 pass

#machinelearning #cuda #performance #llm

3 min read

loading...