Skip to content

DEV Community

LLM Inference Digest Series' Articles

Back to Felipe 0liveira's Series

Felipe 0liveira

Oct 7

The KV Cache Is the Bottleneck Now — 1-Bit Quantization, MoE Stragglers, and Per-Second GPU Billing

#ai #cloud #llm #performance

5 min read

Felipe 0liveira

Oct 14

Multi-Turn Memory, Mixed Precision, and Safer Rollouts — Serving Catches Up to Agentic Workloads

#agents #ai #llm #machinelearning

8 min read