DEV Community

Yuvraj singh Bhadoria profile picture

Yuvraj singh Bhadoria

404 bio not found

Joined Joined on 
Demystifying Speculative Decoding: From Architecture to Production Bottlenecks
yuvraj_llminference profile

Demystifying Speculative Decoding: From Architecture to Production Bottlenecks

#llm #machinelearning #performance #inference
Comments
8 min read
Demystifying Speculative Decoding: From Architecture to Production Bottlenecks
yuvraj_llminference profile

Demystifying Speculative Decoding: From Architecture to Production Bottlenecks

#llm #machinelearning #performance #inference
Comments
8 min read
Demystifying Speculative Decoding: From Architecture to Production Bottlenecks
yuvraj_llminference profile

Demystifying Speculative Decoding: From Architecture to Production Bottlenecks

#llm #inference #machinelearning #performance
Comments
8 min read
KV-Cache Quantization: How 2–4 Bits Cut LLM Memory by 4–8 Without Killing Quality
yuvraj_llminference profile

KV-Cache Quantization: How 2–4 Bits Cut LLM Memory by 4–8 Without Killing Quality

Comments
8 min read
I Wrote the Three Attention Kernels That Run LLM Inference — in Portable Triton, on a Free Colab T4
yuvraj_llminference profile

I Wrote the Three Attention Kernels That Run LLM Inference — in Portable Triton, on a Free Colab T4

1
Comments
6 min read
loading...