Skip to content
Navigation menu
Search
Powered by Algolia
Search
Log in
Create account
DEV Community
Close
Inference Foundations Series' Articles
Back to Sachin Kr. Rajput's Series
One Request, End to End: Tokenize, Prefill, Decode, Stream
Sachin Kr. Rajput
Sachin Kr. Rajput
Sachin Kr. Rajput
Follow
Oct 22
One Request, End to End: Tokenize, Prefill, Decode, Stream
#
llm
#
machinelearning
#
ai
#
beginners
2
reactions
Comments
1
comment
13 min read
Moderation
A Forward Pass for One Token: Where the FLOPs Go
Sachin Kr. Rajput
Sachin Kr. Rajput
Sachin Kr. Rajput
Follow
Oct 26
A Forward Pass for One Token: Where the FLOPs Go
#
llm
#
machinelearning
#
ai
#
beginners
Comments
Add Comment
12 min read
Moderation
Prefill vs Decode: Two Phases, Two Bottlenecks
Sachin Kr. Rajput
Sachin Kr. Rajput
Sachin Kr. Rajput
Follow
Oct 29
Prefill vs Decode: Two Phases, Two Bottlenecks
#
llm
#
machinelearning
#
ai
#
beginners
Comments
Add Comment
10 min read
Moderation
The Roofline Model for LLM Inference
Sachin Kr. Rajput
Sachin Kr. Rajput
Sachin Kr. Rajput
Follow
Nov 2
The Roofline Model for LLM Inference
#
llm
#
machinelearning
#
ai
#
beginners
Comments
Add Comment
9 min read
Moderation
The KV Cache From Scratch
Sachin Kr. Rajput
Sachin Kr. Rajput
Sachin Kr. Rajput
Follow
Nov 4
The KV Cache From Scratch
#
llm
#
machinelearning
#
ai
#
beginners
Comments
Add Comment
8 min read
Moderation
How Much GPU Memory Do I Need?
Sachin Kr. Rajput
Sachin Kr. Rajput
Sachin Kr. Rajput
Follow
Nov 16
How Much GPU Memory Do I Need?
#
inference
#
llm
#
gpu
#
machinelearning
Comments
Add Comment
9 min read
Moderation
We're a place where coders share, stay up-to-date and grow their careers.
Log in
Create account