Skip to content

DEV Community

Inference Foundations Series' Articles

Back to Sachin Kr. Rajput's Series

Cover image for One Request, End to End: Tokenize, Prefill, Decode, Stream

Sachin Kr. Rajput

Oct 22

One Request, End to End: Tokenize, Prefill, Decode, Stream

#llm #machinelearning #inference #performance

12 min read

Cover image for A Forward Pass for One Token: Where the FLOPs Go

Sachin Kr. Rajput

Oct 26

A Forward Pass for One Token: Where the FLOPs Go

#llm #machinelearning #inference #performance

11 min read