DEV Community

Thokozani Buthelezi profile picture

Thokozani Buthelezi

404 bio not found

Joined Joined on 
How vLLM Actually Manages KV Cache (vs the Toy Version I Built)

How vLLM Actually Manages KV Cache (vs the Toy Version I Built)

3
Comments 4
4 min read

Want to connect with Thokozani Buthelezi?

Create an account to connect with Thokozani Buthelezi. You can also sign in below to proceed if you already have an account.

Already have an account? Sign in
How I Implemented GPTQ from Scratch (and What I Learned)

How I Implemented GPTQ from Scratch (and What I Learned)

1
Comments 3
4 min read
DDP Is Not Always Faster

DDP Is Not Always Faster

1
Comments 1
2 min read
Evaluating LLMs for Under a Dollar

Evaluating LLMs for Under a Dollar

2
Comments
4 min read
Reproducing Chinchilla Scaling on a Budget

Reproducing Chinchilla Scaling on a Budget

1
Comments
3 min read
loading...