DEV Community

Discussion on: Running Local LLMs, CPU vs. GPU - a Quick Speed Test

Collapse
 
maximsaplin profile image
Maxim Saplin

JIC, I tested pure cases, 100% CPU and 100% offloading to GPU