DEV Community

#gpu

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Stop Comparing GPU Clouds Only by $/hour
gridport profile

Stop Comparing GPU Clouds Only by $/hour

#gpu #cloud #machinelearning #llm
Comments
10 min read
My CUDA/GPU Journey: From "What Even Is a GPU?" to Actually Fascinated
karthikunni profile

My CUDA/GPU Journey: From "What Even Is a GPU?" to Actually Fascinated

#ai #gpu #nvidia #amd
1
Comments
4 min read
I Got 28 TPS Out of Free Kaggle GPUs. Here's What It Took.
rautaditya2606 profile

I Got 28 TPS Out of Free Kaggle GPUs. Here's What It Took.

#ai #gpu #inference #python
Comments
5 min read
Choosing the Right GPU for Your Model — A Sizing Method, Not a Guess
josef_doornink_930b2caf1c profile

Choosing the Right GPU for Your Model — A Sizing Method, Not a Guess

#ai #gpu #llm
Comments 1
9 min read
What really fits in 8GB VRAM
thekilteddev profile

What really fits in 8GB VRAM

#localllm #vram #gpu #buildinpublic
Comments
7 min read
I ran a GPU inference app for a month on Azure serverless GPU. Here's the actual bill.
aco_dog_32627df9d920ffba4 profile

I ran a GPU inference app for a month on Azure serverless GPU. Here's the actual bill.

#azure #gpu #cloud #devops
1
Comments
4 min read
From API to GPU, Week 5: Tensors, the Data Structure Behind Every Model
dramasamy profile

From API to GPU, Week 5: Tensors, the Data Structure Behind Every Model

#ai #llm #gpu #machinelearning
Comments
12 min read
Mastering Low-Precision AI: FP8 and FP4 Support Across Frameworks in Mid-2026
javaeeeee profile

Mastering Low-Precision AI: FP8 and FP4 Support Across Frameworks in Mid-2026

#nvidia #gpu #ai #deeplearning
Comments
2 min read
Rust Portable SIMD Now Runs on the GPU and It Changes Everything About Cross-Platform Parallelism
trismegistus profile

Rust Portable SIMD Now Runs on the GPU and It Changes Everything About Cross-Platform Parallelism

#rust #gpu #programming #performance
Comments
4 min read
Understanding GPU Memory: VRAM, Bandwidth, and Why Your Model Won't Fit
3ni8ma profile

Understanding GPU Memory: VRAM, Bandwidth, and Why Your Model Won't Fit

#gpu #cuda #vram #memory
1
Comments
2 min read
GPU_WORKLOAD_MISMATCH Part II: From Detection to Runtime Enforcement for AI Infrastructure
ces1231 profile

GPU_WORKLOAD_MISMATCH Part II: From Detection to Runtime Enforcement for AI Infrastructure

#ai #gpu #cybersecurity #machinelearning
1
Comments 1
9 min read
Rust SIMD Just Came to the GPU — and It Changes How We Think About Parallel Programming
trismegistus profile

Rust SIMD Just Came to the GPU — and It Changes How We Think About Parallel Programming

#rust #gpu #programming #performance
2
Comments
4 min read
Renting GPUs for AI? Start with VRAM, Not the GPU
kavs profile
Kavya

Renting GPUs for AI? Start with VRAM, Not the GPU

#machinelearning #llm #gpu #cloud
Comments
2 min read
Why memory bandwidth matters more than TFLOPS for LLM inference
kavs profile
Kavya

Why memory bandwidth matters more than TFLOPS for LLM inference

#llm #gpu #nvidia #machinelearning
Comments
3 min read
KV Cache Quantization: I Stretched Qwen 35B's Context 8 on 12GB VRAM
kenimo49 profile

KV Cache Quantization: I Stretched Qwen 35B's Context 8 on 12GB VRAM

#llm #ai #gpu #performance
1
Comments 1
3 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.