Skip to content

DEV Community

# gpu

👋 Sign in for the ability to sort posts by relevant, latest, or top.

Biricik Biricik

Apr 4

Why I Self-Host 7 RTX 5090 GPUs Instead of Using Cloud AI

#ai #gpu #selfhosted #infrastructure

6 min read

soy

Apr 5

Hopper/Blackwell Tensor Core Optimization, llama.cpp VRAM Fix & 4W NPU Inference

#gpu #nvidia #hardware

3 min read

Biricik Biricik

Apr 4

Why I Self-Host 7 RTX 5090 GPUs Instead of Using AWS

#gpu #selfhosted #ai #startup

6 min read

plasmon

Apr 4

8-Bit Quantization Destroyed 92% of Code Generation — The Culprit Wasn't Bit Count

#ai #llm #machinelearning #gpu

5 min read

plasmon

Apr 4

I Couldn't Build a Local LLM PC for $1,300 — Budget Tiers and the VRAM Cliffs Between Them

#llm #gpu #localllm #vram

6 min read

Apr 1

From one model to seven — what it took to make TurboQuant model-portable

#python #vllm #gpu #triton

3 min read

soy

Apr 4

GPU Power Tools & CUDA Deep Dives for Local LLM Builders

#gpu #nvidia #hardware

3 min read

plasmon

Apr 2

Parameter Count Is the Worst Way to Pick a Model on 8GB VRAM

#llm #locallm #gpu #llamacpp

5 min read

Vishal Vishwakarma

Apr 2

How Much GPU Memory Does Your LLM Actually Need?

#ai #llm #gpu #machinelearning

2 min read

Vu Nguyen

Apr 2

I Couldn’t Debug My AI/ML GPU Incident - So I Built gpuxray

#ai #gpu #opensource #linux

3 min read

Jess Lee for The DEV Team

Apr 3

What do you want to know about hardware acceleration? Ask the Google team!

#discuss #datascience #analytics #gpu

1 min read

plasmon

Mar 31

MoE Beat Dense 27B by 2.4x on 8GB VRAM — The 35B-A3B Benchmark Nobody Expected

#llm #machinelearning #ai #gpu

5 min read

plasmon

Mar 31

The Memory Bandwidth Gap Is 49x and Growing — Why Local LLMs Hit a Ceiling

#hardware #ai #machinelearning #gpu

7 min read

Mar 31

PyRadiomics Inefficiency in Large-Scale Studies Addressed by GPU Acceleration for Faster Processing

#radiomics #gpu #pytorch #medicalimaging

8 min read

Christopher Maher

Mar 30

I Tested TurboQuant KV Cache Compression on Consumer GPUs. Here's What Actually Happened.

#llm #kubernetes #gpu #ai

6 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.