DEV Community

#cuda

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Running the 510 GB DeepSeek-V4.1-Flash on an 8 GB GPU — and three bugs that never raise an error
helgard_orlm profile

Running the 510 GB DeepSeek-V4.1-Flash on an 8 GB GPU — and three bugs that never raise an error

#ai #llm #cuda #python
Comments
8 min read
Running a 133 GB MoE model on an 8 GB GPU at 11 tokens/s by streaming experts from NVMe
helgard_orlm profile

Running a 133 GB MoE model on an 8 GB GPU at 11 tokens/s by streaming experts from NVMe

#ai #llm #cuda #python
Comments
6 min read
Gemma 4 at Over 70 Tokens/s on a 2021 Laptop's 4 GB GPU: The Live Demo, Step by Step
xbill profile

Gemma 4 at Over 70 Tokens/s on a 2021 Laptop's 4 GB GPU: The Live Demo, Step by Step

#gemma #llamacpp #cuda #huggingface
9
Comments
12 min read
Gemma 4 on a Tesla T4, Part 3: Int4 Embeddings Serve E2B in 2.86 GiB at 2.30x bf16
xbill profile

Gemma 4 on a Tesla T4, Part 3: Int4 Embeddings Serve E2B in 2.86 GiB at 2.30x bf16

#gemma #vllm #cuda #machinelearning
9
Comments
11 min read
How Fast Can a 421M-Parameter Decision Model Run? I Benchmarked Laya Across NVIDIA GPUs
cookies_c9dc8b91f33d29250 profile

How Fast Can a 421M-Parameter Decision Model Run? I Benchmarked Laya Across NVIDIA GPUs

#machinelearning #cuda #performance #opensource
Comments 1
6 min read
Exploring Result Visibility of Fixed-Latency Instructions on the SM120 Architecture
comradepenguin1917 profile

Exploring Result Visibility of Fixed-Latency Instructions on the SM120 Architecture

#cuda #nvidia #gpu
1
Comments
10 min read
Nvidia Just Let Rust Into CUDA. Here's Why That's a Bigger Deal Than It Sounds
ashraf_chowdury09 profile

Nvidia Just Let Rust Into CUDA. Here's Why That's a Bigger Deal Than It Sounds

#rust #ai #cuda #programming
1
Comments
5 min read
CUDA Rust: two native tracks, not a wrapper over C++
jtorchia profile

CUDA Rust: two native tracks, not a wrapper over C++

#english #rust #cuda #gpuprogramming
1
Comments
5 min read
A 4 GB Laptop GPU vs a 6-Core CPU on Gemma 4, Re-Measured in ABBA Order: 4.1x
xbill profile

A 4 GB Laptop GPU vs a 6-Core CPU on Gemma 4, Re-Measured in ABBA Order: 4.1x

#gemma #llamacpp #cuda #benchmarking
10
Comments 2
11 min read
Reverse-Engineering NVIDIA: Modifying a CUDA binary
stjepan86 profile

Reverse-Engineering NVIDIA: Modifying a CUDA binary

#nvidia #gpu #cuda #hex
Comments
4 min read
Gemma 4 on a Tesla T4, Part 2: The Minimum GCE VM and a Script to Drive It
xbill profile

Gemma 4 on a Tesla T4, Part 2: The Minimum GCE VM and a Script to Drive It

#gemma #vllm #gcp #cuda
13
Comments
13 min read
Finding a Random Island with Geometry and CUDA
adilaidev profile

Finding a Random Island with Geometry and CUDA

#gpucomputing #geospatial #cuda #geometry
Comments
4 min read
Gemma 4 on a Tesla T4: QAT Weights Decode 1.79x Faster Than bf16
xbill profile

Gemma 4 on a Tesla T4: QAT Weights Decode 1.79x Faster Than bf16

#gemma #vllm #cuda #machinelearning
8
Comments 1
9 min read
Same nvJPEG2000, different numbers: timer boundaries and frames in flight
fastvideo profile

Same nvJPEG2000, different numbers: timer boundaries and frames in flight

#cuda #gpu #performance #cpp
Comments
13 min read
Qwen3.8 27B at 256K: 50 TPS on a 24 GB GPU
pich profile

Qwen3.8 27B at 256K: 50 TPS on a 24 GB GPU

#aiinfrastructure #llm #cuda #performance
1
Comments 1
11 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.