DEV Community

#cuda

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Your CUDA Code Didn't Change. Your Risk Register Just Did: What Nvidia's CEO Exit Means for Builders
shivaysinghrajput profile

Your CUDA Code Didn't Change. Your Risk Register Just Did: What Nvidia's CEO Exit Means for Builders

#nvidia #ai #gpu #cuda
Comments
4 min read
Jensen is out. CUDA isn't. A Developer's Guide to Everything Nvidia Built
unicodeveloper profile

Jensen is out. CUDA isn't. A Developer's Guide to Everything Nvidia Built

#ai #cuda #programming #nvidia
7
Comments 2
25 min read
The 8GB VRAM Breakthrough: How PagedAttention and Dynamic KV-Cache Quantization Unlock 64k Context on Consumer GPUs
bennialencar profile

The 8GB VRAM Breakthrough: How PagedAttention and Dynamic KV-Cache Quantization Unlock 64k Context on Consumer GPUs

#ai #localllm #cuda #opensource
Comments
11 min read
One Spark, four streams: TensorFold’s native CUDA experiment
sparkllm profile

One Spark, four streams: TensorFold’s native CUDA experiment

#ai #opensource #machinelearning #cuda
Comments
3 min read
Quantize or Offload? A 16GB GPU Local LLM Strategy
renato_silva_71eef0fc385f profile

Quantize or Offload? A 16GB GPU Local LLM Strategy

#localllm #machinelearning #python #cuda
Comments
4 min read
I built a free Windows (UEFI) & Linux GUI to unlock RTX 40/30/20 Tensor Cores (2.01x FP16/BF16/FP8 on my RTX 4070 Ti)
mindallik profile

I built a free Windows (UEFI) & Linux GUI to unlock RTX 40/30/20 Tensor Cores (2.01x FP16/BF16/FP8 on my RTX 4070 Ti)

#machinelearning #opensource #cuda #python
1
Comments
3 min read
Same A40, same Spark file: inside cortiq’s new CUDA path
sparkllm profile

Same A40, same Spark file: inside cortiq’s new CUDA path

#ai #opensource #cuda #machinelearning
Comments
4 min read
Splitting Network Paths with Two NICs to Get CUDA Working on RTX 5060 under WSL2 on Windows 11
maskedridersystem profile

Splitting Network Paths with Two NICs to Get CUDA Working on RTX 5060 under WSL2 on Windows 11

#linux #cuda #nvidia
Comments
4 min read
I had an AI agent port Karpathy's GPT-2 trainer from CUDA to SYCL, and made it prove every step
checocadena profile

I had an AI agent port Karpathy's GPT-2 trainer from CUDA to SYCL, and made it prove every step

#cuda #gpu #ai #opensource
Comments
4 min read
How Does Rust Code Run on a GPU? Tracing cuda-oxide and PTX
masamori profile

How Does Rust Code Run on a GPU? Tracing cuda-oxide and PTX

#rust #gpu #cuda #computerscience
Comments
10 min read
Project EREN: My Journey to Building a CUDA-Powered LLM Inference Engine
pathakarunav123 profile

Project EREN: My Journey to Building a CUDA-Powered LLM Inference Engine

#ai #llm #cuda #opensource
1
Comments
4 min read
TorchTPU vs CUDA: Can Native PyTorch Make Google TPUs Easier to Use?
jamilxt profile

TorchTPU vs CUDA: Can Native PyTorch Make Google TPUs Easier to Use?

#pytorch #tpu #cuda #ai
1
Comments
8 min read
Qwen3.8-Flash-Next (125B) on an RTX 3060 12 GB with 30 GB RAM: 50-70 tok/s
sumit_sodhi profile

Qwen3.8-Flash-Next (125B) on an RTX 3060 12 GB with 30 GB RAM: 50-70 tok/s

#llm #opensource #cuda #machinelearning
1
Comments 2
3 min read
Amazon: New TorchNeuron tool challenges Nvidia's dominance
hacksgr profile

Amazon: New TorchNeuron tool challenges Nvidia's dominance

#torchneuron #pytorch #trainium #cuda
1
Comments
2 min read
Running NVIDIA's new 120B Nemotron-3.5-Super on an 8 GB GPU — skipping the zeros, and finding the real bottleneck
helgard_orlm profile

Running NVIDIA's new 120B Nemotron-3.5-Super on an 8 GB GPU — skipping the zeros, and finding the real bottleneck

#ai #llm #cuda #python
Comments
7 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.