DEV Community

#pytorch

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Model soups failed until we fixed one line: our 26M grammar tagger from 11% to 1.9% false fixes

Model soups failed until we fixed one line: our 26M grammar tagger from 11% to 1.9% false fixes

Comments
3 min read
Full fine-tune vs LoRA vs QLoRA on one L40S: Qwen2.5-1.5B, memory, speed and held-out loss, measured

Full fine-tune vs LoRA vs QLoRA on one L40S: Qwen2.5-1.5B, memory, speed and held-out loss, measured

Comments
6 min read
PyTorch Custom Dataset and DataLoader: __getitem__, __len__, collate_fn, and num_workers

PyTorch Custom Dataset and DataLoader: __getitem__, __len__, collate_fn, and num_workers

Comments
9 min read
How PyTorch Became the Socket Every AI Chip Plugs Into

How PyTorch Became the Socket Every AI Chip Plugs Into

5
Comments
4 min read
LoRA on a 16 GB card: what fits and what does not

LoRA on a 16 GB card: what fits and what does not

Comments
5 min read
Blackwell quantisation on my own card

Blackwell quantisation on my own card

Comments
5 min read
Two PyTorch ops that stopped a CUDA text model on an Apple GPU

Two PyTorch ops that stopped a CUDA text model on an Apple GPU

Comments
5 min read
How do you train a PyTorch model on multiple GPUs?

How do you train a PyTorch model on multiple GPUs?

Comments
8 min read
SDXL images per dollar on four GPUs: RTX A6000, L40S, RTX 5090 and H100, eager vs torch.compile

SDXL images per dollar on four GPUs: RTX A6000, L40S, RTX 5090 and H100, eager vs torch.compile

Comments
6 min read
4 GPUs, 2x speed: why PyTorch DDP stalled on a PCIe-only 4x RTX A6000, and two flags that took it to 3.6x

4 GPUs, 2x speed: why PyTorch DDP stalled on a PCIe-only 4x RTX A6000, and two flags that took it to 3.6x

Comments
4 min read
How long until a rented GPU runs CUDA? Launch to first matmul on six GPU types, timed

How long until a rented GPU runs CUDA? Launch to first matmul on six GPU types, timed

Comments
5 min read
My renderer's seed argument changes nothing — how do I prove the seed actually reaches the sampler?

My renderer's seed argument changes nothing — how do I prove the seed actually reaches the sampler?

Comments
1 min read
Beyond seeds: which determinism flags actually mattered for reproducible fine-tunes on a T4?

Beyond seeds: which determinism flags actually mattered for reproducible fine-tunes on a T4?

Comments
1 min read
Same fine-tune recipe, different seeds — one narrow behaviour swings wildly. What actually stabilises it?

Same fine-tune recipe, different seeds — one narrow behaviour swings wildly. What actually stabilises it?

Comments
1 min read
Google and Meta Open-Source TorchTPU for Running PyTorch on TPUs

Google and Meta Open-Source TorchTPU for Running PyTorch on TPUs

1
Comments
3 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.