DEV Community

#pytorch

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
I Trained a Language Model From Scratch on a 4 GB GPU

I Trained a Language Model From Scratch on a 4 GB GPU

Comments
6 min read
Model security on Hugging Face: what executes when you load

Model security on Hugging Face: what executes when you load

1
Comments
7 min read
I Set Every Seed and Trained Twice. The Models Diverged at Step 1

I Set Every Seed and Trained Twice. The Models Diverged at Step 1

Comments
4 min read
Model CPU offload on a 48 GB Mac: 18.5 GB footprint and 9.6 GB of swap

Model CPU offload on a 48 GB Mac: 18.5 GB footprint and 9.6 GB of swap

Comments
2 min read
Building a Transformer from Scratch: Part 1 — The Embedding Layer

Building a Transformer from Scratch: Part 1 — The Embedding Layer

Comments
3 min read
Loading a PyTorch pipeline one stage at a time: Pixal3D on a 48 GB Mac

Loading a PyTorch pipeline one stage at a time: Pixal3D on a 48 GB Mac

Comments
7 min read
How to make GPU training survive spot preemption (without babysitting it)

How to make GPU training survive spot preemption (without babysitting it)

Comments
3 min read
Rebuilding a brain-to-text decoder: from 50% to 23.5% word errors

Rebuilding a brain-to-text decoder: from 50% to 23.5% word errors

1
Comments 1
5 min read
What Does a Neural Network Actually Receive When You Give It an Image?

What Does a Neural Network Actually Receive When You Give It an Image?

Comments
3 min read
Generating electrode stimulation patterns for a simulated cortical prosthesis

Generating electrode stimulation patterns for a simulated cortical prosthesis

5
Comments
5 min read
RoPE vs sinusoidal positional encoding, measured: 55 logits of drift against 0.0005

RoPE vs sinusoidal positional encoding, measured: 55 logits of drift against 0.0005

Comments
7 min read
Demystifying LLMs: Building a 124M-Parameter Decoder-Only Transformer in PyTorch

Demystifying LLMs: Building a 124M-Parameter Decoder-Only Transformer in PyTorch

Comments
24 min read
nn.Module Explained: The Same Model Built with Raw Tensors and with nn.Module

nn.Module Explained: The Same Model Built with Raw Tensors and with nn.Module

Comments
8 min read
25 LLM architecture blocks, side by side, in runnable PyTorch

25 LLM architecture blocks, side by side, in runnable PyTorch

Comments
8 min read
I Rebuilt Jev's Structure with Qwen (Not Its Capabilities)

I Rebuilt Jev's Structure with Qwen (Not Its Capabilities)

Comments
9 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.