DEV Community

#pytorch

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Model DNA, Analyzed: Verifying 'From-Scratch' LLM Claims with Architecture, Tokenizer, and CKA (PyTorch)

Model DNA, Analyzed: Verifying 'From-Scratch' LLM Claims with Architecture, Tokenizer, and CKA (PyTorch)

Comments
6 min read
ResKV: Recovering Evicted Token Contributions via Residual KV Cache — LongBench 32/32

ResKV: Recovering Evicted Token Contributions via Residual KV Cache — LongBench 32/32

Comments
6 min read
Your quantized model got worse, and nothing told you

Your quantized model got worse, and nothing told you

3
Comments 2
5 min read
Demystifying Shape Mismatches: How to Debug and Fix Tensor Dimensions in PyTorch

Demystifying Shape Mismatches: How to Debug and Fix Tensor Dimensions in PyTorch

Comments
4 min read
I Trained a 6.4M-Parameter Transformer From Scratch to Talk About Recipes

I Trained a 6.4M-Parameter Transformer From Scratch to Talk About Recipes

1
Comments
5 min read
RoPE: How 2D Rotations Solved Transformer Long-Context

RoPE: How 2D Rotations Solved Transformer Long-Context

1
Comments
4 min read
Running Qwen3 Through the ExecuTorch MLX Delegate: Up to 4.52x Faster on M1 Max

Running Qwen3 Through the ExecuTorch MLX Delegate: Up to 4.52x Faster on M1 Max

Comments
7 min read
Testing PyTorch 2.13 MPS FlexAttention on M1 Max: Up to 7.83x Faster for Sparse Attention

Testing PyTorch 2.13 MPS FlexAttention on M1 Max: Up to 7.83x Faster for Sparse Attention

Comments
7 min read
What Does `unsqueeze` Do in PyTorch? (And Why Your Model Keeps Asking For It)

What Does `unsqueeze` Do in PyTorch? (And Why Your Model Keeps Asking For It)

Comments
7 min read
PyTorch Broadcasting Explained: The 3 Rules (and the Silent Bug That Bites Everyone)

PyTorch Broadcasting Explained: The 3 Rules (and the Silent Bug That Bites Everyone)

1
Comments
4 min read
GPU-Accelerating MSCRED with CUDA, im2col, GEMM, and a Custom PyTorch Extension

GPU-Accelerating MSCRED with CUDA, im2col, GEMM, and a Custom PyTorch Extension

4
Comments 2
11 min read
Debugging a Python "Memory Leak" That Was Actually a Measurement Bug (ru_maxrss vs VmRSS)

Debugging a Python "Memory Leak" That Was Actually a Measurement Bug (ru_maxrss vs VmRSS)

Comments
4 min read
Classifier-free guidance above 7.5 oversaturated our product renders

Classifier-free guidance above 7.5 oversaturated our product renders

1
Comments
4 min read
Using the channels-last memory format reduced the latency of our conversation backbone by 22%

Using the channels-last memory format reduced the latency of our conversation backbone by 22%

1
Comments
4 min read
The SDXL VAE overflow that decoded black images in fp16

The SDXL VAE overflow that decoded black images in fp16

1
Comments
4 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.