Day 040 — Multi-Head Residual (attention by hand)

Hariom Lohar (hariomlohardev on GitHub) — Lab Notebook No.01 · Day 040 · 10 Aug 2026.

I rebuilt multi-head attention by hand — no PyTorch, just NumPy. From math → NumPy backprop → CNNs → attention.

Live bench + daily logs: https://hariomlohardev.github.io
Full log: https://hariomlohardev.github.io/blog/p/day-040-multi-head-residual/

---

Original log on my portfolio (canonical) → https://hariomlohardev.github.io/blog/p/day-040-multi-head-residual/ — cross-posted to reach more builders. 548 days: 1 Jul 2026 → 31 Dec 2027.