BEST BLOGPOST ABOUT INTIALIZATION AND NORAMLIZATION I COULD FIND!!

I stumbled upon this criminally unrated blogpost that goes into detail about initialization techniques and then bridge them to barchnorm and layernorm.

it has exercises with meticulous instructions, visualizations, mathematical deep dives, raw implementations from scratch, interactive plots, and even a Q&A session.

Link: https://medium.com/towards-artificial-intelligence/initialization-batchnorm-and-layernorm-beyond-textbook-definitions-9306b02c7e9a