Original post - https://www.codingpaths.com/gsoc/gsoc-2020-with-numfocus/

GSoC'20 with NumFOCUS

I am super excited to say that I have been selected as a Google Summer of Code student by NumFOCUS for PyMC4. I would like to thank my mentors Thomas Wiecki and Maxim Kochurov and the entire NumFOCUS community for giving this opportunity.

My project is about adding Variational Inference Interface to PyMC4. Variational Inference scales better over larger datasets as compared to the traditional MCMC algorithms. First, I had plans to implement OPVI¹ framework as done in PyMC3 this summer. But as corrected by my mentor Maxim Kochurov, it would have taken extra time and more debugging because of the difficulty to deal with symbolic graph manipulations in Tensorflow. Now, the whole plan is to implement two Variational Inference Algorithms - Mean Field ADVI² and Full Rank ADVI² in PyMC4. Mean Field ADVI posits a Spherical Gaussian family and Full Rank ADVI posits a Multivariate Gaussian family to minimize KL divergence.

All in all, I look forward to a great summer.

Thank you for reading. 😄
Sayam

---

1. Operator Variational Inference Rajesh Ranganath, Jaan Altosaar, Dustin Tran, David M. Blei (2016) ↩

2. Automatic Differentiation Variational Inference Alp Kucukelbir, Dustin Tran, Rajesh Ranganath, Andrew Gelman, David M. Blei (2016). ↩