Today, we wrapped up Day 2 of our August GenAI for DevOps Engineers batch.
Today’s discussion focused on two important topics:
🔹 GPU for DevOps Engineers
We explored why GPUs have become such an important part of modern AI infrastructure and what DevOps, SRE, Platform, and Cloud Engineers need to understand about them.
🔹 GPU Memory Calculation for LLMs
We discussed how to estimate the GPU memory required to run an LLM and the different factors that impact memory consumption.
One thing we're doing differently in this batch is interactive learning.
Instead of just going through slides, we discuss concepts, ask questions, work through calculations, and try to understand the “why” behind everything.
📅 Next session: August 15, Saturday at 7:00 AM PST
If you were thinking about joining, you still have time to be part of the August batch.
👉 Enroll here:
https://ideaweaver.ai/#courses/genai-for-devops-engineers
And if you'd like to explore today’s topics further, here are two of my YouTube videos:
🎥 GPU Deep Dive
https://youtu.be/p6n-So6uxoY?si=OuzyGnFXpf_ahm0y
🎥 GPU Memory Requirements for LLMs
https://youtu.be/ZERlQmRR_CU?si=BDzABJpBih3tQ7aQ
Day 2 done. A lot more to learn and build together. 🚀
Top comments (0)