DEV Community

Gísli Guðmundsson
Gísli Guðmundsson

Posted on Originally published at gisli78.substack.com

GPU Quotas, VM Sizes and Cost for AI Workloads on Azure

Part 2 of my Azure AI landing zone series is out on Substack.

Before anyone asks for an H100, this post covers what to check: whether you need your own GPUs at all (Foundry pay-per-token, PTU, managed compute vs. your own VMs or AKS), the current Azure GPU VM families and what's retired, how vCPU family quota works and how to check it with az vm list-usage, az quota and az vm list-skus, what Spot, capacity reservations, reservations and savings plans actually guarantee, and guardrails with Azure Policy, budgets by tag and stopping idle GPUs. It also covers the regional VM price increase coming on 1 February 2027.

Read the full article: https://gisli78.substack.com/p/gpu-quotas-vm-sizes-and-cost-for

Bicep sample (policy + budget): https://github.com/gislig/azure-ai-landing-zone/tree/main/examples/gpu-guardrails

Top comments (0)