Originally published on AI Tech Connect.
What this number actually means VentureBeat ran a headline that should make every AI budget-holder wince: "5% GPU utilization: The $401 billion AI infrastructure problem enterprises can't keep ignoring." The claim, drawn from real-world audits, is that the average enterprise GPU fleet runs at roughly 5% utilisation — while AI infrastructure adds something near $401bn of new spend this year, a figure VentureBeat attributes to Gartner. Put those two numbers next to each other and the implication is brutal. If utilisation really averages 5%, then for every pound or rupee of GPU you pay for, the silicon spends roughly nineteen-twentieths of its life doing nothing. That is not a rounding error. That is the single largest hidden cost in AI right now — bigger than model licences, bigger than the…
Top comments (0)