Originally published on AI Tech Connect.
The inference economy in May 2026 The numbers behind serverless inference have moved further in the last twelve months than in the previous three years combined. Blended cost per million tokens on open-weight frontier models has fallen by roughly an order of magnitude since early 2025; H100 spot prices have softened by a comparable margin, as we tracked in our H100 pricing guide. Inference is now cheap enough to ship products that genuinely depend on it — a thesis we explored in why falling inference costs unlock profitable products. Capital is following the curve. DeepInfra closed a $107M Series B in April, covered in our DeepInfra Series B write-up. Together AI continues to grow its multi-tenant fleet, Fireworks has tightened its training-plus-serving loop, and the custom-silicon…
Top comments (0)