LLMs In Prod: Day 1

This is Part 1 of our analysis diving into Portkey's year-end LLM production data. Over the next few days, we'll be unpacking insights from over 2 trillion tokens worth of production data to reveal how the AI ecosystem evolved in 2024.

Today, we're starting with the most crucial aspect: who's dominating the market, who's growing the fastest, and what's really changing in the LLM landscape.

✨LLMs in Prod Day 1: Provider Trends Unveiled

Who’s dominating? Who’s growing the fastest? And what’s really changing in the AI ecosystem?

We analyzed 2 trillion tokens worth of our production data to uncover trends that might surprise you. Let’s get into it. 👇

— Portkey (@PortkeyAI) December 12, 2024

<!--kg-card-end: html--><!--kg-card-begin: html-->

OpenAI: Still Leading, But Watch Out

• 24% monthly growth in requests

• 6% monthly growth in organizations

OpenAI remains the leader, but here’s the twist: their adoption has dropped from 89% to 76%.

Steady dominance? Yes. But competitors are catching up faster than… pic.twitter.com/jkCsxaUcnn

— Portkey (@PortkeyAI) December 12, 2024

<!--kg-card-end: html--><!--kg-card-begin: html-->

Anthropic: Fastest Growing Provider of 2024

• 61% monthly growth in requests

• 22% monthly growth in organizations

Anthropic has been on fire. Every time they launch a new Claude model (like Sonnet 3.5, Haiku-3.5), we see big adoption spikes: model releases matter.

Anthropic… pic.twitter.com/KMsLLOLTsy

— Portkey (@PortkeyAI) December 12, 2024

<!--kg-card-end: html--><!--kg-card-begin: html-->

Gemini (Google): Late Start, Big Momentum

49% monthly growth in requests

9% growth in new organizations

Gemini may have been late to the game, but they’re showing deep usage from those who’ve adopted them.

It’s a strong comeback for a Google—Let’s see how Gemini shapes up in… pic.twitter.com/8DYZReRjar

— Portkey (@PortkeyAI) December 12, 2024

<!--kg-card-end: html--><!--kg-card-begin: html-->

Cloud Providers: Partnerships Are Key

Azure is leading the charge, with 3x more penetration than AWS Bedrock.

But here’s the twist:

Bedrock started the year with 10x the adoption of Vertex AI, but by year-end, it’s only 2x ahead.

It’s clear now: your AI infrastructure is as… pic.twitter.com/XcKMK2Delt

— Portkey (@PortkeyAI) December 12, 2024

<!--kg-card-end: html--><!--kg-card-begin: html-->

Amazon Bedrock: Fewer Orgs, Deeper Usage

13% monthly growth in organizations

91% growth in requests

Bedrock isn’t catching up to OpenAI in reach, but when companies use it, they go all in.

High usage, fewer orgs—it’s all about depth here. pic.twitter.com/cH1TInSoJ7

— Portkey (@PortkeyAI) December 12, 2024

<!--kg-card-end: html--><!--kg-card-begin: html-->

Vertex AI: Building Momentum Fast

43% monthly growth in requests

Vertex AI might’ve started slower, but it’s picking up steam. It’s catching up, just not there yet. pic.twitter.com/ogKPZ47yhl

— Portkey (@PortkeyAI) December 12, 2024

<!--kg-card-end: html--><!--kg-card-begin: html-->

Multi-Provider Usage Is on the Rise

In just 10 months, the proportion of Portkey orgs using multiple providers jumped from 23% to 40%.

Why’s this happening?

Redundancy is cheap. Downtime isn’t.

After a year of outages and capacity issues, companies are finally realizing: you… pic.twitter.com/kGC8T3uVQV

— Portkey (@PortkeyAI) December 12, 2024

<!--kg-card-end: html--><!--kg-card-begin: html-->

Tomorrow: We’ll dive into how these providers actually perform in production. Spoiler alert: the numbers might surprise you. 😉

Stay tuned, and follow @PortkeyAI for more insights from LLMs in Prod '24.

— Portkey (@PortkeyAI) December 12, 2024

<!--kg-card-end: html-->

Find the next post in the series on Portkey's Twitter