DEV Community

Vrushank for Portkey

Posted on • Originally published at portkey.ai on

LLMs In Prod: Day 1

LLMs In Prod: Day 1

This is Part 1 of our analysis diving into Portkey's year-end LLM production data. Over the next few days, we'll be unpacking insights from over 2 trillion tokens worth of production data to reveal how the AI ecosystem evolved in 2024.

Today, we're starting with the most crucial aspect: who's dominating the market, who's growing the fastest, and what's really changing in the LLM landscape.

✨LLMs in Prod Day 1: Provider Trends Unveiled

Who’s dominating? Who’s growing the fastest? And what’s really changing in the AI ecosystem?

We analyzed 2 trillion tokens worth of our production data to uncover trends that might surprise you. Let’s get into it. 👇

— Portkey (@PortkeyAI) December 12, 2024

<!--kg-card-end: html--><!--kg-card-begin: html-->

OpenAI: Still Leading, But Watch Out

• 24% monthly growth in requests

• 6% monthly growth in organizations

OpenAI remains the leader, but here’s the twist: their adoption has dropped from 89% to 76%.

Steady dominance? Yes. But competitors are catching up faster than… pic.twitter.com/jkCsxaUcnn

— Portkey (@PortkeyAI) December 12, 2024

<!--kg-card-end: html--><!--kg-card-begin: html-->

Anthropic: Fastest Growing Provider of 2024

• 61% monthly growth in requests

• 22% monthly growth in organizations

Anthropic has been on fire. Every time they launch a new Claude model (like Sonnet 3.5, Haiku-3.5), we see big adoption spikes: model releases matter.

Anthropic… pic.twitter.com/KMsLLOLTsy

— Portkey (@PortkeyAI) December 12, 2024

<!--kg-card-end: html--><!--kg-card-begin: html-->

Gemini (Google): Late Start, Big Momentum

49% monthly growth in requests

9% growth in new organizations

Gemini may have been late to the game, but they’re showing deep usage from those who’ve adopted them.

It’s a strong comeback for a Google—Let’s see how Gemini shapes up in… pic.twitter.com/8DYZReRjar

— Portkey (@PortkeyAI) December 12, 2024

<!--kg-card-end: html--><!--kg-card-begin: html-->

Cloud Providers: Partnerships Are Key

Azure is leading the charge, with 3x more penetration than AWS Bedrock.

But here’s the twist:

Bedrock started the year with 10x the adoption of Vertex AI, but by year-end, it’s only 2x ahead.

It’s clear now: your AI infrastructure is as… pic.twitter.com/XcKMK2Delt

— Portkey (@PortkeyAI) December 12, 2024

<!--kg-card-end: html--><!--kg-card-begin: html-->

Amazon Bedrock: Fewer Orgs, Deeper Usage

13% monthly growth in organizations

91% growth in requests

Bedrock isn’t catching up to OpenAI in reach, but when companies use it, they go all in.

High usage, fewer orgs—it’s all about depth here. pic.twitter.com/cH1TInSoJ7

— Portkey (@PortkeyAI) December 12, 2024

<!--kg-card-end: html--><!--kg-card-begin: html-->

Vertex AI: Building Momentum Fast

43% monthly growth in requests

Vertex AI might’ve started slower, but it’s picking up steam. It’s catching up, just not there yet. pic.twitter.com/ogKPZ47yhl

— Portkey (@PortkeyAI) December 12, 2024

<!--kg-card-end: html--><!--kg-card-begin: html-->

Multi-Provider Usage Is on the Rise

In just 10 months, the proportion of Portkey orgs using multiple providers jumped from 23% to 40%.

Why’s this happening?

Redundancy is cheap. Downtime isn’t.

After a year of outages and capacity issues, companies are finally realizing: you… pic.twitter.com/kGC8T3uVQV

— Portkey (@PortkeyAI) December 12, 2024

<!--kg-card-end: html--><!--kg-card-begin: html-->

Tomorrow: We’ll dive into how these providers actually perform in production. Spoiler alert: the numbers might surprise you. 😉

Stay tuned, and follow @PortkeyAI for more insights from LLMs in Prod '24.

— Portkey (@PortkeyAI) December 12, 2024

<!--kg-card-end: html-->

Find the next post in the series on Portkey's Twitter

Billboard image

The Next Generation Developer Platform

Coherence is the first Platform-as-a-Service you can control. Unlike "black-box" platforms that are opinionated about the infra you can deploy, Coherence is powered by CNC, the open-source IaC framework, which offers limitless customization.

Learn more

Top comments (0)

A Workflow Copilot. Tailored to You.

Pieces.app image

Our desktop app, with its intelligent copilot, streamlines coding by generating snippets, extracting code from screenshots, and accelerating problem-solving.

Read the docs

👋 Kindness is contagious

Discover a treasure trove of wisdom within this insightful piece, highly respected in the nurturing DEV Community enviroment. Developers, whether novice or expert, are encouraged to participate and add to our shared knowledge basin.

A simple "thank you" can illuminate someone's day. Express your appreciation in the comments section!

On DEV, sharing ideas smoothens our journey and strengthens our community ties. Learn something useful? Offering a quick thanks to the author is deeply appreciated.

Okay