DEV Community

Cover image for Four Models in Seven Weeks. Benchmarks Are a Distraction.
Max Quimby
Max Quimby

Posted on Originally published at computeleap.com

Four Models in Seven Weeks. Benchmarks Are a Distraction.

Google launched Gemini 4 Neon on November 18 — its fourth Gemini 4 model in seven weeks, priced at $3 per million input tokens and $15 per million output tokens. It debuted #1 on the Artificial Analysis Coding Agent Index with a score of 58.6, scored 61 on the AA Intelligence Index at its highest thinking setting, and reportedly matched Claude Opus 5.5 on a real coding benchmark at less than half the cost per task.

📖 Read the full version with charts and embedded sources on ComputeLeap →

Those numbers matter. But they are not the story. The story is that the leaderboard has fractured so completely that four labs can each claim #1 on a different index — and that Google is using price, not performance, as the weapon that actually moves markets.

Google blog post announcing Gemini 4 Neon launch

View original announcement on Google Blog →

Four Models, Seven Weeks

Here is what Google shipped in the Gemini 4 family since late September:

Model Date Role Pricing (per 1M tokens)
Gemini 4 Argon Sep 30 Deep reasoning, frontier intelligence $2 / $10 (intro) → $4 / $20 after Nov 30
Gemini 4 Carbon Oct 28 → Nov 10 (GA) Most complex work, cybersecurity $2 / $10 (intro) → $4 / $20 after Nov 30
Gemini 4 Hydrogen Nov 12 Speed tier, cheapest frontier $1.50 / $0.75
Gemini 4 Neon Nov 18 Coding agents, knowledge work $3 / $15

That is a new model roughly every 12 days. No other lab has matched this shipping velocity in 2026. Anthropic's last major release was Claude Opus 5.5 on September 22 — nearly two months ago. OpenAI shipped GPT-6.2 Astra and Sol on November 17, the day before Neon, and the consensus across YouTube and Substack is that it "got slept on."

We covered the Carbon/Hydrogen double-launch last week. The pattern continues: Google is not trying to win one benchmark cycle. It is trying to make the benchmark cycle irrelevant by shipping faster than anyone can evaluate.

The Pricing Game

The benchmarks are close enough to argue about. The pricing is not.

Artificial Analysis measured the cost per Intelligence Index task across effort levels:

Model Effort Index Score Cost/Task Time/Task
Gemini 4 Neon Low 44 $0.75 3.7 min
Gemini 4 Neon High (default) 60 $3.74 14.8 min
Gemini 4 Neon Xhigh 61 $6.44 21.5 min
Claude Opus 5.5 Low 35 $0.98 3.0 min
Claude Opus 5.5 High 52 $3.46 9.2 min
Claude Opus 5.5 Max 59 $10.04 25.7 min

At the default settings that most developers actually use, Neon scores 60 at $3.74 per task. Claude Opus 5.5 scores 52 at $3.46. Neon delivers 15% more intelligence for 8% more money. At maximum effort, the gap widens — Neon hits 61 for $6.44 while Opus reaches 59 for $10.04. That is a 36% cost premium for two fewer index points.

The Neuron analysis of Gemini 4 Neon cost vs Claude Code

View original article on The Neuron →

The Neuron's cost analysis puts it even more starkly: on the Coding Agent Index, Neon in Google's Antigravity CLI costs $6.86 per task versus $15.47 for Claude Fable 5.2 in Claude Code. That is 56% cheaper for a one-point advantage on the coding index (59 vs 58).

💡 Google's pricing pattern is becoming clear: launch at an aggressive introductory rate, let developers build on it, then normalize upward. Argon and Carbon both started at $2/$10 and jump to $4/$20 on December 1. The question is whether Neon's $3/$15 is permanent or another intro hook.

The cached input rate — $0.15 per million tokens, a 95% discount — is where the subsidy becomes structural. For agentic workloads that repeatedly reference the same codebase or document context, effective input costs approach zero. This is not a competitive move against Claude's pricing. It is a competitive move against Claude's architecture.

Leaderboards as Marketing

Here is the uncomfortable truth that AI Explained laid out this week: every frontier lab can now claim #1 on something.

Index Current Leader Score
AA Intelligence Index Fable 5.2 62
Epoch Capability Index GPT-6.2 Astra —
GDPval STEM Gemini 4 Neon —
FrontierCode 2.0 Fable 5.2 46.4%
AA Coding Agent Index Gemini 4 Neon 58.6
Terminal-Bench 4.0 Gemini 4 Neon 63.6%

The scores are bunched so tightly that the leader changes with every new model drop. When we wrote about Argon winning 12 of 18 benchmarks but ranking 8th in Code Arena, the split was novel. Now that pattern is the norm — every model has blind spots, every model has crown jewels, and the benchmark table has become a marketing surface where labs highlight the rows where they win.

This is not a problem that more benchmarks solve. It is a structural feature of a market where three to four labs are within 2-3 percentage points of each other on most tasks. The meaningful differentiation has shifted from "which model is smartest" to "which model is cheapest for my specific workload" — and that is a question only your production data can answer.

What the Money Says

The prediction markets are not confused. Polymarket's "best AI model end of 2026" has Google at 86% — up 44 percentage points this month alone. Anthropic sits at 10%. OpenAI is at 2%.

That 2% is the most striking number on the board. The market has effectively written OpenAI out of the frontier conversation for this cycle, despite Astra launching to what Sam Altman called "amazing" and "very token-efficient" models.

Sam Altman tweeting about GPT-6.2 Sol and Astra launch

View original post on X →

Meanwhile, the AI bubble burst timing market jumped 20% this week — the crowd pulling the pop date forward to mid-2027. This is happening in the same week as Anthropic's record $81.3B IPO. Classic late-cycle behavior: the biggest raise and the loudest bust predictions arriving simultaneously.

Hacker News thread on Anthropic shares sliding

View on Hacker News →

David Sacks on the Anthropic-Doomer split

View original post on X →

David Sacks frames the emerging narrative: Anthropic is "racing toward Recursive Self-Improvement faster than any other frontier lab" — and doing so with public market money and a quarterly clock. Google's response is not to race toward RSI. It is to make the existing intelligence tier so cheap that the race becomes economically irrelevant for most buyers.

Community Reaction

The community reception splits along predictable lines.

On YouTube, TheAIGRID called Neon "the first real Opus 5.5 competitor for coding agents." Theo went further, calling it his favorite model. AI Explained's take was more measured — progress is real but domain-dependent, and no single model wins across all workloads.

r/ClaudeAI discussion on Anthropic IPO

View on Reddit →

On Reddit, r/ClaudeAI is simultaneously buzzing about the Anthropic IPO (2.2K upvotes) and a stealth model reportedly beating Fable 5.2 on the FDB leaderboard (1.3K upvotes). The juxtaposition is telling — the community is tracking both the financial narrative and the technical competition in the same breath.

The Substack coverage splits into two camps. The Neuron focused on cost analysis, concluding that the pricing gap is "the real story." Latent Space and AI Supremacy treated the week as an Anthropic story with Google as a subplot. Neither framing captures the full picture — this is a market structure story, not a single-company story.

⚠️ Contrarian Corner: The Subsidy Trap. Google's introductory pricing has a pattern: Argon and Carbon both launched at $2/$10 and jump to $4/$20 on December 1 — a 100% increase. If Neon follows the same trajectory, the $3/$15 rate becomes $6/$30 within weeks. Teams that optimize for today's Neon pricing may find themselves locked into a model whose cost advantage evaporates on a corporate calendar. The labs with the stickiest developer ecosystems — Claude Code, Cursor's integration with Anthropic — may win regardless of per-token cost, because switching costs compound faster than token savings.

The Deeper Pattern

Zoom out from any single model and the structure becomes clear. Google is running a periodic-table naming scheme that maps to pricing tiers: Hydrogen ($1.50 input) is the speed tier, Neon ($3) is the value tier, Carbon ($4 post-promo) is the premium tier, and Argon ($4) is the deep-reasoning tier. Each model occupies a price point, not just a capability band.

This is not how Anthropic or OpenAI think about their lineup. Anthropic has Haiku, Sonnet, Opus, and Fable — a good/better/best hierarchy. OpenAI has a Sol/Astra split. Google is building a periodic table where you pick the element that matches your budget constraint, not your intelligence requirement.

The implication: Google is competing on portfolio breadth, not peak performance. When every lab's best model scores within 2-3 points of the others, the lab with the most pricing options captures the most of the demand curve. The DeepSeek V4 Flash price collapse earlier this year showed that aggressive pricing can reshape market expectations overnight. Google appears to have absorbed that lesson.

What This Means for You

💡 Three things to do this week:

  1. Test Neon on your production workload before December. The $3/$15 rate may be introductory. Run your actual tasks — not benchmarks — through the Gemini API and compare cost-per-completion against your current provider. The cached input rate ($0.15/M tokens) makes repeat-context workloads dramatically cheaper.

  2. Build model-agnostic harnesses. The leaderboard rotates monthly. If your agent workflow is hardcoded to one provider's API, you are paying a tax every time the leader changes. Abstract the model layer. The teams winning right now are the ones that can swap providers in a config file.

  3. Watch the December 1 price reset. Argon and Carbon both jump to $4/$20 on December 1. If Neon stays at $3/$15 through the reset, it becomes the unambiguous value pick in Google's own lineup. If it jumps too, the cost advantage over Anthropic narrows significantly.

The frontier AI market in November 2026 looks less like a technology race and more like an airline pricing war. The planes are all roughly the same. The routes are all roughly the same. The question is who has the deepest pockets to subsidize fares until the other carriers blink — and who builds the loyalty program that keeps customers even after the sale ends.

Google has the deepest pockets. That is not a prediction. It is a balance sheet.


For our previous coverage of the Gemini 4 family, see How Google Out-Iterated the Entire Model Race and Gemini 4 Argon Wins 12 of 18 Benchmarks. Code Isn't One..

Originally published at ComputeLeap

Top comments (3)

Collapse
 
paragonaimag profile image
Paragon •

We run a small AI podcast and YouTube series, so I read this through the lens of what actually moves the needle for us — and your $3.74 vs $3.46 per-task line landed, because the gap's tiny next to the Dec 1 price reset. Our own numbers do the same thing: our five episodes' click-through rates were 1.4%, 0.4%, 0.8%, 1.3% and 0.0%, so the thumbnail and title mattered way more than which week we posted. I keep coming back to the same conclusion you did — the per-unit price is the thing to watch, not the leaderboard.

Collapse
 
robertpaschal profile image
Odinaka Robert Nnamani •

the cost-per-task table is the part that survives the hype. $3.74 for a 60 against $3.46 for a 52 says more than the leaderboard.

Collapse
 
the_daily_flare profile image
The daily flare •

I think the cost per task point is the one that will stick with me when I next pick a model.