Benchmarks

👋 Sign in for the ability to sort posts by relevant, latest, or top.

Peremptory

Aug 21

Frontier Models Hit a Wall on Research Thinking

#research #benchmarks #aidevelopment

2 min read

Seth Wheeler

Aug 18

Ranking Language Models by How Well They Spot Liars

#llm #measurement #benchmarks #statistics

9 min read

Charles

Aug 18

The Benchmarkpocalypse: Why AI Benchmarks Are Broken — and What Dan Luu Says We Should Do About It

#ai #machinelearning #benchmarks #programming

4 min read

Peremptory

Aug 18

Labs are ditching factual knowledge for reasoning speed

#benchmarks #modelreleases #aistrategy #research

2 min read

The AI Downside

Aug 15

Why AI Benchmarks Mean Less Than You Think

#benchmarks #llms #evaluation #hype

6 min read

Seth Wheeler

Aug 15

An AI Capture-the-Flag Tournament: What the Scoreboard Counted

#llm #measurement #security #benchmarks

6 min read

Tommy Leonhardsen

Aug 11

Twelve LLMs Played Werewolf. The Real Wolf Was the Thinking Knob.

#llm #benchmarks #reasoning #latency

8 min read

Peremptory

Aug 7

Meta's Muse Code Clears 59% on Deep Software Engineering

#modelrelease #developertools #benchmarks #codingmodels

2 min read

Lola Lin

Jul 28

Kimi K3 for Coding: Real-World Performance Tests and Benchmarks (2026)

#kimik3 #coding #benchmarks #softwareengineering

9 min read

Pneumetron

Jul 17

SynthDocBench: A New Benchmark for Long-Context Visual Document Understanding Reveals VLM Weaknesses

#visionlanguagemodels #vlm #documentunderstanding #benchmarks

4 min read

Pneumetron

Jul 13

UniClawBench: A New Benchmark for Proactive AI Agents in Real-World Scenarios

#aiagents #benchmarks #llms #mllms

3 min read

TerminalBlog

Jul 11

AI News Roundup: Grok 4.5 Hits Tesla, Perplexity's Orchestrator Beats Opus, and Meta Undercuts Pricing

#news #industry #benchmarks #launches

2 min read

Muhammed Rasin O M

Jul 10

Half the answer keys in text-to-SQL benchmarks are wrong. So I generated the database from the answer key.

#evaluation #dataagents #benchmarks #syntheticdata

7 min read

Jonathan Murray

Aug 12

We hit 99.95% on the LoCoMo memory benchmark. Here's the catch, and why it still matters.

#ai #benchmarks #webdev #software

4 min read

Levash0v

Jul 7

Agent Leaderboards Measure Score. We Added Price.

#ai #agents #llm #benchmarks

5 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.