DEV Community

#benchmark

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Qwen3.8 vs Ornith 1.5 on a Mac: speed and code review

Qwen3.8 vs Ornith 1.5 on a Mac: speed and code review

Comments
6 min read
How to Read a Public Leaderboard Without Fooling Yourself

How to Read a Public Leaderboard Without Fooling Yourself

Comments
3 min read
Model-Level RSI: What It Means When a Model Improves Its Own Weights

Model-Level RSI: What It Means When a Model Improves Its Own Weights

Comments
3 min read
LLM Evaluation Explained: How a Benchmark Produces Comparable Numbers

LLM Evaluation Explained: How a Benchmark Produces Comparable Numbers

Comments
3 min read
Open Quantum Challenge (OQC): a reproducible, hardware-free quantum benchmark

Open Quantum Challenge (OQC): a reproducible, hardware-free quantum benchmark

Comments
1 min read
오픈 퀀텀 챌린지(OQC): 재현 가능한 하드웨어 프리 양자 벤치마크

오픈 퀀텀 챌린지(OQC): 재현 가능한 하드웨어 프리 양자 벤치마크

Comments
1 min read
Eleven Number-One Records: Measuring a Model That Swept Math, Science, Law and Decisions

Eleven Number-One Records: Measuring a Model That Swept Math, Science, Law and Decisions

Comments
2 min read
How LLM Evaluation Actually Works: Inside a Benchmark That Produces Comparable Numbers

How LLM Evaluation Actually Works: Inside a Benchmark That Produces Comparable Numbers

Comments
4 min read
HumanEval Passes. Production Burns. The Real Story of AI Code Generation in the Vibe Coding Era

HumanEval Passes. Production Burns. The Real Story of AI Code Generation in the Vibe Coding Era

Comments
8 min read
I benchmarked seven hotel price APIs on the same Rome room, and the prices were 16% apart because of tax

I benchmarked seven hotel price APIs on the same Rome room, and the prices were 16% apart because of tax

Comments
4 min read
I benchmarked four Google Flights APIs on the same searches, and the fares matched to the dollar

I benchmarked four Google Flights APIs on the same searches, and the fares matched to the dollar

Comments
4 min read
Can LLMs read robots.txt? Easily. Can they write one? Only one of nine got every policy right.

Kaggle Benchmarking Challenge Submission

Can LLMs read robots.txt? Easily. Can they write one? Only one of nine got every policy right.

Comments 1
6 min read
What Independent Benchmarks Say About Opus 5.5

What Independent Benchmarks Say About Opus 5.5

Comments
8 min read
LLM Evaluation: How a Benchmark Turns Raw Answers Into Comparable Numbers

LLM Evaluation: How a Benchmark Turns Raw Answers Into Comparable Numbers

Comments
4 min read
Parakeet Redux: is a 178 MB speech model useful in the real world?

Parakeet Redux: is a 178 MB speech model useful in the real world?

Comments
16 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.