DEV Community

Kaggle Benchmarking Challenge

This is the official tag for submissions and announcements related to the Kaggle Benchmarking Challenge.

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Same Score, Different Failure: Fechamento BR

Kaggle Benchmarking Challenge Submission

Same Score, Different Failure: Fechamento BR

Comments
8 min read
Day 3: The benchmark caught me too.

Day 3: The benchmark caught me too.

Comments
6 min read
I asked AI to undo its work. One model broke 7 of 12 already-correct records.

Kaggle Benchmarking Challenge Submission

I asked AI to undo its work. One model broke 7 of 12 already-correct records.

Comments
7 min read
FrameFlip48: four models, one frame switch, two kinds of failure

Kaggle Benchmarking Challenge Submission

FrameFlip48: four models, one frame switch, two kinds of failure

Comments
5 min read
I graded 8 AI models the way I grade new contact centre agents

Kaggle Benchmarking Challenge Submission

I graded 8 AI models the way I grade new contact centre agents

Comments
6 min read
Day 2: The model I want is the one that's boring everywhere

Day 2: The model I want is the one that's boring everywhere

Comments
10 min read
I benchmarked what frontier models actually know about 2026 — most of it, they don't

Kaggle Benchmarking Challenge Submission

I benchmarked what frontier models actually know about 2026 — most of it, they don't

Comments
3 min read
When a Fact Is Retracted, Can an AI Keep What Still Holds?

Kaggle Benchmarking Challenge Submission

When a Fact Is Retracted, Can an AI Keep What Still Holds?

Comments
18 min read
Evidence Boundary: when an AI benchmark measures its own grading rules

Kaggle Benchmarking Challenge Submission

Evidence Boundary: when an AI benchmark measures its own grading rules

Comments
8 min read
Georgian Language Benchmark: Two Biggest AI Labs Clash in a Language That Doesn't Play by Anyone's Rules

Kaggle Benchmarking Challenge Submission

Georgian Language Benchmark: Two Biggest AI Labs Clash in a Language That Doesn't Play by Anyone's Rules

73
Picked as gem Comments 37
20 min read
When LLMs don't know a Greek word, they make one up

Kaggle Benchmarking Challenge Submission

When LLMs don't know a Greek word, they make one up

Comments
5 min read
GPT-5.5 vs Claude vs Gemini: Which AI Explains Things Clearest? I Built a Benchmark to Find Out

Kaggle Benchmarking Challenge Submission

GPT-5.5 vs Claude vs Gemini: Which AI Explains Things Clearest? I Built a Benchmark to Find Out

Comments
1 min read
Only Gemini Failed My False-Premise Benchmark — 7 Models Tested

Kaggle Benchmarking Challenge Submission

Only Gemini Failed My False-Premise Benchmark — 7 Models Tested

Comments
4 min read
To Retry or Not to Retry? That Is the Question.

Kaggle Benchmarking Challenge Submission

To Retry or Not to Retry? That Is the Question.

96
Picked as gem Comments 103
9 min read
Telltale: load-test an LLM's position before you ship it

Kaggle Benchmarking Challenge Submission

Telltale: load-test an LLM's position before you ship it

1
Comments
7 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.