DEV Community

Kaggle Benchmarking Challenge

This is the official tag for submissions and announcements related to the Kaggle Benchmarking Challenge.

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
GhostInk: The Ink Faded. The AI Kept Reading.

Kaggle Benchmarking Challenge Submission

GhostInk: The Ink Faded. The AI Kept Reading.

1
Comments 1
8 min read
I tried to bait LLM judges into picking wrong answers. The weak ones rewrote the math to agree.

I tried to bait LLM judges into picking wrong answers. The weak ones rewrote the math to agree.

1
Comments 2
8 min read
Drafts That Never Shipped: do LLMs treat dead proposals as real standards?

Kaggle Benchmarking Challenge Submission

Drafts That Never Shipped: do LLMs treat dead proposals as real standards?

1
Comments 2
8 min read
Benchmarking Frontier AI on Curved Tire Sidewall OCR

Kaggle Benchmarking Challenge Submission

Benchmarking Frontier AI on Curved Tire Sidewall OCR

1
Comments 5
7 min read
Reading or Guessing? An Urdu Font-Twin Benchmark

Kaggle Benchmarking Challenge Submission

Reading or Guessing? An Urdu Font-Twin Benchmark

Comments 1
5 min read
The Last Responsible Moment: All Three Models Passed—So What Did the Benchmark Actually Measure?

Kaggle Benchmarking Challenge Submission

The Last Responsible Moment: All Three Models Passed—So What Did the Benchmark Actually Measure?

1
Comments 2
6 min read
Will an AI Agent Cheat to Survive? I Built a Benchmark to Find Out

Kaggle Benchmarking Challenge Submission

Will an AI Agent Cheat to Survive? I Built a Benchmark to Find Out

4
Comments 3
7 min read
Three Engines, One Informed Choice: Benchmarking Orbit

Kaggle Benchmarking Challenge Submission

Three Engines, One Informed Choice: Benchmarking Orbit

1
Comments 9
8 min read
I Set a Trap and Even Frontier Models Fell For It

Kaggle Benchmarking Challenge Submission

I Set a Trap and Even Frontier Models Fell For It

10
Comments 3
8 min read
Do AI models still follow instructions when the rules stack up? A control-vs-stress benchmark

Kaggle Benchmarking Challenge Submission

Do AI models still follow instructions when the rules stack up? A control-vs-stress benchmark

Comments 5
2 min read
The Models Read the Release Notes. I Measured the Runtime.

Kaggle Benchmarking Challenge Submission

The Models Read the Release Notes. I Measured the Runtime.

5
Comments
12 min read
The Plausible PR: I Gave 4 LLMs 10 Sneaky Refactors, and They All Missed the Same Bug

Kaggle Benchmarking Challenge Submission

The Plausible PR: I Gave 4 LLMs 10 Sneaky Refactors, and They All Missed the Same Bug

2
Comments 2
3 min read
LLM-Qualia-Benchmark: Analyzing the Limits of LLMs in Qualia and Epistemology

Kaggle Benchmarking Challenge Submission

LLM-Qualia-Benchmark: Analyzing the Limits of LLMs in Qualia and Epistemology

Comments 2
14 min read
Can LLMs Keep Score? I Benchmarked Tennis and Padel Score-Tracking

Kaggle Benchmarking Challenge Submission

Can LLMs Keep Score? I Benchmarked Tennis and Padel Score-Tracking

Comments 3
4 min read
Does AI Lie More in Hinglish? I Benchmarked 5 Models published: false

Does AI Lie More in Hinglish? I Benchmarked 5 Models published: false

19
Comments 4
3 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.