DEV Community

Kaggle Benchmarking Challenge

This is the official tag for submissions and announcements related to the Kaggle Benchmarking Challenge.

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Benchmarking Free AI Models for Outdoor Adventure Generation

Kaggle Benchmarking Challenge Submission

Benchmarking Free AI Models for Outdoor Adventure Generation

Comments 2
2 min read
I ported my coding-agent benchmark to Kaggle, and the first bugs I found were mine

Kaggle Benchmarking Challenge Submission

I ported my coding-agent benchmark to Kaggle, and the first bugs I found were mine

Comments 1
7 min read
RoboVerity: Benchmarking AI Models on Robotics Safety Decisions

RoboVerity: Benchmarking AI Models on Robotics Safety Decisions

1
Comments 1
3 min read
Python Reliability Benchmark: Testing AI Models Beyond Correct Answers

Python Reliability Benchmark: Testing AI Models Beyond Correct Answers

Comments 1
2 min read
KEMT: Benchmarking AI Translation Across Five Kenyan Languages

Kaggle Benchmarking Challenge Submission

KEMT: Benchmarking AI Translation Across Five Kenyan Languages

1
Comments 3
12 min read
I Asked 11 AI Models to Predict My Race Splits. Once I Named the Race, 5 Clearly Beat My Model

Kaggle Benchmarking Challenge Submission

I Asked 11 AI Models to Predict My Race Splits. Once I Named the Race, 5 Clearly Beat My Model

2
Comments
16 min read
It scored 100%. Its note scored 0%

Kaggle Benchmarking Challenge Submission

It scored 100%. Its note scored 0%

6
Comments 2
7 min read
Can a Better Model Be a Worse Thinking Partner?

Kaggle Benchmarking Challenge Submission

Can a Better Model Be a Worse Thinking Partner?

4
Comments 2
10 min read
LLMs Pass the Data-Science Quiz, Then Give Different Advice: A Kaggle Benchmark of 36 Measured Judgment Calls

Kaggle Benchmarking Challenge Submission

LLMs Pass the Data-Science Quiz, Then Give Different Advice: A Kaggle Benchmark of 36 Measured Judgment Calls

3
Comments 4
7 min read
My benchmark scored GPT-5.4 mini 1.00 by silently skipping the 3 questions it failed

Kaggle Benchmarking Challenge Submission

My benchmark scored GPT-5.4 mini 1.00 by silently skipping the 3 questions it failed

1
Comments 2
8 min read
A sharper eye did not make a more careful model.

Kaggle Benchmarking Challenge Submission

A sharper eye did not make a more careful model.

14
Comments 4
10 min read
To Rephrase or Not to Rephrase: Will AI Change Its Answer If I Ask Differently?

Kaggle Benchmarking Challenge Submission

To Rephrase or Not to Rephrase: Will AI Change Its Answer If I Ask Differently?

1
Comments 4
6 min read
NoAdivines: When Valid JSON Still Gets the Order Wrong

Kaggle Benchmarking Challenge Submission

NoAdivines: When Valid JSON Still Gets the Order Wrong

Comments 3
8 min read
7 LLMs reconciled 73 Pix statements: 99.6% correct order links, zero invented orders observed, and the hard part was the clock

Kaggle Benchmarking Challenge Submission

7 LLMs reconciled 73 Pix statements: 99.6% correct order links, zero invented orders observed, and the hard part was the clock

Comments 5
10 min read
Keep the number you wrote: 40 beach plans, 8 models, and where the knots went

Kaggle Benchmarking Challenge Submission

Keep the number you wrote: 40 beach plans, 8 models, and where the knots went

1
Comments 2
5 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.