DEV Community

Kaggle Benchmarking Challenge

This is the official tag for submissions and announcements related to the Kaggle Benchmarking Challenge.

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
AI Models Have a Spine Until You Give Them a Manager

Kaggle Benchmarking Challenge Submission

AI Models Have a Spine Until You Give Them a Manager

2
Comments 11
5 min read
I Benchmarked Whether AI Models Forget Corrections. The Answer Surprised Me.

Kaggle Benchmarking Challenge Submission

I Benchmarked Whether AI Models Forget Corrections. The Answer Surprised Me.

Comments 1
4 min read
Cents Matter: Does a Model Notice When One Financial Fact Changes?

Kaggle Benchmarking Challenge Submission

Cents Matter: Does a Model Notice When One Financial Fact Changes?

1
Comments 7
6 min read
I showed AI the buggy code. Its tests started protecting the bug.

Kaggle Benchmarking Challenge Submission

I showed AI the buggy code. Its tests started protecting the bug.

1
Comments 4
8 min read
Asked to undo a commit, 19 of 36 models destroyed work nobody mentioned

Kaggle Benchmarking Challenge Submission

Asked to undo a commit, 19 of 36 models destroyed work nobody mentioned

Comments 9
6 min read
The model knew the rule. It still used last week's offset.

Kaggle Benchmarking Challenge Submission

The model knew the rule. It still used last week's offset.

3
Comments 5
13 min read
Can AI Be Trusted to Code Financial Software? I Built a Benchmark to Find Out

kagglechallenge

Kaggle Benchmarking Challenge Submission

Can AI Be Trusted to Code Financial Software? I Built a Benchmark to Find Out

1
Comments 1
3 min read
Which clause wins? I benchmarked whether LLMs follow the rules that actually govern

Kaggle Benchmarking Challenge Submission

Which clause wins? I benchmarked whether LLMs follow the rules that actually govern

3
Comments 3
10 min read
Green Tests, Broken Architecture: Four Models Review TypeScript Diffs

Kaggle Benchmarking Challenge Submission

Green Tests, Broken Architecture: Four Models Review TypeScript Diffs

11
Comments 5
4 min read
Changing what my phone agent was shown beat changing the model

Kaggle Benchmarking Challenge Submission

Changing what my phone agent was shown beat changing the model

1
Comments 5
9 min read
Playoff Probability Calibration — LLMs vs. a Real Monte Carlo Model

Playoff Probability Calibration — LLMs vs. a Real Monte Carlo Model

Comments 1
4 min read
When a Failed Request Must Stay Failed: Reservation Replay

Kaggle Benchmarking Challenge Submission

When a Failed Request Must Stay Failed: Reservation Replay

1
Comments 2
5 min read
I Gave 11 Models a One-Line Safety Hint for Parallel Tool Calls. It Helped Only One.

Kaggle Benchmarking Challenge Submission

I Gave 11 Models a One-Line Safety Hint for Parallel Tool Calls. It Helped Only One.

2
Comments 4
18 min read
Every LLM I tested would help my mother prepay a fake OLX seller

Kaggle Benchmarking Challenge Submission

Every LLM I tested would help my mother prepay a fake OLX seller

1
Comments 2
11 min read
19 AI Models, 2 Rounds of Pressure, 0 Caves: Testing Sycophancy on Famous Myths

Kaggle Benchmarking Challenge Submission

19 AI Models, 2 Rounds of Pressure, 0 Caves: Testing Sycophancy on Famous Myths

1
Comments 1
3 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.