DEV Community

Kaggle Benchmarking Challenge

This is the official tag for submissions and announcements related to the Kaggle Benchmarking Challenge.

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Changing what my phone agent was shown beat changing the model

Kaggle Benchmarking Challenge Submission

Changing what my phone agent was shown beat changing the model

1
Comments 3
9 min read
Can AI Return a Copy-Ready Spreadsheet Formula? I Tested 3 Models

Kaggle Benchmarking Challenge Submission

Can AI Return a Copy-Ready Spreadsheet Formula? I Tested 3 Models

Comments 1
2 min read
The Politeness Trap: When Being Nice Breaks the Instruction Hierarchy

Kaggle Benchmarking Challenge Submission

The Politeness Trap: When Being Nice Breaks the Instruction Hierarchy

Comments
5 min read
Asked to undo a commit, 19 of 36 models destroyed work nobody mentioned

Kaggle Benchmarking Challenge Submission

Asked to undo a commit, 19 of 36 models destroyed work nobody mentioned

Comments
6 min read
The Flattery Tax: I pressure-tested 29 LLMs with confident wrong users — the frontier held, the small ones folded

Kaggle Benchmarking Challenge Submission

The Flattery Tax: I pressure-tested 29 LLMs with confident wrong users — the frontier held, the small ones folded

Comments
6 min read
Every LLM I tested would help my mother prepay a fake OLX seller

Kaggle Benchmarking Challenge Submission

Every LLM I tested would help my mother prepay a fake OLX seller

Comments
11 min read
19 AI Models, 2 Rounds of Pressure, 0 Caves: Testing Sycophancy on Famous Myths

Kaggle Benchmarking Challenge Submission

19 AI Models, 2 Rounds of Pressure, 0 Caves: Testing Sycophancy on Famous Myths

1
Comments
3 min read
Which AI lies less in marketing copy?

kagglechallenge

Which AI lies less in marketing copy?

1
Comments
16 min read
Every LLM I tested would help my mother prepay a fake OLX seller

Kaggle Benchmarking Challenge Submission

Every LLM I tested would help my mother prepay a fake OLX seller

Comments
11 min read
Receipt Before Claim: a 4% score that did not mean 96% wrong reasoning

Kaggle Benchmarking Challenge Submission

Receipt Before Claim: a 4% score that did not mean 96% wrong reasoning

Comments
4 min read
Can an AI catch the catch? I benchmarked 14 models on bounty fine print

Kaggle Benchmarking Challenge Submission

Can an AI catch the catch? I benchmarked 14 models on bounty fine print

Comments
6 min read
I tested 11 AI models on Indian GST, UPI and lakh-crore. Three famous ones got Puducherry wrong.

Kaggle Benchmarking Challenge Submission

I tested 11 AI models on Indian GST, UPI and lakh-crore. Three famous ones got Puducherry wrong.

1
Comments
4 min read
The live realtor model passed. The goodbye failed. published: true

Kaggle Benchmarking Challenge Submission

The live realtor model passed. The goodbye failed. published: true

1
Comments
3 min read
My AI agents didn't fake citations. One in four still didn't hold.

Kaggle Benchmarking Challenge Submission

My AI agents didn't fake citations. One in four still didn't hold.

Comments
11 min read
Kaggle Benchmarking Challenge

Kaggle Benchmarking Challenge Submission

Kaggle Benchmarking Challenge

Comments
7 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.