DEV Community

Kaggle Benchmarking Challenge

This is the official tag for submissions and announcements related to the Kaggle Benchmarking Challenge.

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Promise Is Not Payment: Verification Errors That Amount Accuracy Misses

Kaggle Benchmarking Challenge Submission

Promise Is Not Payment: Verification Errors That Amount Accuracy Misses

Comments 2
6 min read
The Flattery Tax: I pressure-tested 29 LLMs with confident wrong users — the frontier held, the small ones folded

Kaggle Benchmarking Challenge Submission

The Flattery Tax: I pressure-tested 29 LLMs with confident wrong users — the frontier held, the small ones folded

Comments 1
6 min read
Same Kind of Bug Isn't the Same Bug: Where AI Models Get Fooled

Kaggle Benchmarking Challenge Submission

Same Kind of Bug Isn't the Same Bug: Where AI Models Get Fooled

1
Comments 2
14 min read
Alberta stopped changing its clocks in June. 19 of 19 frontier models still put Calgary on standard time in November.

Kaggle Benchmarking Challenge Submission

Alberta stopped changing its clocks in June. 19 of 19 frontier models still put Calgary on standard time in November.

6
Comments 1
15 min read
Give an LLM no facts and ask for a job ad. What does it commit to?

Kaggle Benchmarking Challenge Submission

Give an LLM no facts and ask for a job ad. What does it commit to?

Comments
7 min read
Chain-of-Thought Faithfulness: Toggling 'Reasoning Mode' Made One Model 5x More Likely to Follow Its Own Mistakes

Kaggle Benchmarking Challenge Submission

Chain-of-Thought Faithfulness: Toggling 'Reasoning Mode' Made One Model 5x More Likely to Follow Its Own Mistakes

58
Comments 36
5 min read
Breaking Character: How "Thinking" AI Survives Villain Roleplay Traps

Breaking Character: How "Thinking" AI Survives Villain Roleplay Traps

Comments
2 min read
How AI Models "See" Hidden Meaning: A Beginner's Subtext Benchmark

How AI Models "See" Hidden Meaning: A Beginner's Subtext Benchmark

2
Comments
1 min read
I Poisoned One Test Per Problem. The Best Models Noticed, Then Made It Pass Anyway.

Kaggle Benchmarking Challenge Submission

I Poisoned One Test Per Problem. The Best Models Noticed, Then Made It Pass Anyway.

2
Comments 2
9 min read
I Benchmarked 10 AI Models to Reconstruct Real Cyber Attacks

Kaggle Benchmarking Challenge Submission

I Benchmarked 10 AI Models to Reconstruct Real Cyber Attacks

6
Comments 3
13 min read
Can LLMs audit multi-agent prompts? I made them grade my robot football team.

Kaggle Benchmarking Challenge Submission

Can LLMs audit multi-agent prompts? I made them grade my robot football team.

Comments
5 min read
8 LLMs, 480 Questions, 1 Kaggle Benchmark: Who Can Explain a Traffic Drop?

Kaggle Benchmarking Challenge Submission

8 LLMs, 480 Questions, 1 Kaggle Benchmark: Who Can Explain a Traffic Drop?

9
Comments 13
11 min read
Does your model know when it doesn't know? A benchmark for the ESCALATE answer

Kaggle Benchmarking Challenge Submission

Does your model know when it doesn't know? A benchmark for the ESCALATE answer

1
Comments 4
2 min read
Three Engines, One Informed Choice: Benchmarking Orbit

Kaggle Benchmarking Challenge Submission

Three Engines, One Informed Choice: Benchmarking Orbit

1
Comments 9
8 min read
The Plausible PR: I Gave 4 LLMs 10 Sneaky Refactors, and They All Missed the Same Bug

Kaggle Benchmarking Challenge Submission

The Plausible PR: I Gave 4 LLMs 10 Sneaky Refactors, and They All Missed the Same Bug

2
Comments 2
3 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.