DEV Community

Kaggle Benchmarking Challenge

This is the official tag for submissions and announcements related to the Kaggle Benchmarking Challenge.

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Does Your LLM Know the Boundary? I Left the Doors Open and 6 of 10 AI Agents Crowned Themselves

Kaggle Benchmarking Challenge Submission

Does Your LLM Know the Boundary? I Left the Doors Open and 6 of 10 AI Agents Crowned Themselves

26
Comments 11
24 min read
Don't Take Orders From the Internet: Benchmarking 5 LLMs Against Indirect Prompt Injection

Kaggle Benchmarking Challenge Submission

Don't Take Orders From the Internet: Benchmarking 5 LLMs Against Indirect Prompt Injection

Comments
7 min read
A CSV benchmark with two zero scores and a useful diagnostic

Kaggle Benchmarking Challenge Submission

A CSV benchmark with two zero scores and a useful diagnostic

Comments 1
7 min read
When AI Gets the Tickets Right but the Totals Wrong

Kaggle Benchmarking Challenge Submission

When AI Gets the Tickets Right but the Totals Wrong

6
Comments 7
6 min read
I Set a Trap and Even Frontier Models Fell For It

Kaggle Benchmarking Challenge Submission

I Set a Trap and Even Frontier Models Fell For It

9
Comments 2
8 min read
Super-Intelligent Yes-Men: Are We Training AI to Ignore the Truth?

Kaggle Benchmarking Challenge Submission

Super-Intelligent Yes-Men: Are We Training AI to Ignore the Truth?

51
Picked as gem Comments 26
11 min read
A 0-Parameter Heuristic Tied Two Frontier Models at 84.4% and Beat 11 Others. Their Mistakes Were Completely Different.

Kaggle Benchmarking Challenge Submission

A 0-Parameter Heuristic Tied Two Frontier Models at 84.4% and Beat 11 Others. Their Mistakes Were Completely Different.

4
Comments 8
19 min read
Day 1: Most of My Bugs Looked Like Model Behaviour

Day 1: Most of My Bugs Looked Like Model Behaviour

Comments
5 min read
The explanation was right. The policy ID was wrong.

Kaggle Benchmarking Challenge Submission

The explanation was right. The policy ID was wrong.

Comments
5 min read
I Told Six Vision Models a Safe Photo Was Dangerous. Two of Them Started Seeing Danger.

Kaggle Benchmarking Challenge Submission

I Told Six Vision Models a Safe Photo Was Dangerous. Two of Them Started Seeing Danger.

1
Comments 5
12 min read
Can an AI tutor stay at the learner's level?

Kaggle Benchmarking Challenge Submission

Can an AI tutor stay at the learner's level?

Comments 1
6 min read
I let 10 AI models grade their own homework. Only 2 went easy on themselves.

Kaggle Benchmarking Challenge Submission

I let 10 AI models grade their own homework. Only 2 went easy on themselves.

Comments 2
12 min read
Beyond Leaderboard Illusions: Benchmarking Multi-Turn Agentic Feedback Loops in Autonomous Software Engineering with TFD-Bench

Kaggle Benchmarking Challenge Submission

Beyond Leaderboard Illusions: Benchmarking Multi-Turn Agentic Feedback Loops in Autonomous Software Engineering with TFD-Bench

Comments 1
5 min read
PennyWise Economic Decisions: Benchmarking Frontier LLMs on Financial Reasoning Efficiency

Kaggle Benchmarking Challenge Submission

PennyWise Economic Decisions: Benchmarking Frontier LLMs on Financial Reasoning Efficiency

Comments 2
2 min read
Three models aced my Korean prize benchmark. That is the lesson.

Kaggle Benchmarking Challenge Submission

Three models aced my Korean prize benchmark. That is the lesson.

Comments 2
2 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.