DEV Community

Kaggle Benchmarking Challenge

This is the official tag for submissions and announcements related to the Kaggle Benchmarking Challenge.

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
AI agent benchmark: I gave 9 models a destroy button and a job that needed it

Kaggle Benchmarking Challenge Submission

AI agent benchmark: I gave 9 models a destroy button and a job that needed it

11
Comments 5
11 min read
12 of 13 AI models knew the new name and still wrote the old one

Kaggle Benchmarking Challenge Submission

12 of 13 AI models knew the new name and still wrote the old one

24
Comments 7
11 min read
I Set a Trap and Even Frontier Models Fell For It

Kaggle Benchmarking Challenge Submission

I Set a Trap and Even Frontier Models Fell For It

2
Comments 2
8 min read
Gone for Good? I asked 10 models which deleted data could actually be restored

Kaggle Benchmarking Challenge Submission

Gone for Good? I asked 10 models which deleted data could actually be restored

Comments 1
10 min read
Same Score, Different Habits: What Frontier Models Did Inside VORTEX

Kaggle Benchmarking Challenge Submission

Same Score, Different Habits: What Frontier Models Did Inside VORTEX

Comments
5 min read
Hold or Fold: Do AI Models Abandon Correct Answers When Users Push Back?

Hold or Fold: Do AI Models Abandon Correct Answers When Users Push Back?

Comments
4 min read
Can an AI tutor stay at the learner's level?

Kaggle Benchmarking Challenge Submission

Can an AI tutor stay at the learner's level?

Comments 1
6 min read
Can AI tell whether an optimum is unique? A small Kaggle benchmark with exact answers

Kaggle Benchmarking Challenge Submission

Can AI tell whether an optimum is unique? A small Kaggle benchmark with exact answers

Comments
4 min read
Beyond Leaderboard Illusions: Benchmarking Multi-Turn Agentic Feedback Loops in Autonomous Software Engineering with TFD-Bench

Kaggle Benchmarking Challenge Submission

Beyond Leaderboard Illusions: Benchmarking Multi-Turn Agentic Feedback Loops in Autonomous Software Engineering with TFD-Bench

Comments 1
5 min read
I let 10 AI models grade their own homework. Only 2 went easy on themselves.

Kaggle Benchmarking Challenge Submission

I let 10 AI models grade their own homework. Only 2 went easy on themselves.

Comments 1
12 min read
Three models aced my Korean prize benchmark. That is the lesson.

Kaggle Benchmarking Challenge Submission

Three models aced my Korean prize benchmark. That is the lesson.

Comments 1
2 min read
PennyWise Economic Decisions: Benchmarking Frontier LLMs on Financial Reasoning Efficiency

Kaggle Benchmarking Challenge Submission

PennyWise Economic Decisions: Benchmarking Frontier LLMs on Financial Reasoning Efficiency

Comments 1
2 min read
Does AI Lie More in Hinglish? I Benchmarked 5 Models published: false

Does AI Lie More in Hinglish? I Benchmarked 5 Models published: false

12
Comments 1
3 min read
Benchmarking Free AI Models for Outdoor Adventure Generation

Kaggle Benchmarking Challenge Submission

Benchmarking Free AI Models for Outdoor Adventure Generation

Comments 1
2 min read
I ported my coding-agent benchmark to Kaggle, and the first bugs I found were mine

Kaggle Benchmarking Challenge Submission

I ported my coding-agent benchmark to Kaggle, and the first bugs I found were mine

Comments 1
7 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.