DEV Community

Kaggle Benchmarking Challenge

This is the official tag for submissions and announcements related to the Kaggle Benchmarking Challenge.

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
I Surveyed 123 People in India to Benchmark Frontier AI

Kaggle Benchmarking Challenge Submission

I Surveyed 123 People in India to Benchmark Frontier AI

27
Comments
5 min read
DarijaBench: Do AI Models Actually Understand Moroccan Darija?

Kaggle Benchmarking Challenge Submission

DarijaBench: Do AI Models Actually Understand Moroccan Darija?

1
Comments 3
2 min read
I Gave 5 AI Models Bugs That Don't Crash Your Code. Here's Who Actually Fixed Them.

kagglechallenge

I Gave 5 AI Models Bugs That Don't Crash Your Code. Here's Who Actually Fixed Them.

Comments 2
10 min read
Smaller models often read URLs like Python, not like fetch(). I benchmarked where the API key leaks

kagglechallenge

Kaggle Benchmarking Challenge Submission

Smaller models often read URLs like Python, not like fetch(). I benchmarked where the API key leaks

8
Comments 2
10 min read
Valid JSON is not enough: testing bilingual patch contracts on Kaggle

Kaggle Benchmarking Challenge Submission

Valid JSON is not enough: testing bilingual patch contracts on Kaggle

Comments
4 min read
Braşov or Brașov? Give 43 LLMs the wrong letter, and a third of their answers keep it

Kaggle Benchmarking Challenge Submission

Braşov or Brașov? Give 43 LLMs the wrong letter, and a third of their answers keep it

Comments
28 min read
I Found 60+ Live Supabase Keys in Public Repos, So I Benchmark Whether LLMs Can Spot Them

Kaggle Benchmarking Challenge Submission

I Found 60+ Live Supabase Keys in Public Repos, So I Benchmark Whether LLMs Can Spot Them

6
Comments 3
5 min read
A correct action plan can still score zero

Kaggle Benchmarking Challenge Submission

A correct action plan can still score zero

Comments
5 min read
Same Patient, Conflicting Documents: Can AI Preserve the Evidence?

Kaggle Benchmarking Challenge Submission

Same Patient, Conflicting Documents: Can AI Preserve the Evidence?

7
Comments
13 min read
1:30 AM Happens Twice on November 1. Most AI Models Picked One and Moved On.

Kaggle Benchmarking Challenge Submission

1:30 AM Happens Twice on November 1. Most AI Models Picked One and Moved On.

1
Comments 2
5 min read
Ask ten LLMs for a Blender 5.0 script. Then run it in Blender 5.0.

Kaggle Benchmarking Challenge Submission

Ask ten LLMs for a Blender 5.0 script. Then run it in Blender 5.0.

6
Comments 2
9 min read
ProofSec: Benchmarking Epistemic Robustness and Evidence-Grounded Vulnerability Reasoning in Frontier LLM

Kaggle Benchmarking Challenge Submission

ProofSec: Benchmarking Epistemic Robustness and Evidence-Grounded Vulnerability Reasoning in Frontier LLM

10
Comments
14 min read
Hindsight-Free Temporal Evidence Eligibility

Kaggle Benchmarking Challenge Submission

Hindsight-Free Temporal Evidence Eligibility

Comments
4 min read
Do LLMs Catch Bad Startup Math? My First Answer Was Wrong.

Kaggle Benchmarking Challenge Submission

Do LLMs Catch Bad Startup Math? My First Answer Was Wrong.

Comments 7
5 min read
AI reviewers catch Italian UI bugs, then flag the good fixes too

Kaggle Benchmarking Challenge Submission

AI reviewers catch Italian UI bugs, then flag the good fixes too

Comments 1
5 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.