DEV Community

Kaggle Benchmarking Challenge

This is the official tag for submissions and announcements related to the Kaggle Benchmarking Challenge.

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
When LLMs don't know a Greek word, they make one up

Kaggle Benchmarking Challenge Submission

When LLMs don't know a Greek word, they make one up

Comments
5 min read
GPT-5.5 vs Claude vs Gemini: Which AI Explains Things Clearest? I Built a Benchmark to Find Out

Kaggle Benchmarking Challenge Submission

GPT-5.5 vs Claude vs Gemini: Which AI Explains Things Clearest? I Built a Benchmark to Find Out

Comments
1 min read
Only Gemini Failed My False-Premise Benchmark — 7 Models Tested

Kaggle Benchmarking Challenge Submission

Only Gemini Failed My False-Premise Benchmark — 7 Models Tested

Comments
4 min read
The Missing Piece: Why AI Models Hallucinate Answers When They Should Abstain

Kaggle Benchmarking Challenge Submission

The Missing Piece: Why AI Models Hallucinate Answers When They Should Abstain

22
Comments 2
8 min read
LegacyShop: Can an AI maintain a real codebase? (Kaggle Benchmark)

Kaggle Benchmarking Challenge Submission

LegacyShop: Can an AI maintain a real codebase? (Kaggle Benchmark)

8
Comments 1
7 min read
Telltale: load-test an LLM's position before you ship it

Kaggle Benchmarking Challenge Submission

Telltale: load-test an LLM's position before you ship it

1
Comments
7 min read
I Spun a Wheel of Fortune at 13 AI Models. Here's Who Took the Bait.

Kaggle Benchmarking Challenge Submission

I Spun a Wheel of Fortune at 13 AI Models. Here's Who Took the Bait.

Comments 1
13 min read
It knows you changed jobs. It still writes to your old manager.

Kaggle Benchmarking Challenge Submission

It knows you changed jobs. It still writes to your old manager.

Comments 1
8 min read
I asked AI models to build web apps. Most of them shipped a fake server inside the page.

Kaggle Benchmarking Challenge Submission

I asked AI models to build web apps. Most of them shipped a fake server inside the page.

2
Comments 5
4 min read
PageTwins: I Planted One Defect on 100 Landing Pages. Which AI Graders Noticed?

Kaggle Benchmarking Challenge Submission

PageTwins: I Planted One Defect on 100 Landing Pages. Which AI Graders Noticed?

1
Comments 4
9 min read
EvidenceFlip: Do Frontier LLMs Know When Not to Answer?

Kaggle Benchmarking Challenge Submission

EvidenceFlip: Do Frontier LLMs Know When Not to Answer?

6
Comments 3
5 min read
Building a C++ Logical Bug Detection Benchmark on Kaggle: Testing 3 AI Models

Building a C++ Logical Bug Detection Benchmark on Kaggle: Testing 3 AI Models

Comments 2
2 min read
Semantic DLP: Can AI Models Catch the Data Leak?

Kaggle Benchmarking Challenge Submission

Semantic DLP: Can AI Models Catch the Data Leak?

1
Comments 6
8 min read
Benchmarking Frontier AI on Curved Tire Sidewall OCR

Kaggle Benchmarking Challenge Submission

Benchmarking Frontier AI on Curved Tire Sidewall OCR

1
Comments 5
7 min read
The Cheapest, Fastest Model Is the Best Security Reviewer. I Tested 8 to Find Out.

Kaggle Benchmarking Challenge Submission

The Cheapest, Fastest Model Is the Best Security Reviewer. I Tested 8 to Find Out.

Comments 1
7 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.