DEV Community

Kaggle Benchmarking Challenge

This is the official tag for submissions and announcements related to the Kaggle Benchmarking Challenge.

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Drafts That Never Shipped: do LLMs treat dead proposals as real standards?

Kaggle Benchmarking Challenge Submission

Drafts That Never Shipped: do LLMs treat dead proposals as real standards?

1
Comments 2
8 min read
Will an AI Agent Cheat to Survive? I Built a Benchmark to Find Out

Kaggle Benchmarking Challenge Submission

Will an AI Agent Cheat to Survive? I Built a Benchmark to Find Out

3
Comments 3
7 min read
Reading or Guessing? An Urdu Font-Twin Benchmark

Kaggle Benchmarking Challenge Submission

Reading or Guessing? An Urdu Font-Twin Benchmark

Comments 1
5 min read
The Last Responsible Moment: All Three Models Passed—So What Did the Benchmark Actually Measure?

Kaggle Benchmarking Challenge Submission

The Last Responsible Moment: All Three Models Passed—So What Did the Benchmark Actually Measure?

1
Comments 1
6 min read
Do AI models understand daily life in Pakistan? lakh/crore, PKT and Urdu tested

Kaggle Benchmarking Challenge Submission

Do AI models understand daily life in Pakistan? lakh/crore, PKT and Urdu tested

Comments 1
6 min read
What Does AI Forget First?

Kaggle Benchmarking Challenge Submission

What Does AI Forget First?

1
Comments 1
4 min read
Can an LLM Read a Fraud Network? Testing Gemma 4 31B

Kaggle Benchmarking Challenge Submission

Can an LLM Read a Fraud Network? Testing Gemma 4 31B

Comments 1
2 min read
Can GPT-5.4 mini handle least-privilege cloud incidents? A 16-case benchmark

Kaggle Benchmarking Challenge Submission

Can GPT-5.4 mini handle least-privilege cloud incidents? A 16-case benchmark

Comments 2
2 min read
Do AI models still follow instructions when the rules stack up? A control-vs-stress benchmark

Kaggle Benchmarking Challenge Submission

Do AI models still follow instructions when the rules stack up? A control-vs-stress benchmark

Comments 3
2 min read
I Tested 5 AI Models on Hinglish — Here's Who Won

I Tested 5 AI Models on Hinglish — Here's Who Won

3
Comments 1
1 min read
Does your coding agent understand you in your native language?

Kaggle Benchmarking Challenge Submission

Does your coding agent understand you in your native language?

Comments 1
4 min read
Can LLMs Keep Score? I Benchmarked Tennis and Padel Score-Tracking

Kaggle Benchmarking Challenge Submission

Can LLMs Keep Score? I Benchmarked Tennis and Padel Score-Tracking

Comments 3
4 min read
Gone for Good? I asked 10 models which deleted data could actually be restored

Kaggle Benchmarking Challenge Submission

Gone for Good? I asked 10 models which deleted data could actually be restored

1
Comments 2
10 min read
LLM-Qualia-Benchmark: Analyzing the Limits of LLMs in Qualia and Epistemology

Kaggle Benchmarking Challenge Submission

LLM-Qualia-Benchmark: Analyzing the Limits of LLMs in Qualia and Epistemology

Comments 1
14 min read
TeluguMixBench: Evaluating LLMs on Telugu and Telugu-English Code-Mixed Tasks

TeluguMixBench: Evaluating LLMs on Telugu and Telugu-English Code-Mixed Tasks

Comments 1
2 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.