DEV Community

Kaggle Benchmarking Challenge

This is the official tag for submissions and announcements related to the Kaggle Benchmarking Challenge.

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Can an LLM Read a Fraud Network? Testing Gemma 4 31B

Kaggle Benchmarking Challenge Submission

Can an LLM Read a Fraud Network? Testing Gemma 4 31B

1
Comments
2 min read
I Tested Whether AI Actually Understands How My People Talk

I Tested Whether AI Actually Understands How My People Talk

Comments
4 min read
An AI optimization made llama2.c finish sooner and start streaming later

Kaggle Benchmarking Challenge Submission

An AI optimization made llama2.c finish sooner and start streaming later

Comments 3
9 min read
One Model Scored 0%, Another 97%—Their Failures Were Completely Different

Kaggle Benchmarking Challenge Submission

One Model Scored 0%, Another 97%—Their Failures Were Completely Different

Comments 1
6 min read
I Built a Benchmark That Catches AI Models Cheating (And They All Failed)

I Built a Benchmark That Catches AI Models Cheating (And They All Failed)

Comments
3 min read
Does AI get worse with more documents? Open-source vs paid models, tested.

Kaggle Benchmarking Challenge Submission

Does AI get worse with more documents? Open-source vs paid models, tested.

Comments 1
7 min read
SchemaShift: Can LLMs Reliably Debug Data Pipelines?

Kaggle Benchmarking Challenge Submission

SchemaShift: Can LLMs Reliably Debug Data Pipelines?

Comments
3 min read
Same Score, Different Habits: What Frontier Models Did Inside VORTEX

Kaggle Benchmarking Challenge Submission

Same Score, Different Habits: What Frontier Models Did Inside VORTEX

Comments
5 min read
I Tested Whether AI Can Keep Up With a Changing Software Specification

I Tested Whether AI Can Keep Up With a Changing Software Specification

Comments
2 min read
Hold or Fold: Do AI Models Abandon Correct Answers When Users Push Back?

Hold or Fold: Do AI Models Abandon Correct Answers When Users Push Back?

Comments
4 min read
Can AI tell whether an optimum is unique? A small Kaggle benchmark with exact answers

Kaggle Benchmarking Challenge Submission

Can AI tell whether an optimum is unique? A small Kaggle benchmark with exact answers

Comments
4 min read
Invented O'Clock: I removed one fact from 45 scheduling problems to see which AI models make up a time

Kaggle Benchmarking Challenge Submission

Invented O'Clock: I removed one fact from 45 scheduling problems to see which AI models make up a time

Comments
11 min read
Two models sent a moving bill to the wrong chat

Kaggle Benchmarking Challenge Submission

Two models sent a moving bill to the wrong chat

Comments
4 min read
I set filmmaker traps for AI "directors." The models fell for one. My rubric fell for three.

I set filmmaker traps for AI "directors." The models fell for one. My rubric fell for three.

Comments 1
4 min read
Who Reviews the Reviewers? Benchmarking AI Agents on PR Audits

Who Reviews the Reviewers? Benchmarking AI Agents on PR Audits

Comments
2 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.