DEV Community

Kaggle Benchmarking Challenge

This is the official tag for submissions and announcements related to the Kaggle Benchmarking Challenge.

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
I Turned the Reasoning Dial to 'High' on 4 Models. It Fixed One Thing and Billed Me for Everything.

Kaggle Benchmarking Challenge Submission
abeera_lodhi profile

I Turned the Reasoning Dial to 'High' on 4 Models. It Fixed One Thing and Billed Me for Everything.

#devchallenge #kagglechallenge #ai #machinelearning
11
Comments 2
17 min read
PageTwins: I Planted One Defect on 100 Landing Pages. Which AI Graders Noticed?

Kaggle Benchmarking Challenge Submission
starknight profile

PageTwins: I Planted One Defect on 100 Landing Pages. Which AI Graders Noticed?

#devchallenge #kagglechallenge #ai #machinelearning
1
Comments 7
9 min read
Day 11: Kaggle Escalation Benchmark: Rank the floor, not the average.
sean_campbell_840bd62bf7e profile

Day 11: Kaggle Escalation Benchmark: Rank the floor, not the average.

#kagglechallenge #ai #devchallenge #python
Comments 4
7 min read
Your AI Agent Has a Burn Rate — So I Benchmarked the Cost of a Correct Answer

Kaggle Benchmarking Challenge Submission
karmendra_pandey_43ac6983 profile

Your AI Agent Has a Burn Rate — So I Benchmarked the Cost of a Correct Answer

#kagglechallenge #ai #llm #opensource
1
Comments 6
4 min read
I asked AI models to build web apps. Most of them shipped a fake server inside the page.

Kaggle Benchmarking Challenge Submission
fabc14 profile

I asked AI models to build web apps. Most of them shipped a fake server inside the page.

#devchallenge #kagglechallenge #ai #machinelearning
2
Comments 5
4 min read
When AI Gets the Tickets Right but the Totals Wrong

Kaggle Benchmarking Challenge Submission
pranav_kishan_ profile

When AI Gets the Tickets Right but the Totals Wrong

#devchallenge #kagglechallenge #ai #machinelearning
11
Comments 9
6 min read
Can AI close the books? An FP&A reasoning benchmark

Kaggle Benchmarking Challenge Submission
marcopolo2026 profile

Can AI close the books? An FP&A reasoning benchmark

#devchallenge #kagglechallenge #ai #machinelearning
Comments 4
6 min read
DataBugBench: Benchmarking LLMs on Silent Python Data Science Bugs

Kaggle Benchmarking Challenge Submission
coder_432 profile

DataBugBench: Benchmarking LLMs on Silent Python Data Science Bugs

#devchallenge #kagglechallenge #ai #machinelearning
Comments 1
2 min read
Can Modern VLMs Actually Reason Through Spatial Grid Puzzles?

Kaggle Benchmarking Challenge Submission
fahmiiii profile

Can Modern VLMs Actually Reason Through Spatial Grid Puzzles?

#devchallenge #kagglechallenge #ai #machinelearning
1
Comments 3
3 min read
Does your model know when it doesn't know? A benchmark for the ESCALATE answer

Kaggle Benchmarking Challenge Submission
sean_campbell_840bd62bf7e profile

Does your model know when it doesn't know? A benchmark for the ESCALATE answer

#devchallenge #kagglechallenge #ai #machinelearning
1
Comments 4
2 min read
The Runtime IS the Benchmark: Endurance Metrics for Local Agents
ab371 profile

The Runtime IS the Benchmark: Endurance Metrics for Local Agents

#devchallenge #kagglechallenge #ai #machinelearning
1
Comments 2
2 min read
Semantic DLP: Can AI Models Catch the Data Leak?

Kaggle Benchmarking Challenge Submission
ksr profile

Semantic DLP: Can AI Models Catch the Data Leak?

#devchallenge #kagglechallenge #ai #machinelearning
1
Comments 7
8 min read
EvidenceFlip: Do Frontier LLMs Know When Not to Answer?

Kaggle Benchmarking Challenge Submission
az-dev1 profile

EvidenceFlip: Do Frontier LLMs Know When Not to Answer?

#devchallenge #kagglechallenge #ai #machinelearning
6
Comments 3
5 min read
I tried to Dutch-book 26 LLM forecasters. Asked one question at a time, every one of them paid out.

Kaggle Benchmarking Challenge Submission
yy5652hash profile

I tried to Dutch-book 26 LLM forecasters. Asked one question at a time, every one of them paid out.

#devchallenge #kagglechallenge #ai #machinelearning
Comments 2
9 min read
The Backdoor That Survived “Forget Me”: Can LLMs Audit Machine Unlearning?

Kaggle Benchmarking Challenge Submission
khushi_30708f354e56618979 profile

The Backdoor That Survived “Forget Me”: Can LLMs Audit Machine Unlearning?

#security #ai #machinelearning #kagglechallenge
Comments
5 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.