DEV Community

Kaggle Benchmarking Challenge

This is the official tag for submissions and announcements related to the Kaggle Benchmarking Challenge.

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
I let 10 AI models grade their own homework. Only 2 went easy on themselves.

Kaggle Benchmarking Challenge Submission
anishisbusy profile

I let 10 AI models grade their own homework. Only 2 went easy on themselves.

#devchallenge #kagglechallenge #ai #machinelearning
5
Comments 2
12 min read
AI Models Have a Spine Until You Give Them a Manager

Kaggle Benchmarking Challenge Submission
lewisawe profile

AI Models Have a Spine Until You Give Them a Manager

#kagglechallenge #ai #machinelearning #benchmarking
3
Comments 11
5 min read
RoboVerity: Benchmarking AI Models on Robotics Safety Decisions
pavani_malthumkar profile

RoboVerity: Benchmarking AI Models on Robotics Safety Decisions

#devchallenge #kagglechallenge #ai #machinelearning
1
Comments 1
3 min read
I Asked 11 AI Models to Predict My Race Splits. Once I Named the Race, 5 Clearly Beat My Model

Kaggle Benchmarking Challenge Submission
iamrobertmoore profile

I Asked 11 AI Models to Predict My Race Splits. Once I Named the Race, 5 Clearly Beat My Model

#devchallenge #kagglechallenge #ai #machinelearning
3
Comments 1
16 min read
I Benchmarked 3 LLMs on Clinical Care-Management Tasks — They Prescribe the Drug and Skip the Safety Check

Kaggle Benchmarking Challenge Submission
habib-analyst profile

I Benchmarked 3 LLMs on Clinical Care-Management Tasks — They Prescribe the Drug and Skip the Safety Check

#kagglechallenge #ai #llm #healthcare
Comments 1
4 min read
My benchmark scored GPT-5.4 mini 1.00 by silently skipping the 3 questions it failed

Kaggle Benchmarking Challenge Submission
sirenamc profile

My benchmark scored GPT-5.4 mini 1.00 by silently skipping the 3 questions it failed

#kagglechallenge #ai #machinelearning #devchallenge
1
Comments 3
8 min read
I Benchmarked Whether AI Models Forget Corrections. The Answer Surprised Me.

Kaggle Benchmarking Challenge Submission
zerogam1ng profile

I Benchmarked Whether AI Models Forget Corrections. The Answer Surprised Me.

#devchallenge #kagglechallenge #ai #machinelearning
Comments 1
4 min read
LLMs Pass the Data-Science Quiz, Then Give Different Advice: A Kaggle Benchmark of 36 Measured Judgment Calls

Kaggle Benchmarking Challenge Submission
khushi886987 profile

LLMs Pass the Data-Science Quiz, Then Give Different Advice: A Kaggle Benchmark of 36 Measured Judgment Calls

#devchallenge #kagglechallenge #machinelearning #ai
3
Comments 4
7 min read
To Rephrase or Not to Rephrase: Will AI Change Its Answer If I Ask Differently?

Kaggle Benchmarking Challenge Submission
balaji75 profile

To Rephrase or Not to Rephrase: Will AI Change Its Answer If I Ask Differently?

#devchallenge #kagglechallenge #ai #machinelearning
2
Comments 4
6 min read
Can an LLM name the WCAG criterion a snippet violates? A 6-case RGAA benchmark on Kaggle

Kaggle Benchmarking Challenge Submission
yvoolab profile
Yvoo

Can an LLM name the WCAG criterion a snippet violates? A 6-case RGAA benchmark on Kaggle

#devchallenge #kagglechallenge #ai #a11y
Comments
5 min read
Cents Matter: Does a Model Notice When One Financial Fact Changes?

Kaggle Benchmarking Challenge Submission
brunof94_debug profile

Cents Matter: Does a Model Notice When One Financial Fact Changes?

#devchallenge #kagglechallenge #ai #machinelearning
1
Comments 7
6 min read
I showed AI the buggy code. Its tests started protecting the bug.

Kaggle Benchmarking Challenge Submission
shaban_umar_eb956a5f684ce profile

I showed AI the buggy code. Its tests started protecting the bug.

#devchallenge #kagglechallenge #ai #testing
1
Comments 4
8 min read
DeployGuard: Can AI Diagnose Deployment Logs Without Guessing?

Kaggle Benchmarking Challenge Submission
sasankaweera123 profile
Sasa

DeployGuard: Can AI Diagnose Deployment Logs Without Guessing?

#devchallenge #kagglechallenge #ai #machinelearning
1
Comments
6 min read
AgentToolEval: Grading How LLM Agents Use Tools, Not Just What They Answer

Kaggle Benchmarking Challenge Submission
abhisekroy169 profile

AgentToolEval: Grading How LLM Agents Use Tools, Not Just What They Answer

#discuss #devchallenge #kagglechallenge #ai
9
Comments 1
8 min read
Asked to undo a commit, 19 of 36 models destroyed work nobody mentioned

Kaggle Benchmarking Challenge Submission
zerodrop profile

Asked to undo a commit, 19 of 36 models destroyed work nobody mentioned

#devchallenge #kagglechallenge #ai #machinelearning
Comments 9
6 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.