DEV Community

Kaggle Benchmarking Challenge

This is the official tag for submissions and announcements related to the Kaggle Benchmarking Challenge.

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Smaller models often read URLs like Python, not like fetch(). I benchmarked where the API key leaks

kagglechallenge

Kaggle Benchmarking Challenge Submission

pierrelaurentmedori profile

Smaller models often read URLs like Python, not like fetch(). I benchmarked where the API key leaks

#devchallenge #kagglechallenge #machinelearning #ai
8
Comments 2
10 min read
Valid JSON is not enough: testing bilingual patch contracts on Kaggle

Kaggle Benchmarking Challenge Submission
widechaos profile

Valid JSON is not enough: testing bilingual patch contracts on Kaggle

#devchallenge #kagglechallenge #ai #machinelearning
Comments
4 min read
Braşov or Brașov? Give 43 LLMs the wrong letter, and a third of their answers keep it

Kaggle Benchmarking Challenge Submission
danielbutnar profile

Braşov or Brașov? Give 43 LLMs the wrong letter, and a third of their answers keep it

#devchallenge #kagglechallenge #ai #machinelearning
Comments
28 min read
Do LLMs Have a Spine? I Benchmarked Sycophancy Across 7 Frontier Models

Kaggle Benchmarking Challenge Submission
shahbaz_ali profile

Do LLMs Have a Spine? I Benchmarked Sycophancy Across 7 Frontier Models

#devchallenge #kagglechallenge #ai #machinelearning
1
Comments 3
6 min read
The explanation was right. The policy ID was wrong.

Kaggle Benchmarking Challenge Submission
guanguan_li_431227cf61c02 profile

The explanation was right. The policy ID was wrong.

#kagglechallenge
Comments 1
5 min read
8 LLMs, 480 Questions, 1 Kaggle Benchmark: Who Can Explain a Traffic Drop?

Kaggle Benchmarking Challenge Submission
nishikantaray profile

8 LLMs, 480 Questions, 1 Kaggle Benchmark: Who Can Explain a Traffic Drop?

#devchallenge #kagglechallenge #ai #machinelearning
9
Comments 13
11 min read
A correct action plan can still score zero

Kaggle Benchmarking Challenge Submission
luodahong profile

A correct action plan can still score zero

#devchallenge #kagglechallenge #machinelearning #ai
Comments
5 min read
1:30 AM Happens Twice on November 1. Most AI Models Picked One and Moved On.

Kaggle Benchmarking Challenge Submission
wishbone_data profile

1:30 AM Happens Twice on November 1. Most AI Models Picked One and Moved On.

#devchallenge #kagglechallenge #ai #machinelearning
1
Comments 2
5 min read
Same Patient, Conflicting Documents: Can AI Preserve the Evidence?

Kaggle Benchmarking Challenge Submission
p0rt profile

Same Patient, Conflicting Documents: Can AI Preserve the Evidence?

#devchallenge #kagglechallenge #ai #machinelearning
7
Comments
13 min read
Ask ten LLMs for a Blender 5.0 script. Then run it in Blender 5.0.

Kaggle Benchmarking Challenge Submission
rustam335 profile

Ask ten LLMs for a Blender 5.0 script. Then run it in Blender 5.0.

#devchallenge #kagglechallenge #ai #blender
6
Comments 2
9 min read
ProofSec: Benchmarking Epistemic Robustness and Evidence-Grounded Vulnerability Reasoning in Frontier LLM

Kaggle Benchmarking Challenge Submission
anuththara2007w profile

ProofSec: Benchmarking Epistemic Robustness and Evidence-Grounded Vulnerability Reasoning in Frontier LLM

#devchallenge #kagglechallenge #ai #machinelearning
10
Comments
14 min read
Hindsight-Free Temporal Evidence Eligibility

Kaggle Benchmarking Challenge Submission
vereos profile

Hindsight-Free Temporal Evidence Eligibility

#devchallenge #kagglechallenge #ai #machinelearning
Comments
4 min read
Do LLMs Catch Bad Startup Math? My First Answer Was Wrong.

Kaggle Benchmarking Challenge Submission
ritamgit_alt profile

Do LLMs Catch Bad Startup Math? My First Answer Was Wrong.

#devchallenge #kagglechallenge #ai #machinelearning
Comments 7
5 min read
AI reviewers catch Italian UI bugs, then flag the good fixes too

Kaggle Benchmarking Challenge Submission
exochard profile

AI reviewers catch Italian UI bugs, then flag the good fixes too

#devchallenge #kagglechallenge #ai #machinelearning
Comments 1
5 min read
What Happens When an AI System Is Built to Challenge Its Own Decisions?

Kaggle Benchmarking Challenge Submission
danielecangi profile
DaC

What Happens When an AI System Is Built to Challenge Its Own Decisions?

#devchallenge #kagglechallenge #ai #machinelearning
7
Comments 1
6 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.