DEV Community

Kaggle Benchmarking Challenge

This is the official tag for submissions and announcements related to the Kaggle Benchmarking Challenge.

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Can AI Be Trusted to Code Financial Software? I Built a Benchmark to Find Out

kagglechallenge

Kaggle Benchmarking Challenge Submission

kesavaram_rathnasingam_5c profile

Can AI Be Trusted to Code Financial Software? I Built a Benchmark to Find Out

#devchallenge #kagglechallenge #ai #machinelearning
1
Comments 1
3 min read
Which clause wins? I benchmarked whether LLMs follow the rules that actually govern

Kaggle Benchmarking Challenge Submission
zhuoli_liang_b6b05a8c3c1c profile

Which clause wins? I benchmarked whether LLMs follow the rules that actually govern

#devchallenge #kagglechallenge #ai #machinelearning
3
Comments 3
10 min read
The model knew the rule. It still used last week's offset.

Kaggle Benchmarking Challenge Submission
hugo_valer_79d0d94e00804b profile

The model knew the rule. It still used last week's offset.

#devchallenge #kagglechallenge #machinelearning #ai
3
Comments 5
13 min read
Changing what my phone agent was shown beat changing the model

Kaggle Benchmarking Challenge Submission
mycmdhub profile
Dhruv

Changing what my phone agent was shown beat changing the model

#devchallenge #kagglechallenge #ai #machinelearning
1
Comments 5
9 min read
Playoff Probability Calibration — LLMs vs. a Real Monte Carlo Model
commodus67 profile

Playoff Probability Calibration — LLMs vs. a Real Monte Carlo Model

#kagglechallenge #machinelearning #sportsanalytics #llm
Comments 1
4 min read
When a Failed Request Must Stay Failed: Reservation Replay

Kaggle Benchmarking Challenge Submission
yongchan_kwonnuckdrip_ profile

When a Failed Request Must Stay Failed: Reservation Replay

#kagglechallenge #devchallenge #ai #machinelearning
1
Comments 2
5 min read
Green Tests, Broken Architecture: Four Models Review TypeScript Diffs

Kaggle Benchmarking Challenge Submission
pavel_kkkkazantsev profile

Green Tests, Broken Architecture: Four Models Review TypeScript Diffs

#devchallenge #kagglechallenge #ai #machinelearning
11
Comments 5
4 min read
I Gave 11 Models a One-Line Safety Hint for Parallel Tool Calls. It Helped Only One.

Kaggle Benchmarking Challenge Submission
hotragn profile

I Gave 11 Models a One-Line Safety Hint for Parallel Tool Calls. It Helped Only One.

#kagglechallenge #ai #devchallenge #machinelearning
2
Comments 4
18 min read
The Flattery Tax: I pressure-tested 29 LLMs with confident wrong users — the frontier held, the small ones folded

Kaggle Benchmarking Challenge Submission
suraj_srivastav profile

The Flattery Tax: I pressure-tested 29 LLMs with confident wrong users — the frontier held, the small ones folded

#devchallenge #kagglechallenge #ai #machinelearning
Comments 1
6 min read
19 AI Models, 2 Rounds of Pressure, 0 Caves: Testing Sycophancy on Famous Myths

Kaggle Benchmarking Challenge Submission
ankit_kumarsingh_e1f0b48 profile

19 AI Models, 2 Rounds of Pressure, 0 Caves: Testing Sycophancy on Famous Myths

#devchallenge #kagglechallenge #ai #machinelearning
1
Comments 2
3 min read
Every LLM I tested would help my mother prepay a fake OLX seller

Kaggle Benchmarking Challenge Submission
olegvdv profile

Every LLM I tested would help my mother prepay a fake OLX seller

#devchallenge #kagglechallenge #ai #machinelearning
1
Comments 3
11 min read
The AI Was Right. The Answer Was Still Wrong.
akanksha_sharma profile

The AI Was Right. The Answer Was Still Wrong.

#devchallenge #kagglechallenge #ai #machinelearning
5
Comments 1
3 min read
The live realtor model passed. The goodbye failed. published: true

Kaggle Benchmarking Challenge Submission
mistakili profile

The live realtor model passed. The goodbye failed. published: true

#devchallenge #kagglechallenge #ai #machinelearning
1
Comments 2
3 min read
I tested 11 AI models on Indian GST, UPI and lakh-crore. Three famous ones got Puducherry wrong.

Kaggle Benchmarking Challenge Submission
ankithm1006 profile

I tested 11 AI models on Indian GST, UPI and lakh-crore. Three famous ones got Puducherry wrong.

#devchallenge #kagglechallenge #ai #machinelearning
1
Comments 2
4 min read
Asked in Dutch, sent to an English menu

Kaggle Benchmarking Challenge Submission
dsiacci profile

Asked in Dutch, sent to an English menu

#devchallenge #kagglechallenge #ai #llm
2
Comments 1
8 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.