DEV Community

Kaggle Benchmarking Challenge

This is the official tag for submissions and announcements related to the Kaggle Benchmarking Challenge.

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
RTL Receipt Test: Fluent Arabic is not the same as faithful evidence

Kaggle Benchmarking Challenge Submission
redwan_rahman_57319981dd0 profile

RTL Receipt Test: Fluent Arabic is not the same as faithful evidence

#machinelearning #ai #devchallenge #kagglechallenge
Comments
7 min read
ButterflyBench: I Changed One Instruction. What Else Did the AI Change?

Kaggle Benchmarking Challenge Submission
emmimal_alexander_3be8cc7 profile

ButterflyBench: I Changed One Instruction. What Else Did the AI Change?

#devchallenge #kagglechallenge #ai #machinelearning
Comments
8 min read
Engineering Discipline Benchmark

Kaggle Benchmarking Challenge Submission
digitamo profile

Engineering Discipline Benchmark

#kagglechallenge #ai #python
Comments 1
4 min read
Can LLMs read robots.txt? Easily. Can they write one? Only one of nine got every policy right.

Kaggle Benchmarking Challenge Submission
joshuawhite389 profile

Can LLMs read robots.txt? Easily. Can they write one? Only one of nine got every policy right.

#kagglechallenge #ai #webdev #benchmark
Comments 1
6 min read
Stay In Your Lane: 10 LLMs understood the request. Half still tried to referee the game.

Kaggle Benchmarking Challenge Submission
susmita8336biswas profile

Stay In Your Lane: 10 LLMs understood the request. Half still tried to referee the game.

#devchallenge #kagglechallenge #ai #machinelearning
Comments 1
6 min read
Dấu or Die: Can LLMs put the accents back on Vietnamese?
felixdoit profile

Dấu or Die: Can LLMs put the accents back on Vietnamese?

#devchallenge #kagglechallenge #ai #machinelearning
Comments 1
4 min read
My Benchmark's First Leaderboard Measured My Grader, Not the Models

Kaggle Benchmarking Challenge Submission
3dogs profile

My Benchmark's First Leaderboard Measured My Grader, Not the Models

#devchallenge #kagglechallenge #ai #machinelearning
Comments 1
5 min read
We taped over the total. Vision models filled it in anyway.

Kaggle Benchmarking Challenge Submission
zedaina profile

We taped over the total. Vision models filled it in anyway.

#devchallenge #kagglechallenge #ai #machinelearning
Comments
7 min read
Ask an AI for your home loan EMI and it will be off by â‚ą10. Every month.

Kaggle Benchmarking Challenge Submission
reet_singh_ee97da2986538e profile

Ask an AI for your home loan EMI and it will be off by â‚ą10. Every month.

#devchallenge #kagglechallenge #ai #machinelearning
Comments
6 min read
Can AI Return a Copy-Ready Spreadsheet Formula? I Tested 3 Models

Kaggle Benchmarking Challenge Submission
anvi_pardhi profile

Can AI Return a Copy-Ready Spreadsheet Formula? I Tested 3 Models

#devchallenge #kagglechallenge #ai #llm
Comments 1
2 min read
Hold the Line: Do AI Models Cave to Fake Math Professors?

Kaggle Benchmarking Challenge Submission
arjav_patni_1963ed32c00d2 profile

Hold the Line: Do AI Models Cave to Fake Math Professors?

#devchallenge #kagglechallenge #ai #machinelearning
Comments
3 min read
The Politeness Trap: When Being Nice Breaks the Instruction Hierarchy

Kaggle Benchmarking Challenge Submission
kumbayaya1804 profile

The Politeness Trap: When Being Nice Breaks the Instruction Hierarchy

#kagglechallenge
Comments
5 min read
Which AI lies less in marketing copy?

kagglechallenge

gracelee087 profile

Which AI lies less in marketing copy?

#kagglechallenge
1
Comments
16 min read
Can an AI catch the catch? I benchmarked 14 models on bounty fine print

Kaggle Benchmarking Challenge Submission
shenjun93 profile

Can an AI catch the catch? I benchmarked 14 models on bounty fine print

#devchallenge #kagglechallenge #ai #machinelearning
Comments
6 min read
Receipt Before Claim: a 4% score that did not mean 96% wrong reasoning

Kaggle Benchmarking Challenge Submission
carlosjv91 profile

Receipt Before Claim: a 4% score that did not mean 96% wrong reasoning

#kagglechallenge
Comments
4 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.