DEV Community

Kaggle Benchmarking Challenge

This is the official tag for submissions and announcements related to the Kaggle Benchmarking Challenge.

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
I put one wrong test in the file. Most models sided with the test.

Kaggle Benchmarking Challenge Submission
anaalkmim profile

I put one wrong test in the file. Most models sided with the test.

#devchallenge #kagglechallenge #ai #machinelearning
Comments 1
6 min read
Only What I Asked
akj1608 profile

Only What I Asked

#kagglechallenge #ai
Comments
3 min read
Hook constraint benchmark kaggle-challenge DONE !!!

Kaggle Benchmarking Challenge Submission
shahzeen_anwar_75143f6785 profile

Hook constraint benchmark kaggle-challenge DONE !!!

#devchallenge #kagglechallenge #ai #machinelearning
Comments
3 min read
UMKM-Bench: I tested 8 LLMs on how Indonesians really text online shops

Kaggle Benchmarking Challenge Submission
rizkynandapr profile

UMKM-Bench: I tested 8 LLMs on how Indonesians really text online shops

#devchallenge #kagglechallenge #ai #machinelearning
Comments
8 min read
10 Real Airflow Incidents, 5 AI Models — Which One Handled Production Best?

Kaggle Benchmarking Challenge Submission
suyashmagar17 profile

10 Real Airflow Incidents, 5 AI Models — Which One Handled Production Best?

#devchallenge #kagglechallenge #ai #machinelearning
Comments 1
4 min read
Ask ten LLMs for a Blender 5.0 script. Then run it in Blender 5.0.

Kaggle Benchmarking Challenge Submission
rustam335 profile

Ask ten LLMs for a Blender 5.0 script. Then run it in Blender 5.0.

#devchallenge #kagglechallenge #ai #blender
3
Comments 1
9 min read
Small AI Models Can See the Trap. They Fall In Anyway

Kaggle Benchmarking Challenge Submission
mujohn26 profile

Small AI Models Can See the Trap. They Fall In Anyway

#devchallenge #kagglechallenge #ai #machinelearning
1
Comments
5 min read
Can an AI Agent Know When Not to Act? A Fail-Closed Reliability Benchmark Across Six Models

Kaggle Benchmarking Challenge Submission
tdealer01crypto profile

Can an AI Agent Know When Not to Act? A Fail-Closed Reliability Benchmark Across Six Models

#devchallenge #kagglechallenge #ai #machinelearning
Comments
4 min read
Do LLMs Actually Check Their Tools? I Built a Benchmark That Lies to Them

Kaggle Benchmarking Challenge Submission
ridhoajaaa profile

Do LLMs Actually Check Their Tools? I Built a Benchmark That Lies to Them

#devchallenge #kagglechallenge #ai #machinelearning
2
Comments 5
8 min read
100% vuln detection wasn't enough: measuring whether AI respects the patch

Kaggle Benchmarking Challenge Submission
unit_500_c36d1b1011fdf39c profile

100% vuln detection wasn't enough: measuring whether AI respects the patch

#devchallenge #kagglechallenge #ai #machinelearning
7
Comments 4
6 min read
Do LLMs Catch Bad Startup Math? My First Answer Was Wrong.

Kaggle Benchmarking Challenge Submission
ritamgit_alt profile

Do LLMs Catch Bad Startup Math? My First Answer Was Wrong.

#devchallenge #kagglechallenge #ai #machinelearning
Comments 5
3 min read
Can AI Diagnose a Linux Production Incident Without Making It Worse?

Kaggle Benchmarking Challenge Submission
yemmmyc profile

Can AI Diagnose a Linux Production Incident Without Making It Worse?

#devchallenge #kagglechallenge #ai #machinelearning
Comments 2
5 min read
Chain-of-Thought Faithfulness: Toggling 'Reasoning Mode' Made One Model 5x More Likely to Follow Its Own Mistakes

Kaggle Benchmarking Challenge Submission
dj29 profile

Chain-of-Thought Faithfulness: Toggling 'Reasoning Mode' Made One Model 5x More Likely to Follow Its Own Mistakes

#devchallenge #kagglechallenge #ai #machinelearning
44
Comments 20
5 min read
LAW-N Real-World Data Layer
peacebinflow profile

LAW-N Real-World Data Layer

#devchallenge #kagglechallenge #ai #machinelearning
3
Comments
8 min read
Don't Take Orders From the Internet: Benchmarking 5 LLMs Against Indirect Prompt Injection

Kaggle Benchmarking Challenge Submission
kakarotdev profile
Axel

Don't Take Orders From the Internet: Benchmarking 5 LLMs Against Indirect Prompt Injection

#kagglechallenge #ai #llm #programming
Comments
7 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.