DEV Community

Kaggle Benchmarking Challenge

This is the official tag for submissions and announcements related to the Kaggle Benchmarking Challenge.

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
ASTRAL-Bench: Probing Architectural Stress Points and Cognitive Resilience in Modern LLMs

Kaggle Benchmarking Challenge Submission

ASTRAL-Bench: Probing Architectural Stress Points and Cognitive Resilience in Modern LLMs

1
Comments
8 min read
Small AI Models Can See the Trap. They Fall In Anyway

Kaggle Benchmarking Challenge Submission

Small AI Models Can See the Trap. They Fall In Anyway

1
Comments
5 min read
Can an AI Agent Know When Not to Act? A Fail-Closed Reliability Benchmark Across Six Models

Kaggle Benchmarking Challenge Submission

Can an AI Agent Know When Not to Act? A Fail-Closed Reliability Benchmark Across Six Models

Comments
4 min read
Do LLMs Actually Check Their Tools? I Built a Benchmark That Lies to Them

Kaggle Benchmarking Challenge Submission

Do LLMs Actually Check Their Tools? I Built a Benchmark That Lies to Them

2
Comments 5
8 min read
Spec, Hash or Guess: Can LLMs Keep Spain's Tamper-Proof Invoice Ledger?

Kaggle Benchmarking Challenge Submission

Spec, Hash or Guess: Can LLMs Keep Spain's Tamper-Proof Invoice Ledger?

2
Comments 2
7 min read
I Gave 15 AI Models Proof Their Hacking Target Was a Real Company. 73% of the Ones That Noticed Told No One.

Kaggle Benchmarking Challenge Submission

I Gave 15 AI Models Proof Their Hacking Target Was a Real Company. 73% of the Ones That Noticed Told No One.

111
Picked as gem Comments 100
44 min read
AI agent benchmark: I gave 9 models a destroy button and a job that needed it

Kaggle Benchmarking Challenge Submission

AI agent benchmark: I gave 9 models a destroy button and a job that needed it

28
Comments 24
11 min read
Don't Take Orders From the Internet: Benchmarking 5 LLMs Against Indirect Prompt Injection

Kaggle Benchmarking Challenge Submission

Don't Take Orders From the Internet: Benchmarking 5 LLMs Against Indirect Prompt Injection

Comments
7 min read
A CSV benchmark with two zero scores and a useful diagnostic

Kaggle Benchmarking Challenge Submission

A CSV benchmark with two zero scores and a useful diagnostic

Comments 1
7 min read
I Built a Benchmark That Grades AI Code Reviewers on Planted Defects

Kaggle Benchmarking Challenge Submission

I Built a Benchmark That Grades AI Code Reviewers on Planted Defects

Comments 2
10 min read
Who Keeps Creative Control? Benchmarking LLMs as a Whole Film Crew

Kaggle Benchmarking Challenge Submission

Who Keeps Creative Control? Benchmarking LLMs as a Whole Film Crew

Comments 1
9 min read
A 0-Parameter Heuristic Tied Two Frontier Models at 84.4% and Beat 11 Others. Their Mistakes Were Completely Different.

Kaggle Benchmarking Challenge Submission

A 0-Parameter Heuristic Tied Two Frontier Models at 84.4% and Beat 11 Others. Their Mistakes Were Completely Different.

4
Comments 8
19 min read
Day 1: Most of My Bugs Looked Like Model Behaviour

Day 1: Most of My Bugs Looked Like Model Behaviour

Comments
5 min read
I Told Six Vision Models a Safe Photo Was Dangerous. Two of Them Started Seeing Danger.

Kaggle Benchmarking Challenge Submission

I Told Six Vision Models a Safe Photo Was Dangerous. Two of Them Started Seeing Danger.

1
Comments 5
12 min read
Super-Intelligent Yes-Men: Are We Training AI to Ignore the Truth?

Kaggle Benchmarking Challenge Submission

Super-Intelligent Yes-Men: Are We Training AI to Ignore the Truth?

52
Picked as gem Comments 34
11 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.