DEV Community

Kaggle Benchmarking Challenge

This is the official tag for submissions and announcements related to the Kaggle Benchmarking Challenge.

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
I put one wrong test in the file. Most models sided with the test.

Kaggle Benchmarking Challenge Submission

I put one wrong test in the file. Most models sided with the test.

Comments 1
6 min read
Only What I Asked

Only What I Asked

Comments
3 min read
Hook constraint benchmark kaggle-challenge DONE !!!

Kaggle Benchmarking Challenge Submission

Hook constraint benchmark kaggle-challenge DONE !!!

Comments
3 min read
ASTRAL-Bench: Probing Architectural Stress Points and Cognitive Resilience in Modern LLMs

Kaggle Benchmarking Challenge Submission

ASTRAL-Bench: Probing Architectural Stress Points and Cognitive Resilience in Modern LLMs

1
Comments
8 min read
AgentToolEval: Grading How LLM Agents Use Tools, Not Just What They Answer

Kaggle Benchmarking Challenge Submission

AgentToolEval: Grading How LLM Agents Use Tools, Not Just What They Answer

9
Comments 1
8 min read
Small AI Models Can See the Trap. They Fall In Anyway

Kaggle Benchmarking Challenge Submission

Small AI Models Can See the Trap. They Fall In Anyway

1
Comments
5 min read
Can an AI Agent Know When Not to Act? A Fail-Closed Reliability Benchmark Across Six Models

Kaggle Benchmarking Challenge Submission

Can an AI Agent Know When Not to Act? A Fail-Closed Reliability Benchmark Across Six Models

Comments
4 min read
Do LLMs Actually Check Their Tools? I Built a Benchmark That Lies to Them

Kaggle Benchmarking Challenge Submission

Do LLMs Actually Check Their Tools? I Built a Benchmark That Lies to Them

2
Comments 5
8 min read
Spec, Hash or Guess: Can LLMs Keep Spain's Tamper-Proof Invoice Ledger?

Kaggle Benchmarking Challenge Submission

Spec, Hash or Guess: Can LLMs Keep Spain's Tamper-Proof Invoice Ledger?

2
Comments 2
7 min read
12 of 13 AI models knew the new name and still wrote the old one

Kaggle Benchmarking Challenge Submission

12 of 13 AI models knew the new name and still wrote the old one

27
Comments 17
11 min read
I Gave 15 AI Models Proof Their Hacking Target Was a Real Company. 73% of the Ones That Noticed Told No One.

Kaggle Benchmarking Challenge Submission

I Gave 15 AI Models Proof Their Hacking Target Was a Real Company. 73% of the Ones That Noticed Told No One.

107
Picked as gem Comments 97
44 min read
Don't Take Orders From the Internet: Benchmarking 5 LLMs Against Indirect Prompt Injection

Kaggle Benchmarking Challenge Submission

Don't Take Orders From the Internet: Benchmarking 5 LLMs Against Indirect Prompt Injection

Comments
7 min read
The Missing Piece: Why AI Models Hallucinate Answers When They Should Abstain

Kaggle Benchmarking Challenge Submission

The Missing Piece: Why AI Models Hallucinate Answers When They Should Abstain

23
Comments 2
8 min read
A CSV benchmark with two zero scores and a useful diagnostic

Kaggle Benchmarking Challenge Submission

A CSV benchmark with two zero scores and a useful diagnostic

Comments 1
7 min read
I Built a Benchmark That Grades AI Code Reviewers on Planted Defects

Kaggle Benchmarking Challenge Submission

I Built a Benchmark That Grades AI Code Reviewers on Planted Defects

Comments 2
10 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.