DEV Community

Kaggle Benchmarking Challenge

This is the official tag for submissions and announcements related to the Kaggle Benchmarking Challenge.

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
The AI Was Right. The Answer Was Still Wrong.
akanksha_sharma profile

The AI Was Right. The Answer Was Still Wrong.

#devchallenge #kagglechallenge #ai #machinelearning
5
Comments 1
3 min read
The live realtor model passed. The goodbye failed. published: true

Kaggle Benchmarking Challenge Submission
mistakili profile

The live realtor model passed. The goodbye failed. published: true

#devchallenge #kagglechallenge #ai #machinelearning
1
Comments 2
3 min read
Count It or Compute It: When a Tool Returns Rows, the Models That Count Them Right Spend the Tokens

Kaggle Benchmarking Challenge Submission
xbill profile

Count It or Compute It: When a Tool Returns Rows, the Models That Count Them Right Spend the Tokens

#devchallenge #kagglechallenge #ai #machinelearning
15
Comments 7
10 min read
I tested 11 AI models on Indian GST, UPI and lakh-crore. Three famous ones got Puducherry wrong.

Kaggle Benchmarking Challenge Submission
ankithm1006 profile

I tested 11 AI models on Indian GST, UPI and lakh-crore. Three famous ones got Puducherry wrong.

#devchallenge #kagglechallenge #ai #machinelearning
1
Comments 1
4 min read
Asked in Dutch, sent to an English menu

Kaggle Benchmarking Challenge Submission
dsiacci profile

Asked in Dutch, sent to an English menu

#devchallenge #kagglechallenge #ai #llm
2
Comments 1
8 min read
TOOL JUDGMENT: Does an AI Know When NOT to Use a Tool?
jaysjain_ profile

TOOL JUDGMENT: Does an AI Know When NOT to Use a Tool?

#devchallenge #kagglechallenge #ai #machinelearning
Comments 1
5 min read
How well do AI models read Tanglish? I tested 13 of them
mrmaran profile

How well do AI models read Tanglish? I tested 13 of them

#devchallenge #kagglechallenge #ai #nlp
1
Comments
5 min read
Would an AI let my patient drink thin water? Benchmarking LLMs on dysphagia diet safety

Kaggle Benchmarking Challenge Submission
daniel_drew profile

Would an AI let my patient drink thin water? Benchmarking LLMs on dysphagia diet safety

#devchallenge #kagglechallenge #ai #machinelearning
Comments
14 min read
I tested 36 AI models for fake packages and found zero

Kaggle Benchmarking Challenge Submission
aarishmansur profile

I tested 36 AI models for fake packages and found zero

#devchallenge #kagglechallenge #ai #machinelearning
7
Comments
7 min read
Legacy Code Modernization Benchmark

Kaggle Benchmarking Challenge Submission
manan_822e7 profile

Legacy Code Modernization Benchmark

#devchallenge #kagglechallenge #ai #machinelearning
1
Comments
3 min read
LIQUIDITY EVENT IDENTIFICATION An LLM Reasoning Benchmark

Kaggle Benchmarking Challenge Submission
iamclassified profile

LIQUIDITY EVENT IDENTIFICATION An LLM Reasoning Benchmark

#devchallenge #kagglechallenge #ai #machinelearning
3
Comments
2 min read
ToolTrap: My support agent handed a customer a fake phone number. The fix worked, until the fake moved.

Kaggle Benchmarking Challenge Submission
himanshu_748 profile

ToolTrap: My support agent handed a customer a fake phone number. The fix worked, until the fake moved.

#devchallenge #kagglechallenge #ai #machinelearning
21
Comments 22
6 min read
I showed 30 AI models 336 monitoring dashboards. Most of them can't tell time.

Kaggle Benchmarking Challenge Submission
uptimearchitect profile

I showed 30 AI models 336 monitoring dashboards. Most of them can't tell time.

#devchallenge #kagglechallenge #machinelearning #ai
Comments
11 min read
It Quoted the Failure: Two Kinds of False 'Done'

Kaggle Benchmarking Challenge Submission
iswt42 profile

It Quoted the Failure: Two Kinds of False 'Done'

#devchallenge #kagglechallenge #ai #machinelearning
1
Comments 1
15 min read
Can LLMs Actually Audit Code, or Just Fix Commas? A 12-Task Security & Jailbreak Benchmark

Kaggle Benchmarking Challenge Submission
hao610 profile

Can LLMs Actually Audit Code, or Just Fix Commas? A 12-Task Security & Jailbreak Benchmark

#devchallenge #kagglechallenge #ai #machinelearning
2
Comments 2
4 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.