DEV Community

Testing

Find those bugs before your users do! 🐛

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
75.8% of failing AI coding runs still say "Done". Here's what finally caught mine.
sjh9714 profile

75.8% of failing AI coding runs still say "Done". Here's what finally caught mine.

#ai #testing #opensource #productivity
1
Comments 6
3 min read
A Passing Test Suite Is Not a Release Signal
sleepyfalcon247 profile

A Passing Test Suite Is Not a Release Signal

#testing #devops #ai #webdev
6
Comments 1
8 min read
I read the metric libraries of five widely-used eval tools. The metric was never the hard part.
maya_andersson_dev profile

I read the metric libraries of five widely-used eval tools. The metric was never the hard part.

#llm #opensource #statistics #testing
Comments 6
7 min read
How I Got My AI Agent to Catch Its Own Bugs: 5 Lessons on Self-Verification
yureki_lab profile

How I Got My AI Agent to Catch Its Own Bugs: 5 Lessons on Self-Verification

#ai #claudecode #softwareengineering #testing
Comments
6 min read
Evaluation-Driven Development for RAG Systems: Building the Feedback Loop That Makes AI Actually Improve
alaikrm profile

Evaluation-Driven Development for RAG Systems: Building the Feedback Loop That Makes AI Actually Improve

#ai #llm #rag #testing
Comments
6 min read
The sparring partner was reading my config file

Summer Bug Smash: Smash Stories 🐛🛹
zkasuran profile

The sparring partner was reading my config file

#devchallenge #bugsmash #testing #ai
3
Comments
4 min read
I audited 249 of my own AI coding sessions. The problem wasn't lying.
sjh9714 profile

I audited 249 of my own AI coding sessions. The problem wasn't lying.

#showdev #ai #testing #opensource
1
Comments
7 min read
An Empty Prompt Is Not a Blind Review
hexisteme profile
John

An Empty Prompt Is Not a Blind Review

#agents #ai #llm #testing
1
Comments
6 min read
Your LLM-as-judge is lying to you
loopandretry profile

Your LLM-as-judge is lying to you

#evals #llmasjudge #testing #bias
Comments
8 min read
How to Build a First Test Suite From Scratch for a New Project?
marxjenes profile

How to Build a First Test Suite From Scratch for a New Project?

#testing #webdev #productivity #automation
Comments 2
4 min read
The Channel Gap: Why Your LLM Judge is Blind in One Eye

Combines text judges with filesystem checks
zxpmail profile

The Channel Gap: Why Your LLM Judge is Blind in One Eye

#ai #llm #agents #testing
20
Comments 25
15 min read
Your LLM-as-judge disagrees with itself between runs
ethanwritesai profile

Your LLM-as-judge disagrees with itself between runs

#ai #cicd #llm #testing
Comments
4 min read
Inbox Contracts for Scheduled Automation
mrdapperx profile

Inbox Contracts for Scheduled Automation

#automation #devops #testing #webdev
Comments
4 min read
My VM state check reads one line of VBoxManage output, and it's one character from reading the wrong one
tiltedlunar123 profile

My VM state check reads one line of VBoxManage output, and it's one character from reading the wrong one

#powershell #testing #virtualbox #opensource
Comments
3 min read
The bug that differential fuzzing cannot find
sanjaysah profile

The bug that differential fuzzing cannot find

#go #typescript #testing #hackathonraptors
3
Comments 3
12 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.