DEV Community

Testing

Find those bugs before your users do! 🐛

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Revert Production. Agent Tests Must Fail.

Revert Production. Agent Tests Must Fail.

Comments 1
5 min read
I built 13 labelled OpenAPI breaking-change cases, and oasdiff missed 2 of them

I built 13 labelled OpenAPI breaking-change cases, and oasdiff missed 2 of them

Comments 2
1 min read
Code Review: When Checkout Success Still Breaks Inventory

Code Review: When Checkout Success Still Breaks Inventory

6
Comments 8
8 min read
How an eval set is built, and why it rots

How an eval set is built, and why it rots

Comments 2
10 min read
Measuring error in support AI, and what accuracy hides

Measuring error in support AI, and what accuracy hides

Comments 2
10 min read
Using Token Data to Improve the AI Agent Experience

Using Token Data to Improve the AI Agent Experience

5
Comments 5
4 min read
Your test harness can silently not be testing the thing you think it is

Your test harness can silently not be testing the thing you think it is

Comments
4 min read
Before you file it: how to find the duplicate a newest first list hides

Before you file it: how to find the duplicate a newest first list hides

1
Comments
4 min read
Extract, Draft, Sign: Regen-Safe Lanes for AI Docs

Extract, Draft, Sign: Regen-Safe Lanes for AI Docs

Comments 1
7 min read
Shadow-Compare the Agent Patch. Merge Only Classified Divergences.

Shadow-Compare the Agent Patch. Merge Only Classified Divergences.

Comments
8 min read
My Bot's KPI: Trades 2 > Opportunities 1?! When Your Numerator and Denominator Don't Observe the Same Time.

My Bot's KPI: Trades 2 > Opportunities 1?! When Your Numerator and Denominator Don't Observe the Same Time.

Comments
4 min read
I said no data was leaving. On the first good run, two records left

I said no data was leaving. On the first good run, two records left

Comments
3 min read
0.47% a year: why your challenge target needs a different test

0.47% a year: why your challenge target needs a different test

1
Comments 1
3 min read
FAQ: Five Myths That Confuse the Model With the Box

FAQ: Five Myths That Confuse the Model With the Box

1
Comments
6 min read
Most Test Suites Only Work in a World That Doesn't Exist

Most Test Suites Only Work in a World That Doesn't Exist

7
Comments 3
8 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.