DEV Community

Testing

Find those bugs before your users do! 🐛

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Nine Bugs in My Own Evaluation Harness. Every One Made My Results Look Better.
marvinoka4 profile

Nine Bugs in My Own Evaluation Harness. Every One Made My Results Look Better.

#testing #ai #programming #python
2
Comments 26
6 min read
My benchmark harness was wrong fourteen ways before it measured anything

Exposes hidden flaws in benchmarking
remdore profile

My benchmark harness was wrong fourteen ways before it measured anything

#devops #python #performance #testing
8
Comments 10
9 min read
Exclusion Lists Managed by Name Always Rot. Mark the Population Instead.
hexisteme profile
John

Exclusion Lists Managed by Name Always Rot. Mark the Population Instead.

#testing #codequality #architecture #softwareengineering
2
Comments
7 min read
The Chat Log Is Not git status: Five Agent Myths
gitlab_3188 profile

The Chat Log Is Not git status: Five Agent Myths

#ai #git #agents #testing
2
Comments 1
7 min read
Add a Cost Axis Before You Trust an Agent Score
apppro_5726 profile

Add a Cost Axis Before You Trust an Agent Score

#ai #agents #testing #performance
1
Comments 3
5 min read
My script typed 4,953 characters into an editor and produced a text I could not publish
blueticks profile

My script typed 4,953 characters into an editor and produced a text I could not publish

#discuss #automation #webdev #testing
1
Comments
3 min read
Designing a compliance check that does not cry wolf in CI
nicholas_toledo_5a6f9e576 profile

Designing a compliance check that does not cry wolf in CI

#devops #security #testing #opensource
Comments 3
8 min read
Eval-First RAG: Use Separate Scores to Triage Failures
nsachok profile

Eval-First RAG: Use Separate Scores to Triage Failures

#rag #ai #machinelearning #testing
Comments 1
5 min read
100% line coverage did not catch the one bug that mattered
bosun18 profile

100% line coverage did not catch the one bug that mattered

#php #symfony #testing #opensource
1
Comments
6 min read
How I Built a Verifier Engine That Catches AI Agents Lying About What They Did
yaminbinyoosuf profile

How I Built a Verifier Engine That Catches AI Agents Lying About What They Did

#agents #ai #software #testing
Comments 4
6 min read
What if API testing worked like Terraform? (An experiment in Go)
budment profile

What if API testing worked like Terraform? (An experiment in Go)

#go #testing #webdev #opensource
Comments 4
1 min read
Every agent on my team passed its own tests. The team still shipped wrong answers.
kartik-nvjk profile

Every agent on my team passed its own tests. The team still shipped wrong answers.

#ai #agents #autogen #testing
1
Comments 2
4 min read
How We Test Mobile Web Performance on Real Android and iPhone Devices
ujimobile profile

How We Test Mobile Web Performance on Real Android and iPhone Devices

#mobile #performance #testing #webdev
Comments
4 min read
Passing locally proves nothing: four ways production disagreed in one week
wisplu profile

Passing locally proves nothing: four ways production disagreed in one week

#agents #debugging #testing #devops
1
Comments
4 min read
The bug your test suite can't have: a test you never wrote
ashwin_ugale_102f2abc9cec profile

The bug your test suite can't have: a test you never wrote

#ai #llm #testing #python
1
Comments 4
3 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.