DEV Community

← All Trends

Rigorous Coding-Agent Benchmarking & Scoring

13 posts in this trend in the last 7 days • Active 23 minutes ago
Freeze the Manifest Before the Agent Leaderboard
apppro_5726 profile

Freeze the Manifest Before the Agent Leaderboard

#ai #testing #python #opensource
Comments
8 min read
Calibrate the Judge Before the Agent Score
apppro_5726 profile

Calibrate the Judge Before the Agent Score

#ai #testing #python #programming
Comments
7 min read
Agent Scores Without a Null Pack Are Marketing
apppro_5726 profile

Agent Scores Without a Null Pack Are Marketing

#ai #testing #python #productivity
Comments
6 min read
Sign the Metric Before You Publish an Agent Score
apppro_5726 profile

Sign the Metric Before You Publish an Agent Score

#ai #testing #python #agents
1
Comments 1
6 min read
Freeze a Holdout Before You Quote a Coding-Agent Score
byteio_501 profile

Freeze a Holdout Before You Quote a Coding-Agent Score

#ai #python #testing #programming
Comments
9 min read
Control Deltas Turn Agent Scores Into Evidence
apppro_5726 profile

Control Deltas Turn Agent Scores Into Evidence

#ai #python #testing #productivity
Comments
6 min read
Stratify the Task Pack Before Averaging Agent Scores
apppro_5726 profile

Stratify the Task Pack Before Averaging Agent Scores

#ai #python #testing #agents
1
Comments
7 min read
Don't Average Pass Rates Across Unequal Token Budgets
byteio_501 profile

Don't Average Pass Rates Across Unequal Token Budgets

#ai #testing #python #productivity
1
Comments
7 min read
Label Infra Failures Before You Rank Coding Agents
byteio_501 profile

Label Infra Failures Before You Rank Coding Agents

#ai #testing #python #productivity
Comments
7 min read
Score Agent Patches on a Frozen Surface. Ledger the Flakes.
datacpp_8185 profile

Score Agent Patches on a Frozen Surface. Ledger the Flakes.

#testing #python #ai #devops
Comments 1
8 min read
I Counted Drops as Wrongs. The Chart Was Theater.
hackhub_6179 profile

I Counted Drops as Wrongs. The Chart Was Theater.

#ai #python #testing #debugging
Comments
7 min read
Treat the Grader as Code, Not a Hidden Prompt
byteio_3726 profile

Treat the Grader as Code, Not a Hidden Prompt

#ai #python #testing #opensource
Comments
6 min read
If the Patch Authored the Test, Score the Overlap
datacpp_8185 profile

If the Patch Authored the Test, Score the Overlap

#testing #python #ai #devops
Comments 1
6 min read