DEV Community

Discussion on: Two AI Agents Reviewed the Same PR. Was That Actually Independent?

 
jes_p_d4f61f7aa2ec405a418 profile image
Dev_PJS •

'Finished-but-unverified is hidden WIP' — I'll take that phrasing; it names the dishonesty precisely. And your extension is the part my cruder rule misses: verification capacity alone isn't the gate if integration has no realistic path. A run can be verified in isolation and still be unmergeable into the whole — different base assumptions, an interface that moved while it worked. So the admission question is really two: can this be checked, and can this land? Work that can be checked but can't land is just well-documented waste.

Thread Thread
 
suirindo profile image
asagiman •

Exactly. "Can this be checked?" and "Can this land?" are two different admission decisions.

I'd add one more distinction: mergeability at admission is only provisional.

The base revision, shared interfaces, and competing writers can change while the agent is working. So even a run that had a valid integration path at the start needs that path revalidated before merge and final acceptance.

For multi-agent work, I'm thinking of three concrete requirements:

  1. Reserve independent verification and integration capacity before starting.
  2. Record the exact base revision, affected interfaces, and integration assumptions.
  3. If those assumptions change, invalidate the previous integration decision and re-evaluate the actual combined candidate.

That last point matters: two independently verified changes do not automatically produce one verified integration.

Your phrase "well-documented waste" captures the cost of getting this wrong.

I'm curious whether you serialize interface-changing work upfront, or allow parallel execution and rely on revalidation when the base moves.