DEV Community

Discussion on: I tested the 'deterministic agent loop' claims with four experiments. They all failed — including my own fix.

Collapse
 
reneza profile image
René Zander

Your three illusions share a root cause worth naming: each one puts a deterministic wrapper on a semantic decision. Lexical overlap, a temperature-0 judge, and a phase gate are all trying to make a probabilistic judgment call ("is this done", "is this a new task") return a binary fact, and dressing it in code does not change what it is. Determinism does hold in production, but only on the mechanical layer: did the tool call return, did the schema validate, is the side effect idempotent, did we blow the step budget. Those checks never need the model and never lie, which is exactly why it is tempting to smuggle the semantic questions in next to them. The honest move for the judgment layer is not a temp-0 oracle, it is human approval on the material calls plus a hard step budget, letting the deterministic checks guard only what is actually binary. I went deep on the "is it done" version of this here: renezander.com/blog/why-ai-coding-...

Collapse
 
zxpmail profile image
zxpmail

Your comment identified the root framing problem of the series more precisely than I did.
The insight — that lexical overlap, temperature-0 judges, and phase gates all put a deterministic wrapper on a semantic decision — is correct. The series spent six parts iterating better wrappers without questioning the premise.

I need to correct one thing in my own comment history. I previously claimed here that directional failure was a verified blind spot with experimental support. That claim was not backed by data. I later attempted the experiment but did not complete it to a publishable standard. I cannot present the partial results as evidence for or against the claim. The statement should be treated as unsupported.

Your three recommendations (hard step budget, human approval on material calls, deterministic checks on binary facts only) are the honest alternative to the wrapper approach. I don't have a counterargument — they are architecturally sound and I'm incorporating the layer-separation principle into the forge-verify design.