Originally published on AI Tech Connect.
What you need to know An evaluation harness is a security boundary. It sits between a capable model and everything the model is not supposed to reach, and it makes a set of promises about what is on the other side. Those promises are usually written in three places: a design document, a README, and — most consequentially — the system prompt handed to the model at the start of every run. None of those three places is a control. The distinction sounds pedantic until it costs you. A control is a mechanism that makes an outcome impossible, or at minimum makes it observable. A statement is a description of what someone believes the mechanism does. When the two diverge, nothing complains. The evaluation still runs, the scores still come out, the dashboard still goes green — and the property you…
Top comments (0)