Originally published on AI Tech Connect.
What you need to know Frequency and severity are independent. Work on reliability does not bound harm, and work on harm does not improve accuracy. Budget for both. Classify every action on two axes — reversibility and reach. The mitigations are different for each, so a single risk score loses the information you need. Blast radius is set by four things: identity, credentials, network reachability and data scope. All four are configuration, not model behaviour. You need three kill switches, not one — pause, revoke, quarantine. A stop button usually only implements pause. Latency and error rate are bad circuit-breaker signals for agents. A confidently wrong agent is fast and throws nothing. Untested controls do not work. Run a game day; time each control; write the number down. Why this is…
Top comments (0)