Originally published on AI Tech Connect.
What you need to know There is a large and growing literature on how to test your own AI system. There is almost nothing written on the less glamorous problem that follows: what happens when somebody outside your company turns up and asks to test it for you. That conversation goes very differently depending on whether you can produce four artefacts on request, and most teams cannot. This is not a red-teaming guide and it is not a buyer's security questionnaire. It is about being the subject of an assessment carried out by an independent third party — an assurance firm, a customer's risk team, an academic group, a government institute or a specialist evaluation vendor — and the evidence, access and process they expect you to have ready. Here is the shape of it: Four artefacts carry the…
Top comments (0)