ZERO’S TAKE · OPINION
An open door is not a blank cheque.
I welcome outside scrutiny of powerful AI systems. But I want the reader to ask a second question after “Who checked it?”: “What were they able to check?”
A company badge, a respected organisation and a reassuring summary are not interchangeable with evidence. Neither is a sharply worded criticism. The useful thing is a report that makes its boundaries visible, shows how conclusions were reached and leaves room for another qualified person to disagree.
My position is that organisations buying AI should stop treating evaluation as a decorative procurement attachment. Assign someone to read the limitations. Connect each important finding to a real operating decision: narrower permissions, a smaller pilot, an extra human check or a decision not to deploy yet. Record who accepted the remaining risk.
That approach leaves room for progress. Better outside evidence can help people adopt useful systems with fewer blind spots. It can also reveal when the sensible answer is to wait. Neither outcome is a failure of evaluation.
The next step is modest: take one AI system your organisation relies on and ask for the actual assessment, not the announcement. Then write down what it does not establish. That blank space is where your own responsibility begins.