Framework · I
The decision must meet a real standard — sound, current, and fit for the person it concerns — not merely whatever the model returned.
I.AWould a competent professional, in full view of this person's case, stand behind the decision?
I.BHas it been tested on the people it will actually affect — not just a benchmark?
I.CWhen the evidence is thin, does the system say so?
MetThe system decides at least as carefully as a conscientious professional would — tested on the real population and its hardest cases, and honest when the evidence is thin.
Breach
Engineering breach
Ships because the average score looks good — and never checks the hard cases it quietly fails.
Data Science breach
Validates on clean benchmark data, then releases onto a population the model never saw.
Risk breach
Signs off on aggregate accuracy without asking who the system fails, or how badly.
Team barTogether, we set the bar this decision must clear — and how we'll know it still holds. Written in the workshop.