Competence
The decision must meet a real standard — sound, current, and fit for the person it concerns — not merely whatever the model returned.
A system inherits the obligation to decide at least as carefully as a conscientious person would. Accuracy in aggregate is not enough; the duty is owed to each individual the decision lands on. A system that decides worse than a competent person is not a tool — it is a hazard that was chosen, and choosing it is itself a breach.
Test 01Would a competent professional, in full view of this person's case, stand behind the decision?
Test 02Has it been tested on the people it will actually affect — not just a benchmark?
Test 03When the evidence is thin, does the system say so?