Can a cheaper AI safely judge clinical AI answers?
A proprietary decision model was fast, stable and often competitive across four evaluation sets, but it missed most physician-labelled safety failures in one hospital sample. Hybrid review helped; patient safety remains unproven.
The short version
- What happened
- The study combined 118 paediatric decision-support answers, 29,511 HealthBench response-criterion pairs, 45,384 MedHELM responses and 525 physician-written HealthBench Professional responses.
- Who it affects
- Clinical teams could review more AI outputs within a fixed budget, but patients would be exposed if a low-cost judge became a substitute for expert oversight. Routing thresholds should be set around missed harm, not price alone.
- What remains unproven
- This is an unreviewed retrospective evaluation; one physician-labelled use case came from a single hospital and was translated.
Keep in mind
This is an unreviewed retrospective evaluation; one physician-labelled use case came from a single hospital and was translated.
Two large test sets rely mainly on AI-generated reference judgements, not direct clinician ground truth.
Jev's architecture and training data are undisclosed, creating contamination and reproducibility uncertainty.
The authors report no relevant funding or competing interests, but the evaluated model is a proprietary TypeSafe AI service accessed through an API.
Source analysis · 1 linked source. Primary analysed source date: 20 October 2026.
Read the full report · 3 min The evidence, methods, implications and limitations
Four tests covered very different kinds of agreement
The team tested Jev, a proprietary probability-returning model whose architecture and training data are undisclosed. One set contained 118 paediatric clinical decision-support answers from a single Israeli tertiary hospital, scored on six rubrics and an overall grade by five physicians after Hebrew-to-English translation. HealthBench contributed 29,511 response-criterion pairs from 3,671 conversations labelled by 186 physicians. MedHELM added 45,384 model responses across 13 systems, but only 56 had clinician ratings. HealthBench Professional supplied 525 physician-written responses and 1,135 criteria, with GPT-5.4 as the reference judge.
Jev was run three times and was highly stable. Against physicians in the paediatric set, its agreement coefficient was 0.50 for the most probable label and 0.53 when its probabilities were averaged. That matched or beat seven of 12 generative judges, though five scored between 0.60 and 0.81. On HealthBench, its macro F1 was 0.665, close to one open judge and below two others, while exceeding the tested GPT-6 and Claude configurations.[1]
Speed is useful only if important failures still reach people
Reported October 2026 API prices made Jev 73 to 294 times cheaper than frontier judges, with median latency between 0.12 and 0.55 seconds. Its calibrated probabilities also allowed low-confidence cases to be routed elsewhere. Yet on the paediatric safety rubric it detected only 31% of physician-labelled failures. Requiring agreement with Claude or GPT-6 raised sensitivity to 49% or 51%, illustrating why a monitor may need multiple checks and human escalation.
The single-hospital answers were translated, and public benchmarks may have appeared in Jev's undisclosed training data. MedHELM and HealthBench Professional mostly compare one AI judge with other AI judges, so their large denominators do not create equivalent clinical ground truth. The three-version stability test also cannot reveal silent provider updates. The study supports further evaluation of a triage tool—not automatic approval of clinical answers. Prospective, multi-site studies measuring escaped errors, review workload and patient outcomes would change the assessment.[1]
The distinction that matters
A possible clinical-AI review route
Probability scores can route uncertain evaluations without making the evaluator a final clinical authority.
Score
Return probabilities for pass or fail
Makes confidence visible
Cross-check
Compare with another judge
Catches some missed safety failures
Escalate
Send disagreement or low confidence to clinicians
Keeps consequential decisions with people