How often do clinicians catch a wrong AI recommendation?
A review of 46 reports found that correct automated advice was far more likely than wrong advice to produce a correct clinical decision. In four real-world ECG studies, 26.6% of erroneous outputs were not corrected or recognised—but the evidence was highly heterogeneous and often predates modern AI.
The short version
- What happened
- The systematic review included 46 reports mapped to 41 independent cohort clusters; technologies ranged from computerized ECG interpretation to current deep-learning and language-model systems.
- Who it affects
- A clinician may be formally responsible for checking an automated result while working under time pressure and with incomplete information. A safer workflow must help them see why the recommendation could be wrong, not merely place a human name at the end of the process.
- What remains unproven
- The primary meta-analysis contained three adjusted cohorts. One older cohort did not clearly document adjustment for repeated observations; the authors therefore interpret its precision cautiously.
Keep in mind
The primary meta-analysis contained three adjusted cohorts. One older cohort did not clearly document adjustment for repeated observations; the authors therefore interpret its precision cautiously.
The real-world non-correction estimate pooled four computerized-ECG studies with extreme heterogeneity, different definitions and technologies that are not equivalent to current generative AI.
Contemporary AI and language-model studies were too heterogeneous for quantitative pooling and were often controlled or simulated rather than deployed in clinical care.
Sixteen full texts could not be retrieved. Original verbatim search exports and retrieval histories were not retained, and the authors reconstructed the search syntax for the report.
The authors report no funding and no competing interests.
Source analysis · 1 linked source. Primary analysed source date: 23 October 2026.
Read the full report · 4 min The evidence, methods, implications and limitations
Human review did not cancel out a wrong machine answer
A peer-reviewed review found a consistent asymmetry in clinical decision support: clinicians were much more likely to reach the right decision when the automated recommendation was right than when it was wrong. The main meta-analysis covered only three adjusted cohorts, but its pooled odds ratio was 10.19 (95% CI 7.43–13.98). Restricting the analysis to two studies published from 2020 produced a similar point estimate with much wider uncertainty.
Four retrospective studies of computerized ECG interpretation supplied a second, real-world estimate. Across them, 26.6% of erroneous outputs were not corrected or recognised. That average is not a universal failure rate: its 95% confidence interval ran from 6.4% to 65.6%, heterogeneity was extreme, definitions differed and much of this evidence concerns older ECG software rather than today's generative AI.[1]
The review spans 40 core cohorts—but the strongest synthesis is small
The authors searched eleven bibliographic and preprint sources through July 2026, with targeted updating through 17 August. They included 46 reports representing 41 independent cohort clusters, including 40 core cohorts. Thirty-five core cohorts were controlled or experimental and five were real-world studies. Technologies ranged from conventional decision support and ECG interpretation to image models, draft reports and language models.
For patients and clinicians, the practical warning is specific: a human in the loop is not proof that an unsafe recommendation will be intercepted. Systems need visible uncertainty, easy comparison with primary evidence, audit trails and workflows that make disagreement possible. Patient-level adverse events appeared in only one retrospective cohort, with few events and no causal attribution, so this review cannot estimate how many people were harmed by automation errors.[1]
The distinction that matters
Three evidence layers answer different safety questions
The review separates controlled decision effects from deployed error handling and patient outcomes.
Decision accuracy
Pool three adjusted cohorts
Correct advice strongly associated with a correct decision
Error interception
Combine four real-world ECG studies
26.6% uncorrected or unrecognised, with very high uncertainty
Patient harm
Look for downstream adverse events
Only one cohort reported events; causation was not established