An AI stethoscope missed too many abnormal lung sounds for stand-alone use

The field test was more demanding than a quiet laboratory

An AI-enabled stethoscope was not reliable enough to decide on its own whether a young child had abnormal lung sounds. In a peer-reviewed study from rural Bangladesh, the algorithm detected 61.8% of children whom a paediatrician listening panel classified as having crackles or wheeze. It correctly identified 60.7% of panel-negative children. In this demanding field dataset, those figures describe moderate performance, not a safe replacement for clinical assessment.

Non-physician health workers recorded four chest positions from 990 children under five with cough or difficulty breathing at community clinics. The main analysis included 867 children with at least three recordings the panel considered interpretable. That is a larger, less controlled paediatric field test than many earlier studies, and it exposed noises a real service must handle: crying, vocalising, movement and a crowded clinic.[1]

The model often heard abnormality where experts did not

The panel classified adventitious sounds in 36.7% of children meeting the study's pneumonia definition and 27.9% of those without it. The algorithm marked 44.3% and 47.7% respectively. That high AI-positive rate outside the pneumonia group suggests artefact was often mistaken for wheeze or crackles. Among pneumonia cases, sensitivity rose only to 63.5% and specificity to 66.8%.

There was also a crucial mismatch in what each side could say. Paediatricians could reject an uninterpretable recording; the algorithm could only call it normal or abnormal. Performance improved when the panel was confident, but that does not remove the real-world problem: the noisy recording is exactly the one an automated tool must recognise rather than force into a diagnosis-shaped category.

The result also helps explain why impressive figures from smaller hospital studies may not travel cleanly into primary care. A specialist can often capture cleaner sounds from a child who is already admitted, while a community worker has less control over noise, cooperation and timing. External validity here comes from the messiness, even though that same messiness depressed performance.[1]

A useful assistant must know when not to answer

For a community health worker, automated auscultation could still become useful alongside breathing rate, chest indrawing, oxygen saturation and clinical judgement. But a moderate match with expert listeners cannot establish pneumonia, decide on antibiotics or safely reassure a family. The authors call for training that can recognise uninterpretable and low-confidence recordings.

The evidence check is stricter than the headline numbers. Expert listening is imperfect and is not a gold-standard diagnosis; the study evaluated sound classification, not treatment decisions, hospitalisation or child outcomes. The main analysis also excluded 123 enrolled children without enough interpretable positions, potentially removing hard cases. Confidence would rise if a prospective trial showed that a revised system rejects poor recordings, improves decisions beyond standard IMCI assessment and does not widen errors across clinics or ages. Until then, this is a warning against turning a digital stethoscope into an automated verdict.[1]