A liver-cancer model ranked risk well—but the cancer rate was 0.062%
A nationwide South Korean study reported AUROC 0.945 in an unmatched validation cohort. Its precision-recall result was 0.0503, and the original probabilities needed recalibration before risk groups were interpretable.
The short version
- What happened
- Researchers built the model from a final cohort of 7,961,075 South Korean adults without known viral hepatitis or prior liver cancer; 4,942 developed hepatocellular carcinoma during six years of follow-up.
- Who it affects
- People at elevated risk could receive more focused follow-up, but poor calibration or an unsuitable threshold could also generate anxiety, extra scans and avoidable procedures across a very large screened population.
- What remains unproven
- Retrospective South Korean claims and screening data; rare outcome; probabilities required recalibration; no geographic or temporal external validation, prospective workflow trial, screening comparator or patient-outcome evidence.
Keep in mind
Retrospective South Korean claims and screening data; rare outcome; probabilities required recalibration; no geographic or temporal external validation, prospective workflow trial, screening comparator or patient-outcome evidence.
Source analysis · 1 linked source. Primary analysed source date: 17 October 2026.
Read the full report · 4 min The evidence, methods, implications and limitations
A huge cohort produced a strong ranking result, not a screening verdict
Researchers used South Korea's National Health Insurance Service screening data to develop a six-year hepatocellular-carcinoma risk model. From 14,607,170 screened adults aged 20 to 79, the final development population contained 7,961,075 people after exclusions for viral hepatitis, HIV, previous liver cancer and other criteria. There were 4,942 incident liver-cancer cases from 2018 to 2023. In an unmatched validation cohort that retained the real 0.062% cancer prevalence, the final deep neural network reached an area under the ROC curve of 0.9450 (95% confidence interval 0.9400 to 0.9510).[1]
The low base rate changes what the impressive AUROC means
AUROC measures how well a model ranks people who later develop cancer above those who do not across possible thresholds. It does not say how often a flagged person actually develops cancer. The precision-recall area was 0.0503—much higher than the 0.00062 baseline, but still modest in absolute terms. At the paper's 0.5 threshold, the positive predictive value was 15.29 times the population prevalence. After recalibration, the highest-risk quartile contained 597,080 people and 1,385 cancers, an observed six-year risk of 0.232%; the equally sized lowest quartile contained five cancers.
For patients and screening services, that distinction matters. A useful ranking tool might help decide who receives additional assessment, but even the highest group was dominated by people who did not develop cancer during follow-up. Benefits therefore depend on what test follows, how often it produces false alarms, whether earlier detection improves treatment, and whether extra surveillance displaces care elsewhere.[1]
The distinction that matters
Why ranking, precision and calibration answer different questions
The study reports three distinct properties of a rare-event prediction model.
Population
Follow 7,961,075 adults for six years
4,942 liver-cancer cases; prevalence 0.062%
Ranking
Compare model scores for cases and non-cases
AUROC 0.9450 in unmatched validation
Usefulness
Test precision and recalibrate absolute risk
AUPRC 0.0503; probabilities required correction
Calibration and external validation remain the safety test
The model's original probabilities substantially overestimated absolute risk, so the researchers recalibrated them before presenting four risk groups. Performance also fell in a separate non-selected cohort of 6,126,058 people, where AUROC was 0.8848 and AUPRC 0.0293. That is useful stress testing, but both cohorts came from the same national health system. The study used claims-based outcomes and routine screening variables rather than imaging, pathology, alpha-fetoprotein or detailed clinical records; baseline subclinical disease may also have influenced predictions.
The authors report Soonchunhyang University funding and no competing interests. The evidence supports population ranking within the studied Korean data, not a clinical recommendation or proof of prevented deaths. The assessment would change with temporal and international external validation, prospectively chosen thresholds, calibration reported by subgroup, and a controlled study showing that model-guided surveillance detects treatable cancers without disproportionate unnecessary testing.[1]