LLMs found depression signals in one-minute diaries—but not a diagnosis
Seven language models produced scores that moved with self-reported mood in 108 US adults. The peer-reviewed study is an early measurement test, not evidence that passive screening is accurate or safe in clinical care.
The short version
- What happened
- The study followed 108 Pittsburgh-area adults aged 18–40 for 14 or 21 days; they completed a mean 14.9 one-minute video diaries, alongside surveys and a baseline clinical interview.
- Who it affects
- People may welcome a lower-burden way to describe how they feel, but diary text is intimate. A monitoring service could misread ordinary distress, miss serious symptoms or expose private context unless consent, security and human review are designed into the workflow.
- What remains unproven
- One small Pittsburgh sample of 108 adults aged 18–40; diary data from 2016–2018; no diagnostic threshold, crisis detection, prospective outcome, multilingual validation or adequately powered racial-bias analysis.
Keep in mind
One small Pittsburgh sample of 108 adults aged 18–40; diary data from 2016–2018; no diagnostic threshold, crisis detection, prospective outcome, multilingual validation or adequately powered racial-bias analysis.
Source analysis · 1 linked source. Primary analysed source date: 17 October 2026.
Read the full report · 4 min The evidence, methods, implications and limitations
The models tracked some of the same variation as surveys
Researchers asked 108 adults to record roughly one-minute smartphone videos about the most significant event of their day. The group was 53% female, averaged 28.3 years old and included 49 people currently receiving mental-health treatment. Participants completed diaries on 77% of study days, a mean 14.9 entries each. Whisper transcribed the audio, then GPT-4.1, GPT-4.1 Mini, Claude 3.7 Sonnet, Gemini 2.5 Pro, Grok 3 Beta, Llama 4 Maverick and Qwen3-235B each scored three depression items from the text with temperature set to zero.
Averaged across the seven models, the diary score correlated 0.45 with within-person changes in same-day self-reported depression and 0.61 with differences between participants' average self-reports. Model-specific correlations were similar: 0.40–0.45 within people and 0.55–0.64 between people. The averaged LLM score correlated 0.53 with both interview-rated major-depression symptom counts and interview-rated depressivity. Correlation is agreement in movement, not diagnostic accuracy.[1]
Why a useful measurement result is not a screening licence
The study tested convergent, criterion and incremental validity—not whether an LLM could safely identify a disorder, predict deterioration or trigger care. LLM and survey scores showed similar patterns against daily affect and stress, and each retained some associations after adjustment for the other. But the clinical interviews were conducted once at baseline, inter-rater agreement was moderate, and no sensitivity, specificity, false-alarm rate or treatment outcome was reported.
The authors found no age- or sex-related moderation, but the sample was too small to assess racial, linguistic or other demographic bias. Participants were 18–40, from one US city and mostly community or outpatient volunteers; more severe psychiatric populations were not tested. The diaries were recorded in 2016–2018, while the seven LLMs were applied later. That design cannot show how people would change what they say when they know an automated system is monitoring them.[1]
The distinction that matters
What the study measured—and what it did not
The paper compared model-generated mood scores with other measures; it did not validate a diagnostic or crisis-detection system.
Input
108 adults record mean 14.9 daily diaries
About one minute of speech per entry
Comparison
Seven LLM scores versus surveys and interviews
r = 0.45 within people; r = 0.61 between people
Boundary
No prospective clinical deployment
No diagnostic accuracy or patient outcome test
Privacy and consent sit outside the reported correlations
Short narratives can reveal relationships, work problems, health concerns and location clues that a three-item mood survey never collects. The research used informed consent and did not openly release recordings or transcripts. A real service would still need purpose limits, secure processing, retention rules, human review and a clear route for people to refuse or challenge an inference. None of those safeguards was evaluated here.
For clinicians and researchers, the immediate value is narrower: natural-language ratings may add a different signal to repeated self-report measures. The case would strengthen with preregistered replication in larger multilingual cohorts, independent models, repeated clinical interviews, prospective outcome prediction, subgroup error estimates and direct comparisons of burden. Until then, the study supports supervised research—not passive diagnosis from everyday speech.[1]