AI-supported job training improved recruitment tasks—but did AI cause the gain?
A cohort study of 186 Chinese education graduates found better expert-rated recruitment work after a structured AI-supported programme. The design cannot separate the AI from practice and feedback.
The short version
- What happened
- Researchers allocated 12 intact cohorts of 186 education graduates in Guangdong to either structured AI-supported development or career guidance matched for topics, duration and facilitator contact.
- Who it affects
- For graduates, the practical test is whether AI-assisted preparation builds work they can explain and reproduce when the tool is unavailable—not merely whether it produces a polished draft.
- What remains unproven
- Whole cohorts rather than individuals were allocated
Keep in mind
Whole cohorts rather than individuals were allocated
9.7% attrition before the post-test
Expert ratings lacked a pre-specified rubric
AI was bundled with structured practice and feedback
One region and one employment sector
No interview, hiring or longer-term workplace outcomes
Source analysis · 1 linked source. Primary analysed source date: 26 October 2026.
Read the full report · 3 min The evidence, methods, implications and limitations
The advantage remained when AI was removed from the test
A peer-reviewed study found stronger recruitment-task work after a structured development programme supported by generative AI. Researchers enrolled 186 graduates seeking education-sector posts in Guangdong, China, and allocated 12 intact cohorts—six per condition—to the programme or to career guidance matched on topics, duration and facilitator contact.
Participants produced recruitment materials before and after the programme under invigilation and without AI. Among the 168 who completed the post-test, blinded experts gave the programme group an adjusted 5.38-point advantage on a 100-point scale (95% CI 2.76–8.01; standardised effect d = 0.60). The result was stable across eight model specifications, making a chance imbalance less likely, although 9.7% of participants did not complete the post-test.[1]
This tested a training package, not AI on its own
The comparison answers a useful workplace question: can learning supported by AI carry into an AI-free task? It does not show which element produced the gain. The intervention bundled generative-AI support with structured practice and feedback, while the control received conventional career guidance. Whole cohorts, rather than individuals, were allocated, and expert ratings did not use a pre-specified rubric.
Four new self-report scales showed small effects of d = 0.12–0.29; none remained significant after correction for multiple testing, and the study was underpowered for effects below roughly d = 0.40. Confidence would rise with individual or larger cluster randomisation, a published scoring rubric, independent replication and follow-up into interviews, job offers and sustained performance. The study was unfunded and reported no competing interests.[1]
The distinction that matters
What was compared
The outcome was independently rated work produced without AI after two different development programmes.
AI-supported programme
Structured practice and feedback
Higher adjusted post-test score
Matched guidance
Same topics, time and facilitator contact
Comparison condition
AI-free assessment
Invigilated recruitment materials
Tests transfer, not live tool performance