A slower start helped people write better with AI—and the benefit carried into the next task
A Microsoft Research preprint randomised 297 US workers to an AI writing interface with or without planning prompts. Quality gains were small, and the study did not test long-term workplace performance.
The short version
- What happened
- In a randomised experiment, 297 US-based Prolific participants wrote two professional briefs, producing 594 essays; only the treatment group saw planning scaffolds during the first task.
- Who it affects
- Workers often experience AI tools as pressure to accept a fast first draft. A planning scaffold could preserve more of their judgement, but only if organisations allow the extra effort and measure whether it reduces later rework.
- What remains unproven
- The preprint was not preregistered and all authors were affiliated with Microsoft Research, which has a commercial interest in AI workplace tools.
Keep in mind
The preprint was not preregistered and all authors were affiliated with Microsoft Research, which has a commercial interest in AI workplace tools.
Primary essay scoring used an LLM judge whose absolute agreement with the human benchmark was moderate, ICC 0.456.
The sample was US-based, English-first and recruited through Prolific; the tasks were short online briefs rather than embedded workplace projects.
Only 159 of 297 participants returned for the three-day recall survey, and the recall confidence intervals were wide.
Source analysis · 1 linked source. Primary analysed source date: 22 October 2026.
Read the full report · 3 min The evidence, methods, implications and limitations
The interface asked for a plan before a draft
Participants used the same GPT-5.3 chat-and-canvas system, but one group first received dynamic controls that asked them to state the goal and break the job into parts. They spent longer on task one—27.84 minutes versus 16.35—but produced slightly higher-scoring briefs. In task two, both groups lost the scaffold; the previously scaffolded group still held a smaller quality advantage and used more deliberate prompts.[1]
Better work felt less helpful
The extra planning raised cognitive load and reduced perceived helpfulness even as measured output improved. That tension matters for workplace rollouts: ease and satisfaction can reward an interface that gets to a draft quickly, while a short pause to specify purpose, audience and checks may leave the worker with a stronger result. The experiment cannot tell whether the effect survives routine deadlines or repeated use.[1]
The distinction that matters
What the scaffold changed
The intervention inserted two planning steps before AI drafting.
Goal
State purpose, audience and constraints
Makes success criteria explicit
Decompose
Split the assignment into checkable parts
Creates places for review and revision
Transfer
Remove the scaffold on a second task
Tests whether the prompting habit carries over briefly
The evidence supports a design test, not a universal rule
Teams can test lightweight planning prompts against their own work: compare quality, rework, factual checking and worker control, not just completion time. The study’s primary judge was another language model; human ratings of 107 essays pointed in the same direction but were imprecise. A three-day topic-recall signal also had wide confidence intervals and high follow-up loss.[1]