Skip to main content

Evidence note

The Effects of Generative AI on High-Skilled Work: Evidence from Three Field Experiments with Software Developers

Controlled Experiment2026Management Science

What was examined?

Three randomised field experiments involving professional developers at Microsoft, Accenture and an anonymous Fortune 100 company.

Randomised access to an AI coding assistant, with development task completion used as a primary productivity outcome.

4,867 developers across three experiments.

Key findings

  1. 1Across the combined experiments, developers with AI assistance completed approximately 26.08% more development tasks.
  2. 2Less-experienced developers showed stronger adoption and larger measured gains.
  3. 3Individual experimental estimates were noisier than the combined result.

Why it matters. Lornets interpretation.

There is credible causal evidence that AI assistance can materially increase development output in some professional settings. That result does not independently establish faster releases, higher production quality or equivalent increases in business value.

This is the Lornets reading of the source, not a finding of the source itself.

What it does not establish

  1. 1Completed development tasks are not equivalent to production releases.
  2. 2The result does not establish a universal productivity effect across tasks, tools or engineering environments.
  3. 3The measured productivity effect should not be translated directly into a percentage reduction in software cost or delivery time.

Source

Venue
Management Science
Evidence type
Controlled Experiment
Published
2026
Status
Current

Read the original research

Relevant Lornets framework areas

Framework domains

  • Delivery & Change Control

Related evidence

Last verified 2026-08-11

2025

Industry Survey

Stack Overflow Developer Survey 2025: AI

84% of respondents to the relevant question said they were using or planning to use AI tools in development.

Stack Overflow

  • AI-Assisted Development
  • Rapidly Built Software