Skip to main content
Lornets

Evidence note

Novice Developers Produce Larger Review Overhead for Project Maintainers while Vibe Coding

Peer-Reviewed Research2026MSR 2026

What was examined?

An empirical analysis of 22,953 AI-assisted pull requests from 1,719 contributors in open-source GitHub repositories.

Contributors were grouped using an experience proxy based on historical GitHub contribution activity.

22,953 pull requests; 1,719 contributors.

Key findings

  1. 01The lower-experience-proxy group submitted 2.15 times more commits per pull request.
  2. 02The group changed 1.47 times more files per pull request.
  3. 03The group received 4.52 times more review comments.
  4. 04Resolution time was 5.16 times longer.
  5. 05Acceptance rate was 31% lower.

Why it matters. Lornets interpretation.

The speed or volume of code generation should not be treated as equivalent to downstream integration efficiency. Review, architecture fit and repository-specific constraints remain part of the engineering system.

This is the Lornets reading of the source, not a finding of the source itself.

What it does not establish

  1. 01GitHub contribution history is a proxy for experience, not a direct measurement of developer skill.
  2. 02Project review policies may affect the measured outcomes.
  3. 03The study concerns open-source pull requests rather than complete commercial applications.
  4. 04The reported multipliers must not be presented as universal maintenance multipliers.

Source

Venue
MSR 2026
Evidence type
Peer-Reviewed Research
Published
2026
Status
Current

Read the original research

Relevant Lornets framework areas

Framework domains

  • Architecture & Maintainability
  • Delivery & Change Control

Related evidence

Source record

Published
2026
Last verified
2026-08-11
Source status
Current