Researchers studied 7,581 GitHub Copilot pull requests with public session data. 58% of these PRs had no human intervention. Human collaboration was brief when it occurred, with a median of two loops. Merged PRs had fewer initial trajectory iterations than unmerged ones. The first human intervention cut later iterations by 20.8 and duration by 8.4 minutes. Later interventions showed minimal iteration drops and no duration change. Most work happened in the initial trajectory. Developers used small, focused requests that Copilot completed quickly. Collaboration modes included delegated work via feedback and adding their own commits. Developers sometimes guided Copilot through repeated interventions within a PR. Some guidance spanned multiple PR editions.
What it unlocks
Understanding real-world human-in-the-loop coding agent collaboration patterns.
- 7,581 Copilot-authored PRs studied
- 58% with no human intervention
- median 2 Human-AI loops per intervention
- 20.8 fewer iterations after first intervention
Sources