The Effects of Generative AI on High Skilled Work: Evidence from Three Field Experiments with Software Developers
How to cite
peng, sida. 2024. "The Effects of Generative AI on High Skilled Work: Evidence from Three Field Experiments with Software Developers." AEA RCT Registry. AEARCTR-0014530. https://doi.org/10.1257/rct.14530-1.0
Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.
* Primary investigator
Abstract
This study evaluates the impact of generative AI on software developer productivity by
analyzing data from three randomized controlled trials conducted at Microsoft, Accenture,
and an anonymous Fortune 100 electronics manufacturing company. These field
experiments, which were run by the companies as part of their ordinary course of business,
provided a randomly selected subset of developers with access to GitHub Copilot, an AIbased
coding assistant that suggests intelligent code completions.
Intervention
The study granted a randomly selected subset of software developers access to GitHub
Copilot, an AI-based coding assistant that suggests intelligent code completions.
Experimental design
Initially, a random subset of developers is granted access to GitHub Copilot. During the
intervention period, developers not in our treatment group cannot use Copilot. After the
intervention period, all developers are able to use Copilot, but there may still be differential
adoption across treatment and control groups, and we also utilize this variation.
Design details
Cited by
No citation data available for this registration yet.