Experimental Evidence on the Learning Impact of Generative AI
How to cite
Reyes, Germán; Contractor, Zara. 2025. "Experimental Evidence on the Learning Impact of Generative AI." AEA RCT Registry. AEARCTR-0015806. https://doi.org/10.1257/rct.15806-1.1
Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.
* Primary investigator
Abstract
This study examines how access to generative artificial intelligence (AI) tools affects student learning outcomes in higher education. Using a randomized controlled experiment, we assign undergraduate students to complete learning tasks on unfamiliar academic topics either with or without access to generative AI tools. The experiment consists of two sessions approximately one week apart, allowing us to measure both immediate performance and longer-term knowledge retention. In the first session, participants complete a baseline assessment, engage in a structured learning exercise on an assigned topic, and produce a written analysis. Only participants in the treatment group are permitted to use generative AI during this process. In the second session, all participants complete knowledge retention assessments without access to AI. By comparing performance across conditions, we aim to identify causal effects of AI access on learning outcomes and explore potential mechanisms behind these effects. The findings will provide empirical evidence on an important question facing higher education as these technologies become increasingly prevalent.
Experimental design
This experiment uses a between-subjects design with random assignment. Undergraduate participants complete two sessions approximately one week apart. In Session One, participants learn about an unfamiliar academic topic and complete assessments. In Session Two, all participants complete retention assessments.
Design details
Cited by
No citation data available for this registration yet.