The Impact of Customized AI Tutoring on Group Learning
How to cite
Govindan, Pavitra; Ersoy, Fulya; Zhang, Peilu; Brown, Matthew; Yehoshua-Sandak, Tomer. 2025. "The Impact of Customized AI Tutoring on Group Learning." AEA RCT Registry. AEARCTR-0017406. https://doi.org/10.1257/rct.17406-1.0
Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.
* Primary investigator
Abstract
Group work plays a vital role in college students’ learning, and research has long emphasized the cognitive and social benefits of cooperative learning (Johnson, Johnson and Smith, 2014). As artificial intelligence (AI) becomes increasingly integrated into educational settings (Zhang and Aslan, 2021), understanding its role in cooperative learning environments is critical, as dynamics in group work such as peer influence, shared responsibility, and social presence may interact with AI support in complex ways. Studies on AI in cooperative learning have focused on online learning platforms (Tan, Lee and Lee, 2022).
This study investigates whether incorporating a customized AI assistant—trained on course materials and designed to prompt critical thinking—into group work affects student outcomes.
References
Johnson, D. W., Johnson, R. T., & Smith, K. A. (2014). Cooperative learning: Improving university instruction by basing practice on validated theory. Journal on Excellence in College Teaching, 25(3&4), 85–118.
Tan, Seng Chee, Alwyn Vwen Yen Lee, and Min Lee. "A systematic review of artificial intelligence techniques for collaborative learning over the past two decades." Computers and Education: Artificial Intelligence 3 (2022): 100097.
Zhang, Ke, and Ayse Begum Aslan. "AI technologies for education: Recent research & future directions." Computers and education: Artificial intelligence 2 (2021): 100025.
Intervention
Students in discussion sections work on practice problems. In treatment groups, students are allowed to use an AI tool to assist with problem-solving; in control sessions, students are not allowed to use the AI tool. All students can use course materials and ask questions to teaching assistants. After the practice period, students complete a 10-minute quiz without any aids, followed by a short online survey.
Experimental design
Unit of Randomization: Individual student
Stratification: By instructor-section
Groups: Students are randomly assigned to groups of five within each section, stratified by treatment status. Groups are re-randomized each session.
Timeline: Six discussion sections over eight weeks (three before midterm, three after).
Randomization Procedure:
Pre-midterm (Sections 1–3): Students randomly assigned to treatment or control (1/2 in control and 1/2 in treatment).
Post-midterm (Sections 4–6): Assignment conditional on prior exposure:
Students with treatment in all first three sessions → control for remaining.
Students with no prior treatment → treatment for remaining.
Others → randomized.
Communication: Assignment revealed at the start of each discussion section.
Design details
Cited by
No citation data available for this registration yet.