The Impact of Customized AI Tutoring on Group Learning

How to cite

Govindan, Pavitra; Ersoy, Fulya; Zhang, Peilu; Brown, Matthew; Yehoshua-Sandak, Tomer. 2025. "The Impact of Customized AI Tutoring on Group Learning." AEA RCT Registry. AEARCTR-0017406. https://doi.org/10.1257/rct.17406-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Pavitra Govindan* , Fulya Ersoy , Peilu Zhang , Matthew Brown , Tomer Yehoshua-Sandak

* Primary investigator

Registry ID
AEARCTR-0017406
DOI
https://doi.org/10.1257/rct.17406-1.0
First registered
Last updated
Status
In development
Trial dates
2026-01-05 – 2028-06-01
Countries
Private
JEL codes
A22; C90; C93; D02; D04; D91
Registry record
http://www.socialscienceregistry.org/trials/17406

Abstract

Group work plays a vital role in college students’ learning, and research has long emphasized the cognitive and social benefits of cooperative learning (Johnson, Johnson and Smith, 2014). As artificial intelligence (AI) becomes increasingly integrated into educational settings (Zhang and Aslan, 2021), understanding its role in cooperative learning environments is critical, as dynamics in group work such as peer influence, shared responsibility, and social presence may interact with AI support in complex ways. Studies on AI in cooperative learning have focused on online learning platforms (Tan, Lee and Lee, 2022).

This study investigates whether incorporating a customized AI assistant—trained on course materials and designed to prompt critical thinking—into group work affects student outcomes.

References
Johnson, D. W., Johnson, R. T., & Smith, K. A. (2014). Cooperative learning: Improving university instruction by basing practice on validated theory. Journal on Excellence in College Teaching, 25(3&4), 85–118.

Tan, Seng Chee, Alwyn Vwen Yen Lee, and Min Lee. "A systematic review of artificial intelligence techniques for collaborative learning over the past two decades." Computers and Education: Artificial Intelligence 3 (2022): 100097.

Zhang, Ke, and Ayse Begum Aslan. "AI technologies for education: Recent research & future directions." Computers and education: Artificial intelligence 2 (2021): 100025.

Intervention

Students in discussion sections work on practice problems. In treatment groups, students are allowed to use an AI tool to assist with problem-solving; in control sessions, students are not allowed to use the AI tool. All students can use course materials and ask questions to teaching assistants. After the practice period, students complete a 10-minute quiz without any aids, followed by a short online survey.

Experimental design

Unit of Randomization: Individual student
Stratification: By instructor-section
Groups: Students are randomly assigned to groups of five within each section, stratified by treatment status. Groups are re-randomized each session.
Timeline: Six discussion sections over eight weeks (three before midterm, three after).
Randomization Procedure:
Pre-midterm (Sections 1–3): Students randomly assigned to treatment or control (1/2 in control and 1/2 in treatment).
Post-midterm (Sections 4–6): Assignment conditional on prior exposure:

Students with treatment in all first three sessions → control for remaining.
Students with no prior treatment → treatment for remaining.
Others → randomized.

Communication: Assignment revealed at the start of each discussion section.

Design details

Randomization method
Randomization done in office by a computer for treatment assignment. Groups are assigned using https://www.random.org/lists/ list randomizer to randomly order students in each list (treatment and control). Sort students into 5-people groups based on the ordered list.
Randomization unit
Individual student level randomization
Clusters
The treatment is assigned at the individual student level and the number of individual students are the number of clusters.
Observations
600 students X 6 observations/student = 3600 observations for quizzes and variables measured in the weekly surveys 600 observations for variables measured in the midterm survey 600 observations for midterm grade
Arms
Two treatment arms each with 300 students.
Primary outcomes
Weekly quiz grades and midterm exam grades.
Secondary outcomes
Stress level, measure of group interaction, perception of the discussion section, AI usage, attitudes toward group work and attitudes towards AI use.

Cited by

No citation data available for this registration yet.

Keywords