Rapid Evaluation of the Impact of Gemini Guided Learning on Students’ Mathematics Scores in School Grades 8 and 9 in India

How to cite

Aspillaga, Natalia Valdes; Khawar, Usman; Atherton, Paul; Roman, Ignacio. 2025. "Rapid Evaluation of the Impact of Gemini Guided Learning on Students’ Mathematics Scores in School Grades 8 and 9 in India." AEA RCT Registry. AEARCTR-0017071. https://doi.org/10.1257/rct.17071-2.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Natalia Valdes Aspillaga* , Usman Khawar , Paul Atherton , Ignacio Roman

* Primary investigator

Registry ID
AEARCTR-0017071
DOI
https://doi.org/10.1257/rct.17071-2.0
First registered
Last updated
Status
In development
Trial dates
2025-10-30 – 2026-06-30
Countries
Private
JEL codes
I24
Registry record
http://www.socialscienceregistry.org/trials/17071

Abstract

This study evaluates the impact of Gemini Guided Learning, an AI-powered instructional experience within Gemini that provides personalised learning through guided questions, step-by-step scaffolding, and multimodal resources rather than supplying direct answers, on mathematics learning and developing metacognitive skills in grade 8 and 9 in India (ages 13–15). This evaluation is part of a multisite evaluation. The trial randomly assigns classrooms either to continue with regular teaching or to use Gemini in approximately half of their mathematics lessons over an eight to nine (8-9) week period. The same teachers are responsible for both treatment and control classrooms; all will receive training on how to use the tool, though it will only be applied in treatment classes. Mathematics performance of students and teachers will be assessed at the beginning and end of the intervention. The study will provide rigorous evidence on whether AI-supported guided learning can strengthen mathematics learning in junior secondary education.

Intervention

Gemini Guided Learning is an AI-powered instructional tool within Gemini, designed to support students’ mathematics learning and metacognitive development through guided questions, step-by-step scaffolding, adaptive feedback, and multimodal resources rather than providing direct answers. Infused with Google’s LearnLM research, Gemini encourages students to reflect on their own thinking, deepening metacognition while fostering curiosity and active engagement. The intervention will be implemented in grade 8 and grade 9 (ages 13–15) over an eight- to nine-week period, during which students in treatment classrooms will use Gemini in about half of their mathematics lessons. Teachers will receive training on how to use the tool, although it will only be applied in treatment classrooms.

Experimental design

This study employs a cluster randomized controlled trial with classrooms as the unit of randomization. Randomization is stratified by school, grade level (8 and 9), and mathematics teacher using computer-generated random assignment with a pre-specified seed. This stratification approach ensures balanced allocation across key prognostic factors and prevents potential confounding between teacher effects and treatment effects.
Classrooms are randomly assigned to either: (1) Treatment arm receiving access to an AI-powered mathematics tutoring platform in addition to standard instruction, or (2) Control arm receiving standard mathematics instruction only.

Design details

Randomization method
Done in office by a computer using stata
Randomization unit
Classroom
Clusters
100 classrooms (37 grade 8 and 65 grade 9) across 7 schools
Observations
4,150
Arms
50 control and 50 treated
Primary outcomes
The primary outcome of interest is student mathematics achievement, measured using standardised assessments aligned with the grade 8 and 9 curriculum and administered at endline.
Secondary outcomes
The secondary outcome measures students’ metacognitive skills, defined as their capacity to reflect on their reasoning, evaluate their understanding, and regulate their learning strategies while engaging with mathematical tasks.
Partners
Name: City Montessori Schools Partner_type: none Url: https://cmseducation.org/ Name: the Centre for Science of Student Learning (CSSL) Url: https://www.cssl.in/

Cited by

No citation data available for this registration yet.

Keywords