AI-assisted teaching in Pakistan

How to cite

Rexer, Jonah; Sharma, Siddharth; Das, Jishnu; Asad, Saher. 2025. "AI-assisted teaching in Pakistan." AEA RCT Registry. AEARCTR-0017128. https://doi.org/10.1257/rct.17128-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Jonah Rexer* , Siddharth Sharma , Jishnu Das , Saher Asad

* Primary investigator

Registry ID
AEARCTR-0017128
DOI
https://doi.org/10.1257/rct.17128-1.0
First registered
Last updated
Status
In development
Trial dates
2025-12-01 – 2026-12-31
Countries
Private
Registry record
http://www.socialscienceregistry.org/trials/17128

Abstract

This study investigates whether artificial intelligence (AI) can improve learning outcomes in Pakistan. Foundational literacy and numeracy (FLN) remain critical challenges in the country; according to the 2023 Annual Status of Education Report, only 50 percent of grade 5 in Pakistan students can read a simple story in Urdu, Sindhi, or Pashto, and just 46 percent can do two-digit division (ITA 2024). In addition, there is growing evidence pointing to significant learning losses experienced by students during breaks between school semesters and academic years. In particular, recent studies show that children in low- and middle-income countries often lose the equivalent of several months of learning during school closures or long breaks, with the youngest and most disadvantaged students falling furthest behind (World Bank, 2022). In response to this challenge, the study explores whether a structured winter school program can mitigate these learning losses, and whether incorporating AI-based tools into teaching practices can enhance its effectiveness.

The intervention involves a winter school program centered on the Targeted Instruction Program (TIP) curriculum. The TIP curriculum focuses on foundational competencies in Urdu, mathematics, and English. The winter school program will serve students in grades 2 through 5 in Quetta, Balochistan, Pakistan during the extended winter break period. Balochistan has particularly poor academic outcomes, with just 46 and 26 percent of students able to read a simple story in their native language or do two-digit division, respectively. In addition to the core academic instruction, the intervention includes teacher training and the integration of AI-assisted lesson planning, grading, and educational material support.

Intervention

The intervention involves a winter school program centered on the Targeted Instruction Program (TIP) curriculum. The TIP curriculum focuses on foundational competencies in Urdu, mathematics, and English. The winter school program will serve students in grades 2 through 5 in Quetta, Balochistan, Pakistan during the extended winter break period. Balochistan has particularly poor academic outcomes, with just 46 and 26 percent of students able to read a simple story in their native language or do two-digit division, respectively. In addition to the core academic instruction, the intervention includes teacher training and the integration of AI-assisted lesson planning, grading, and educational material support.

Experimental design

The study will employ a randomized controlled trial (RCT) with three treatment arms

Control: a control group receiving no intervention,

T1: a group attending the winter school without AI.

T2: a group attending the winter school with AI-supported instruction.

Students will be recruited from their existing schools, and participation will be voluntary. All students who sign up will be tested at baseline. These students will then be randomly assigned to one of the three groups, ensuring student-level randomization. Teachers will also voluntarily sign up to teach in the winter school and will be randomly assigned to classrooms either with or without AI assistance. To encourage participation, students will receive transportation and meal allowances, while teachers will be compensated with additional salary. The winter school will follow a student-teacher ratio of 40:1.

Design details

Randomization method
Public lottery
Randomization unit
Child-level randomization
Clusters
9000 students
Observations
9000 students
Arms
3000 students per treatment arm (T1, T2, and Control)
Primary outcomes
The primary outcome of interest is a composite test score combining performance in Urdu, math, and English. A composite measure is used to maintain statistical power and avoid the need for multiple hypothesis correction. All 9,000 students who sign up will complete a baseline assessment conducted in their home schools. After the winter school program concludes, endline testing will be conducted. A follow-up assessment six months to one year after the intervention will evaluate the persistence of learning gains. Winter school teachers will also be surveyed on their background, characteristics, and time use, at baseline and endline. Basic demographic data will be collected from all students using take-home forms and existing student registries at the time of the baseline survey. Prior test scores if available will be collected at origin schools. Additional data will be collected to monitor program implementation and compliance. Metadata from the AI tool will be leveraged to measure engagement. Teacher and student attendance, as well as tool usage, will be recorded as part of the treatment data, providing outcomes for a “first-stage” measuring take-up of both the winter school and the AI technology. Compliance will be monitored through AI-assisted image checks and occasional spot checks or site visits.

Cited by

No citation data available for this registration yet.

Keywords