Optimizing tutoring programs for scale: Evidence from multiple iterative randomized A/B tests

How to cite

Cullen, Claire; Angrist, Noam. 2025. "Optimizing tutoring programs for scale: Evidence from multiple iterative randomized A/B tests." AEA RCT Registry. AEARCTR-0016323. https://doi.org/10.1257/rct.16323-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Claire Cullen* , Noam Angrist

* Primary investigator

Registry ID
AEARCTR-0016323
DOI
https://doi.org/10.1257/rct.16323-1.0
First registered
Last updated
Status
Completed
Trial dates
2020-10-01 – 2025-01-25
Countries
Botswana ()
JEL codes
I21, O15, C93, D61
Registry record
http://www.socialscienceregistry.org/trials/16323

Abstract

This study uses a series of iterative randomized A/B tests to optimize the cost-effectiveness of a phone-based tutoring program in Botswana. Across multiple experimental rounds, we test modifications aimed at reducing implementation costs or enhancing learning outcomes, such as reducing scheduling frictions and increasing caregiver engagement. We test whether low-cost modifications can significantly improve program efficiency, offering scalable solutions to address the foundational learning crisis in low-resource settings.

Experimental design

This study consists of multiple sequential randomized A/B tests designed to test the impact of modifications of a phone-based tutoring program. Each round randomly assigns students to one of two variants of the program: either the status quo model or a modified version designed to improve cost-effectiveness.

Design details

Randomization method
randomization done in office by a computer in stata
Randomization unit
Household level.
Clusters
Each round includes approximately 1000 households. We will include multiple sequential tests in analysis.
Observations
Approximately 1000 households across 12 tests: 12000 households total
Arms
500 households in A and 500 households in B, each test.
Primary outcomes
Student learning level (measuring using a validated phone-adapted ASER tool, measuring proficiency in addition (1), subtraction (2), multiplication (3) and division (4)).

Cited by

No citation data available for this registration yet.

Keywords