Estimating the Educational Production Function in EdTech: Experimental Evidence from Russia
How to cite
Loyalka, Prashant; Fairlie, Robert. 2019. "Estimating the Educational Production Function in EdTech: Experimental Evidence from Russia." AEA RCT Registry. AEARCTR-0004126. https://doi.org/10.1257/rct.4126-1.3000000000000003
Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.
* Primary investigator
Abstract
Although EdTech is rapidly expanding in developing countries little is known about its marginal productivity. Based on a large field experiment we will provide the first test in the literature of whether the educational production function is concave, convex or linear in computer assisted learning (CAL). Results are fundamental to understanding optimal investments in technology-based education. We will use two treatment arms with different levels of time on CAL and a pure control group to estimate effects on student achievement. We will also examine cost-effectiveness and whether different types of students face different production functions. Using two treatment intensities will also allow us to avoid the potential problem of choosing a treatment intensity that is too low or too high, and thus might provide a misleading evaluation of the effectiveness of CAL. Theory and the newness of EdTech in developing countries provide almost no guidance on optimal levels of investment.
Intervention
A large online technology company in Russia (hereafter “the provider”), has developed an online education platform through which students are given math and language arts items to solve. The platform has more than 10 thousand items across various math and language sub-content areas for grades 2 to 4. The items are aligned with national educational standards and curricula for primary schools.
In both the CAL Dosage X and CAL Dosage 2X treatment arms, teachers are asked to assign the online items for homework. The dosages were chosen based on a large number of interviews that the provider conducted with teachers outside of the study sample and prior to the experiment. Dosage X is 25 minutes (10 online items) per subject per week. Dosage 2X is 50 minutes (20 online items) per subject per week.
Experimental design
The RCT involves more than 6,000 third grade schoolchildren in 343 classes/schools in two provinces of Russia. The RCT includes three treatment arms: an “X” dosage CAL arm in which students have approximately 25 minutes per week of math CAL and 25 minutes of Russian language CAL, a “2X” dosage CAL arm in which students have approximately 50 minutes of math CAL and 50 minutes of Russian language CAL, and a control arm. The number of schools/classes in each treatment arm is as follows:
A. CAL Dosage X (T1) 115 classes (in 115 schools)
B. CAL Dosage 2X (T2) 113 classes (in 113 schools)
C. Control (C) 115 classes (in 115 schools)
Design details
Cited by
No citation data available for this registration yet.