Do Students Benefit from Personalized Learning? Experimental Evidence from India
How to cite
Ganimian, Alejandro; Barros, Andreas de; Muralidharan, Karthik. 2017. "Do Students Benefit from Personalized Learning? Experimental Evidence from India." AEA RCT Registry. AEARCTR-0002459. https://doi.org/10.1257/rct.2459-1.1
Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.
* Primary investigator
Abstract
There is mounting evidence indicating that schoolchildren in many developing countries lag far behind their expected grade-level performance. Remedial education can help these low-performing students, but it does not address the needs of their high-performing peers. Ability-based grouping can benefit both types of students, but it may be too coarse to address students' individual learning needs. We will conduct an experiment in 14 public "model" schools in Rajasthan, India to evaluate the impact of personalized instruction for 3,331 students in grades 6 to 8, as delivered by a computer-assisted learning software. We will compare a version of the software that provides students with only grade-appropriate activities (the typical approach used by most software products) with a fully and a partially customized version of the program, as well as with a remedial version of the program. We plan to use these comparisons to understand what type of personalization is most (cost-)effective in improving student learning.
Intervention
We will use a computer-assisted learning (CAL) software to randomly assign students to either a "control" (i.e., business-as-usual) or one of three "treatment" (i.e., intervention) conditions. The software is called Mindspark and it was developed by Educational Initiatives (EI), a leading Indian education firm, over a 10-year period. It is currently used by over 400,000 students, it has a database of over 45,000 questions, and it administers over a million questions across its users every day. It can be delivered in school during the school day, before/after school at stand-alone centers, and through a self-guided online platform. It is also platform-agnostic: it can be deployed through computers, tablets, or smartphones, and it can be used both online and offline. A randomized evaluation of the before/after school version of the program in 2015 found that it had a large impact on the math and language achievement of middle school students in Delhi (see Muralidharan et al. 2016). We will use the in-school version of the software which is targeted at Indian government schools. We do not evaluate the impact of the software by itself. Instead, we exploit the existing software to study the impact of personalization on student learning.
Experimental design
We will randomly assign students within each section to one of four experimental groups: (a) a control group ("not customized"), in which students are provided with activities on the Mindspark platform that matched their enrolled grade level; (b) a "fully customized" treatment group (T1), in which students complete activities that fully adjust to their "diagnosed" grade level (i.e., the way the Mindspark platform currently works); (c) a "partially customized" treatment group (T2), in which students complete activities that adjust to their diagnosed grade level, but in which the degree of customization is limited to only one grade level below or above that level; or (d) a "remedial" treatment group (T3), in which students complete activities that adjust to their diagnosed grade level, but in which the degree of customization is limited to only grades at or below that level.
We will randomly assign students in equal shares to one of the above experimental groups, at the individual level, within each section stratum. Group sizes may differ slightly when the number of students in stratum is not divisible by four. In this case, we randomly assign "left-over" observations (or "misfits") to one of the four groups, within each stratum.
Design details
Papers from this trial
- de Barros, A., & Ganimian, A. J. (2023). Which Students Benefit from Computer-Based Individualized Instruction? Experimental Evidence from Public Schools in India. Journal of Research on Educational Effectiveness, 17(2), 318–343. https://doi.org/10.1080/19345747.2023.2191604 https://doi.org/10.1080/19345747.2023.2191604
Cited by
No citation data available for this registration yet.