How Much Do Students Benefit from Practice Exercises? Experimental Evidence from India
How to cite
Barros, Andreas de; Ganimian, Alejandro; Muralidharan, Karthik; Venkatachalam, Anuja. 2017. "How Much Do Students Benefit from Practice Exercises? Experimental Evidence from India." AEA RCT Registry. AEARCTR-0002455. https://doi.org/10.1257/rct.2455-1.1
Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.
* Primary investigator
Abstract
In mathematics instruction, it is quite common for teachers to explain a topic and then assign their students a number of practice exercises - either as classwork or homework - to build "procedural knowledge" (i.e., knowledge about the algorithms to be followed to solve a specific problem) and "fluency" (i.e., capacity to solve these problems rapidly). Although there is general agreement among educators that this strategy is beneficial, prior studies have not determined the extent to which students benefit more from this practice. We will use a computer-assisted learning (CAL) software called "Mindspark" to randomly assign 5,756 students in grades 4-7 in 9 private schools in India to receiving or not receiving practice exercises after they learn a new mathematical concept, and to assess the impact on their procedural knowledge and fluency.
Intervention
We will use a computer-assisted learning (CAL) software to randomly assign students to either a "control" (i.e., business-as-usual) or a "treatment" (i.e., intervention) condition. The software is called Mindspark and it was developed by Educational Initiatives (EI), a leading Indian education firm, over a 10-year period. It is currently used by over 400,000 students, it has a database of over 45,000 questions, and it administers over a million questions across its users every day. It can be delivered in school during the school day, before/after school at stand-alone centers, and through a self-guided online platform. It is also platform-agnostic: it can be deployed through computers, tablets, or smartphones, and it can be used both online and offline. A randomized evaluation of the before/after school version of the program in 2015 found that it had a large impact on the math and language achievement of middle school students in Delhi (see Muralidharan et al. 2016).
We will use the in-school version of the software which is currently accessed by over 86,000 students in 187 private schools in India and abroad. We do not evaluate the impact of the software by itself. Instead, we exploit the existing software and user database to study the impact of practice exercises on student learning. Students at private schools can interact with Mindspark during school hours and after school hours. They typically interact with the software once a week for 45 minutes per week in school, and once a week for 42 minutes per week at home.
Experimental design
We will randomly assign students to either: (a) a ``treatment'' group, which will receive a set of practice exercises during their interaction with the math content of the Mindspark software; or (b) a ``control'' group, which will not receive those exercises (see "Intervention (Public)" for the learning trajectories of control and treatment groups).
We will randomly assign students to either experimental group within each section-by-performance level stratum. We will first categorize students in each grade based on their performance on the Mindspark platform before the study begins (below or at/above the median for their section) and then run two separate lotteries: one for students performing below the median and one for students performing at or above the median.
Group sizes may differ slightly when the number of students in stratum is odd. In this case, we randomly assign these left-over observations (or "misfits") to one of the two groups, within each stratum.
Design details
Papers from this trial
- de Barros, A., Ganimian, A. J., & Venkatachalam, A. (2021). Which Students Benefit from Independent Practice? Experimental Evidence from a Math Software in Private Schools in India . Journal of Research on Educational Effectiveness, 15(2), 279–301. https://doi.org/10.1080/19345747.2021.2005203 https://doi.org/10.1080/19345747.2021.2005203
Cited by
No citation data available for this registration yet.