Evaluation of a technology-aided instruction platform (Mindspark) in government schools in Rajasthan

How to cite

Muralidharan, Karthik; Singh, Abhijeet. 2020. "Evaluation of a technology-aided instruction platform (Mindspark) in government schools in Rajasthan." AEA RCT Registry. AEARCTR-0002546. https://doi.org/10.1257/rct.2546-1.3

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Karthik Muralidharan* , Abhijeet Singh

* Primary investigator

Registry ID
AEARCTR-0002546
DOI
https://doi.org/10.1257/rct.2546-1.3
First registered
Last updated
Status
On going
Trial dates
2017-08-01 – 2021-04-30
Countries
India (Rajasthan)
Registry record
http://www.socialscienceregistry.org/trials/2546

Abstract

The problem of low productivity of instruction in government schools in India (“the learning crisis”) is well documented. This study focuses on the increased use of technology in education, which is frequently proposed for improving this low productivity, but where the evidence base for the effectiveness of such policies remains mixed. We are evaluating the impact of a technology-led intervention (Mindspark), developed by Education Initiatives (EI) which provides personalized instruction to students in grades 1-8 which is individually customized to their level of achievement on student learning. We use a randomized control trial method to evaluate the impact of the program on classroom processes and student learning in Adarsh (consolidated) schools in four districts of Rajasthan over three academic years. This trial builds on promising results reported in Muralidharan, Singh and Ganimian (2019) in out-of-school settings in Delhi. The primary outcomes for this study will be student achievement, which will be measured directly using independently-designed student assessments in language and mathematics. In addition, we will be collecting data on program usage from the software as well as information on program implementation through direct observations and interviews with students and teachers.

Intervention

The intervention in the schools is being implemented by EI in partnership with Government of Rajasthan. Mindspark program (developed by EI) provides personalized instruction using a software (reflecting over 10 years of product development by EI) to students which is individually customized to their level of achievement. The software aims to address several constraints:
• Adaptive instruction addresses the twin constraints of (a) the mismatch between curricular expectations and actual academic levels of students and (b) the wide spread of achievement levels in a single grade, which make delivery of any single curriculum difficult;
• Engaging interactive content, often game-based, aims to improve student attention;
• Real-time assessment and grading allows for immediate feedback to students and continuous diagnostics about student comprehension
• Careful analyses of patterns of student errors, enabled by “big data”, allow for precisely targeting content to clarify specific areas of misunderstanding.

Each class in grades 1-8 to will receive at least four class periods (two per subject of Hindi and Math) per school week in a laboratory class in the school. Each class period is of 40-minute duration.

Experimental design

The study is based on a sample of 80 Adarsh schools across four districts in Rajasthan. The selection of these schools from the population of Adarsh schools in these four districts is based on certain defined criteria by the Education Initiatives based on the infrastructural readiness of the Adarsh schools to accept the Mindspark programs. 40 schools from this sample was randomly assigned to the receive the treatment. The remaining 40 schools are pure controls.

Design details

Randomization method
Randomization done in office on computer, using Stata
Randomization unit
Schools
Clusters
80 Schools
Observations
Total number of schools: 80 Total number of students in grades 1-8: 160*80= 12,080 (average of around 160 students per school) Total number of teachers in grades 1-8 teaching Math and Hindi: 7*80=560
Arms
40 Treatment schools, 40 control schools
Primary outcomes
Student learning levels in Math and Hindi (local language)
Partners
Name: Educational Initiatives India Url: https://www.ei-india.com/ Name: Government of Rajasthan Partner_type: government

Cited by

No citation data available for this registration yet.

Keywords