Evaluating the scale-up of a remedial education program in India

How to cite

McManus, Jeffery; Kaul, Akashi; Biswas, Susmit; Sagar, Nilay. 2023. "Evaluating the scale-up of a remedial education program in India." AEA RCT Registry. AEARCTR-0010873. https://doi.org/10.1257/rct.10873-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Jeffery McManus* , Akashi Kaul , Susmit Biswas , Nilay Sagar

* Primary investigator

Registry ID
AEARCTR-0010873
DOI
https://doi.org/10.1257/rct.10873-1.0
First registered
Last updated
Status
On going
Trial dates
2022-07-01 – 2024-06-30
Countries
Private
JEL codes
I25, I26
Registry record
http://www.socialscienceregistry.org/trials/10873

Abstract

The quality of education remains a stumbling block for Indian schoolchildren. According to the 2018 Annual Status of Education Report (ASER), which assesses a representative sample of students in every district in India, only 27% of children in grade 3 and 50% of children in grade 5 can read at the grade 2-level. 72% of children in grade 5 are unable to complete a subtraction problem from the grade 2 curriculum.

Educate Girls seeks to address educational quality and inequities by recruiting and managing a large staff of field coordinators and a network of community-based volunteers to deliver their programming to tens of thousands of the poorest and most remote villages in India. Educate Girls’ core program involves in-school remedial instruction in reading, math, and English to students in grades 3 to 5 in government primary schools. From 2015 to 2018, Educate Girls participated in a clustered randomized controlled trial of their in-school program across 332 schools, which found that Educate Girls’ program had large positive effects on learning outcomes.

Educate Girls has received funding to scale up their program to 35,000 villages over five years. This evaluation will assess whether Educate Girls can maintain high levels of impact at a much larger scale than was previously assessed. We will conduct a clustered randomized controlled trial from 2022 to 2024 in a sample of 267 expansion villages. Children will be sampled at baseline and assessed after one-year and two-years in basic literacy and math skills.

As of this registration, randomization and baseline data collection have been completed. No outcome data has been collected.

Intervention

Educate Girls’ core program involves volunteer-based in-school remedial instruction. Educate Girls field coordinators recruit and train community volunteers (“Team Balika”) who delivered a basic reading, math, and English curriculum ("Gyan ka Pitara" or GKP) to students in grades 3 to 5 in government primary schools.

Experimental design

The evaluation will take place in Sidhi, Singhrauli, and Shahdol districts in Madhya Pradesh. Educate Girls has identified 686 eligible villages in these districts based on eligibility criteria and a high predicted number of out-of-school girls. These villages have been divided into 84 Field Coordinator (FC) clusters, with village size per cluster ranging from 6 to 10 villages per cluster.

We have sampled 54 of these 84 clusters using stratified random sampling. Within these 54 clusters, we randomized six schools per cluster into three groups: T1, T2, or C. The two “T1” schools will receive the learning program in Year 1 (2022-23), the two “T2” schools will receive the learning program in Year 2 (2023-24), and the two “C” schools will receive the learning program after the evaluation period (and will serve as the control group). Educate Girls may introduce the program in additional schools following the evaluation period, but since this decision is pending and may not apply across all FC clusters, we ignore these schools for the purposes of the evaluation.

Out of the 324 schools that were randomized in the 54 clusters, 267 will be sampled for student assessments. Some of those schools will be visited twice and others three times. In total, we will make 640 village visits over the course of the two-year evaluation.
 
Students will be sampled from Grades 3, 4, and 5, which are the grades covered by GKP. Students will be selected by using stratified random sampling to sample students based on the number of students in each grade and gender distribution across those grades. We have already sampled from among all students enrolled in Grades 2, 3, and 4 at the end of the 2022-23 school year, in order to have a sample of students in Grades 3, 4, and 5 for the 2023-24 school year.

We estimate that this sample size will enable us to detect 1-year effect sizes of 0.06 SD and 2-year effect sizes of 0.13 SD at 80% power. These calculations use estimates of intracluster correlation and autocorrelation (between baseline and endline scores) from the earlier Educate Girls RCT.

Design details

Randomization method
Randomization done by a computer using Stata.
Randomization unit
School-level randomization.
Clusters
267
Observations
8,000 students
Arms
107 control, 107 treatment for one year, 53 treatment for two years
Primary outcomes
Learning gains in foundational Hindi literacy, numeracy, and English literacy

Cited by

No citation data available for this registration yet.

Keywords