After School Tutoring: A randomised controlled trial

How to cite

Islam, Asad; Ruthbah, Ummul; Zenou, Yves; Zhang, Xin. 2022. "After School Tutoring: A randomised controlled trial." AEA RCT Registry. AEARCTR-0008736. https://doi.org/10.1257/rct.8736-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Asad Islam* , Ummul Ruthbah , Yves Zenou , Xin Zhang

* Primary investigator

Registry ID
AEARCTR-0008736
DOI
https://doi.org/10.1257/rct.8736-1.0
First registered
Last updated
Status
Completed
Trial dates
2013-11-01 – 2017-02-01
Countries
Bangladesh (Satkhira and Khulna)
JEL codes
C93, I21, 012, 015
Registry record
http://www.socialscienceregistry.org/trials/8736

Abstract

Tutoring has become widespread, particularly in developing countries. A two-stage randomized controlled trial was implemented of an after-school free tutoring program conducted in 254 schools over two years from year 2013 to year 2015 in rural Bangladesh. The program offered students in primary schools group-based private tutoring and/or a weekly one-to-one home visit. In the PT-only treatment, tutors provided two hours of teaching English and Math to students in a group setting. In the HPT treatment, in addition to receiving tutoring in a group setting, students received one-hour one-on-one instruction from a tutor every week. The purpose of the home visit was to provide individualized sessions, teaching at the students’ level to identify the individual learning gap and meet their learning needs.

The RCT involved a two-stage design where, in the first stage, all schools were randomly assigned as either treatment or control schools. The second stage involved randomly selecting subgroups of students from each grade within each treatment school and offering them the intervention.

The intervention lasted for two years from year 2013 to year 2015, and various dimensions of data collected at different period of time. Examples include test scores and non-cognitive skills of students, parent, teacher and school information. Successful randomization is guaranteed based on the fact that student-level characteristics and school-level variables are balanced across groups. Then the effect of the program on educational outcomes of students was estimated.

Intervention

The main objective of the tutoring program is to improve the learning outcomes of rural children. Global Development Research Initiative (GDRI), an NGO, implemented the intervention in collaboration with the Directorate of Primary Education in Bangladesh. The intervention offered free outside school hours tutoring for two years from 2013 to 2015. The intervention took place in public schools located in two south-western districts of Bangladesh, Khulna and Shatkhira.

In year 1, the tutoring program started in March 2014 among students in grade 3 and grade 4 and lasted for nine months until November 2014 when the students sat for the end-of-year exam. In year 2, the tutoring started in late February with the same cohort of students who progressed to grade 4 and grade 5, respectively. The program ended in November 2015.

We implemented a two-stage RCT design. The first stage involved assigning schools in these districts into treatment or control groups. In the second stage, students in each grade were randomly selected for free private tutoring. Thus, some students from the same grade did not receive free tuition from the program. Schools were randomly assigned to one of the three types of treatments- free small group tutoring to random groups of students(PT, treatment 1); free tutoring plus an additional weekly one-to-one session to random groups of students (HPT, treatment 2) ; free small group tutoring to most central students in each classroom (PT-central, treatment 3).

In PT treatment (treatment 1), students received tutoring for about 2 hours a day in a small group/batch, three days a week. The tutors taught mathematics and English, the two subjects that most Bangladeshi students find difficult. The tutors helped the students complete homework, prepare for exams, and understand the relevant basic concepts to develop more foundational skills.

In the HPT treatment (treatment 2), in addition to private tutoring as described above, the tutors also made home visits once a week to provide individual tutoring sessions for each student. The purpose of adding an individual session through home visit was to make sure that students were taught in accordance with their abilities and individual needs were better assessed and addressed. Tutors were also instructed to focus on the students' individual needs, so each student gets the opportunity to learn something that is difficult to cover in a group setting. During the home visit, tutors spent about an hour at students’ homes.

In PT-central treatment (treatment 3), treated students receive private tutoring which is same as treatment 1, but selected based on students' centrality, only central students in each classroom was treated. Centrality is calculated based on baseline social network survey in which each student was asked to nominate who are their best friends in his/her classroom, then students were ranked from high to low in terms of their centrality. Only students with high centrality in each classroom were selected to receive treatment.

Experimental design

We use a two-stage randomization design where we first assign each school to one of the four experimental groups described above in the intervention section, and then assign students within treatment schools (PT, HPT, and PT-central) to receive treatment. In total, 254 primary (public) schools participated in our study randomly selected from two rural districts in Bangladesh, Satkhira and Khulna.

These 254 primary schools were randomly allocated into treatment and control groups, resulting in 100 schools allocated to the control group and the other 154 schools allocated to one of the treatment groups: 58 schools were randomly assigned to Treatment 1 (PT: private tutoring only ), 58 schools were randomly assigned to Treatment 2 (HPT: private tutoring and home visits), and 38 schools were randomly assigned to Treatment 3 (T3: centrality-based private tutoring). The school-level randomization was conducted based on school-level characteristics collected in the baseline survey such as facility, transportation, number of rooms, teacher characteristics and so on. Successful randomization is guaranteed given school-level characteristics are balanced across PT, HPT and PT-central groups.

After school-level randomization, we implemented student-level randomization. In details, within PT and HPT schools, a subgroup of students in each classroom were randomly chosen to receive the treatment. We used baseline test scores of students to randomize and guarantee that baseline test scores of students are balanced across groups and across treated and untreated students. In the 38

Treatment 3 (PT-central) schools, treated students were not chosen at random but selection was based on their eigenvector centrality. Eigenvector centrality is calculated according to network survey implemented in the baseline survey. In fact, in each school, only students with the highest centrality were treated and these students only received private tutoring, i.e., the same intervention as treated students in PT treatment (treatment 1). All students in each classroom were asked to nominate and rank ten of their closest friends among their classmates. To be more precise, we asked each student to pick their ten best friends and rank them from 1 (very close friends) to 10 (least close friends). Then centrality measures the degree of influence a student is among his classmates.

Design details

Randomization method
Randomization is done by a computer based on student-level and school-level characteristics collected in baseline surveys
Randomization unit
Two levels of randomization, one is school-level randomization (randomize schools into treatment and control groups), the second one is student-level randomization (randomize treated and untreated students within treatment schools)
Clusters
254 schools
Observations
14,216 students
Arms
58 schools PT treatment: private tutoring only, 58 schools HPT treatment: private tutoring and home visit, 38 schools PT-central treatment: private tutoring to central students, 100 control school
Primary outcomes
The primary outcomes are represented by cognitive skills and non-cognitive skills of students. Cognitive skills are represented by English and Math test scores of students, collected at different points of time. The tests were conducted among all students, especially for evaluating the intervention, and hence they are different from school-administered final exams or other exams. The tests focused on actual learning to understand how much students really have learned. Our second group of outcome variables consist of measures of the noncognitive skills of the students. To obtain these measures, we designed several questions to explore three main domains of noncognitive skills of each student: self-control, social skills, and motivation. School teachers (not the private tutors) provided an evaluation of a student in these dimensions. The questions collected to measure each skill are listed in the detail section.
Secondary outcomes
Apart from primary outcomes, we collected other outcomes in order to identify the possible channels to explain why private tutoring intervention matters, these outcomes are represented by different surveys conducted during and after the completion of the intervention. Firstly, we collected student survey at the end of 2015 just before the completion of the intervention, the survey gathered information on the distribution of out-of-school time between studies, leisure, self-esteem, ambition, confidence, etc. The answers were obtained from survey responses of parents about their children, and students’ self-reporting their behaviors. The purpose of student survey is to measure how much effort students have spent on study in order to evaluate whether private tutoring intervention shaped students' behavior. Next, we collected parent survey one year after the intervention finished in 2017. The key variables measure parent behavior and investment towards a child’s education. The purpose of parent survey is to understand whether the program increase or decrease parent effort devoted on their children's education. By examining parents’ time and resource allocation on their children, we are able to understand whether private tutoring increased or decreased parent effort and whether there are persistent effect on parents after intervention finished. In addition, we collected teacher survey in August, 2015 which contains information on teaching methods and teachers’ level of effort in the class. These data were collected by random visits to the classrooms by the enumerators during the intervention and the teachers were not pre-informed about the visits. The objective of teacher survey is to assess whether tutoring program would change the behavior of class teachers. For example, they may be more engaged in class activities as the program could a threat to their position ; Or they could be less engaged in class activities given students already obtained help from private tutors. Finally, we also collected cognitive skills of students one year after the intervention finished in order to assess whether private tutoring generated long-term effects that persist after the intervention finished. The cognitive skills are represented by PSC exam scores. PSC exams are externally administered public exam for the grade 5 students, called the primary school certificate (PSC) exam. A student needs to pass the PSC exam to move to secondary school, and the results for this PSC exam are taken seriously by teachers, parents, and students.
Partners
Name: Global Development Research Initiative Partner_type: ngo Url: https://gdri.org

Cited by

No citation data available for this registration yet.

Keywords