Evaluating the Design and Impact of the Secondary School Teacher Training Initiative under the Government of Nepal’s School Sector Development Program
How to cite
Glewwe, Paul; Schaffner, Julie; Sharma, Uttam. 2019. "Evaluating the Design and Impact of the Secondary School Teacher Training Initiative under the Government of Nepal’s School Sector Development Program." AEA RCT Registry. AEARCTR-0004338. https://doi.org/10.1257/rct.4338-2.0
Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.
* Primary investigator
Abstract
This RCT is designed to evaluate the impacts on the subject knowledge and pedagogical practices of teachers of 9th and 10th grade math and science, and on student learning, of Nepal's School Sector Development Program (SSDP) teacher training (TT). The main teacher training (TT) intervention requires all 9th and 10th grade teachers in government schools to attend government-run in-service teacher training modules that are intended to raise their subject knowledge and to motivate and equip them to use practical, demonstration-based teaching methods rather than more traditional teaching methods. The training includes a 10-day session at an Education Training Center (ETC), and then completion by participating teachers of the equivalent of five days of “self-study project work,” which includes independent lesson plan development and other classroom research and practice activities. The TT intervention in study schools differs slightly from the broader intervention to be rolled out throughout Nepal over the next several years in several respects. First, rather than waiting for teachers and schools to request trainings, the ETCs specifically invited teachers in treatment schools, and were asked not to invite teachers in control schools or other schools within the same small geographic areas (associated with the local Village Development Committees) as the control schools. Second, while in the broader roll-out priority will be given to inviting teachers with permanent positions who had not received training under the previous education plan (the School Sector Reform Program or SSRP), ETCs were requested to invite all teachers of grade 9 and 10 math and science, regardless of contract type or previous training experience. Third, while in principle the full SSDP training will include two modules, each including 10 days of training at an ETC and five days of self-study project work, in practice only the first module has so far been rolled out, and only this first module is included in this evaluation.
The supplementary Video Assignment (VA) treatment requires each trained teacher to submit (before he or she can receive full credit for the training) a video of himself or herself (during an entire class session) implementing one of the new lesson plans that he or she is expected to create as part of the self-study project. The aim of adding the VA is to increase teachers’ motivation for investing serious effort in the self-study project activities, which may be important for translating what teachers learn at the ETC into new and improved classroom practices. In what follows, “TT treatment” will refer to the provision of the basic teacher training intervention without the video assignment, while “TTVA treatment” will refer to the provision of the teacher training intervention with the video assignment.
The study involves 204 schools, of which 102 are randomly assigned to the treatment and 102 serves as controls. Of the 102 assigned to the treatment, 51 are randomly assigned to the standard TT program, while the other 51 are randomly assigned to the TT supplemented by the Video Assignment (VA) treatment.
Intervention
The main teacher training (TT) intervention requires all 9th and 10th grade teachers in government schools to attend government-run in-service teacher training modules that are intended to raise their subject knowledge and to motivate and equip them to use practical, demonstration-based teaching methods rather than more traditional teaching methods. The training includes a 10-day session at an Education Training Center (ETC), and then completion by participating teachers of the equivalent of five days of “self-study project work,” which includes independent lesson plan development and other classroom research and practice activities. The TT intervention in study schools differs slightly from the broader intervention to be rolled out throughout Nepal over the next several years in several respects. First, rather than waiting for teachers and schools to request trainings, the ETCs specifically invited teachers in treatment schools, and were asked not to invite teachers in control schools or other schools within the same small geographic areas (associated with the local Village Development Committees) as the control schools. Second, while in the broader roll-out priority will be given to inviting teachers with permanent positions who had not received training under the previous education plan (the School Sector Reform Program or SSRP), ETCs were requested to invite all teachers of grade 9 and 10 math and science, regardless of contract type or previous training experience. Third, while in principle the full SSDP training will include two modules, each including 10 days of training at an ETC and five days of self-study project work, in practice only the first module has so far been rolled out, and only this first module is included in this evaluation.
The supplementary Video Assignment (VA) treatment requires each trained teacher to submit (before he or she can receive full credit for the training) a video of himself or herself (during an entire class session) implementing one of the new lesson plans that he or she is expected to create as part of the self-study project. The aim of adding the VA is to increase teachers’ motivation for investing serious effort in the self-study project activities, which may be important for translating what teachers learn at the ETC into new and improved classroom practices. In what follows, “TT treatment” will refer to the provision of the basic teacher training intervention without the video assignment, while “TTVA treatment” will refer to the provision of the teacher training intervention with the video assignment.
Experimental design
The study collects data from 204 schools. The primary randomization divides the 204 study schools into two groups of equal size: 1. 102 “Phase I” schools, which were to receive the SSDP teacher training in late 2017; and 2. 102 “Phase II” schools, which were to receive the SSDP teacher training only after May of 2019, and which serve as the control group during the period of study. To minimize the potential for spillover effects of training on Phase II study schools, other schools in the same small geographic areas that contain the Phase II schools will also receive the relevant training only after May of 2019. The secondary randomization divides the 102 Phase I schools into two groups: 1. 51 TTVA schools, in which each teacher must submit a video of himself or herself implementing in his or her classroom a new lesson plan developed as part of the SSDP training to receive full credit for the training; and 2. 51 TT schools, in which no video is required to receive full credit for the training.
To achieve a sample representative of most of Nepal, while containing costs, the research team chose to stratify the sample first by district. To reduce data collection costs further, the team (in consultation with its partners in the Nepalese government) eliminated from consideration 10 of the most remote or otherwise difficult districts. From the remaining 65 districts (which contain 94.3% of Nepal’s schools), the team randomly selected a representative set of 16 districts, and then sampled schools only within those districts.
At the request of the team’s government partners, and to increase the study’s power to identify impact on the teachers for whom the TT training was most likely to have impact, the team sorted schools within districts into two strata: “priority” and “non-priority” schools, and over-sampled the former. Schools were identified as priority schools if there was no evidence (in hard copy records made available by the National Center for Educational Development) of any permanent teacher, or any teacher for which contract type was unknown, having completed all three modules of the SSRP training. The specifics of this rule were dictated largely by the idiosyncrasies of the only existing records identifying which schools and teachers had received SSRP training. The team chose to select two-thirds of the sample within a district from the priority stratum, while the other one-third would come from the non-priority stratum.
Design details
Cited by
No citation data available for this registration yet.