Strengthening Teacher Accountability to Reach All Students (STARS)

How to cite

Beg, Sabrin; Fitzpatrick, Anne; Lucas, Adrienne. 2019. "Strengthening Teacher Accountability to Reach All Students (STARS)." AEA RCT Registry. AEARCTR-0003977. https://doi.org/10.1257/rct.3977-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Sabrin Beg* , Anne Fitzpatrick , Adrienne Lucas

* Primary investigator

Registry ID
AEARCTR-0003977
DOI
https://doi.org/10.1257/rct.3977-1.0
First registered
Last updated
Status
On going
Trial dates
2018-05-16 – 2019-07-05
Countries
Private
JEL codes
C93; I21; J24; O15
Registry record
http://www.socialscienceregistry.org/trials/3977

Abstract

Public programs in developing countries, even when proven successful at smaller scales, tend to suffer from implementation challenges when scaled up and may not deliver the intended benefits. For instance, low accountability of public officials like teachers leads to high absenteeism; thus, teacher training programs that may be effective when delivered with intense monitoring for a small number of schools, cannot be implemented at a larger scale if teachers are frequently out-of-school. This project evaluates a large, government-led scale-up of an effective pedagogical technique, targeted instruction, to increase learning among primary school students in Ghana. Additionally, this project investigates how existing government mid-level managers can be leveraged to facilitate the take-up and delivery of the program and enhance effectiveness of government scale-up efforts.

We use a randomized controlled trial to evaluate the impact of the targeted instruction (TI) program at scale, and the incremental impact of combining it with the management training program. The targeted instruction intervention provides training and materials to treatment schools for teaching students in grades 4 through 6 by their learning levels instead of their grade level. The management training program offers additional training to school managers on managerial best practices. Our trial answers the following questions: how effective and cost effective is a large-scale targeted instruction program? Can a government-led management training improve managerial practices and enhance the take-up and impact of this program? The study will be conducted across 210 schools in 20 districts of Ghana.

Intervention

Targeting instruction pedagogy provides teachers with the tools and resources to teach at the learning level of the student, instead of the student’s grade. In this project, it is implemented in grades 4 through 6 during the 2018-2019 academic year.

To encourage fidelity of implementation of targeted instruction, an additional treatment arm provides additional training to school managers in addition to the targeted instruction program---in this treatment circuit supervisors and head teachers participated in a management training. This training focused on school management and encouraging and supporting a reflective teaching practice. Participants were also given a copy of a management training manual with sections on how to support teachers on implementing targeted instruction.

Experimental design

This randomized controlled trial is in the 20 districts in Ghana that UNICEF supports. This study will operate in 140 circuits (groups of schools) within these districts. We study 210 in these 140 circuits, that are randomly divided into three groups:

Treatment 1 (Control)—P4-P6 teachers and head teachers continue as usual, receiving no additional training or resources. (70 schools)
Treatment 2—P4-P6 teachers, head teachers, and circuit supervisors all receive targeted instruction training. Schools receive targeted instruction teaching and learning materials. Head teachers and circuit supervisors do not receive enhanced management training. (70 schools)
Treatment 3—P4-P6 teachers, head teachers, and circuit supervisors receive targeted instruction training. Schools receive targeted instruction teaching and learning materials. Head teachers and circuit supervisors also receive enhanced management training. (70 schools)

Design details

Randomization method
Randomization done in office by a computer
Randomization unit
Circuit level randomization for management training intervention School level randomization for targeted instruction intervention in circuits not selected for management training.
Clusters
140 circuits, 210 schools
Observations
140 Circuit supervisors, 210 Schools, 210 Head teachers, 600 Teachers, 6300 Students.
Arms
70 schools in control group, 70 schools with targeted instruction treatment, 70 schools with targeted instruction + management training treatment.
Primary outcomes
The primary outcome variables for students are: 1. Attendance 2. Standardized test score on the mathematics exam at follow-up 3. Standardized test score on the English exam at follow-up 4. Standardized combined mathematics and English test score at follow-up The primary outcome variables for classrooms are: 1. A teacher present in the classroom 2. A teacher engaged with students 3. Whether teaching and learning materials are visible and/or being used 4. Whether at least one student had an opportunity to express an idea 5. Whether students were divided by level or grade Additionally, we will construct an index based on the first four measures as a measure of overall teaching effectiveness. The outcome variables for teachers are: 1. Present at school The primary outcome variables for head teachers and the school level are: 1. Head teacher attendance 2. Teacher reported observation frequency 3. Teacher reported observation usefulness 4. Management Practices Index (see below) The primary outcome variables at the CS-level are: 1. Teacher reported number of visits 2. Teacher reported presence of feedback 3. Teacher reported usefulness of feedback 4. HT reported number of visits 5. HT reported number of meetings 6. Self-reported number of meetings with HTs in their circuit 7. Self-reported number of visits to study schools 8. Self-reported number of classroom observations conducted by the CS Further we will combine all 8 in an index.

Cited by

No citation data available for this registration yet.

Keywords