The Impact of Teaching at the Right Level in Zambia: With and Without Additional Continuous Professional Development for Teachers

How to cite

Barros, Andreas de. 2024. "The Impact of Teaching at the Right Level in Zambia: With and Without Additional Continuous Professional Development for Teachers." AEA RCT Registry. AEARCTR-0014922. https://doi.org/10.1257/rct.14922-1.5

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Andreas de Barros*

* Primary investigator

Registry ID
AEARCTR-0014922
DOI
https://doi.org/10.1257/rct.14922-1.5
First registered
Last updated
Status
On going
Trial dates
2022-06-15 – 2025-04-30
Countries
Zambia (Central Province), Zambia (Itezhi-Tezhi District), Zambia (Western Province)
JEL codes
C93 - Field Experiments; H52 - Government Expenditures and Education; I21 - Analysis of Education; I28 - Government Policy; J24 - Human Capital; Skills; Occupational Choice; Labor Productivity
Registry record
http://www.socialscienceregistry.org/trials/14922

Abstract

Remedial education and differentiated instruction are promising approaches to tackle the low learning levels that plague many low- and middle-income countries. However, little is known about how to promote these strategies at scale. Researchers are evaluating the impact of the “Teaching at the Right Level” program on students’ foundational literacy and mathematics skills. The program—which runs in Zambia’s public primary schools and is locally known as “Catch Up”—divides children into groups based on their learning needs and pace and adds extra time during which teachers provide tailored instruction to each group. The study also investigates the effectiveness of combining the Catch Up program with a continuous professional development program for teachers. This trial was first registered ahead of completing its endline data collection; the trial's baseline report was also published at the beginning of the study period (https://www.gpekix.org/sites/default/files/webform/submit_to_the_library/268/TaRL%20Africa_Zambia%20Evaluation_%20Baseline%20Report%202023.pdf).

Intervention

Zambia's Ministry of Education has embraced the Teaching at the Right Level (TaRL) methodology since the 2016-17 academic year. The Zambian TaRL program focuses on grades three to five, and it is locally known as Catch Up (CU). It currently covers eight (out of ten) provinces, reaching 4,900 schools and impacting about 735,000 learners per year. The program divides children into groups based on their learning needs and pace and adds extra remedial lessons during which teachers provide differentiated instruction to each group. All of the program implementers are regular teachers and inspectors commonly assigned to the public primary schools.

Based on the findings from an earlier mixed-methods study and a subsequent year of iterative piloting on a small scale, the Research Practice Partnership between J-PAL, TaRL Africa, VVOB, and the Ministry of Education co-developed a continuous professional development program to better support Catch Up teachers. This program complements the standard Catch Up program by establishing and supporting communities of practice among teachers (both within schools and between schools via WhatsApp). During regular professional development meetings, teachers engage in discussions about the Catch Up program, receive additional guidance documents and videos that align with their responsibilities throughout the academic year, and are invited to collaborate with their colleagues to participate in biweekly “mastery challenges.” In addition, the Ministry recognizes teachers’ successful participation through non-monetary incentives and issues formal letters of commendation.

Experimental design

We created three experimental groups of schools for the study. We began by randomly assigning half of 182 zones to either receive the Catch Up program or not receive the program (and continue with business as usual). Those zones assigned to the Catch Up program are the same in which we sampled two government schools for data collection; in the remaining zones not assigned to the program, we sampled one school. We randomized zones within strata of four zones each. We generated these strata by grouping zones that (a) shared the same district and (b) had similar levels of average academic performance. After that, in the zones assigned to the program, we randomly assigned one school to receive the program together with the additional continuous professional development (CPD) program.

Design details

Randomization method
Randomization done in office by a computer
Randomization unit
Zones: To either receive the Catch Up program or not receive the program (and continue with business as usual). Schools: In the zones assigned to the program, one school to receive the program together with the additional continuous professional development (CPD) program or not (and continue with the usual program).
Clusters
273 schools in 182 zones
Observations
8,025 students sampled at baseline (to be tracked over two years). Assuming a worst-case scenario of 20% attrition, the planned number of observations is between 6,420 and 8,025 students.
Arms
91 control schools, 91 schools with the regular Catch Up intervention, and 91 schools with the Catch Up intervention and additional continuous professional development for teachers
Primary outcomes
The study's main outcome of interest is children's learning of foundational skills in mathematics and literacy as measured with independent one-on-one assessments.
Secondary outcomes
Student-level end points - Student subskills in math and literacy (including the subdomains targeted by the program vs other subdomains of foundational numeracy) - Student socio-emotional skills and creativity - Student non-subject-matter cognitive outcomes - Student attitudes towards literacy, math, school In addition, the study collects data on intermediate outcomes at the teacher level, program take-up, and implementation fidelity.

Cited by

No citation data available for this registration yet.

Keywords