Improving pedagogy at-scale in low-income countries
How to cite
Rodriguez-Segura, Daniel; Sullivan, Tim; Pinell, Anne; Geraghty, Sean; Maricourt, Clotilde de. 2022. "Improving pedagogy at-scale in low-income countries." AEA RCT Registry. AEARCTR-0009211. https://doi.org/10.1257/rct.9211-1.2
Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.
* Primary investigator
Abstract
Strong pedagogy is a key component of rich classroom environments. As such, it is also a determinant of the resulting learning outcomes of students. This is particularly important in low- and middle-income countries (LMIC), where teacher content-knowledge, preparation, and educational background are typically weak. Therefore, focusing on strengthening pedagogical practices in these contexts is a promising avenue to improve education, as this type of interventions can have large returns to learning due to a sense of being a “low-hanging fruit”, while being near fiscally-neutral. However, improving pedagogy at-scale in LMIC has been relatively under-studied, partly because of the difficulty of successfully implementing these reforms in many classrooms at once.
In this study, we will explore whether two pedagogical changes rooted in the “science of learning”, namely “spaced retrieval” and “interleaving” can actually deliver higher learning outcomes at-scale in 312 Liberian public schools, via two separate randomized trials. Given the centralized and scripted nature of lesson delivery in Bridge Liberia, the implementing agency of these trials, we have the opportunity to seamlessly incorporate these changes into the lessons, and ensure that as long as lessons are delivered, take-up of the pedagogical changes follows suit.
This work builds off previous internal RCTs testing the effectiveness of similar pedagogical changes to our lessons. However, these trials were conducted in a different country, and the data collected for those will not be used for analysis in the current study in any way. These other studies are unpublished as of the time of pre-registration of the current RCT.
Intervention
Interventions(s): This study will consist of two different RCTs modifying pedagogical practices, by introducing “spaced retrieval” in grade 3 science lessons, and “interleaving” in math lessons for grades 4-6. Schools will be randomly assigned to being part of the treatment group, or the comparison group, and will be part of that experimental group for both trials. Below, we describe the specific interventions in greater detail:
Spaced Retrieval in Grade 3 Science
This intervention aims to give a daily dosage of “mixed review” questions to students in Grade 3 Science, and to ensure that they are given an opportunity first to attempt to answer the question without any support from the book. It will give them a chance to find the answer in their text. After that, the teacher will share the correct answer. “Mixed Review” activities will vary between full lesson length of 45 minutes (12 lessons), 15 minutes (14 lessons), and 5 minutes (35 lessons), with the number of questions varying proportionally according to how much time is allotted for the review.
Interleaving in Upper Primary Mathematics
The current status quo of the math lessons is that each lesson has 20 practice problems, and all of those problems are blocked practice (i.e. aligned to the content of that lesson). This intervention would include changing those practice problems from blocked to interleaved. 40% of the practice problems would remain focused on the topic taught that day, while 60% of the practice problems would be distributed among the past 4 “levels” of content. This technique creates an opportunity for retrieving the interleaved content, but it also creates what cognitive scientists call “desirable difficulty”: the brain retains new information much better and retains it for longer if it meets a certain threshold of rigor (when the difficulties are palpable but learners have the means to overcome them).
Experimental design
To minimize potential spillovers of the treatment, we randomly allocate treatment at the school level. To increase statistical power, we create randomization strata that absorb some of the variation in outcomes. In particular, we create 8 strata based on previous academic performance for schools for which we have that data. For those schools that we do not have baseline assessment data, we stratify in 4 groups based on pupil attendance. For those schools with neither set of baseline data, we pool them into a single strata. Finally, we leave in a single strata 14 schools which we know that have had operational issues at the start of the semester, and as such may not be able to implement the intervention. We reserve the right to exclude them from the analysis, if the qualitative reports from the field point in the direction of implementation not being successful in the strata. In total, we are left with 14 different strata, within which treatment was randomly assigned to approximately half of all schools.
Design details
Cited by
No citation data available for this registration yet.