Randomized evaluation of markets for impact in the Ghana and Sierra Leone basic education sectors
How to cite
Leaver, Clare; Opare-Kumi, Jennifer; Mansoor, Zahra; Angrist, Noam. 2025. "Randomized evaluation of markets for impact in the Ghana and Sierra Leone basic education sectors." AEA RCT Registry. AEARCTR-0015340. https://doi.org/10.1257/rct.15340-1.1
Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.
* Primary investigator
Abstract
The governments of Ghana and Sierra Leone have each designed an outcomes fund mechanism with the goal of improving student access, retention, and learning. Part of the rationale is to create a ‘market for impact’. The hope is that service providers with good insights into how to drive learning for all children will bid to win contracts and implement their ideas in schools (and with communities). By incentivizing outcomes—rather than inputs, as is typical in many programmes in the social sector—implementation is not fixed. Providers can innovate over time in search of improved implementation and better outcomes. The design is a geographic-lot-based, school-level cluster RCT. The unit of randomization is the school. There is one treatment group in each country: ‘included in the project’. The study will evaluate impacts on practices to improve learning, teacher and student behaviour, and student cognitive and non-cognitive foundational skills.
Intervention
The governments of Ghana and Sierra Leone have created ‘markets for impact’ by implementing an outcomes funding mechanism in their education sectors. These programs are called the Ghana Education Outcomes Project (GEOP) and the Sierra Leone Education Innovation Challenge (SLEIC). The GEOP has two components: an Accelerated Learning Programme and a Mainstream School Improvement Programme (MSIP). This study is focusing on the MSIP.
Each government identified geographic lots with schools in need of support, awarded a contract per lot to a grantee (service provider) via competitive procurement, set target outcomes (based on literacy and numeracy by gender), and is making year-end payments for outcomes achieved (measured via randomized evaluation). The treatment group in Ghana is 610 schools enrolled in the GEOP MSIP, and in Sierra Leone 325 schools enrolled in the SLEIC. The intended treatment is ‘receipt of a package of support activities from a service provider reimbursed by an outcomes contract’. The design of each mechanism is stable and has been implemented by the respective government. That said, these mechanisms purposefully incentivize innovation. Since providers are paid based on whether students learn, they have substantial freedom to evolve their activities in service of those outcomes. At the bidding stage, most support packages included a combination of teacher professional development, pedagogical training, targeted instruction, and community engagement. The study will purposefully document what each provider is implementing and how this evolves over time.
Experimental design
Ghana.
Sampling of schools. An initial sample of schools was drawn by the research team. The sampling frame was the list of basic government-run schools in the World Bank funded Ghana Accountability for Learning Outcomes Project (GALOP) in the six geographic GEOP lots identified by the Ghana Ministry of Education. We randomly sampled an agreed number of schools (sufficient to give the required number of treatment schools, plus an equal number of control schools, and some replacements) using an exclusion restriction based on school GALOP index scores to maximise cross-lot comparability. This created a sample of 1,261 schools located across 27 districts, out of the total 1,626 GALOP schools in the area. We visited these schools in May-July 2022 to conduct a baseline survey. The Independent Verification Agent, KMPG, then drew a slightly smaller sample of 1,220 schools which became the GEOP sample.
Randomisation. There is a single treatment arm (schools receive interventions from GEOP grantees), and a single control arm. KMPG performed the treatment assignment, in private using Stata. The sample was stratified by the 27 districts and, within districts, by GALOP score (above average vs below average score).
Sierra Leone.
Sampling of schools. OPM used the Annual Primary School Census from 2020 as the initial sampling frame for schools. Out of 7,020 schools in Sierra Leone, 3,438 schools were selected based on 8 eligibility criteria: GoSL-approved schools (either government-owned or financially supported by GoSL); pupil enrolment of 100 or more; four of more teachers; single-shift; accessible; Grades 1-6; coed/mixed; not part of the Education Innovation Challenge Programme (a precursor to the SLEIC). The sampling frame was then stratified. Selected schools were divided into five geographical lots and then further stratified within each lot based on: enrolment (3 categories), distance from district HQ (3 categories), and gender parity in enrolment (2 categories). 650 schools were drawn from the 3,438 schools using these lots, and within lots, 13 strata. This gave a total of 65 individual strata across the five lots.
Randomisation. There is a single treatment arm (schools receive interventions from SLEIC grantees), and a single control arm (schools do not receive interventions from SLEIC grantees). OPM performed the treatment assignment, in private using Stata. The method used was using random systematic sampling (with equal probabilities within the stratum). The eligible schools within each stratum were first ordered geographically, in order to provide implicit stratification and a proportional allocation of the schools by district within each lot and stratum. The selected schools within each stratum were then systematically divided into two replicates. One replicate was randomly assigned to the treatment group, and the other to the control group. This ensured that the treatment and control schools are equally representative of the stratum and have the same geographic implicit stratification.
Design details
Cited by
No citation data available for this registration yet.