Malawi National Numeracy Programme Impact Evaluation
How to cite
Pugatch, Todd; Nchadze, Lontum; French, Evaewero; Acikol, Alperen; Kadzamira, Esme. 2023. "Malawi National Numeracy Programme Impact Evaluation." AEA RCT Registry. AEARCTR-0011964. https://doi.org/10.1257/rct.11964-1.1
Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.
* Primary investigator
Abstract
The Malawi Ministry of Education is implementing the National Numeracy Programme (NNP). The NNP aims to improve early grade mathematics outcomes. This study will assess the impact of the NNP during the 2023/24 school year. The evaluation will use a randomized controlled trial design with 150 primary schools. Schools will be randomly assigned to treatment and control groups within matched sets of schools. Treatment schools will implement the revised NNP materials and training. Student learning outcomes will be measured using the Early Grade Mathematics Assessment in grades S1-S4. The study will also evaluate impacts on instructional quality using classroom observations. The evaluation will provide rigorous evidence on the impact of the NNP model on foundational numeracy skills, to inform decisions about national scale-up.
Intervention
Led by the Malawi Ministry of Education (MoE), funded by the United Kingdom’s Foreign, Commonwealth & Development Office (FCDO), and delivered by Cambridge Education, the four-year NNP aims to improve outcomes in mathematics so girls and boys have a solid foundation in basic skills to succeed in the rest of their schooling and fulfil their potential. The NNP aims to develop a new vision for teaching and learning mathematics in Malawi in which children experience mathematics as a meaningful, sense-making and problem-solving activity. Learners will be expected not only to know mathematics, but also to understand the mathematics they know, apply it to solve unfamiliar problems and reason and argue using the mathematics they develop. The NNP includes: a) revision of maths curriculum for the first year of primary school and subsequent training; 2) one-to-one ratio workbooks that are given to the children and that children can bring home; 3) semi-structured teacher guides guiding teachers to teach one page of workbook per day.
Experimental design
Cluster RCT, with treatment assignment at school level.
From a sample of 150 public primary schools in Malawi, half will be randomly assigned to the National Numeracy Program (NNP; treatment group), with the other half keeping the status quo mathematics curriculum (control group).
Details: We will begin with a sampling frame of 300 schools (100 in each of the three sample districts). Randomization will be stratified by district and school characteristics. School characteristics will be measured by the first principal component of the following school characteristics from the 2021 EMIS:
• age of school
• enrollment
• pupil-teacher ratio (PTR)
• female enrollment %
• female teacher %
• remoteness categories (from Asim et al 2019)
• share with ECD exposure
• share of repeaters in S1-S4
• passing rate on PSLCE exam
• management index, calculated as the proportion of the following reported as active at the school:
o PTA
o school management committee
o community volunteers
o School Improvement Plan
We will use these criteria to group schools into groups of 4.
Within each group of 4 schools, we will randomly assign two to treatment and two to control. This method of stratification follows recommendation by Athey and Imbens (2017).
Within treatment and control pairs, we will randomly assign one school for inclusion in the sample, the other as replacement.
This will result in an evaluation sample of 150 schools (75T/75C). It will also generate a replacement sample of equal size, to be used as necessary.
Design details
Cited by
No citation data available for this registration yet.