Effect of targeted messages and informational videos on school data quality in South Africa

How to cite

Böhmer, Bianca L.. 2026. "Effect of targeted messages and informational videos on school data quality in South Africa." AEA RCT Registry. AEARCTR-0018888. https://doi.org/10.1257/rct.18888-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Bianca L. Böhmer*

* Primary investigator

Registry ID
AEARCTR-0018888
DOI
https://doi.org/10.1257/rct.18888-1.0
First registered
Last updated
Status
On going
Trial dates
2025-08-01 – 2027-02-28
Countries
Private
Registry record
http://www.socialscienceregistry.org/trials/18888

Abstract

High-quality administrative education data are essential for monitoring system performance, allocating resources, and informing decision-making. However, the value of these data depends on schools submitting information that is accurate, complete, and timely. Despite significant improvements over time and ongoing investments in education management information systems and data dashboards in South Africa, challenges remain in ensuring consistent and high-quality data submissions across schools.

This study evaluates whether low-cost, scalable communication interventions can improve the frequency, completeness, and quality of administrative data submissions to the South African School Administration and Management System (SA-SAMS). Specifically, the study examines the impact of targeted messages and informational videos delivered to schools participating in the Data Driven Districts (DDD) programme.

The evaluation will be implemented as a randomised controlled trial involving approximately 10,550 schools. By testing interventions that can be deployed at scale with minimal resource requirements, the study aims to generate evidence on practical approaches for strengthening administrative data quality and improving the effectiveness of data-driven decision-making within education systems.

Intervention

Schools in the treatment group will receive a combination of the following nudges, in addition to existing communication that is already part of the normal Data Driven Districts (DDD) operations.
1. Targeted messaging
Users receive SMS or email messages containing customised:
• Notifications of missing or incorrect data fields
• Reminders to complete submissions.
• Information about their recent data submissions (in comparison to other schools)
Messages are customised based on current data or previous submission patterns.
2. Informational videos
Users receive video(s) explaining:
• Roles and responsibilities in data management
• Data submission procedures (can include links)
• Reminders on the importance of high-quality data.

Experimental design

The evaluation will be conducted as a randomised controlled trial. Randomisation will take place at the school level. Schools will be randomly assigned to either the treatment or control group:
- The control group will consist of about 5275 school who would receive no additional interventions on top of normal planned district and DDD operations.
- The treatment group will consist of about 5275 schools who will receive targeted data submission messages as well as data quality training videos and guidelines sent to schools in Term 1 and 2 of 2026

Design details

Randomization method
Randomisation done on a computer
Randomization unit
Randomisation was performed at the school level.
Clusters
No clustering
Observations
~10,550 schools
Arms
~5,275 in control and 5,275 in treatment
Primary outcomes
The primary outcomes pertain to the completeness of data entry for Learner National Identifyer (ID) and an estimate of the quality of the Learner attendance and Educator attendance data at the school level.
Secondary outcomes
The secondary outcomes look at the quality of Learner National Identifyer (ID) and the frequency and speed to submission of Learner and Educator attendance data. Aside from the secondary outcomes on the three main variables, there is a secondary outcomes that will be analysed, namely user engagement with the DDD system.

Cited by

No citation data available for this registration yet.

Keywords