Ground-truthing best education practices and evidence for COVID-19 learning recovery. Does presenting scientific evidence alter teachers’ beliefs and behaviors vis-a-vis global guidance?

How to cite

Ramachandra, Shrihari; Angrist, Noam; Chang, Andres Yi; Djaker, Sharnic; Sabarwal, Shwetlena. 2022. "Ground-truthing best education practices and evidence for COVID-19 learning recovery. Does presenting scientific evidence alter teachers’ beliefs and behaviors vis-a-vis global guidance?." AEA RCT Registry. AEARCTR-0010191. https://doi.org/10.1257/rct.10191-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Shrihari Ramachandra* , Noam Angrist , Andres Yi Chang , Sharnic Djaker , Shwetlena Sabarwal

* Primary investigator

Registry ID
AEARCTR-0010191
DOI
https://doi.org/10.1257/rct.10191-1.0
First registered
Last updated
Status
On going
Trial dates
2022-05-20 – 2022-12-31
Countries
Private
Registry record
http://www.socialscienceregistry.org/trials/10191

Abstract

COVID-19 shuttered schools for over a billion children, resulting in substantial learning losses. Institutions such as the World Bank, UNESCO, and UNICEF have issued considerable policy guidance on evidence-based best practices to recover learning losses. These include extending instructional time, conducting remedial education classes, and regular learning assessments. How realistic is it to implement these best practices? This study provides some of the first empirical evidence of teachers’ awareness, willingness, and implementation of learning loss recovery programs. We collect ground truth estimates by surveying teachers across three countries: Bangladesh, India, and Nepal. Further, we evaluate the impacts of delivering scientific evidence on the effectiveness of the global guidance on learning loss recovery using a randomized control trial by randomly assigning the teachers into four groups. The control group is only informed about the global policy in focus and is not given any evidence about its effectiveness. The three treatment groups are informed that the policy in focus is being recommended based on high-quality experimental evidence on the effectiveness from a similar or different context (Treatment 1 - Global Evidence and solution, Treatment 2 - Local Evidence, and Treatment 3 - Local evidence and solution).

Intervention

We collect data through standardized phone surveys in three countries - India, Nepal, and Bangladesh surveying 928 teachers (primary and secondary). The experiment elicits teachers' willingness to contribute (in minutes) to conducting extra learning recovery activities in addition to regular schooling for (a) developing and administering tests and (b) conducting remedial classes. The telephonic teacher survey comprised questions on teacher characteristics and focused on three policy modules – 1) Regular class assessments, 2) Remedial classes, and 3) Teacher school attendance in case of COVID cases, in addition to questions on non-cognitive traits and salary information. Further, the teachers are randomly assigned to either of the four groups: - 1 control and three treatment groups. In the control group, teachers are informed about the global policy in focus but are not given any evidence about its effectiveness. In the three treatment groups, T1 - The teachers are informed about the global policy and provide global evidence about the effectiveness. T2 - The teachers are informed about the policy in the local context. T3 - The teachers are informed about the local policy and also given local evidence about the effectiveness. The study aims to evaluate the impacts of delivering scientific evidence of the efficacy of global guidance on learning loss recovery.

Experimental design

The experiment is a telephonic survey comprising 928 teachers (primary and secondary school) in 3 countries - India, Bangladesh, and Nepal. The questions are on teacher characteristics and focused on three policy modules –
1) Regular class assessments
2) Remedial classes, and
3) Teacher school attendance in case of COVID cases.
Further, the teachers are randomly assigned to four groups
1) Control - Teachers are only provided with global policy information.
2) Treatment 1 - Teachers are provided with global policy information and a global evidence-based solution
3) Treatment 2 - Teachers are provided with local policy information
4) Treatment 3 - Teachers are provided with local policy information and a local evidence-based solution

Design details

Randomization method
Stata randomization
Randomization unit
Individual
Clusters
928 teachers. 3 countries
Observations
928 teachers
Arms
928 teachers. 3 countries
Primary outcomes
1) Currently conducting remedial classes (baseline) 2) Currently conducting regular formative assessments 3) Willingness to conduct extra classes. 4) Willingness to conduct regular formative assessments. 5) Willingness to spend additional time in school (in minutes) to conduct a) Extra classes b) regular formative assessments 6) Willingness to spend additional time in school (in minutes) to conduct a) Extra classes b) regular formative assessments after the treatment.
Secondary outcomes
1) Willingness to attend during low COVID cases 2) Willingness to attend during high COVID cases 3) Number of days willing to attend in case of low-COVID cases ( for 30 working days) 4) Number of days willing to attend in case of high-COVID cases (for 30 working days)

Cited by

No citation data available for this registration yet.

Keywords