Evaluating the Effects of School Reopening in the Pandemic: Evidence from São Paulo
How to cite
Lichand, Guilherme; Cossi, João Paulo; Carneiro, Carlos Alberto Doria; Neto, Onicio Leal. 2020. "Evaluating the Effects of School Reopening in the Pandemic: Evidence from São Paulo." AEA RCT Registry. AEARCTR-0006742. https://doi.org/10.1257/rct.6742-1.2000000000000002
Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.
* Primary investigator
Abstract
In this study, we evaluate the effect of schools reopening in the context of the Covid-19 pandemic on students' educational and health outcomes, their families' health and economic outcomes, and school staff's health outcomes. A subset of schools in São Paulo, Brazil, reopened at the beginning of October. We will combine administrative and phone survey data as well as quasi-experimental and experimental methods to evaluate the effect of the reopening on the outcomes of interest. In the experiment, we randomly encourage students in some schools, but not others, to returns to in-person classes when they resume.
Intervention
To measure the impact of school reopening, we will take advantage of the fact that schools will reopen progressively. We combine administrative data for the universe of students and school staff and mobile survey data for a sample comprising both students and school staff enrolled and working in schools that have reopened and those enrolled and working in schools that are still closed.
Approximately 20% of the municipalities in São Paulo State authorized schools to reopen for optional sports and cultural activities on September 7, 2020 and for regular activities (only for high school students) on October 7, 2020. The return of school activities might depend on several characteristics, such as the state of the pandemic in the municipality, mayor's characteristics, etc.
In this project, we will combine quasi-experimental and experimental methods to evaluate the causal effect of school reopening on the outcomes of interest. The experiment will comprise an encouragement design, in which we send nudges to motivate students to return to
school -- randomly assigning within municipalities where schools are open. We will send motivation SMS to students themselves (grades 10 to 12) or a students' parent or legal guardian (grades 6 to 9, if those are allowed to resume regular
classes in the months that follow).
We can use this experiment to assess the reduced-form effects of school reopening on the outcomes of interest by simply comparing treated schools with non-treated schools within municipalities that chose to reopen schools. If we have access to attendance data for the schools that reopen, from administrative records, we can use the assignment to nudges as an instrumental variable to estimate the causal effect of school reopening on health and education outcomes.
In order for the simple comparison described above to generate causal effects, we need to assume that the messages do not have a direct effect on the outcomes of interest but affect them only through the attendance in reopened schools. We will verify if this is the case by sending placebo messages. Specifically, we will send the same messages to students enrolled in schools that did not reopen. Since we will have information on students in both types of schools, we can evaluate if messages have a direct effect on the outcomes of interest.
Experimental design
We plan on reaching at least 18.258 students equally divided between the treatment, placebo, and control groups (although the intervention might end up reaching as many as 400,000 students).
The content of the messages will be the same, but the students in the treatment group will be randomly assigned among those in municipalities that reopen schools. The placebo group, on the other hand, will be composed of a random set of students of the municipalities that did not reopen schools.
We will send two messages a month for each student during three months. To implement the intervention, we will partner with Brazilian EdTech Movva, specialized in nudges via text messages, withexpertise in implementing randomized trials and partnering with researchers to
conduct evaluations to assess the effectiveness of programs and policies. Movva is in charge of designing and sending text messages in the context of our experimental intervention.
Design details
Cited by
No citation data available for this registration yet.