Fighting the learning loss: Evaluating C-SEF for university students and staff.

How to cite

Amador, Michelle González; Lock, Edwin; Finster, Simon; Marmolejo-Cossío, Francisco. 2022. "Fighting the learning loss: Evaluating C-SEF for university students and staff.." AEA RCT Registry. AEARCTR-0009466. https://doi.org/10.1257/rct.9466-2.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Michelle González Amador* , Edwin Lock , Simon Finster , Francisco Marmolejo-Cossío

* Primary investigator

Registry ID
AEARCTR-0009466
DOI
https://doi.org/10.1257/rct.9466-2.0
First registered
Last updated
Status
Completed
Trial dates
2022-06-01 – 2022-06-30
Countries
Mexico (San Luis Potosí)
JEL codes
C61, C88, C93, D82, H12, I12, I23, I24
Registry record
http://www.socialscienceregistry.org/trials/9466

Abstract

We introduce the COVID-19 safe education framework (C-SEF), a novel mechanism for monitoring and safeguarding a population in educational institutions. The mechanism aims to mitigate the effect of COVID-19 restrictions on economic, psychological and educational well-being, a phenomenon that has been referred to as ‘learning loss’ in other similar instances. We propose a utility-weighted algorithmic approach to pool testing individuals in a scarce-resource setting. The mechanism uses pooled testing to identify healthy individuals, who are permitted to return on-site, while guaranteeing that infected individuals continue to work off-site. The utility-based optimisation approach underlying our solution takes into account factors such as psychological well-being, need for academic resources and socio-economic status in order to optimally allocate testing. To evaluate the efficacy and robustness of our proposed solution, we conduct a randomised controlled
trial at the Potosinian Institute of Scientific and Technological Research (IPICYT). The outcome of our experiment will be measured in terms of performance and productivity, mental health and infection probabilities. Moreover, the evaluation results will allow us to make policy recommendations for better governance of educational institutions during pandemic times.

Experimental design

We implement a mechanism to ensuring the safety of an educational institution (C-SEF) on the academic population at IPICYT in San Luis Potosí, Mexico. We randomly assign individuals into a treatment and a control group. Subjects in the treatment group follow a pool-testing protocol and are allowed to freely use the facilities of the university so long as they test negative. Individuals in the control group are expected to work remotely and only use the facilities for emergencies [the definition of an emergency is at the discretion of the head of department to which the student/staff belongs]. The physical isolation of treatment group and control groups is essential for our protocol to work; both to avoid health spillovers and disentangle psychological dynamics. The IPICYT campus lends itself, for the most part, to a two-group randomisation approach. The campus consists of two similar buildings for research in natural sciences, two similar buildings for research in computer science and mathematics, one building for classes, and one building for administration. The individuals participating in our trial are randomly assigned to the treatment and control group. Note however that some individuals in the control group will still work on-site based on exceptions. Therefore, we use the following strategy: one of the natural science buildings is randomly assigned to be treated and one of the CS and math buildings is randomly assigned to be treated. Crucial for this approach to be effective is that individuals in both buildings are comparable. Given IPICYT's reports about their staff, we know that both research students and researchers are assigned to work in each of the buildings contingent only on their academic discipline, based on no individual characteristics important for the evaluation of our framework. Hence, we may consider the assignment as pseudo-random. Nevertheless, we further collect a number of covariates to conduct a balance analysis [Should there be a clear imbalance, we will subscribe to a post-experimental matching approach as proposed by Bruhn and McKenzie (2009)]. Within the staff building, we also need to physically separate the space allocated to treatment and control group. Our strategy here is to separate the four-storied building by floors. We randomly select either the top two or the bottom two floors for treatment, and the remaining two floors for control. Similar to the other two buildings, we accept that the assignment is pseudo-random. Students can be assigned to classrooms depending on availability and suitability for the course taught. Moreover, students in the control group will exclusively participate in online learning. Therefore, each individual in the student population is assigned randomly to either treatment or control.

Individuals assigned to the treatment group are invited to participate in the C-SEF protocol. All information about the institute-wide study is shared with the IPICYT population via an online communication campaign co-produced by the principal investigators and the communications department of the Institute. Consent is obtained from each individual via a form, which precedes a survey that collects baseline data. There exists no natural disincentive to participate in the study, and on the contrary, participation may indirectly give participants more freedom of movement, so we confidently estimate study compliance to be at nearly 100%. The C-SEF protocol uses a utility-weighted selection algorithm that groups individuals for pool testing. Individuals who test negative are allowed to attend their work or study activities on campus. Individuals who test positive are asked to isolate and work remotely until their next test. For a more detailed explanation about the testing mechanism please refer to the Pre-Analysis Plan document.

Design details

Randomization method
Cluster randomization (computerized).
Randomization unit
Unit of cluster: academic discipline (buildings); unit of analysis: students and staff.
Clusters
1 university population with 5 clusters (disciplines).
Observations
500 students and staff
Arms
250 students and staff per treatment arm
Primary outcomes
Posterior probabilities of infection, Perceived stress scale, Subjective well-being, performance and productivity.

Materials

Papers from this trial

  1. Finster, Simon, Michelle González Amador, Edwin Lock, Francisco Marmolejo-Cossío, Evi Micha, and Ariel D. Procaccia. "Welfare-Maximizing Pooled Testing." arXiv preprint arXiv:2206.10660 (2022). https://doi.org/10.48550/arXiv.2206.10660

Cited by

No citation data available for this registration yet.

Keywords