SMS Nudges for Better Academic Performance: a Non-Placebo Randomized Controlled Trial

How to cite

Oskorouchi, Hamid; Brandt, Alicia; Sousa-Poza, Alfonso. 2021. "SMS Nudges for Better Academic Performance: a Non-Placebo Randomized Controlled Trial." AEA RCT Registry. AEARCTR-0008399. https://doi.org/10.1257/rct.8399-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Hamid Oskorouchi* , Alicia Brandt , Alfonso Sousa-Poza

* Primary investigator

Registry ID
AEARCTR-0008399
DOI
https://doi.org/10.1257/rct.8399-1.0
First registered
Last updated
Status
In development
Trial dates
2021-11-03 – 2022-03-31
Countries
Private
Registry record
http://www.socialscienceregistry.org/trials/8399

Abstract

The shift to online teaching during the COVID-19 pandemic has challenged Universities to maintain high students' motivation and performance. This study will investigate the effectiveness of text messages (SMS) as a nudging tool to increase learning engagement and improve academic performance. Specifically, we will test if SMS can improve academic performance (as measured by final exam grades) regardless of the information they convey. Our hypothesis is that receiving SMS motivates the students to study regularly throughout the semester.
We will run a non-placebo randomized controlled trial (RCT) at the University of Hohenheim (Germany) within a large postgraduate course in "Multivariate Data Analysis" (MVDA; winter term 2021/2022). The students (who will provide their consent to take part in this study) will be randomly assigned to treatment and control groups. The former will receive a total of 34 short SMS throughout the semester, whereas the latter group will have access to the same information via the ILIAS online learning platform. By providing the control group the information on a platform (and not via text messages) allows us to directly measure the motivational effect of such messages (as oppose to content). Before the start of the experiment, the students will participate in a survey that collects basic socio-demographic variables. At the end of the experiment, but before the first exam period, we will ask the students to complete an end-line survey about their course satisfaction and study experience during the semester.

Intervention

The treatment group will receive a set of SMS at random days (times) of the week (day) (Monday-Friday, 8AM-7PM).
The SMS will comprise reminders or will provide information related to the topics thought in the online class.
The control group will not receive any SMS, but has access to the messages in a dedicated folder of the ILIAS online platform.

Experimental design

A non-blinded non-placebo RCT with two equally-sized arms.
Treatment group: receives reminder and lecture-related SMS (no new information) at random days and times (7AM-7PM, Mon-Fri).
Control group: no SMS, but content available on the ILIAS online teaching platform.

-Balance of baseline characteristics after randomization.
-Estimation of the intention-to-treat effect (ITT) of SMS nudges on primary and secondary outcomes via regression analysis with and without control variables (baseline characteristics)

Notes: SMS design and allocation are blind to the lecturers teaching and preparing the final exam and the online tests.

Design details

Randomization method
Randomization done in office by a computer. The sample will be equally divided into treatment and control group.
Randomization unit
Individuals (students)
Clusters
1 University postgraduate course
Observations
200-250 individuals
Arms
100-125 individuals
Primary outcomes
-Final exam grades (only first exam period) -Online tests (during the semeter)
Secondary outcomes
Course satisfaction (placebo) Use of the online forum (transmission channel) Regular studies (transmission channel) Coping with online teaching (transmission channel) Correct response for specific exam questions on which topic SMS were sent (placebo)

Cited by

No citation data available for this registration yet.

Keywords