How messages of encouragement influence students’ grades on exams?

How to cite

Keller, Tamas; Szakál, Péter. 2019. "How messages of encouragement influence students’ grades on exams?." AEA RCT Registry. AEARCTR-0005155. https://doi.org/10.1257/rct.5155-1.1

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Tamas Keller* , Péter Szakál

* Primary investigator

Registry ID
AEARCTR-0005155
DOI
https://doi.org/10.1257/rct.5155-1.1
First registered
Last updated
Status
In development
Trial dates
2019-12-09 – 2020-01-31
Countries
Private
JEL codes
I21, I23, I25
Registry record
http://www.socialscienceregistry.org/trials/5155

Abstract

We will conduct a large-scale randomized field experiment at the University of Szeged that takes the form of a message of encouragement. All students at the university will receive before their exam. We will randomize when students receive the message. A randomly selected half of all students will receive the message of encouragement before their first exam, and will not receive it before their second exam. The other random half of the sample will be treated before their second exam, and will not be treated before their first exam. By comparing students who receive the message of encouragement with those who do not, we will investigate how the message of encouragement influences students’ grades on the exam. We will explore treatment heterogeneity and test for the particular mechanism through which the potential effect might operate. Our research has particular policy relevance in terms of its search for low-cost, easily scalable interventions that can prevent students from dropping out.

Intervention

Our intervention takes the form of a message of encouragement that students will receive before their exam. The student will receive the message of encouragement via two channels: e-mail and text message on their mobile device.

Experimental design

We have designed a crossover randomized field experiment (Brown 1980) in which students function as their own control since we have repeated measurements (first and second exam) about the same students.

Design details

Randomization method
We will randomize students at the student level. We will employ pair-matched randomization (Imai, King, and Nall 2009). We will first sort the data file according to the following baseline variables: the study program on which the student is enrolled, the level of training, the type of training, the financial form of training, students’ gender, and students’ ability. In the sorted data file, we will identify the most similar pairs of students. We will randomly assign students from the same pair to Group A or Group B based on the value of a randomly generated number.
Randomization unit
student
Clusters
No clusters
Observations
We expect a sample size of at least 10,000 students in the analytical sample
Arms
We have 16,992 different students at the university. Half of them will be treated before the first exam. The other half will be treated before the second exam.
Primary outcomes
The primary outcome variable is students’ grades on the exam, which are integers between 1 and 5.
Secondary outcomes
In addition to the primary outcome variable, we pre-register secondary outcome variables which will comprise 1 if a student fails the exam (grade 1) and 0 if the student receives any other grades.

Cited by

No citation data available for this registration yet.

Keywords