The Effects of Personalized Feedback

How to cite

Aucejo, Esteban. 2021. "The Effects of Personalized Feedback." AEA RCT Registry. AEARCTR-0007105. https://doi.org/10.1257/rct.7105-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Esteban Aucejo*

* Primary investigator

Registry ID
AEARCTR-0007105
DOI
https://doi.org/10.1257/rct.7105-1.0
First registered
Last updated
Status
In development
Trial dates
2021-01-11 – 2022-05-01
Countries
Private
JEL codes
I2
Registry record
http://www.socialscienceregistry.org/trials/7105

Abstract

The purpose of this study is to investigate the impact of giving personalized email feedback to students attending a large public institution in the US. We aim to learn more about what type of feedback is the most impactful on student learning and retention (i.e., what information is more likely to affect student behavior). We also plan to assess heterogeneity on how different group of students (i.e. first generation, gender group, field of study, type of instruction) respond to feedback after receiving their exam scores. To assess the impact of feedback, we will not only look at educational outcomes but we will also elicit from the students how their beliefs have changed after receiving their exam scores and personalized feedback.

Intervention

We will send email to students (that attend introductory classes in economics) with different feedback messages. The content of these messages will depend on students' performance in the exams. These emails will be submitted at random conditional on performance. We also plan to administer several surveys to students in order to gather background information and to understand how they update their beliefs about their own abilities.

Experimental design

Students attending a large public higher education institution will receive different feedback messages (at random) conditional on their exam performance. The goal is to determine how different types of feedback influence student outcomes. We will focus on students enrolled in introductory classes in economics.

Design details

Randomization method
The randomization will be done in office by a computer using the Stata command "stratarand".
Randomization unit
Randomization will be done at the student level conditional on attending the same class (we have approximately 18 classes in our experiment). Students will receive a feedback email at random conditional on their performance in the class. Assignment to treatment will be done by stratifying the sample.
Clusters
No clusters, we will randomize students into the tretament and control groups within classroom. We plan to perform the randomizatoin on approximately 18 classrooms.
Observations
Our sample involves approximately 1350 students that are divided across approximately 18 different classrooms.
Arms
Approximately 300 students will be randomly allocated to each of the three treatment groups and 300 students in the control group.
Primary outcomes
The primary outcomes that we plan to analyze are: final grade in the class, whether the student dropouts from the class, whether the student changes major/field of study, whether the student dropouts from university (conditional on being able to have access to this information), whether the student updates beliefs regarding own abilities, and whether the student believes that receiving certain type of feedback is helpful.

Cited by

No citation data available for this registration yet.

Keywords