Normatively Framed Relative Performance Feedback – Field Experiment and Replication

How to cite

Brade, Raphael; Himmler, Oliver; Jäckle, Robert. 2018. "Normatively Framed Relative Performance Feedback – Field Experiment and Replication." AEA RCT Registry. AEARCTR-0003288. https://doi.org/10.1257/rct.3288-2.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Raphael Brade* , Oliver Himmler , Robert Jäckle

* Primary investigator

Registry ID
AEARCTR-0003288
DOI
https://doi.org/10.1257/rct.3288-2.0
First registered
Last updated
Status
Completed
Trial dates
2014-10-01 – 2022-09-30
Countries
Germany ()
JEL codes
I23, C93
Registry record
http://www.socialscienceregistry.org/trials/3288

Abstract

Feedback can help individuals put their performance into perspective, especially when transitioning into a new environment such as university or a different job. In a randomized field experiment we give first-year university students normatively framed relativeperformance feedback about their accumulated course credits. We find an increase in subsequent performance, but only when the feedback is positive. Using a regression discontinuity design, we show that the improved performance is not driven by unobserved characteristics of those receiving positive feedback, but that it is indeed due to the positive rather than negative nature of the feedback. We administer a replication experiment with the next wave of first-year students one year later and reproduce the results. Survey data provides suggestive evidence that positive feedback has an effect on behavior when students underestimate their relative performance, and that consistent with a mechanism of selective information processing, individuals focus on positivefeedback to adjust their beliefs.

Experimental design

Students were randomly assigned to one of the following two conditions:
1) Absolute Feedback: this is the control condition. Students in this condition receive two letters in the mail informing them about their obtained credits in the previous semester.
2) Relative Feedback: this is the treatment condition. These students receive the same information, but the letters also inform them about how well they performed relative to the average student and the student on the 80th percentile. This information is augmented with normative messages of approval for those who obtained at least the average number of credits. For those below the average the approving normative messages are greyed out. We label the different types of feedback as follows: positive (= above average performance + approving normative message) and negative (= below average performance + no approving normative message).
Both groups receive absolute feedback with respect to their obtained GPA.

Design details

Randomization method
randomization done in office by a computer
Randomization unit
Individual
Clusters
812 students in Experiment I (initial trial) 797 students in Experiment II (replication)
Observations
812 students in Experiment I (initial trial) 797 students in Experiment II (replication)
Arms
405 students in the control group in Experiment I (initial trial) 407 students in the treatment group in Experiment I (initial trial) 398 students in the control group in Experiment II (replication) 399 students in the treatment group in Experiment II (replication)
Primary outcomes
Obtained credit points as provided by the student office.
Secondary outcomes
The GPA as provided by the student office. The number of attempted exams as provided by the student office. The number of failed exams as provided by the student office. Dropout as provided by the student office. Subjective outcomes (collected in surveys): lecture visits, students’ satisfaction with the study program, life satisfaction, satisfaction with grades; time spent on studying, and stress level.

Papers from this trial

  1. Relative Performance Feedback and the Effects of Being Above Average - Field Experiment and Replication (with Oliver Himmler and Robert Jäckle). Economics of Education Review, (89), 102268, 2022. https://doi.org/10.1016/j.econedurev.2022.102268

Cited by

No citation data available for this registration yet.

Keywords