Who Should Receive Relative Feedback? And Why? (Addition)

How to cite

Opitz, Saskia; Sliwka, Dirk; Vogelsang, Timo; Zimmermann, Tom. 2024. "Who Should Receive Relative Feedback? And Why? (Addition)." AEA RCT Registry. AEARCTR-0013047. https://doi.org/10.1257/rct.13047-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Saskia Opitz* , Dirk Sliwka , Timo Vogelsang , Tom Zimmermann

* Primary investigator

Registry ID
AEARCTR-0013047
DOI
https://doi.org/10.1257/rct.13047-1.0
First registered
Last updated
Status
On going
Trial dates
2023-01-16 – 2024-12-31
Countries
Private
JEL codes
C21, C93, M54
Registry record
http://www.socialscienceregistry.org/trials/13047

Abstract

Previous research has provided evidence that feedback in the form of relative performance information (RPI) can increase employees’ performance. However, it is very likely that the strength of the performance effects resulting from such a feedback depends on the feedback recipient’s personality traits and prior performance (e.g., whether the feedback is positive or negative). In this study, we aim to investigate whether machine learning can enhance the effects of RPI by tailoring it to an employee's individual characteristics. Additionally, we will utilize both closed-form and open-ended questions to target RPI and explore the use of alternative data sources. In this addition to AEARCTR-0012213, we investigate whether monetary incentives can increase performance in our task significantly above the level RPI can.

Intervention

In the RPI treatment, participants will receive feedback in the form of relative performance information. That is, they receive feedback on their percentile ranks based on how many grids they correctly solved during the 7.5 minutes of a real-effort task. In the incentive group, participants do not receive relative performance information but a piece rate for each mistake they identify in the real-effort grid task.

Experimental design

We run the experiment on Prolific. In the real-effort task, participants have to identify mistakes in 10-row by 15-column grids with symbols, i.e., numbers, letters or emojis. A mistake is defined as a symbol that differs from the most commonly occurring symbol in the specific grid. In each grid, there are between one and five mistakes and participants have to provide the location of each mistake. They have 7.5 minutes to solve as many grids as possible. All participants receive information about the number of correctly identified mistakes on their screen.

After this first work phase, participants will be randomly assigned to either a RPI treatment or an incentive group. In the RPI treatment, participants will receive feedback in the form of relative performance information. That is, they receive feedback on their percentile ranks based on how many mistakes they correctly identified during the 7.5 minutes of the real effort task. The percentile rank is computed in comparison to participants from a pilot study in which no RPI was provided. In the incentive group, participants will not receive any relative performance feedback but are informed that they will receive a piece rate for each mistake they correctly identify in the second work phase.

Afterwards, participants work again 7.5 minutes on the same real effort task and, after completing the task, receive information on the number of correctly identified mistakes on their screen as well as their relative performance if they were in the RPI treatment after completing the task or the total bonus amount if they are in the incentive group. At the end, they will complete a short post-survey consisting of control questions as well as questions regarding stress while working on the task, enjoyment with the task, whether they would have liked to receive (no) relative performance information, and how important it was for them to do well on the task. At the end of the experiment, workers will be redirected to Prolific and all receive the same fixed compensation as well as their additionally earned bonuses.

Design details

Randomization method
We will randomize participants into RPI or incentive group such that there is an equal number of subjects in each group
Randomization unit
Individual subject
Clusters
The number of clusters is the same as the number of observations (please see below).
Observations
We invite 200 individual subjects to participate in the study.
Arms
100 individual subjects in the RPI treatment and 100 individual subjects in the incentive group
Primary outcomes
The primary outcome variable is the number of correctly identified mistakes in the second 7.5 minutes of the real-effort task (controlling for the number of correctly identified mistakes in the first working phase).
Secondary outcomes
Secondary outcome variables are stress while working on the task and enjoyment of the task.

Cited by

No citation data available for this registration yet.

Keywords