Feedback and Performance: A Lab Experiment

How to cite

Casaburi, Lorenzo; Heursen, Lea. 2021. "Feedback and Performance: A Lab Experiment." AEA RCT Registry. AEARCTR-0007718. https://doi.org/10.1257/rct.7718-2.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Lorenzo Casaburi* , Lea Heursen

* Primary investigator

Registry ID
AEARCTR-0007718
DOI
https://doi.org/10.1257/rct.7718-2.0
First registered
Last updated
Status
In development
Trial dates
2021-05-26 – 2025-12-31
Countries
Switzerland ()
Registry record
http://www.socialscienceregistry.org/trials/7718

Abstract

In an online lab experiment, participants are asked to design two drafts of a recruitment poster for the lab. Before they complete the second draft, they receive a review of their first draft from one of the other participants. Participants are allocated to different "feedback groups": in one group, pairs of participants review each other (sequentially); in another group, participants are matched anonymously. Subjects' payments are based on the peer feedback for the first draft (within a tournament) and on researchers' grading of the second draft. We study how feedback groups affect performance in the second poster and contribution in a public good game subjects play at the end of the session, as well as feedback content.

Experimental design

In an online lab experiment, participants are asked to design two drafts of a recruitment poster for the lab. Before they complete the second draft, they receive a review of their first draft from one of the other participants. Participants are allocated to different "feedback groups": in one group, pairs of participants review each other (sequentially); in another group, participants are matched anonymously. Subjects' payments are based on the peer feedback for the first draft (within a tournament) and on researchers' grading for the second draft. We study how feedback groups affect performance in the second poster and contribution in a public good game subjects play at the end of the session, as well as feedback content.
We also conduct a Prediction Survey on Prolifics with approximately 200 HR professionals (May 2025). In this survey, we ask which of the two feedback groups (reciprocal vs. non-reciprocal) improved their final posters more, by which percentage, and why.

Design details

Randomization method
Randomization done within each session by a computer
Randomization unit
Individual-level randomization
Clusters
20 experimental sessions, for a total of 742 participants (split into A-players and B-players). A-B pairs are randomly allocated to the two feedback treatment groups.
Observations
Our analysis focuses on B-players (i.e., those who receive feedback in step 2) for the second draft performance and the number of comments received. Our sample includes a total of 367 B-players. We also analyze contributions to the PGG for all participants (an expected total of 320 observations).
Arms
N/A
Primary outcomes
- Performance in the second draft of the poster (total score and two sub-scores: content and design ) - Contribution to public good game
Secondary outcomes
- Number of comments received in the feedback to the first draft of the poster - Quality of comments (exploratory measures: survey items with subjective assessment of comments quality; correlation of number of comments received with objective score in first draft of the poster) - Answers to a prediction survey on Prolifics, where we ask HR professionals which of the two feedback groups (reciprocal vs. non-reciprocal) improved their final posters more, by which percentage, and why.

Cited by

No citation data available for this registration yet.

Keywords