Supervisory Feedback, Effort, and Performance - a Randomized Experiment Using an Online Game

How to cite

Lovasz, Anna. 2019. "Supervisory Feedback, Effort, and Performance - a Randomized Experiment Using an Online Game." AEA RCT Registry. AEARCTR-0003984. https://doi.org/10.1257/rct.3984-2.1

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Anna Lovasz*

* Primary investigator

Registry ID
AEARCTR-0003984
DOI
https://doi.org/10.1257/rct.3984-2.1
First registered
Last updated
Status
Completed
Trial dates
2019-04-01 – 2020-02-28
Countries
Hungary ()
JEL codes
D91, I24, J16, M54
Registry record
http://www.socialscienceregistry.org/trials/3984

Abstract

We study the effects of various elements of supervisory communication - peer performance information and subjective feedback - on the effort and performance of individuals. To do so, we randomize the provision of such communication elements during a simple online game of visual perception. The game is advertised as a challenging game of self-improvement using social media outlets. We study the effect on various outcomes: intensity of play and number of games played (effort), as well as accuracy and game score (performance). We study the mean effect on players, as well as the effect on subgroups based on task-related confidence and gender.

Intervention

The intervention includes elements of performance feedback (leader board) and subjective feedback (encouragement, praise, trash talk), given prior to and during the online game.

Experimental design

We collect data using an online game that is advertised using social media outlets.
During the 2 minute game, treatment is given using pop-up text boxes using simple phrases and graphics.
Treatment is randomized among the interactions of two dimensions: (1) performance information and (2) subjective feedback.

Design details

Randomization method
Randomization via computer (algorithm).
Randomization unit
Randomization will be done at the individual game session level.
Clusters
1 online game
Observations
8000 individuals
Arms
1000 individuals for each treatment arm (8 arms including control group)
Primary outcomes
We plan to measure individual effort (number of games played, intensity of game playing (clicks)), as well as performance measures (accuracy of clicks, game score).

Cited by

No citation data available for this registration yet.

Keywords