The effect of rank feedback provision on performance: an experimental study using high school students

How to cite

Lou, Hanlin. 2021. "The effect of rank feedback provision on performance: an experimental study using high school students." AEA RCT Registry. AEARCTR-0008145. https://doi.org/10.1257/rct.8145-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Hanlin Lou*

* Primary investigator

Registry ID
AEARCTR-0008145
DOI
https://doi.org/10.1257/rct.8145-1.0
First registered
Last updated
Status
In development
Trial dates
2021-08-27 – 2021-09-10
Countries
Private
Registry record
http://www.socialscienceregistry.org/trials/8145

Abstract

The effect of relative performance feedback, especially ordinal rank feedback, on performance has been broadly discussed in recent decades. However, there are few studies on the relationship between the impacts of providing relative performance feedback and the choice of comparison groups. We conjecture that splitting a large comparison group into multiple smalls can improve the motivational effects of providing rank feedback. We will conduct a field experiment in a high school to test whether giving rank feedback can motivate individuals and whether the motivational effects tend to be enhanced in small reference groups.

Intervention

The basic experimental design requires participants to do a two-stage task consisting of two tests. We randomise participants into one of three conditions:

Control group: No feedback
We will give participants in the control group a "to do your best" notification after the first test.

Treatment 1: Class rank feedback
We will inform participants of their rank in their classroom after the first test.

Treatment 2: Group rank feedback
We will inform participants of their rank in a same-ability group of five members after the first test.

Experimental design

We will ask participants to do a two­-stage task. At each stage, participants will be given a list of 15 English sentences and the corresponding Chinese translation and asked to remember them, and then we told them that there would be a translation test based on the list two days later. Specifically, they need to translate the Chinese sentences on the test papers into English subject to the sentence lists they received.

After the first test, we will rank participants in each classroom based on their performance, and we will divide them from top to bottom into multiple groups of five members. It means that participants in each group had similar performances. Then, we will randomly select some participants and provide them with rank feedbacks, whereas we will give others a "to do your best" notification. Both rank feedbacks and notifications will be printed on an A4 paper and privately given to participants. We will also encourage them not to share their feedback with others. In this experiment, we will introduce two types of rank feedback. The one is Class-rank feedback. Participants who are selected to receive class rank feedback will be informed of their rank in their classroom. We can interpret the class rank as a measurement of one's relative position in a large comparison group. Another one is Group-rank feedback. Instead of informing participants of their class rank, we will tell them their rank in the group of five members. In this case, participants will learn their relative position in a small comparison group that all members have similar initial performances. Then, they will be given another sentence list and test.

Design details

Randomization method
Randomization by a computer programme.
Randomization unit
We randomise all treatments at the individual level.
Clusters
At least 450 participants.
Observations
At least 450 participants.
Arms
150 participants in the Control group; 150 participants in Treatment 1; 150 participants in Treatment 2
Primary outcomes
Participants' scores in each test.

Cited by

No citation data available for this registration yet.

Keywords