Effects of Relative Rank in Achievement and Effort

How to cite

Pollard, Garrison; Knight, Thomas; Estrada, Carlos. 2024. "Effects of Relative Rank in Achievement and Effort." AEA RCT Registry. AEARCTR-0014216. https://doi.org/10.1257/rct.14216-3.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Garrison Pollard* , Thomas Knight , Carlos Estrada

* Primary investigator

Registry ID
AEARCTR-0014216
DOI
https://doi.org/10.1257/rct.14216-3.0
First registered
Last updated
Status
In development
Trial dates
2025-01-13 – 2026-05-08
Countries
Private
JEL codes
I21, J24
Registry record
http://www.socialscienceregistry.org/trials/14216

Abstract

This research proposal seeks to explore how receiving information regarding relative standing within an academic environment—such as a student’s individual rank in comparison to peers—affects students’ learning experiences, engagement levels, and overall achievement. When student achievement is independent of peer achievement, economic theory predicts that information on relative achievement rank should have no impact on student effort allocation or future achievement. Extensive literature demonstrates this is simply not true [for a review, see Delaney and Devereux (2022)]. This study adds an additional dimension to this literature by introducing relative effort ranks. Rather than providing all students with information regarding their rank in some achievement distribution, we would provide a subset of students with information on their rank in an effort distribution. Our work, by considering a new type of information, is well suited to address the practical limitations of the existing literature on rank effects.

Intervention

This study is to be conducted in an introductory economics course (Principles of Macroeconomics) at a large, comprehensive research university.

When grades are posted for the first and second exam in Principles of Macroeconomics, the course grader will send an email or Canvas message to each student providing: (1) their grade on the exam, (2) a link to the answer key for the exam, and (3) one of 3 randomly chosen messages:
1. (Treatment 1) Information on their Relative Performance Rank (i.e. percentile) on the exam
2. (Treatment 2) Information on their Relative Effort Rank (i.e. percentile) in the period prior to the exam
3. (Control) No Additional Information
The Relative Performance Rank will be determined using actual test score distributions for the entire course. The Relative Effort Rank will be determined by an index measure generated using Canvas course analytics to capture relative course engagement.

REVISION 1: The information above applies to experiment run in Spring 2025 semester. For Fall 2025 semester, the study will be conducted in two introductory economics courses (Principles of Macroeconomics AND Principles of Microeconomics).

REVISION 2: The information above applies to experiment run in Spring 2025 semester. For Spring 2026 semester, the study will be conducted in two introductory economics courses (Principles of Macroeconomics AND Principles of Microeconomics).

Experimental design

Students in large introductory economics courses will receive an email after each exam containing information on their performance on the exam as well as some additional information on relative performance which varies by treatment arm.

Design details

Randomization method
Randomization by computer
Randomization unit
Individual
Clusters
1200 students (approximation which depends on student enrollment) Fall 2025: 2400 additional students (approximation which depends on student enrollment) Spring 2026: 2000 additional students (approximation which depends on student enrollment)
Observations
1200 students (approximation which depends on student enrollment) Fall 2025: 2400 additional students (approximation which depends on student enrollment)
Arms
400 control, 400 treatment 1, 400 treatment 2 Fall 2025: additional 800 control, 800 treatment 1, 800 treatment 2 Spring 2026: additional 666 control, 667 treatment 1, 667 treatment 2
Primary outcomes
1 - Future Exam Performance 2 - Course Withdrawal
Secondary outcomes
1 - Future Course Engagement

Cited by

No citation data available for this registration yet.

Keywords