How does relative performance feedback affect beliefs and academic decisions?
How to cite
Franco, Catalina. 2020. "How does relative performance feedback affect beliefs and academic decisions?." AEA RCT Registry. AEARCTR-0006970. https://doi.org/10.1257/rct.6970-1.0
Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.
* Primary investigator
Abstract
I design field and lab-in-the field experiments at a test preparation institute in Colombia to understand how students incorporate relative performance feedback into their beliefs and decisions. I focus on a high-stakes context where relative performance beliefs are particularly consequential - college entrance exams - and aim to answer the following question: How do beliefs about academic ability and academic choices change when students of different ability levels learn about their performance relative to their peers? I conduct an RCT in which I randomly assign students taking the course either to receive or not to receive feedback about their quartile in the score distribution in weekly practice tests. I elicit beliefs about their perceived quartiles after each practice test and provide the treatment group with an above-/below- median signal to study belief updating. Combining elicited beliefs and administrative data from the course and university admissions, I study (i) belief updating, (ii) academic investments, (iii) performance, and (iv) academic decisions.
Intervention
The intervention consists of two parts: (i) I collect beliefs about relative performance in practice tests from all participants in a weekly lab-in-the-field experiment, and (ii) I provide relative performance feedback to a randomly selected sample of students preparing to take a college entrance exam at a test preparation institute in Medellin, Colombia. After each practice test students take as part of the preparation course, I elicit probabilities of falling in each of the four quartiles of the math and reading practice-test score distributions. I modify the institute's results report to provide relative performance feedback to treated students.
Experimental design
I randomly assign half of the students who consented to participate to a treatment group that received weekly relative performance feedback in the two subjects covered by the exam over 8 weeks. To reduce sample variability and to conduct heterogeneity analysis, the randomization was stratified based on gender, whether they had taken the exam in the past, quartile in the initial practice test, and type of course they were enrolled in (morning, afternoon/evening, weekends, pre-medicine, joint preparation for two entrance exams at different universities).
To deliver the relative performance feedback, I separately compute quartiles of the math and reading practice test-score distributions. The quartiles are calculated based on the scores of all students taking the same weekly practice test. To circumvent the problem of ties in practice test scores that may lead to quartiles of unequal sizes, students who are in the limit between two quartiles are randomly assigned to one or the other. The decision to provide relative performance feedback in terms of quartiles and not other finer measure is related to the belief elicitation task, which would be much more time-consuming and error-prone if students had to assign probabilities to deciles or ventiles of the score distribution.
Using individual surveys, I elicited prior beliefs across 10 rounds after each practice test except after the initial one. From the experimental performance report, I obtain posterior beliefs across 8 rounds. After every practice test, I administered a survey with questions about students' expected absolute and relative performance, hours of study in the previous week, and the perceived difficulty of the test. I provided paper or online surveys depending on the type of practice test (in-person or online). Overall, there were 10 rounds of prior belief elicitation, excluding the first practice test. I collected posterior beliefs (online only) using the experimental performance report.
Design details
Cited by
No citation data available for this registration yet.