Gender Gaps at the Top: Exam Performance and Choking Under Pressure
How to cite
Skarpeid, Ingvild Lindgren; Franco, Catalina. 2022. "Gender Gaps at the Top: Exam Performance and Choking Under Pressure." AEA RCT Registry. AEARCTR-0009873. https://doi.org/10.1257/rct.9873-1.0
Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.
* Primary investigator
Abstract
Being admitted to top-quality education is highly consequential for long-term outcomes. Admissions to top schools are determined by performing well in high-stakes exams in many countries around the world. Yet, a growing body of evidence shows that men outperform women in these important exams. To date, there is scarce evidence as to how and why gender differences in performance arise in high pressure, high-stakes situations. We design an experiment to explore female exam underperformance when the pressure goes up in a controlled environment. In the experiment, we give Prolific workers a series of two Raven's-type short tests containing easy, middle-difficulty and hard questions. After completing the baseline test (Test 1), we introduce treatments in Test 2 varying the level of pressure faced by participants in two ways: (1) We introduce a cutoff that determines whether participants receive a bonus payment, and (2) We increase the monetary payment per correct answer. We measure whether the treatments induce underperformance relative to a control group, and whether there are gender differences in underperformance. Lastly, we assess the role of an intervention providing participants with the full test structure and question difficulty. We plan to collect the data for this experiment starting in August 2022.
Intervention
The main treatments variations of this study seek to increase the pressure that participants face in two ways. Relative to a pure control group, treated participants will face the introduction of a cutoff in Test 2. To increase pressure even further, participants in another treatment arm will face higher stakes through a higher monetary payment per correct answer in addition to the cutoff. We expect to generate substantial gender differences in performance with the introduction of these treatment variations. In addition, in another treatment arm we test whether knowing the level of difficulty of each question could mitigate the gender gap in performance.
Experimental design
Participants perform in two timed tests of 4 minutes, where they face 7 Raven-style IQ questions. They are informed that one of the tests will be drawn for payout, and that they should do their best on both tests to maximize their payoff. Both tests are constructed such that questions follow a set order of difficulty (unknown to participants apart from in the Difficulty treatment). The first test is paid with piece rate incentives, and the second test participants are paid according to the treatment incentives described above.
Participants can choose to respond to the questions as they appear or move questions to the end of the test. After responding to each question, they are given up to 20 seconds to answer a set of questions regarding their experience solving the question: How difficult they found it, whether they are certain that they got it right, and if they completely guessed when answering it.
In each of the tests, after the four minutes run out or after answering all seven questions, participants are asked an incentivized measure of beliefs regarding number of correct answers. The also report how much effort they exerted when answering the questions. After completing the two tests, participants answer an end questionnaire that maps neuroticism, anxiety, stress and motivation as well as how familiar they are with these types of exercises. We also collect background questions e.g. on gender, age, geographical location, household income and educational attainment.
Control
Participants in the pure control condition are presented with piece rate incentives equivalent to 0.20GBP per correct answer in both Test 1 and Test 2.
Low incentives with cutoff
Participants face higher pressure by introducing a cutoff; if participants score less than the set cutoff of 5 correct answers they will earn zero, otherwise they earn 0.20GBP per correct answer.
High incentives with cutoff
Participants face the same cutoff, and pressure is increased even more by increasing the monetary stakes. Instead of earning 0.20GBP per correct answer, they will earn 5 GBP per correct answer, if they score equal to or above the cutoff.
Difficulty treatment
In this treatment we test whether knowing the level of difficulty of each question could mitigate the gender gap in performance under pressure. We keep the incentives and cutoff as in High incentives with cutoff, and show participants the level of difficulty of the question they are currently attempting, as well as a diagram with the overview of the difficulty level of all the questions in Test 2.
Design details
Cited by
No citation data available for this registration yet.