Do Words Matter - Understanding the Effect of Exam Question Phrasing

How to cite

Röver, Nicolas. 2023. "Do Words Matter - Understanding the Effect of Exam Question Phrasing." AEA RCT Registry. AEARCTR-0012687. https://doi.org/10.1257/rct.12687-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Nicolas Röver*

* Primary investigator

Registry ID
AEARCTR-0012687
DOI
https://doi.org/10.1257/rct.12687-1.0
First registered
Last updated
Status
In development
Trial dates
2023-12-13 – 2024-08-01
Countries
Private
Registry record
http://www.socialscienceregistry.org/trials/12687

Abstract

n Western countries, a gender gap in quantitative subjects in university and STEM-related1
jobs is well documented (e.g. Chen and Luo, 2022 and Ross et al., 2012). There is a multitude
of factors driving the gender gap; in this study we focus on the role of exams. Exam
performance is a major factor in university admission and job allocation. However, the notion
that exams are fair and truly test the abilities they are designed for is more and more called
into question (e.g. Duquennois 2022). There is a growing body of evidence suggesting that
the setting of exams and design of questions can systematically disadvantage socioeconomic
groups.2 Duquennois (2022) shows that students from poor families perform worse if a
question has a financial theme. Building on this result, our study aims to understand if
certain question phrasings systematically disadvantage one gender. By randomly varying
the exam question phrasing, we want to study this.

Experimental design

We will randomly vary question phrasing in math related questions.

Design details

Randomization method
randomization done in office by a computer
Randomization unit
individual
Clusters
500
Observations
1500
Arms
1
Primary outcomes
Exam Scores

Cited by

No citation data available for this registration yet.

Keywords