Do Time-Constraints Matter? How, Why, and for Whom?
How to cite
Ozer, Esma; Krishna, Kala; Akyol, Pelin. 2023. "Do Time-Constraints Matter? How, Why, and for Whom?." AEA RCT Registry. AEARCTR-0010719. https://doi.org/10.1257/rct.10719-1.2
Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.
* Primary investigator
Abstract
We study test-taking behavior in time-constrained exams and describe time's role in shaping the distribution of students' performance outcomes. We do this by leveraging a policy change in Turkey which increased the college entrance exam time. Supporting administrative school-level data with the experimental data we collected, we show that having more test time is significantly associated with less wrong answers and less skipping patterns in a multiple-choice test where negative marking exists. Moreover, this association varies by gender and ability which we proxy for using background data. Female students are less likely to gain from an extra minute than male students and above median students are less likely to gain from an extra minute than below median students. Besides the performance changes, we also find that more test-time reduces the standard error and thus leads convergence of scores to each other. These data patterns motivates us to construct a model of test-taking behavior in time-constrained exam settings to firstly quantify the gains and losses from the policy change and secondly provide alternative exam policies with counterfactual exercises, interacting test-time with other test settings.
Experimental design
The sample is composed of 12th grade students in a high school. There is one treatment-arm which is the (more) time limit in a multiple choice test.The sample is randomly grouped into two: time-relaxed and time-constrained.
In the first wave of experiment: students take a multiple choice (with 5 choices) test with four subjects (Turkish, Math, Science, Social Science) where negative marking applies. The booklets given to students are identical, i.e., the question difficulty/order doesn't differ across randomization units. Time-constrained group are given 90 minutes for 100 questions while time-relaxed group are given 170 minutes for 100 questions. The time-limit is designed such that the time-relaxed group is only ability-constrained. Proctoring is provided by randomly assigned school teachers in each of 5 classrooms. Students are incentivized with money per their ranking in their group. They can earn money between $0-30.
In the second wave of the experiment, all the settings stay same but the negative marking. We remove negative marking to see the changes in our primary outcomes with respect to time-constraints.
Design details
Cited by
No citation data available for this registration yet.