Do Time-Constraints Matter? How, Why, and for Whom?

How to cite

Ozer, Esma; Krishna, Kala; Akyol, Pelin. 2023. "Do Time-Constraints Matter? How, Why, and for Whom?." AEA RCT Registry. AEARCTR-0010719. https://doi.org/10.1257/rct.10719-1.2

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Esma Ozer* , Kala Krishna , Pelin Akyol

* Primary investigator

Registry ID
AEARCTR-0010719
DOI
https://doi.org/10.1257/rct.10719-1.2
First registered
Last updated
Status
On going
Trial dates
2022-10-12 – 2024-02-28
Countries
Turkey (Malatya)
Registry record
http://www.socialscienceregistry.org/trials/10719

Abstract

We study test-taking behavior in time-constrained exams and describe time's role in shaping the distribution of students' performance outcomes. We do this by leveraging a policy change in Turkey which increased the college entrance exam time. Supporting administrative school-level data with the experimental data we collected, we show that having more test time is significantly associated with less wrong answers and less skipping patterns in a multiple-choice test where negative marking exists. Moreover, this association varies by gender and ability which we proxy for using background data. Female students are less likely to gain from an extra minute than male students and above median students are less likely to gain from an extra minute than below median students. Besides the performance changes, we also find that more test-time reduces the standard error and thus leads convergence of scores to each other. These data patterns motivates us to construct a model of test-taking behavior in time-constrained exam settings to firstly quantify the gains and losses from the policy change and secondly provide alternative exam policies with counterfactual exercises, interacting test-time with other test settings.

Experimental design

The sample is composed of 12th grade students in a high school. There is one treatment-arm which is the (more) time limit in a multiple choice test.The sample is randomly grouped into two: time-relaxed and time-constrained.
In the first wave of experiment: students take a multiple choice (with 5 choices) test with four subjects (Turkish, Math, Science, Social Science) where negative marking applies. The booklets given to students are identical, i.e., the question difficulty/order doesn't differ across randomization units. Time-constrained group are given 90 minutes for 100 questions while time-relaxed group are given 170 minutes for 100 questions. The time-limit is designed such that the time-relaxed group is only ability-constrained. Proctoring is provided by randomly assigned school teachers in each of 5 classrooms. Students are incentivized with money per their ranking in their group. They can earn money between $0-30.
In the second wave of the experiment, all the settings stay same but the negative marking. We remove negative marking to see the changes in our primary outcomes with respect to time-constraints.

Design details

Randomization method
Randomization is done using computer with random number generator.
Randomization unit
Randomization unit is individiual in a given school.
Clusters
One school with planned 80-100 students.
Observations
80-100 students.
Arms
40-50 students control, 40-50 students treatment.
Primary outcomes
We are interested in learning how time-constraints impact (i) probability of getting correct, (ii) probability of skipping in a multiple-choice exam set up.

Cited by

No citation data available for this registration yet.

Keywords