Understanding Performance Declines

How to cite

Meyer, Carl; Reyes, German; Somerville, Jason. 2025. "Understanding Performance Declines." AEA RCT Registry. AEARCTR-0016565. https://doi.org/10.1257/rct.16565-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Carl Meyer* , German Reyes , Jason Somerville

* Primary investigator

Registry ID
AEARCTR-0016565
DOI
https://doi.org/10.1257/rct.16565-1.0
First registered
Last updated
Status
In development
Trial dates
2025-08-18 – 2026-10-01
Countries
Private
JEL codes
C91
Registry record
http://www.socialscienceregistry.org/trials/16565

Abstract

Performance declines within individuals over the course of cognitively demanding tasks have been documented across diverse settings—from students performing worse on later questions of high-stakes exams to physicians making more diagnostic errors later in their shifts—yet our understanding of why individual performance deteriorates remains limited. We study a potential driver of performance declines in an online experiment.

Intervention

Participants complete a 30-question, 50-minute online math exam. We randomly vary the order of the questions and the timing of a higher bonus rate that can apply to one third of the exam (first, middle, or final ten questions). We also elicit participants’ preferred timing and valuation for when to receive higher bonus.

Experimental design

Individual online experiment involving math test with randomized order of questions and random timing of a higher bonus rate applied to one third of the test. We elicit beliefs and preferences about performance and bonus timing. Question order is randomized to separate difficulty from time-on-task effects.

Design details

Randomization method
Randomization done by computer
Randomization unit
Individual participant (BB timing). Question order is randomized within participant.
Clusters
Approximately 475 individuals
Observations
Approximately 475 individuals
Arms
Approximately 100 individuals per treatment arm
Primary outcomes
1. Test performance: indicator for correct answer at the question level. 2. Performance decline: slope of performance with respect to question position over the exam. 3. Bonus-boost preferences: (a) stated preferred timing (first/middle/final third); (b) WTP for timing options.
Secondary outcomes
1. Effort allocation: time per question. 2. Beliefs about performance: pre- and post-exam forecasts for each third. 3. Cognitive fatigue: pre- and post-exam self-reports. 4. Cross-price elasticities of effort/performance across boosted vs. non-boosted thirds; Slutsky-symmetry test following Bronchetti et al. (2023). 5. Self-reported effort/time allocation (actual vs. ideal) post-exam. 6. Qualitative measures: open-ended BB rationale and advice to future participants (to be categorized with LLMs, exploratory). 7. Heterogeneity: outcomes by gender, income, education.

Cited by

No citation data available for this registration yet.

Keywords