Does Increasing Numeracy Reduce Probability Weighting?
How to cite
Dogan, Gokce. 2025. "Does Increasing Numeracy Reduce Probability Weighting?." AEA RCT Registry. AEARCTR-0017250. https://doi.org/10.1257/rct.17250-1.0
Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.
* Primary investigator
Abstract
Probability weighting, a cognitive bias that leads individuals to assign subjective probabilities to events that differ from their objective likelihoods, has been shown to correlate with the ability to comprehend probabilistic and mathematical concepts, namely numeracy. While the existing literature suggests that individuals with higher numeracy exhibit behaviors more aligned with expected utility maximization, the evidence remains inconclusive. In this experiment, we aim to explore: i) the relationship between probability weighting and numeracy; and ii) whether this relationship can be influenced through manipulating numeracy. We employ the standard certainty equivalence elicitation technique to estimate probability weighting parameters and the Objective Numeracy Scale (ONS) of \cite{weller} to measure the numeracy levels of participants.
Intervention
The treatment group will undergoe a numeracy intervention involving arithmetic exercises (addition, subtraction, multiplication, and division) using a number line. Specifically, they will be asked to compute arithmetic questions involving listed operations and place the correct answer on a number line. The difficulty of the arithmetic questions adapts dynamically based on performance: correct answers increase the difficulty, while incorrect answers reduce it. Participants should answer at least 25 questions (and at most 125) to complete the training. This adaptive approach prevents highly skilled participants from becoming disengaged and ensures that lower-skilled participants do not become discouraged. Responses are submitted by marking the result on a number line, which enhances numerical reasoning by reinforcing relative magnitude comparisons.
The control group will receive an active placebo intervention consisting of 30 trivia questions (sport, history, geography, etc.) which should not affect the numeric abilities of the participants. This active control intervention will help us keep the effort level and time spent constant across two groups.
Experimental design
This experimental design is implemented through Prolific. We recruit participants with approval ratings of at least 95% and aim for a sample balanced by gender. We will also use Prolific’s demographic information to control for income, educational background, socioeconomic status, neurodiversity, and dyslexia/dyscalculia status.
The experiment consists of a single session with five stages and is expected to last approximately one hour. Participants receive a $10 show-up fee plus any earnings from their decisions; all five stages are eligible for bonus payments.
In Stages 1 and 4, participants’ numeracy levels are assessed before and after the intervention using the 8-item Objective Numeracy Scale (ONS) developed by Weller et al. (2013). If one of these stages is selected for bonus payment, a single question from the set of eight will be randomly drawn, and participants will earn a $3 bonus if their answer is correct.
In Stages 2 and 5, we elicit certainty equivalents using Multiple Price Lists (MPLs) administered before and after the intervention. Each lottery is paired with a descending list of certain outcomes via a computerized interface. Certainty equivalents are necessary for estimating value and probability-weighting functions, following Tversky and Kahneman (1992) and Prelec (1998). Bonus payments for these stages are determined based on a randomly selected lottery question from a randomly selected MPL. This procedure ensures accurate elicitation of certainty equivalents and robust estimation of probability-weighting parameters.
Stage 3 constitutes the intervention. Participants are randomly assigned to either the treatment or control group. The treatment group completes a numeracy training intervention involving arithmetic exercises—addition, subtraction, multiplication, and division—answered by placing solutions on a number line. The control group receives an active placebo consisting of trivia questions unrelated to numerical ability.
Design details
Cited by
No citation data available for this registration yet.