Likelihood Magnitudes and Posterior Beliefs
How to cite
Saeed, Tashfeen. 2026. "Likelihood Magnitudes and Posterior Beliefs." AEA RCT Registry. AEARCTR-0019513. https://doi.org/10.1257/rct.19513-1.0
Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.
* Primary investigator
Abstract
This study proposes an experiment that examines how the magnitude of underlying likelihoods influences likelihood judgments and posterior beliefs. The experiment constructs information environments that hold the likelihood ratio—and therefore the Bayesian posterior—fixed while varying the absolute magnitude of the underlying likelihoods. By eliciting both likelihood judgments and posterior beliefs, the study investigates whether likelihood-reporting distortions depend on likelihood magnitude, whether these distortions propagate to posterior beliefs, and whether pure and mixed samples with identical likelihood ratios generate different likelihood judgments or posterior beliefs.
Experimental design
The study uses a belief-updating task based on a standard bookbag-and-poker-chip paradigm. Participants complete multiple independent rounds in which there are two bags containing different proportions of colored balls. In each round, one bag is selected at random, a small sample of balls is drawn with replacement, and participants report probabilities based on the observed sample.
Participants are randomly assigned to one of two treatment conditions. In the Posterior (P) condition, participants report only the probability that each bag generated the observed sample. In the Likelihood/Posterior (L/P) condition, participants first report the probability of drawing the sample from each bag (likelihood judgments) and then report posterior beliefs.
Across rounds, the experimental environments vary the sample size, bag compositions, and observed samples. The primary environments are constructed to hold the likelihood ratio—and therefore the Bayesian posterior—fixed while varying the absolute magnitude of the underlying likelihoods. Additional benchmark environments compare pure and mixed samples that imply the same likelihood ratio and Bayesian posterior. All questions are framed hypothetically, with probabilities fully determined by the stated bag compositions and samples.
Additional details on the experimental procedures, analysis plan, and exclusion criteria are provided in the uploaded Pre-Analysis Plan.
Design details
Cited by
No citation data available for this registration yet.