Likelihood Magnitudes and Posterior Beliefs

How to cite

Saeed, Tashfeen. 2026. "Likelihood Magnitudes and Posterior Beliefs." AEA RCT Registry. AEARCTR-0019513. https://doi.org/10.1257/rct.19513-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Tashfeen Saeed*

* Primary investigator

Registry ID
AEARCTR-0019513
DOI
https://doi.org/10.1257/rct.19513-1.0
First registered
Last updated
Status
In development
Trial dates
2026-08-31 – 2026-09-20
Countries
Private
JEL codes
D83, C91
Registry record
http://www.socialscienceregistry.org/trials/19513

Abstract

This study proposes an experiment that examines how the magnitude of underlying likelihoods influences likelihood judgments and posterior beliefs. The experiment constructs information environments that hold the likelihood ratio—and therefore the Bayesian posterior—fixed while varying the absolute magnitude of the underlying likelihoods. By eliciting both likelihood judgments and posterior beliefs, the study investigates whether likelihood-reporting distortions depend on likelihood magnitude, whether these distortions propagate to posterior beliefs, and whether pure and mixed samples with identical likelihood ratios generate different likelihood judgments or posterior beliefs.

Experimental design

The study uses a belief-updating task based on a standard bookbag-and-poker-chip paradigm. Participants complete multiple independent rounds in which there are two bags containing different proportions of colored balls. In each round, one bag is selected at random, a small sample of balls is drawn with replacement, and participants report probabilities based on the observed sample.

Participants are randomly assigned to one of two treatment conditions. In the Posterior (P) condition, participants report only the probability that each bag generated the observed sample. In the Likelihood/Posterior (L/P) condition, participants first report the probability of drawing the sample from each bag (likelihood judgments) and then report posterior beliefs.

Across rounds, the experimental environments vary the sample size, bag compositions, and observed samples. The primary environments are constructed to hold the likelihood ratio—and therefore the Bayesian posterior—fixed while varying the absolute magnitude of the underlying likelihoods. Additional benchmark environments compare pure and mixed samples that imply the same likelihood ratio and Bayesian posterior. All questions are framed hypothetically, with probabilities fully determined by the stated bag compositions and samples.

Additional details on the experimental procedures, analysis plan, and exclusion criteria are provided in the uploaded Pre-Analysis Plan.

Design details

Randomization method
Participants are randomly assigned to one of two treatment conditions using Qualtrics’ built-in randomization features.
Randomization unit
Individual participants
Clusters
200 participants
Observations
200 participants
Arms
100 participants in each of the two treatment groups
Primary outcomes
The primary outcomes are participants’ reported posterior probabilities that a bag generated a given sample, and their reported likelihood probabilities of drawing the sample from each bag.

Cited by

No citation data available for this registration yet.

Keywords