Learning: Retractions versus Novel Information

How to cite

Willis, Jack; Libgober, Jonathan; Goncalves, Duarte. 2019. "Learning: Retractions versus Novel Information." AEA RCT Registry. AEARCTR-0003820. https://doi.org/10.1257/rct.3820-1.1

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Jack Willis* , Jonathan Libgober , Duarte Goncalves

* Primary investigator

Registry ID
AEARCTR-0003820
DOI
https://doi.org/10.1257/rct.3820-1.1
First registered
Last updated
Status
In development
Trial dates
2020-06-11 – 2020-07-31
Countries
Private
Registry record
http://www.socialscienceregistry.org/trials/3820

Abstract

This project aims to understand why people may fail to unlearn, i.e. to disregard information once it is shown to be irrelevant. It is motivated by many examples of people continuing to hold incorrect beliefs long after they have been widely discredited, for example the belief that vaccines cause autism. We seek to study whether people are able to "unlearn" effectively by comparing the process of unlearning irrelevant information, through retractions of earlier signals, to the process of learning from new information, through receiving new signals. By focusing on an abstract lab setting, we can ensure that the informational content of retractions is the same as that of new signals. Our design also allows us to test whether acting on previous information affects the ability to unlearn it, one possible mechanism, as well as whether receiving a retraction affects learning from subsequent information. We will also use the opportunity of observing beliefs at high frequency to add to existing evidence on how learning deviates from a Bayesian benchmark more generally.

Experimental design

The experiment will be run on MTurk. See the supplementary doc for the MTurk instructions, which explain the design.

Design details

Randomization method
Randomization is done by oTree, the software on which the experiment is run.
Randomization unit
The unit of randomization for retractions versus novel information (and the specific balls draws) is the round-individual level (each person faces 32 rounds). The unit of randomization for the effect of previous belief elicitation is the individual level. The unit of randomization for the motivated vs unmotivated treatment is at the individual level - each individual faces either the motivated or unmotivated treatment for all 16 rounds.
Clusters
Approximately 400 individuals
Observations
Approximately 400 individuals, each of whom will play the game 32 times.
Arms
Approximately 400 individuals, each of whom will play the game 32 times. Elicitation each round vs elicitation at the end is randomized at the level of the individual. One half of individuals will face elicitation each round, one half elicitation at the end.
Primary outcomes
Outcomes are beliefs which are elicited at various points in the experiment. Our analysis will test how these beliefs vary across different histories / treatments. Our primary hypotheses are: 1. Retractions induce mistakes, more so than informationally equivalent new signals: a. Individuals do not completely "delete" retracted signals, i.e. when a signal is retracted, individuals do not "go back" to the beliefs without that signal b. Individuals have more difficulty in interpreting retractions than equivalent direct information (new signals) c. In turn, retractions accentuate standard biases in updating, compared to informally equivalent signals 2. Mechanisms / why retractions fail: a. Does acting on information hinder subsequent updating from retractions of the information? (comparing effects of retractions when beliefs have already been elicited vs when they have not) b. Do retractions of recent signals work differently from retractions of earlier signals? c. Do retractions become less effective as evidence becomes stronger in one direction?
Secondary outcomes
1. Do retractions change subsequent updating a. Are individuals less reactive to new information after a retraction? (comparing updating in period 4 with and without a retraction in period 3) 2. Replicate standard findings on belief updating from direct information - Grether-style analysis (log-odds regressions): base-rate neglect (coeff on log-odds prior), under-reaction to signals (coeff on signal sign scaled by signal's informational value), confirmation bias (coeff on signal on whether signal's sign matches the prior, e.g. signal is +/- and prior is >/< .5) - Order dependence

Cited by

No citation data available for this registration yet.

Keywords