Rational Memory vs Reinforcement Learning

How to cite

Neligh, Nathaniel. 2019. "Rational Memory vs Reinforcement Learning." AEA RCT Registry. AEARCTR-0004638. https://doi.org/10.1257/rct.4638-3.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Nathaniel Neligh*

* Primary investigator

Registry ID
AEARCTR-0004638
DOI
https://doi.org/10.1257/rct.4638-3.0
First registered
Last updated
Status
In development
Trial dates
2020-03-13 – 2020-05-16
Countries
Private
JEL codes
D8, D9, C9
Registry record
http://www.socialscienceregistry.org/trials/4638

Abstract

Kunreuther et al. (2013) document a phenomenon whereby the demand for disaster insurance increases after a disaster and then falls when no further disasters arise, even when no serial correlation is present. If individuals were perfect Bayesian learners, we would expect these responses to disappear asymptotically, but they appear to be persistent in equilibrium. These “insurance cycles” can be explained by a more general phenomenon called recency bias where more recent events have an out-sized impact on beliefs and behavior. New theoretical work in Neligh (2019) has demonstrated how recency bias and insurance cycles can naturally result from a rational memory model where memories decay over time, but individuals preserve their memories better by expending costly cognitive resources. In this paper, we conduct an experiment testing some predictions of the rational memory model in an insurance purchasing game. We also test whether player behavior is better described by a rational memory model or a traditional reinforcement learning model by separately manipulating the value of information and the reward associated with it.

Intervention

In this experiment we independently manipulate the value of information and the reward associated with information in order to determine which has a larger impact on learning. Under the reinforcement learning hypothesis, reinforcement should be the primary determinant of learning. Under rational memory, information value should be the main factor at play.

Experimental design

In this experiment, individuals engage in an insurance purchasing game where they must choose whether or not to insure 3 fictional businesses every period.

Design details

Randomization method
Disasters randomized by computer during sessions. Business risk levels randomized by computer during sessions. Treatment order randomized in office by computer with each session having a different order. All orders will be tested.
Randomization unit
Treatment order randomized by session Disasters randomized on the period/business level
Clusters
60 subjects
Observations
60 subjects* 2 businesses * 20 periods * 3 treatments =7200 observations
Arms
Design is within subject so all subjects see all treatment arms
Primary outcomes
The basic outcome variable is insurance purchasing.
Secondary outcomes
Recency bias

Cited by

No citation data available for this registration yet.

Keywords