Choice Misprediction: Incorrect Beliefs, Mistakes, and Mistaken Learning
How to cite
Koepcke, Eric. 2022. "Choice Misprediction: Incorrect Beliefs, Mistakes, and Mistaken Learning." AEA RCT Registry. AEARCTR-0009602. https://doi.org/10.1257/rct.9602-1.1
Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.
* Primary investigator
Abstract
When we ask someone to predict their future choices or behavior, we are implicitly asking them to predict the likelihood of future states of the world, to predict their behavior (based off their preferences) in each of these states, and then to aggregate all this information into a final prediction. Each "step" in this mental process could be prone to biases or error, leading to misprediction of future behavior. In this study, we seek to decompose and quantify how much of a role each of these "steps" plays in misprediction and explore mechanisms for why people make mistakes in each "step." We also seek to document whether this decomposition changes over time, as we give people opportunities to learn.
Specifically, we will run a 5-session modification of the survey-based experiment from Augenblick and Rabin (2019), adding uncertainty about the sentence length of a Greek transcription task (i.e., how much time/effort a task takes). We give respondents information about the sentence length distribution and ask them to predict this distribution. We also ask them to predict their future work choices both unconditionally and conditional on being assigned specific sentence lengths. We explore several misprediction mechanisms: present-focus, motivated beliefs, non-Bayesian updating, and cognitive mistakes due to complexity.
Experimental design
This is a five-session study. Each session is conducted via a Qualtrics' survey and is spaced a few days apart.
The study is a modified version of the one used in Augenblick and Rabin (2019). In this study, respondents make choices/predictions about how many Greek transcription tasks they will do. Each Greek transcription task involves transcribing a sentence of blurry Greek characters into their English counterpart. In our study, task sentences can either be 21, 28, or 35 characters long. Respondents don't know which sentence length they'll be assigned for tasks or the sentence length probability distribution.
Each session has several components:
(1) Three practice/warm-up tasks, one of each possible sentence length
(2) Survey questions:
(a-i) Current work: Respondents are asked to report how many tasks they would like to do at the end of the Current session for different (per-task) wages. They are asked to give separate answers for each possible sentence length
(a-ii) (Conditional) Work Predictions: Respondents are asked to predict how many tasks they would like to do at the Next session for different wages. They are asked to give separate answers for each possible sentence length
(a-iii) Prediction Accuracy: Respondents are asked to guess how accurate their predictions will be and how accurate (on average) other peoples' predictions will be. They are asked why they think their/others' predictions may be inaccurate and whether they'd like accuracy information in future sessions
(a-iv) Desired work: Respondents are asked to report how many tasks they'd like to do at the next session for different wages. They are only asked to answer for the case where the task sentence length is 28 characters
(b) Sentence Length Probability Distribution Prediction: Respondents are shown three random draws (i.e., sentence lengths) from the sentence length probability distribution, they are then asked to predict the probability of being assigned each task sentence length and to report their confidence in their predictions. This is repeated four more times (for a total of 15 random draws). Note: The probability distribution is randomized both across people and across sessions
(c-i) (Unconditional) Work Predictions: Respondents are asked to predict, on average, how many tasks they will choose to do Next session for different wages (the average should be taken over their perceived sentence length probability distribution)
(c-ii) Respondents are asked to guess how accurate their predictions will be and why they think their predictions may be inaccurate
(3) Task Completion: A random task sentence length is selected (according to the true distribution) and a random (per-task) wage is selected. Respondents are then free to complete tasks of that sentence length for that wage.
Note: Session 5 doesn't involve any questions about future work predictions
Accuracy Information Treatment:
In session 3 and onwards, between (2a-i) and (2a-ii), respondents are given information about prediction accuracy from the previous two sessions. In session 3, half of the respondents are shown their own prediction accuracy and are asked to explain why their predictions were inaccurate/accurate. The other half are shown the sample's average prediction accuracy and are asked to guess why other peoples' predictions were inaccurate/accurate. For session 4, we flip which prediction accuracy information each respondent gets. In session 5, each respondent is shown both pieces of information. They are first shown the sample average prediction accuracy, they are then asked to predict whether their own accuracy was better/worse than the sample average. They are then shown their own prediction accuracy and asked to explain why their accuracy was better/worse than the sample average.
Design details
Cited by
No citation data available for this registration yet.