Belief reactions to sequential AI predictions
How to cite
Lambrecht, Marco; Herold, Theo; Wengström, Erik; GSE, Hanken School of Economics & Helsinki. 2025. "Belief reactions to sequential AI predictions." AEA RCT Registry. AEARCTR-0011057. https://doi.org/10.1257/rct.11057-1.0
Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.
* Primary investigator
Abstract
Artificial intelligence (AI) has become integral in decision-making processes, with tools such as ChatGPT increasingly shaping outcomes. These AI systems are inanimate but operate based on human-coded algorithms. In this study, we explore how previous success and streaks influence beliefs over sequential AI predictions, comparing them to beliefs over sequences generated by humans and inanimate objects. We also examine how outcomes (the frequency of correct decisions) affect participants' willingness to switch to an alternative source of data generation. These insights may guide AI policy, such as efforts to address 'cognitive behavioral manipulation.'
Intervention
We conduct a two-stage experiment to investigate participants' beliefs over sequential AI predictions.
In the first stage, we compare belief reactions across three different treatments between subjects.
In the second stage, we compare across two treatments how participants react to information regarding their correct answers in the first stage.
Experimental design
Our design builds on a previous experiment and consists of two stages. In the previous experiment, we acquire binary outcomes from three different sources: (i) humans, (ii) an algorithm, and (iii) an inanimate pure chance object in the form of dice rolls.
In the first stage, we provide participants with outcomes from the previous experiment. Depending on treatment, outcomes will originate from one of the three sources of the previous experiment. Participants are tasked with predicting whether the ninth outcome in each sequence is correct or not.
In the second stage, participants receive information about their correct decisions made during the first stage and choose between a human- or algorithm-generated sequence of outcomes.
Design details
Cited by
No citation data available for this registration yet.