Expertise, Personal Experience, and Algorithm Aversion (study 4)

How to cite

Gao, Yu; Wang, Cong; Chong. 2022. "Expertise, Personal Experience, and Algorithm Aversion (study 4)." AEA RCT Registry. AEARCTR-0009610. https://doi.org/10.1257/rct.9610-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Yu Gao* , Cong Wang , Chong

* Primary investigator

Registry ID
AEARCTR-0009610
DOI
https://doi.org/10.1257/rct.9610-1.0
First registered
Last updated
Status
Completed
Trial dates
2022-06-15 – 2022-06-19
Countries
China ()
Registry record
http://www.socialscienceregistry.org/trials/9610

Abstract

Research shows that evidence-based algorithms perform better than humans in predicting the future. Yet people give less weight to AI advice than they should. By exogenously variating personal experience with AI predictions, we explore how personal experience impacts weight on algorithm advice and how the level of expertise moderates this relationship. Our results will help design algorithms that are better adopted by human decision-makers, and mitigate the biases that experts hold on algorithms.

Experimental design

Each doctor will be randomly assigned to the aggregate information treatment or the control, where they will receive information regarding their performance in a diagnosis task relative to an AI. Then, subjects will receive advise from the AI. We will measure their reliance on AI’s advice.

Design details

Randomization method
Randomization will be done by the survey platform.
Randomization unit
individual
Clusters
131 doctors per group. That is about 262 in total.
Observations
393 observations in each group
Arms
We need at least 393 observations in each group. That is about 131 individuals per group.
Primary outcomes
Main outcome is reliance on AI after receiving different information about AI's relative performance compared to self.
Secondary outcomes
their tolerance of the AI and a human expert

Cited by

No citation data available for this registration yet.

Keywords