Expertise, Personal Experience and Algorithm Aversion: Study 2

How to cite

Gao, Yu; Chong; Wang, Cong. 2021. "Expertise, Personal Experience and Algorithm Aversion: Study 2." AEA RCT Registry. AEARCTR-0008072. https://doi.org/10.1257/rct.8072-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Yu Gao* , Chong , Cong Wang

* Primary investigator

Registry ID
AEARCTR-0008072
DOI
https://doi.org/10.1257/rct.8072-1.0
First registered
Last updated
Status
On going
Trial dates
2021-07-27 – 2021-08-28
Countries
Private
Registry record
http://www.socialscienceregistry.org/trials/8072

Abstract

Artificial Intelligence (AI) outperforms humans in many tasks. However, accumulating evidence suggests AI aversion – a tendency to distrust and thus ignore AI advice, especially among experts. In a two-stage experiment, we test if trained experts are more acceptive of AI advice in forming predictions and are more sensitive to the AI’s incidental performance. Our results will help design algorithms that are better adopted by human decision-makers, and mitigate the biases that experts hold on algorithms.

Experimental design

In Stage 1, each subject will be randomly assigned to the expert or the laypeople group, where they will receive immediate feedback or delayed feedback regarding their performance in a prediction task, respectively.
In Stage 2, each subject will be exposed to three randomly drawn levels of AI’s performance using the strategy method approach. Each subject will be firstly randomly assigned into the positive (+1 to +18) or the negative feedback (-1 to -18) group, and then we draw three numbers in the corresponding range.

Design details

Randomization method
Randomization will be done by the survey platform.
Randomization unit
In stage 1, randomization is done at the individual level. In stage 2, each individual will be assigned into a positive or negative performance condition, and then we draw three feedback levels in each corresponding condition.
Clusters
1200 individuals
Observations
In stage 1, each individual will provide 10 observations (10 tasks). In stage 2, each individual will provide 3 (aggregate into one Baseline WOA) + 3*3 observations (aggregate into 3 Endline WOA).
Arms
In Stage 1, we will assign 600 individuals to the expert and 600 to the laypeople condition. In Stage 2, we will assign 600 individuals to the positve and 600 to the negative condition.
Primary outcomes
weight on advice (WOA) and change in WOA
Secondary outcomes
confidence in self, confidence in AI and self-predicted performance in the task

Cited by

No citation data available for this registration yet.

Keywords