Expertise, Personal Experience and Algorithm Aversion: Study 3

How to cite

Gao, Yu; Chong; Wang, Cong. 2021. "Expertise, Personal Experience and Algorithm Aversion: Study 3." AEA RCT Registry. AEARCTR-0008395. https://doi.org/10.1257/rct.8395-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Yu Gao* , Chong , Cong Wang

* Primary investigator

Registry ID
AEARCTR-0008395
DOI
https://doi.org/10.1257/rct.8395-1.0
First registered
Last updated
Status
On going
Trial dates
2021-10-01 – 2021-10-31
Countries
Private
Registry record
http://www.socialscienceregistry.org/trials/8395

Abstract

Artificial Intelligence (AI) outperforms humans in many tasks. However, accumulating evidence suggests AI aversion – a tendency to distrust and thus ignore AI advice, especially among experts. In a two-stage experiment, we test if trained experts are more acceptive of AI advice in forming predictions and are more sensitive to the AI’s incidental performance. Our results will help design algorithms that are better adopted by human decision-makers, and mitigate the biases that experts hold on algorithms.

Experimental design

In Stage 1, each subject will be randomly assigned to a training task to predict exam scores according to application profiles or to predict celebrities’ BMI according to their face photos. During the training phase, subjects will receive immediate feedback regarding their performance in the corresponding prediction task.
After the training phase, we measure subjects’ baseline weight on advice (WOA) using a different prediction task. In specific, if a subject was trained using the exam score (BMI) task, then we measure her WOA using the BMI (exam score) task.
In Stage 2, each subject will be exposed to three randomly drawn levels of AI’s performance using the strategy method approach. We then measure the endline weight on advice (WOA).

Design details

Randomization method
Randomization will be done by the survey platform.
Randomization unit
In stage 1, randomization is done at the individual level. In stage 2, each individual will be assigned into a positive or negative performance condition, and then we draw three feedback levels in each corresponding condition.
Clusters
352 individuals per group
Observations
352*3
Arms
at least 352 individuals in training 1, and 352 individuals in training 2.
Primary outcomes
change in WOA

Cited by

No citation data available for this registration yet.

Keywords