Predictability of humans and AI: a lab study

How to cite

Kandul, Serhiy; Christen, Markus; Burri, Thomas. 2022. "Predictability of humans and AI: a lab study." AEA RCT Registry. AEARCTR-0009667. https://doi.org/10.1257/rct.9667-1.1

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Serhiy Kandul* , Markus Christen , Thomas Burri

* Primary investigator

Registry ID
AEARCTR-0009667
DOI
https://doi.org/10.1257/rct.9667-1.1
First registered
Last updated
Status
On going
Trial dates
2022-06-27 – 2022-08-31
Countries
Private
Registry record
http://www.socialscienceregistry.org/trials/9667

Abstract

We measure the ability of non-experts to predict the performance of humans and AI in an incentivized laboratory experiment.
We compare the objective predictability of humans and AI in a given context with the subjective beliefs about the predictability. We manipulate the information about the type of the agent, human or AI, given to participants and measure how this information affects participants' performance.

Experimental design

We measure participants' ability to predict the performance of AI and a human in a specific task (within-subject design). We then compare the objective prediction success with participants' subjective beliefs about their performance in the prediction task.

Design details

Randomization method
Randomized by Python.
Randomization unit
36
Clusters
144
Observations
144
Arms
72
Primary outcomes
predicition success (number of correct predictions); beliefs about performance, a score

Cited by

No citation data available for this registration yet.

Keywords