OK Computer: Job applicants' choice regarding algorithmic screening

How to cite

Rezaei, Sarah; Fumagalli, Elena; Salomons, Anna. 2020. "OK Computer: Job applicants' choice regarding algorithmic screening." AEA RCT Registry. AEARCTR-0004411. https://doi.org/10.1257/rct.4411-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Sarah Rezaei* , Elena Fumagalli , Anna Salomons

* Primary investigator

Registry ID
AEARCTR-0004411
DOI
https://doi.org/10.1257/rct.4411-1.0
First registered
Last updated
Status
On going
Trial dates
2019-07-03 – 2021-08-31
Countries
Private
JEL codes
C9, J24, M51, O33
Registry record
http://www.socialscienceregistry.org/trials/4411

Abstract

The screening of job applicants using data-driven technologies such as artificial intelligence (AI) has grown rapidly in the U.S. and is starting to pick up pace in Europe. We aim to study the decision process of job-applicants when offered a choice between algorithmic and human evaluation, using a behavioral experiment. An emerging literature suggests that such algorithmic screening technologies are indeed valuable hiring tools for firms. However, concerns are being raised that algorithmic screening technologies may perpetuate or exacerbate existing labor market biases, exclude vulnerable groups from the labor market, provide no legal basis for appeals, and are poorly understood by the people judged by them (Barocas and Selbst, 2016). We study how job-applicants perceive and value algorithmic vs. human screening, and how they change their behavior in response to algorithmic settings. These questions have so far been neglected.

We would like to answer the following questions: Do job applicants prefer to be evaluated by an algorithmic or by a human recruiter? Which demographic characteristics, perceptions, and attitudes are correlated with this choice? Are job applicants willing to pay to change the recruiting method they have been assigned to? Does job applicants' skill level correlate with their choice of a recruiter?

Experimental design

We experimentally mimic a hiring setting in which participants perform a number-finding task and then choose whether to be evaluated by an algorithmic or a human recruiter. We also elicit their willingness to pay to obtain their favourite recruiter. We randomly provide information about the median performance in the number finding-task to a subsample of the participants (treatment group) and we do not provide this piece of information to another subsample (control group).

Design details

Randomization method
Randomization done by a computer
Randomization unit
Individual level
Clusters
0
Observations
500 individuals, recruited on Amazon's Mechanical Turk (MTurk)
Arms
300 treatment, 200 control
Primary outcomes
- A discrete choice variable of participants choosing either the algorithmic or human recruitment method (0 - human; 1 - algorithmic) - Willingness to pay for their preferred recruitment method

Cited by

No citation data available for this registration yet.

Keywords