The impact of AI and Debiasing on job applicants

How to cite

Vecci, Joe; Ip, Edwin; Chen, Li; Awad, Edmond; Balafoutas, Loukas. 2022. "The impact of AI and Debiasing on job applicants." AEA RCT Registry. AEARCTR-0010470. https://doi.org/10.1257/rct.10470-1.1

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Joe Vecci* , Edwin Ip , Li Chen , Edmond Awad , Loukas Balafoutas

* Primary investigator

Registry ID
AEARCTR-0010470
DOI
https://doi.org/10.1257/rct.10470-1.1
First registered
Last updated
Status
Completed
Trial dates
2022-11-24 – 2022-12-01
Countries
United States of America ()
Registry record
http://www.socialscienceregistry.org/trials/10470

Abstract

In this project, we study how different evaluators (AI or human) and the nature of them (biased or debiased) affect application decisions and quality of applicants.

Intervention

We vary the type of the evaluators (human or AI) and nature of the evaluators (biased or debiased) as well as the nature of the job (competitiveness).

Experimental design

In this experiment, we ask online subjects to apply for “jobs” with different types of evaluators.

Design details

Randomization method
Randomization will be carried out by a computer.
Randomization unit
The randomization unit will be the individual for all treatments.
Clusters
Since randomization occurs at the individual level we cluster at the level of the individual. We will collect data from 1000 individuals.
Observations
We plan to collect data from 1000 individuals. We utilize a within subject design, since we have 2 experiments, the first one collecting data from 4 choices and the second from 6 choices, for each individual we will have 10 choices in total. Exclusion: Participants are excluded if they fail two attention check or complete the survey in less than a third of the median time from the pilot launch. Participants are excluded for providing nonsense responses in particular to the open ended questions asking them to explain their choices.
Arms
We utilize a within subject design, meaning all subjects are assigned to all treatments (in a random order). This means the total sample size is the same as the number of individuals in the experiment.
Primary outcomes
We collect the following primary outcomes: - Application decisions In particular, we are interested in how decisions differ based on -Confidence of the applicants -Skills of the applicants -Gender -Treatment
Secondary outcomes
We are interested in a number of additional explanatory variables: We study demographic variables, quality of resume collected as part of the experiment (self-reported). We study possible mechanisms including beliefs about how good each evaluator (i.e., human evaluators, Human Evaluators trained on equal opportunities for all genders, AI and a debiased AI) is at selecting applicants with the best quantitative skills and similarly ensuring gender diversity.

Cited by

No citation data available for this registration yet.

Keywords