The Supply Effects of Additional Screening in Recruitment

How to cite

Avery, Mallory; Leibbrandt, Andreas; Vecci, Joseph; Ip, Edwin. 2024. "The Supply Effects of Additional Screening in Recruitment." AEA RCT Registry. AEARCTR-0013356. https://doi.org/10.1257/rct.13356-2.2

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Mallory Avery* , Andreas Leibbrandt , Joseph Vecci , Edwin Ip

* Primary investigator

Registry ID
AEARCTR-0013356
DOI
https://doi.org/10.1257/rct.13356-2.2
First registered
Last updated
Status
Completed
Trial dates
2024-04-22 – 2024-05-30
Countries
United States of America ()
Registry record
http://www.socialscienceregistry.org/trials/13356

Abstract

In this project, we study the impact of screening stages in recruitment on applicant behavior.

Intervention

In the project we study whether job applicants respond to different screening methods during the recruitment process for a real job. To study this we experimentally vary the mode of screening applicants.

We consider this as the supply side experiment. A future demand side experiment will be pre-registered prior to collecting the demand side data.

Experimental design

Our design aims to measure the impact various types of additional screening stages in the recruitment process on the behavior of job applicants.

Design details

Randomization method
Randomization will be carried out by a computer.
Randomization unit
The randomization unit will be the individual for all treatments.
Clusters
Treatment is assigned at the level of the individual so clustering will take place at the individual level.
Observations
The clusters will be equal to the number of legitimate candidates. Based on previous experience we expect to have at least 2400 legitimate job applicants across 3 jobs, but this will likely vary depending on a number of factors. However, we plan to keep the jobs open until we have at least 2400 applicants. A legitimate candidate is someone who resides in the United States and completes the initial application form. We plan to assign an equal proportion of the sample to each treatment except for the zoom treatment, which will have a smaller assignment depending on the available evaluating resources. Further, we will stratify by gender such that there is the same proportion of men/women in each treatment.
Arms
We plan to have at least 2400 applicants. We will split the applicants equally across the treatments except for the zoom treatment, which will be based on available resources.
Primary outcomes
We collect the following primary outcomes on the supply side: • Initial Dropout • Screening Dropout
Secondary outcomes
To understand possible mechanisms, we elicit the following secondary outcome variables: Evaluation scores: This is the score of the assessment calculated by the algorithm/human. Time taken: This is calculated as the time the candidate spends completing the whole screening. Type of language used: We will use an algorithm to assess the type of language used in applicants’ responses. Fairness/bias perceptions : We will elicit applicants’ perceptions of whether the interview process they experienced was fair or biased Interview anxiety: We will elicit applicants’ interview anxiety through the index of McCarthy and Goffin (2004). Measure of perceived meritocracy of the interview process: We will elicit applicants’ perceptions of meritocracy for different types of interview methodologies. Recommendation intention: We will elicit the applicants’ willingness to recommend the employer as an indicator of perception about the employer through a modified Reichheld (2003) measure.

Cited by

No citation data available for this registration yet.

Keywords