Unconscious Bias in Hiring in the Australian Public Service: Evidence from a Framed Field Experiment in Shortlisting of Job Candidates

How to cite

Hiscox, Michael. 2016. "Unconscious Bias in Hiring in the Australian Public Service: Evidence from a Framed Field Experiment in Shortlisting of Job Candidates." AEA RCT Registry. AEARCTR-0001783. https://doi.org/10.1257/rct.1783-3.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Michael Hiscox*

* Primary investigator

Registry ID
AEARCTR-0001783
DOI
https://doi.org/10.1257/rct.1783-3.0
First registered
Last updated
Status
Completed
Trial dates
2016-10-24 – 2016-12-09
Countries
Australia ()
JEL codes
D80 (Information, Knowledge, and Uncertainty—general); D03 (Behavioural Microeconomics: underlying principles)
Registry record
http://www.socialscienceregistry.org/trials/1783

Abstract

Women are under-represented in management and executive-level positions in the private sector and in many areas in the Australian government. This may reflect gender discrimination in hiring and promotion decisions. Such discrimination is generally difficult to overcome because cognitive biases can be so internalized that individuals are unaware that their decision making processes are affected. Creating gender-blind processes for reviewing job applications may provide an effective way to mitigate unconscious bias. The proposed study aims to assess the magnitude of gender bias in standard Australian government processes for selecting job candidates and whether the introduction of a gender-blind approach to reviewing job applications can help eliminate bias. The primary outcomes we will measure are reviewers’ initial assessments of whether applicants are ‘potentially suitable’ to the job or not, the rating scores (0-10 cardinal scale) reviewers give to applicants they initially select as ‘potentially suitable’ for the job, and whether any of the ‘potentially suitable’ applicants are recommended among the top 5 applicants to be shortlisted for further consideration for appointment to a senior position; in each case we will compare average outcomes when the applicants are identified in review materials as female or male, and when they are not identified by gender.

Intervention

The trial is an individually randomized controlled trial. Specifically it is a “framed field experiment” in which subjects are drawn from the population of interest and complete a familiar task, something they would normally perform in a naturally-occurring context, but understand that in this instance they are completing the task as part of an experiment and their behaviour is being studied.

Individuals who agree to participate in the study and register online will be randomly assigned to review materials in either the de-identified (treatment) or usual (control) condition, with pre-randomization stratification based upon agency, age, gender, and job level. If our sample of participants is large enough, we will have two control groups and one treatment group such that the only difference between the two control groups is that each of the applicant CVs will have the first name swapped to a similar first name of the opposite gender (e.g. Jane Smith in control group 1 would be John Smith in control group 2). Having these two control groups would allow us to fully control for all other characteristics of the CVs while experimentally altering only gender (i.e. the first name in the CVs).

Experimental design

The trial is an individually randomized controlled trial, conducted in partnership with Australian Government agencies. The trial is a “framed field experiment” in which subjects drawn from the ranks of senior and executive-level officers in Australian Government agencies are asked to review job applications for an executive-level position, a familiar task, but understand that this exercise is part of an experiment and their behaviour is being studied. Subjects either review applications in the usual way based upon curriculum vitae in which the gender of applicants is identifiable or they review the same applications in de-identified (gender blind) form.

Design details

Randomization method
Randomization done by a computer algorithm
Randomization unit
Individual
Clusters
N/A
Observations
1,600 individuals (government officers)
Arms
1,600 individuals (government officers)
Primary outcomes
The key outcome variables are the percentage of women initially recommended as ‘potentially suitable’ for the job, the percentage of women shortlisted for the job, and the average suitability score (on a 0-10 scale) of women among the ‘potentially suitable’ applicants.

Cited by

No citation data available for this registration yet.

Keywords