Nonbinary hiring discrimination and the politicization of pronouns: A resume audit study

How to cite

Eames, Taryn. 2023. "Nonbinary hiring discrimination and the politicization of pronouns: A resume audit study." AEA RCT Registry. AEARCTR-0011183. https://doi.org/10.1257/rct.11183-3.1

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Taryn Eames*

* Primary investigator

Registry ID
AEARCTR-0011183
DOI
https://doi.org/10.1257/rct.11183-3.1
First registered
Last updated
Status
Completed
Trial dates
2023-05-18 – 2024-03-04
Countries
United States of America (Colorado), United States of America (Utah), United States of America (Washington)
JEL codes
C93, J15, J16, J23, J71
Registry record
http://www.socialscienceregistry.org/trials/11183

Abstract

Thousands of randomly generated fictitious resumes will be sent in response to online job postings in a selection of US cities. A matched pair of resumes will be sent to each job posting, where resumes are similar except for a characteristic of interest: pronoun disclosure. To investigate hiring discrimination against nonbinary applicants, employer response rates will be compared for resumes which disclose "they/them" pronouns (signals the applicant is nonbinary), disclose binary pronouns congruent with sex implied by name (contains political and other signals associated with pronoun disclosure in general), and do not disclose pronouns (control group). Multiple hypotheses will be explored, including whether discrimination varies by geographic politics; sex implied by name; the extent to which the occupation is customer-facing; female-dominated, male-dominated, and non-dominated occupations; and years of relevant work experience.

Intervention

A resume audit study design will be leveraged to estimate hiring discrimination against nonbinary applicants (signaled on resumes via “they/them” pronouns listed below the name) and cisgender applicants who disclose pronouns (signaled on resumes via binary pronouns congruent with name-implied sex—for example, “she/her” for Madeline and “he/him” for William). Outcomes among these two treatment groups will be compared to a control applicant who does not disclose pronouns on their resume.

Experimental design

A team of research assistants will search major job posting websites (Indeed, Monster, Craigslist, etc.) for occupation vacancies in a selection of United States CBSAs. When an appropriate job posting is found, a pair of fictitious, randomized, matched, formatted resumes will be generated and sent in in response. To reduce cost, job postings will only be applied to if the application process involves uploading a resume PDF and answering simple, standardized questions that can be easily determined from the randomized resume (e.g., how many years of relevant experience do you have?) or that can have a standard general response (e.g., can you reliably commute to work at this location?—yes). When applying, information on job posting, employer, and resume characteristics will be recorded in an encrypted database.

Resume characteristics (name, pronouns, objective, work experience, education, skills, certifications) are randomly generated using a program from Lahey and Beasley (2009). During randomization, some characteristics will be matched same (i.e., if the first resume is randomly assigned characteristic A, then the matched pair will also be given characteristic A) and other characteristics matched different (i.e., if the first resume is randomly assigned characteristic A, then the matched pair will be randomly assigned a characteristic aside from A). The characteristic of interest is pronouns, where the research objective is to determine whether similar applicants with different pronoun disclosures receive different positive employer response rates. Once resume content is generated for the matched pair, each will be randomly given one of two possible resume formats.

Employer response will be carefully tracked via phone and email. For each CBSA, two phone lines will be set up using an area code local to the area. To limit fraud detection by email providers and job boards, there are in total two female names and two male names used in each state (e.g., all matched resume pairs in Colorado where the name-implied sex is female will use the same two names). Emails are specific to names, and each name will always use the same phone number when applying in a given city. As a result, with 12 names, 12 emails will be set up in total. Phone voicemails and emails will be monitored on an ongoing basis to identify applications which receive a positive employer response.

Design details

Randomization method
Randomization is done in office by a computer. In particular, the computer program by Lahey and Beasley (2009) is used to construct resume randomization logic. A detailed breakdown is included in the pre-analysis plan.
Randomization unit
Randomization occurs at the firm (job posting) level. Matched pairs of resumes are generated simultaneously, where they are matched same in some characteristics (e.g., years of relevant work experience) and matched different in other characteristics (e.g., name). The set of inputs over which randomization occurs is occupation-specific for some characteristics (e.g., work experience) and independent of occupation for other characteristics (e.g., name). These matched pairs are both sent in response to one job posting by a particular firm (location and employer) for a particular occupation.
Clusters
3,240 pairs of matched resumes sent to the same number of job postings
Observations
6,480 total resumes
Arms
Approximately 2160 resumes with "they/them" pronouns, 1080 resumes with binary pronouns congruent with sex implied by name, 3,240 control resumes. Of these, approximately half will have male-sounding names and half female-sounding names. Approximately half will be in Republican geographies and half in Democratic geographies. Approximately one third will be in female-dominated, male-dominated, and non-dominated occupations. Approximately one third will be in high, medium, and low customer interaction occupations.
Primary outcomes
Positive employer response to job applications is the outcome of interest. Emails and phone lines will be set up and carefully tracked to identify applicants for whom employers respond.

Cited by

No citation data available for this registration yet.

Keywords