Worker Sorting and Gender-Inclusive Language in Job Ads

How to cite

Balgova, Maria; Sockin, Jason; Jessen, Jonas; Adrjan, Pawel; Jaeger, Simon. 2025. "Worker Sorting and Gender-Inclusive Language in Job Ads." AEA RCT Registry. AEARCTR-0015209. https://doi.org/10.1257/rct.15209-1.2

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Maria Balgova* , Jason Sockin , Jonas Jessen , Pawel Adrjan , Simon Jaeger

* Primary investigator

Registry ID
AEARCTR-0015209
DOI
https://doi.org/10.1257/rct.15209-1.2
First registered
Last updated
Status
In development
Trial dates
2025-01-22 – 2026-12-31
Countries
Private
Registry record
http://www.socialscienceregistry.org/trials/15209

Abstract

We describe a survey-based discrete choice experiment in which respondents are asked to choose between job ads with exogenously varying attributes, following a similar setup as Maestas et al. (2023) and Nagler et al. (2023). The aim of this experiment is to estimate willingness to pay for a range of non-monetary attributes including workers’ preference for non-binary gender-inclusive language (NB-GIL). We also elicit respondents’ political beliefs, labour market and demographic characteristics. In this pre-analysis plan, we describe the experimental setup, our estimation of willingness to pay for job attributes, and our broad empirical strategy for testing the interaction between workers’ preferences and their political opinions and characteristics.

Intervention

We collect data in an online survey-based discrete choice experiment in which respondents are asked to choose between job ads with exogenously varying attributes, following a similar setup as Maestas et al. (2023) and Nagler et al. (2023).

We study:
(i) whether job-seekers have any preferences over non-binary gender-inclusive language (NB-GIL) in vacancy postings
(ii) if yes, what is the willingness to pay to work for an employer that includes NB-GIL in their job ads
(iii) what worker or job characteristics drive these preferences

NB-GIL is not a standard job attribute (such as job flexibility or remote work that have been studied in the literature) but primarily a signal about the firm. As a result, we don’t ask about it directly in the experimental part of our survey, and include randomization whenever respondents come into contact with NB-GIL in our survey instructions.

We incentivize the survey by providing the respondents with non-public information from an online job board about wages and job attributes of recent vacancies based on their answers in the survey. We inform respondents about this reward at the start of the survey, which provides additional incentives to fill the survey accurately.

Experimental design

The discrete choice experiment presents the respondent 7-8 pairs of hypothetical job vacancies and asks the respondent to choose which one they prefer more from each pair. The presented vacancies randomly vary any of the 6 dimensions listed in part (1) of question 3 above (all positions are indicated to be full-time). In particular, the random variation in wage allows us to estimate the willingness to pay (WTP) for these amenities listed in job ads. The job title and wage of the vacancies presented to each individual depend on their occupation and preferred job title, which the respondent chooses at the start of the survey.

In addition, we assign the respondents to 6 orthogonal treatment arms:
information about the content of vacancy postings: we show all respondents two postings to demonstrate what to expect in the experiment
(1) Vacancy with NB-GIL language shown first, then vacancy without NB-GIL language
(2) Vacancy without NB-GIL language shown first, then vacancy with NB-GIL language

Questions about perceptions about employers offering NB-GIL: respondents are asked to give their opinion about a hypothetical employer based on a shown vacancy posting
(1) Vacancy with NB-GIL and all amenities (lunch, Deutschlandticket, flexible work)
(2) Vacancy without NB-GIL and all amenities (lunch, Deutschlandticket, flexible work)
(3) Vacancy with NB-GIL and no amenities
(4) Vacancy without NB-GIL and no amenities

The respondents are also asked standard questions about their demographic characteristics and political opinions. We ask the respondents how they search for jobs to be able to match the results of our experiment to observational data on revealed preference for NB-GIL from an online job board.

The survey is incentivised: at the end of the survey, we display information about average pay and job attributes based on respondents’ answers. This information is taken from online job board Indeed.com and is not publicly available, and thus acts as an incentive for the respondent to fill the survey accurately.

Design details

Randomization method
Randomization done by a computer
Randomization unit
Individual (choice between two job ads)
Clusters
6000 individuals
Observations
Between 42,000 - 48,000 hypothetical choices. The exact number depends on the occupations selected by the respondents. Note that answers by170 resondents have been collected already as a part of piloting the study. We will pool this data with that from the pre-registered survey if the design survey doesn’t change substantially. We will separately present results from the pooled and pre-registered-only data.
Arms
Between 7,000 and 8,000 observations within each treatment arm.
Primary outcomes
(1) Individual preferences over characteristics of job vacancies, including wage and NB-GIL language
Secondary outcomes
(1) Individual perceptions of employers offering NB-GIL (2) Individual opinions on a range of political issues

Cited by

No citation data available for this registration yet.

Keywords