From Degrees to Skills: How Job Requirements Shape Applicant Composition and Fit

How to cite

Oseguera, Mariana. 2025. "From Degrees to Skills: How Job Requirements Shape Applicant Composition and Fit." AEA RCT Registry. AEARCTR-0016070. https://doi.org/10.1257/rct.16070-3.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Mariana Oseguera*

* Primary investigator

Registry ID
AEARCTR-0016070
DOI
https://doi.org/10.1257/rct.16070-3.0
First registered
Last updated
Status
Completed
Trial dates
2025-11-18 – 2026-03-31
Countries
United States of America ()
Registry record
http://www.socialscienceregistry.org/trials/16070

Abstract

This paper examines how skill-based hiring practices influence the composition of the applicant pool, focusing on candidates’ educational backgrounds, skill profiles, race, and gender. Evidence shows that degree requirements often exclude qualified candidates and reinforce inequality, prompting many employers to adopt skill-based practices such as removing degree requirements to signal that skills, rather than credentials, will drive hiring decisions. Yet little is known about how such requirements affect job seekers’ application behavior. To address this gap, I partnered with a firm hiring for entry-level positions in software engineering and marketing and randomized the educational qualifications stated in job postings across three conditions: (1) a bachelor’s degree explicitly required, (2) no degree requirement stated, and (3) an explicit commitment to skill-based hiring, emphasizing alternative pathways and skill assessments. Using unique identifiers in emails and job board postings, I track candidate engagement (clicks, visits, and applications) and application outcomes. The primary outcomes are (i) the diversity of the applicant pool by education, race, and gender; (ii) the degree of skill match between applicants and job requirements; and (iii) organizational search costs. This design provides evidence on whether removing degree requirements and emphasizing skill assessments expands access for non-degree holders and underrepresented groups, while also assessing potential trade-offs in applicant quality and recruitment efficiency.

Intervention

This study consists of a two-sided field experiment with job applicants and recruiters. In the first stage of the intervention consists of randomizing the educational qualifications stated in job postings for entry-level positions. Each applicant is exposed to one of three versions of the posting:

Degree Required: The job description explicitly requires a bachelor’s degree.
Degree Silent: The job description does not mention educational requirements.
Skill-Based Hiring: The job description explicitly states that the company welcomes candidates who have developed skills through diverse pathways and/or that hiring decisions will be based on skill assessments.

Candidates are recruited through two channels: (a) direct outreach via email campaigns using candidate lists from ZipRecruiter, and (b) organic job board traffic to the firm’s career site. Randomization occurs at the individual candidate level through unique identifiers embedded in email links and randomized landing pages. Once assigned, candidates consistently view the same condition.

The second stage of the field experiment will provide the measure of skill quality used in the first stage to examine how degree requirements shape the applicant pool in terms of skill match. To obtain an exogenous measure, I will remove the confounding effects of (i) the job framing and (ii) applicant-pool composition from recruiters’ assessments of quality by randomizing. These removed effects will capture the equilibrium dynamics of the labor market: how—by shaping who applies—degree requirements will influence how recruiters evaluate those who do, which may further reinforce stratification.
To achieve this, surveyed recruiters will be randomly assigned to one of three conditions:
1.Matched Framing and Applicant Pool.
2. Framing Randomization across Fixed Applicant Pools.
3. Joint Randomization of Framing and Applicant Pool.

Experimental design

This study examines how job posting language influences who applies for open positions. The partnering organization will vary the way educational qualifications are described across three versions of the same job: (1) a posting that requires a bachelor’s degree, (2) a posting that omits any mention of a degree requirement, and (3) a posting that explicitly welcomes candidates with diverse pathways to skills and/or notes that skill assessments may be part of the process.

Job openings will be advertised as part of the company’s regular hiring process in four occupations: software engineering, sales, administration, and marketing. Applicants will encounter one version of the job posting at random, either through direct outreach or through the company’s career site. Application data will then be used to evaluate how the different postings affect the diversity, skills, and backgrounds of the applicant pool.

The second stage of the field experiment will provide the measure of skill quality used in the first stage to examine how degree requirements shape the applicant pool in terms of skill match. To obtain an exogenous measure, I will remove the confounding effects of (i) the job framing and (ii) applicant-pool composition from recruiters’ assessments of quality. These removed effects will capture the equilibrium dynamics of the labor market: how—by shaping who applies—degree requirements will influence how recruiters evaluate those who do, which may further reinforce stratification.
To achieve this, surveyed recruiters will be randomly assigned to one of three conditions:
1. Baseline: Matched Framing and Applicant Pool. Recruiters will evaluate candidates generated under a specific treatment condition (e.g., applicants to the ”degree required” job ad) paired with the same job framing that produced that pool. This condition will replicate the natural pairing of framing and applicant pool, and will provide a baseline distribution of skill-match assessments that would occur in real hiring contexts.
2. Framing Randomization across Fixed Applicant Pools. Recruiters will be randomly assigned to a fixed applicant pool from the baseline condition, but the job framing they see will be randomly assigned across the three treatments. By holding the candidate set constant while varying only the job framing, systematic differences in ratings will capture how evaluators’ perceptions of identical candidates change when job language shifts. This will isolate the direct framing effect—how posting language alone shapes skill assessments.
3. Joint Randomization of Framing and Applicant Pool. In the third condition, both the job framing and the applicant pool will be independently randomized, so each recruiter will view a unique combination of job description and candidate set. Because neither element corresponds to its original treatment condition, this design will provide a benchmark for how recruiters evaluate candidates absent systematic framing or sorting effects. Comparing this benchmark with evaluations from Conditions 1 and 2 will quantify how much recruiters’ judgments

Design details

Randomization method
Randomization is done by a computer program at the individual candidate level. When candidates click on an outreach email link or visit the company’s careers page through a job board, they are automatically assigned by the system to one of the experimental conditions. Assignment is persistent through first-party cookies/session storage, ensuring candidates always see the same version if they return. No manual procedures, coin flips, or third-party cookies are used.
Randomization unit
The unit of randomization is the individual job seeker. Each candidate is independently assigned to a treatment condition. Randomization occurs across all recruitment channels (ZipRecruiter outreach sample and organic job board sample).
Clusters
0 (not clustered; randomization at the individual job‑seeker level). Unit clarification: No clusters (e.g., no schools/firms). The analysis unit is individual candidates. 500 Recruiters
Observations
~10,000 individual candidates reached out via email (depending on qualified candidates in the pool) and additional organic job‑board visitors; the final total N will exceed 10,000. We will report the realized organic N and arm counts at the end of fielding. 500 Recruiters
Arms
Sample ( N = 10,000; equal allocation, 1/3 each, may vary based on application rates): Degree required — ~3,300 Degree silent — ~3,300 Skill‑based (welcoming + assessment) — ~3,300
Primary outcomes
Application decision Whether a candidate clicks on the job posting link (click-through rate). Whether a candidate submits a job application (application rate). Applicant composition Educational background: share of applicants with and without a college degree. Demographics: share of applicants by gender and race/ethnicity. Applicant quality (skill match) Degree to which applicants’ résumés and experience align with the job’s required skills, assessed using (a) structured evaluations by HR managers (blinded to treatment) and (b) automated résumé parsing/assessment tools. Recruitment efficiency (search costs) Number of applications received per posting. Time/resources required for screening applicants, proxied by the distribution of low-match vs. high-match applicants.
Secondary outcomes
Job search engagement beyond applications Visits without application: measured as the number of unique visitors who clicked on a job posting but did not complete an application. This captures candidates who were initially interested but decided not to apply after viewing the posting. Time on page: for candidates who clicked but did not apply, session data (e.g., time spent on the job posting page) will be recorded as an additional indicator of engagement. Heterogeneity by occupation and recruitment channel Occupation-specific effects: outcomes will be analyzed separately for software engineering and marketing roles, given differences in occupational cultures and hiring practices. Recruitment channel: outcomes will also be compared between (a) candidates reached through ZipRecruiter outreach and (b) candidates arriving via organic job board traffic. Demographic differences in engagement Click vs. application by subgroup: differences between the proportion of candidates who click and the proportion who apply, broken down by gender, race/ethnicity, and educational background. This will help identify whether some groups are more likely to self-select out at different stages of the process. Perceived candidate fit (exploratory) HR surveys and interviews will be recorded and analyzed qualitatively to capture how managers interpret different résumé characteristics across conditions. The order of candidate profile information modules (e.g., education, work experience, skills) will be randomized to test whether sequencing influences perceptions of candidate fit. These insights will provide context for understanding patterns in applicant composition and quality.

Cited by

No citation data available for this registration yet.

Keywords