Coding Test

How to cite

Bapna, Sofia; Funk, Russell; Parasurama, Prasanna. 2025. "Coding Test." AEA RCT Registry. AEARCTR-0015889. https://doi.org/10.1257/rct.15889-1.1

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Sofia Bapna* , Russell Funk , Prasanna Parasurama

* Primary investigator

Registry ID
AEARCTR-0015889
DOI
https://doi.org/10.1257/rct.15889-1.1
First registered
Last updated
Status
In development
Trial dates
2025-05-01 – 2026-05-31
Countries
Private
Registry record
http://www.socialscienceregistry.org/trials/15889

Abstract

How does the selection process influence the applicant pool for software jobs?
We examine differences in applicant pools (pool size, gender composition, and applicant experience/quality) when a coding test is explicitly mentioned in the job posting versus when this information is omitted.

Experimental design

A software/mobile developer job is posted on LinkedIn by a company. The job post includes a link to apply to the job. When interested candidates click on the link they are directed to a form (on Qualtrics) where their contact info is collected. Following this they are randomly shown one of two selection processes. One process indicates that there will be a coding test and interview and the other process indicates that there will be two rounds of interviews. We analyze the applicant data to identify if more people are likely to apply to one of the experimental conditions, and if there is heterogeneity (by gender and experience/quality) across conditions.

Design details

Randomization method
Randomization will occur via Qualtrics. The Qualtrics survey will contain 2 blocks for the selection process (one for the treatment and one for the control). Qualtrics will randomly display one of the blocks.
Randomization unit
Randomization is at the individual level.
Clusters
Not applicable
Observations
It is difficult to predict how many people the job will be shown to (as this depends on the competing bids on LinkedIn), and of these the number of people who will be interested in applying to the job. The job ad will run for a month and the ad will be set up to be more discoverable (by job-seekers) in states where there are more software developers.
Arms
See the section titled "planned number of observations."
Primary outcomes
The key outcome is whether an interested individual (anyone who clicks on the job-application link in the job post) applies for the job after seeing the selection process.

Cited by

No citation data available for this registration yet.

Keywords