Measuring Directed Search: Evidence from Incentivized Vacancy Ratings

How to cite

Selz, Vincent. 2026. "Measuring Directed Search: Evidence from Incentivized Vacancy Ratings." AEA RCT Registry. AEARCTR-0019193. https://doi.org/10.1257/rct.19193-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Vincent Selz*

* Primary investigator

Registry ID
AEARCTR-0019193
DOI
https://doi.org/10.1257/rct.19193-1.0
First registered
Last updated
Status
In development
Trial dates
2026-07-19 – 2027-07-31
Countries
Private
Registry record
http://www.socialscienceregistry.org/trials/19193

Abstract

We study how job seekers evaluate job vacancies and form beliefs about application success. In an incentivized online vacancy-rating study, graduating Business and Economics students in the Rhine-Main area rate a series of experimentally constructed vacancies and report, for each, how likely they would be to apply and their perceived probability of receiving an offer. Based on their answers, participants receive a personalized list of five real vacancy recommendations. The hypotheses, design details, and analysis are specified in a pre-analysis plan and in hidden registry fields, which will be made public after data collection ends in order to avoid experimenter demand effects.

Intervention

In order to avoid experimenter demand effects, we describe the study in fields that will not become public until after the experiment is over.

Experimental design

In order to avoid experimenter demand effects, we describe the study in fields that will not become public until after the experiment is over.

Design details

Randomization method
randomization done by a computer
Randomization unit
vacancy × individual
Clusters
300 individuals. Only participants who complete the full study (all 42 ratings and the post survey) enter the estimation sample; duplicate participations (the same person completing more than once) are removed, keeping the first completion. Of these, we exclude (i) participants who trigger the automated-agent trap embedded in the post survey (an instruction invisible in normal use that only an automated agent would follow), (ii) participants whose total completion time on the vacancy-rating pages is below the 3rd percentile, and (iii) participants whose median time per vacancy exceeds the 98th percentile — (ii) and (iii) computed once on the pooled final sample after applying (i). Operationally, recruitment proceeds in waves and continues until the number of completed, non-duplicate, trap-passing participants reaches 316 (≈ 300/0.95, using the two percentile-based exclusions), or until 31 July 2027, whichever comes first.
Observations
12,600 vacancy ratings =300 individuals * 42 vacancies
Arms
There are no separate treatment arms: no individual-level treatment is assigned. Vacancy attributes are randomized at the vacancy × individual level, generating variation both within individual (across the vacancies each rates) and across individual (for a given vacancy).
Primary outcomes
application intention: “How likely would you apply?” perceived success probability: “If you applied, what is the probability of receiving an offer?”
Secondary outcomes
see pre-analysis plan for details

Cited by

No citation data available for this registration yet.

Keywords