We study how job seekers evaluate job vacancies and form beliefs about application success. In an incentivized online vacancy-rating study, graduating Business and Economics students in the Rhine-Main area rate a series of experimentally constructed vacancies and report, for each, how likely they would be to apply and their perceived probability of receiving an offer. Based on their answers, participants receive a personalized list of five real vacancy recommendations. The hypotheses, design details, and analysis are specified in a pre-analysis plan and in hidden registry fields, which will be made public after data collection ends in order to avoid experimenter demand effects.
Intervention
In order to avoid experimenter demand effects, we describe the study in fields that will not become public until after the experiment is over.
Experimental design
In order to avoid experimenter demand effects, we describe the study in fields that will not become public until after the experiment is over.
Design details
Randomization method
randomization done by a computer
Randomization unit
vacancy × individual
Clusters
300 individuals.
Only participants who complete the full study (all 42 ratings
and the post survey) enter the estimation sample; duplicate participations (the same person
completing more than once) are removed, keeping the first completion. Of these, we exclude (i)
participants who trigger the automated-agent trap embedded in the post survey (an instruction
invisible in normal use that only an automated agent would follow), (ii) participants whose total
completion time on the vacancy-rating pages is below the 3rd percentile, and (iii) participants
whose median time per vacancy exceeds the 98th percentile — (ii) and (iii) computed once on
the pooled final sample after applying (i).
Operationally, recruitment proceeds in waves and continues until
the number of completed, non-duplicate, trap-passing participants reaches 316 (≈ 300/0.95, using the two percentile-based exclusions), or until 31 July 2027, whichever comes first.
There are no separate treatment arms: no individual-level treatment is assigned. Vacancy attributes are randomized at the vacancy × individual level, generating variation both within individual (across the vacancies each rates) and across individual (for a given vacancy).
Primary outcomes
application intention: “How likely would you apply?”
perceived success probability: “If you applied, what is the probability of receiving an offer?”
Secondary outcomes
see pre-analysis plan for details
Cited by
No citation data available for this registration yet.