Algorithmic Profiling and the Beliefs of Caseworkers and Jobseekers: a Field Experiment in Unemployment Insurance

How to cite

Arni, Patrick. 2026. "Algorithmic Profiling and the Beliefs of Caseworkers and Jobseekers: a Field Experiment in Unemployment Insurance." AEA RCT Registry. AEARCTR-0019067. https://doi.org/10.1257/rct.19067-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Patrick Arni*

* Primary investigator

Registry ID
AEARCTR-0019067
DOI
https://doi.org/10.1257/rct.19067-1.0
First registered
Last updated
Status
Completed
Trial dates
2012-10-01 – 2019-07-31
Countries
Switzerland (Canton of Fribourg)
JEL codes
C53, D73, D83, J65, J64, J68
Registry record
http://www.socialscienceregistry.org/trials/19067

Abstract

This RCT uses an algorithmic profiling prediction as an intervention to affect caseworker beliefs on their clients' (job seekers) chances of finding a job. The trial was conducted within unemployment insurance in Switzerland (at the public employment service agencies of the Canton of Fribourg). Based on an elaborate prediction model, an individual prediction of the expected unemployment duration of the job seeker was provided to the caseworker, in a randomized number of cases. This prediction was supposed to serve as a signal to the caseworker to revise and update her/his own expectation concerning her/his client's unemployment duration. (Earlier evidence has shown that caseworkers are on average too optimistic with respect to the their client's expected duration to finding a job.) The idea was that caseworkers may act on this corrective signal by adjusting their decisions and strategy how to treat their client (using their available instruments of counseling, job search requirements and active labor market policy measures). The final policy intent was that this revision of the treatment strategy should positively affect the job seekers' labor market outcomes.
These steps of expected reactions can be tracked by collected data on caseworkers and job seekers. Thus, this RCT provides a unique set of (linked) data tracing the caseworkers' and the job seekers' activities, behaviors and beliefs, as well as the individual labor market outcomes. A tool within the unemployment insurance register database was used to collect the mentioned data and to provide the algorithmic predictions. The collected behavioral data on job seekers can be used for two purposes: first, they provided important input for the profiling prediction model (in a calibration phase of the project); second, the variables on behaviors and personal characteristics are of analysis interest per se, to better understand job seeker's behaviors. The data is linked at the individual level to the unemployment insurance register data (covering job seeker demographics, all events in the unemployment spell and the use of caseworkers' instruments) and to social security data (covering earnings and employment status post-unemployment).

Intervention

Algorithmic profiling prediction of the client's expected unemployment duration, released to the related UI caseworker

Experimental design

Randomization within caseworker (in 50% of the cases/clients the prediction was shown, in other 50% not). Profiling prediction is shown in a tool within the official UI registry database system. In the tool, the caseworker first needs to record the mentioned data/variables for each case, then, on a next screen, the profiling prediction (and the "barometer", see above) is shown in the treated cases, otherwise not. The tool is used during the first meeting with the client (taking place about 10-14 days after registration at the PES). It is again used in the client meeting about 2 months later -- to collect second observations of the above-mentioned variables.

Design details

Randomization method
Randomization (whether to release the client's profiling prediction to the caseworker or not) is performed in real-time within the tool.
Randomization unit
Unit of randomization is an individual job seeker spell
Clusters
200 caseworkers in total
Observations
4000 job seeker spells in total
Arms
2000 job seeker spells in treatment group, 2000 job seeker spells in control group
Primary outcomes
by unemployment spell: job seeker perspective: unemployment duration, post-unemployment earnings and employment stability caseworker perspective: use of instruments (counseling, job search requirements, sanctions, ALMP measures like job search assistance, training and job offer referrals)
Secondary outcomes
behavioral outcomes, by unemployment spell: caseworker perspective: belief/expectation of client's unemployment duration -- incl. second measure (update) of belief after about 2 months job seeker perspective: job-search-behavior variables: reservation wage, number of submitted applications, wage expectations, motivation, quality of applications -- incl. second measure after about 2 months
Sponsors
Name: Swiss State Secretariat of Economic Affairs SECO Location: Bern, Switzerland Url: https://www.seco.admin.ch/en/labour

Cited by

No citation data available for this registration yet.

Keywords