A field experiment on online job search assistance

How to cite

Briscese, Guglielmo; Quinn, Veronica; Zanella, Giulio. 2019. "A field experiment on online job search assistance." AEA RCT Registry. AEARCTR-0005032. https://doi.org/10.1257/rct.5032-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Guglielmo Briscese* , Veronica Quinn , Giulio Zanella

* Primary investigator

Registry ID
AEARCTR-0005032
DOI
https://doi.org/10.1257/rct.5032-1.0
First registered
Last updated
Status
Completed
Trial dates
2017-03-01 – 2019-10-15
Countries
Australia ()
JEL codes
J08, J64, J68
Registry record
http://www.socialscienceregistry.org/trials/5032

Abstract

Finding a job is a full-time job, and it requires basic skills to engage effectively with employers with vacancies. We design and evaluate experimentally the impact of a website we purposely created with useful job search resources: an annotated resume template, a cover letter template, and tips on how to look and apply for jobs. We informed about 2,000 job seekers in Australia about the website via low-cost communication channels and tracked their outcomes for almost two years. We find the website is effective at increasing job-finding rates, particularly among a most receptive group of job seekers aged 35-50 and women within this age group for whom job placements were respectively 6% and 8% higher compared to the control group after three months. We also find a marginal improvement in the quality of job matches. We discuss policy implications for improving targeting of employment programs and the potential for online government services.

Intervention

We test a low-cost and easily scalable online intervention to supplement job search skills among income support recipients. The intervention consists in user-friendly online resources to help unemployed job seekers find a job. Specifically, we developed a website with three webpages, each basic resources needed when looking for work: (i) a resume template, (ii) a cover letter template), and (iii) tips on how to look and apply for jobs. The first two webpages contain a downloadable template, a brief explanation on how to customize it, and a short video from an employment advisor that explains how to use the resources effectively. We then notified around 2,000 job seekers about the existence of the website via offline and online channels. We left the website online for four months, and tracked recipients' employment outcomes for a period of nearly two years.

Experimental design

We partnered with an employment agency to select 22 of their job centres in the area of metropolitan Sydney, Australia. In order to minimize spillovers onto job seekers in the control group and because crucial aspects of the trial such as the presence of posters and the role of job advisors cannot be varied within job centers, the randomization was conducted at the level of job centers.

Job seekers who, at the beginning of the trial, were registered at job centers assigned to treatment or who registered at these centers during the trial constitute the treatment group, which was a total of 1,983 persons. The control group is given by 1,764 job seekers who registered at job centers not assigned to treatment.

Design details

Randomization method
Job seekers were randomised into treatment or control at the site level. Randomisation was achieved using a balance check and re-randomisation procedure . This procedure involved randomly allocating sites to control and treatment 1000 times, and then calculating the relative imbalance on each of the above variables. Relative imbalance was calculated by taking the absolute value of the t-statistics on a simple regression with treatment allocation as the outcome variable and the balance variable as the sole predictor. We then took the largest t-statistic of the balance checks for each allocation, and chose the allocation that had the smallest maximum imbalance. We balanced on the following variables which may influence treatment effect: • Part-time or full-time status of the site (binary) • East/ West status of the site (binary) • Caseload of wage subsidy eligible job seekers • Caseload of job seekers at the site • Single or composite site (i.e. where sites might share an employment advisor; binary) • Average monthly job placements at the site
Randomization unit
The unit of randomisation was the job centre.
Clusters
The trial was run on 22 clusters (job centres) randomly allocated between control and treatment
Observations
At the end of the trial, the total sample size was 3,746 unemployed job seekers.
Arms
11 job centres in control and 11 job centres in treatment
Primary outcomes
The primary outcomes of interest in our experiment are: 1) Found employment 2) Found own employment (i.e. the vacancy was not secured by an employment advisor) 3) Job retention rates over a period of 12 months before the trial and 22 months after the trial
Secondary outcomes
The secondary outcomes of interest in our experiment are: 1) Gender difference across all primary outcomes 2) Age differences across all primary outcomes 3) Number of days needed to find a job 4) Job type, for the subset of the sample who found one (e.g. full-time, part-time)

Cited by

No citation data available for this registration yet.

Keywords