Inefficient Hiring in Entry-Level Labor Markets

How to cite

Pallais, Amanda. 2016. "Inefficient Hiring in Entry-Level Labor Markets." AEA RCT Registry. AEARCTR-0001021. https://doi.org/10.1257/rct.1021-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Amanda Pallais*

* Primary investigator

Registry ID
AEARCTR-0001021
DOI
https://doi.org/10.1257/rct.1021-1.0
First registered
Last updated
Status
Completed
Trial dates
2010-04-25 – 2010-12-31
Countries
United States of America (North America)
JEL codes
JEL J23, J24, M51
Registry record
http://www.socialscienceregistry.org/trials/1021

Abstract

Hiring inexperienced workers generates information about their abilities. If this information is public, workers obtain its benefits. If workers cannot compensate firms for hiring them, firms will hire too few inexperienced workers. I determine the effects of hiring workers and revealing more information about their abilities through a field experiment in an online marketplace. I hired 952 randomly-selected workers, giving them either detailed or coarse public evaluations. Both hiring workers and providing more detailed evaluations substantially improved workers’ subsequent employment outcomes. Under plausible assumptions, the experiment’s market-level benefits exceeded its cost, suggesting that some experimental workers had been inefficiently unemployed.

Intervention

Low-wage data-entry specialists from the online marketplace oDesk were invited to apply for 10-hour data-entry jobs. 3,767 workers who applied proposing wages of $3 per hour or less formed the experimental sample. The workers were randomly assigned to three groups: (1) a treatment group which was hired and given an evaluation like those traditionally given in the marketplace, (2) a treatment group which was hired and given a more detailed evaluation, and (3) a control group which was not hired and thus did not receive any evaluation.

Experimental design

Workers were first randomized into either the control group or one of two treatment groups: the detailed evaluation or the coarse evaluation treatment group. Randomization into any treatment group was stratified on prior oDesk experience, such that workers without oDesk experience had a higher chance of being in any treatment group (32 percent) than experienced workers (15 percent). Conditional on receiving any treatment, all workers had a 50 percent chance of receiving the detailed evaluation treatment. Inexperienced workers constituted approximately three quarters of each treatment group.

The coarse evaluation treatment was designed to be equivalent to being hired (and, thus, evaluated) by a typical employer in the marketplace. The detailed evaluation treatment was identical to the coarse evaluation treatment except that it provided the market with more information about some workers’ job performance. Workers in both treatment groups were hired and given a maximum of ten hours over one week to enter the data. They were told that if, after spending ten hours on the task, they had not completed it, they should send the file back unfinished. The following objective measures of workers’ performance were used: their data entry speed, their error rate, the date they returned the data file, and three measures of whether they had followed the data entry instructions. All hired workers were rated on a one-to-five scale using a weighted average of workers’ scores on these performance measures. The distribution of scores from the job was designed to match the distribution of scores low-wage data entry workers received in the marketplace, adjusted for the fact that a worker in the sample was more likely to be inexperienced than a typical oDesk worker. The scores were calculated in the same way for workers in both treatment groups. Approximately 18 percent of workers did not return the file or log any hours. Under oDesk’s protocol, these workers were not rated. Thus, the treatments should be considered as an intent to hire.

The particular treatment group to which workers were assigned affected only the type of comment workers were eligible to receive. No workers in either treatment group received a comment if they earned a rating below three. The remaining workers in the coarse evaluation treatment received an uninformative comment. The remaining workers in the detailed evaluation treatment received a detailed comment if they scored at least a four and an uninformative comment if they scored between three and four. Workers in the detailed evaluation treatment did not know that they would receive a detailed evaluation until it was posted.

The uninformative comment was chosen to be short and positive, like most of the comments in the marketplace. The detailed comment provided objective information on the worker’s data entry speed and accuracy, whether the worker met the deadline, and whether she followed the job’s instructions. Additionally, it repeated the uninformative comment, so the only difference between the two comment types was the objective information provided in the detailed evaluation.

Design details

Randomization method
Randomization in office via computer
Randomization unit
Individual randomization
Clusters
3,767 workers
Observations
3,767 workers
Arms
Treatment groups: 1) 476 workers hired and given detailed job evaluation; 2) 476 workers hired and given coarse job evaluation; Control group: 2,815 workers not hired
Primary outcomes
Post-experiment employment, earnings, and reservation wages of workers in all three experimental groups

Materials

Papers from this trial

  1. Pallais, Amanda. 2014. "Inefficient Hiring in Entry-Level Labor Markets." American Economic Review 104(11): 3565-3599. http://scholar.harvard.edu/files/pallais/files/inefficient_hiring.pdf

Cited by

No citation data available for this registration yet.

Keywords