Inefficient Hiring in Entry-Level Labor Markets
How to cite
Pallais, Amanda. 2016. "Inefficient Hiring in Entry-Level Labor Markets." AEA RCT Registry. AEARCTR-0001021. https://doi.org/10.1257/rct.1021-1.0
Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.
* Primary investigator
Abstract
Hiring inexperienced workers generates information about their abilities. If this information is public, workers obtain its benefits. If workers cannot compensate firms for hiring them, firms will hire too few inexperienced workers. I determine the effects of hiring workers and revealing more information about their abilities through a field experiment in an online marketplace. I hired 952 randomly-selected workers, giving them either detailed or coarse public evaluations. Both hiring workers and providing more detailed evaluations substantially improved workers’ subsequent employment outcomes. Under plausible assumptions, the experiment’s market-level benefits exceeded its cost, suggesting that some experimental workers had been inefficiently unemployed.
Intervention
Low-wage data-entry specialists from the online marketplace oDesk were invited to apply for 10-hour data-entry jobs. 3,767 workers who applied proposing wages of $3 per hour or less formed the experimental sample. The workers were randomly assigned to three groups: (1) a treatment group which was hired and given an evaluation like those traditionally given in the marketplace, (2) a treatment group which was hired and given a more detailed evaluation, and (3) a control group which was not hired and thus did not receive any evaluation.
Experimental design
Workers were first randomized into either the control group or one of two treatment groups: the detailed evaluation or the coarse evaluation treatment group. Randomization into any treatment group was stratified on prior oDesk experience, such that workers without oDesk experience had a higher chance of being in any treatment group (32 percent) than experienced workers (15 percent). Conditional on receiving any treatment, all workers had a 50 percent chance of receiving the detailed evaluation treatment. Inexperienced workers constituted approximately three quarters of each treatment group.
The coarse evaluation treatment was designed to be equivalent to being hired (and, thus, evaluated) by a typical employer in the marketplace. The detailed evaluation treatment was identical to the coarse evaluation treatment except that it provided the market with more information about some workers’ job performance. Workers in both treatment groups were hired and given a maximum of ten hours over one week to enter the data. They were told that if, after spending ten hours on the task, they had not completed it, they should send the file back unfinished. The following objective measures of workers’ performance were used: their data entry speed, their error rate, the date they returned the data file, and three measures of whether they had followed the data entry instructions. All hired workers were rated on a one-to-five scale using a weighted average of workers’ scores on these performance measures. The distribution of scores from the job was designed to match the distribution of scores low-wage data entry workers received in the marketplace, adjusted for the fact that a worker in the sample was more likely to be inexperienced than a typical oDesk worker. The scores were calculated in the same way for workers in both treatment groups. Approximately 18 percent of workers did not return the file or log any hours. Under oDesk’s protocol, these workers were not rated. Thus, the treatments should be considered as an intent to hire.
The particular treatment group to which workers were assigned affected only the type of comment workers were eligible to receive. No workers in either treatment group received a comment if they earned a rating below three. The remaining workers in the coarse evaluation treatment received an uninformative comment. The remaining workers in the detailed evaluation treatment received a detailed comment if they scored at least a four and an uninformative comment if they scored between three and four. Workers in the detailed evaluation treatment did not know that they would receive a detailed evaluation until it was posted.
The uninformative comment was chosen to be short and positive, like most of the comments in the marketplace. The detailed comment provided objective information on the worker’s data entry speed and accuracy, whether the worker met the deadline, and whether she followed the job’s instructions. Additionally, it repeated the uninformative comment, so the only difference between the two comment types was the objective information provided in the detailed evaluation.
Design details
Materials
Papers from this trial
- Pallais, Amanda. 2014. "Inefficient Hiring in Entry-Level Labor Markets." American Economic Review 104(11): 3565-3599. http://scholar.harvard.edu/files/pallais/files/inefficient_hiring.pdf
Cited by
No citation data available for this registration yet.