Why the Referential Treatment?: Evidence from Field Experiments on Referrals

How to cite

Pallais, Amanda; Sands, Emily Glassberg. 2016. "Why the Referential Treatment?: Evidence from Field Experiments on Referrals." AEA RCT Registry. AEARCTR-0001492. https://doi.org/10.1257/rct.1492-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Amanda Pallais* , Emily Glassberg Sands

* Primary investigator

Registry ID
AEARCTR-0001492
DOI
https://doi.org/10.1257/rct.1492-1.0
First registered
Last updated
Status
Completed
Trial dates
2013-01-01 – 2013-06-30
Countries
Philippines (Southeast Asia)
JEL codes
C93, J24, J63, M51
Registry record
http://www.socialscienceregistry.org/trials/1492

Abstract

Referred workers are more likely than non-referred workers to be hired, all else equal. In three field experiments in an online labor market, we examine why. We find that referrals contain positive information about worker performance and persistence that is not contained in workers' observable characteristics. We also find that referrals performed particularly well when working directly with their referrers. However, we do not find evidence that referrals exert more effort because they believe their performance will affect their relationship with their referrer or their referrer's position at the firm.

Experimental design

This project analyzed a set of field experiments in an online labor market to answer two open questions about referrals: first do referrals contain information about worker productivity? Second, do referred workers work harder or more effectively because they are referred? Three experiments were conducted for this project: the peer influence experiment, the team experiment, and the selection experiment.

The peer influence experiment was designed primarily to determine whether referrals work harder as a result of being referred because they think their performance and persistence will affect either their referrer's position at the firm or their relationship with their referrer. In the peer influence experiment, referred and non-referred workers tested an airline flight website by answering questions about the site every other day for 12 days. Referrals in this experiment were randomized into two treatments. The non-monitoring treatment was designed to minimize peer influence. Referrals in this treatment were told their referrers would never know their performance and (after referring) referrers were told they would not be judged on the performance of their referrals. The monitoring treatment was designed to maximize peer influence. Each referrer in this treatment received an update on their referral's performance after each day of work. It was implied to each referrer that their referral's performance and willingness to continue working would affect whether the referrer was promoted.

The team experiment was designed to determine whether directly working with their referrers leads referrals to perform better. In the team experiment, the task was to work with an assigned partner to create a single, shared slogan for a public service announcement (PSA). Each of the two partners was given a different information sheet containing a distinct criterion for the slogan. Partners were asked to discuss the task and then to each submit the same slogan, which should have satisfied both criteria. Workers completed three such PSA tasks, each with a different partner. Each referral completed one task with their referrer and one task with another randomly-chosen referrer.

The selection experiment was designed explicitly to determine whether referrals contain information about worker quality. Four months after the peer influence experiment, the performance and persistence of referred and non-referred workers was measured in a job to which the referred workers had not been referred. Job offers were made to all referred and non-referred workers from the peer influence experiment. Similar to the peer influence experiment, workers who accepted the job offers were given a task that measured individual diligence over time. Workers were asked to visit the Twitter pages of three successful musicians and to answer a ten-question survey about those accounts every day for five consecutive days.

Design details

Randomization method
Randomization in office via computer
Randomization unit
Selection experiment: individual workers Peer influence experiment: individual workers (referrers were randomized; referrals were put into same treatment as referrer) Team experiment: referrer-referral pairs -- In the team experiment, each referrer participated in all three team types. Referrer-referral pairs were randomly placed into blocking groups and only partnered with other people in the same blocking group. Within a blocking group, the ordering of the type of team workers participated in was random. Within team type, when relevant, workers' assigned partners were also randomly assigned.
Clusters
See below on number of observations
Observations
Selection Experiment: 265 workers; Peer Influence Experiment: 608 workers; Team Experiment: 658 workers
Arms
Selection Experiment: (no treatment arms) Peer Influence Experiment: - Monitoring treatment: 213 referred workers - Non-monitoring treatment: 215 referred workers Team Experiment: (no treatment arms)
Primary outcomes
Dependent variables for each experiment are listed below: Selection Experiment (measuring job performance and turnover) - Accepted job offer - Submitted work - Submitted work on-time - Accuracy - Re-apply to continue in job; Peer Influence Experiment (measuring job performance and turnover) - Submitted work - Submitted work on-time - Accuracy - Re-apply to continue in job; Team Experiment (measure individual diligence and team performance) - Logged in to task site - Submitted work - Answered individual question correctly - Used own criterion in slogan - Both partners submitted work - Partners answered team question the same way - Partners submitted the same slogan - Partners submitted the same slogan which used both criteria

Papers from this trial

  1. Pallais, Amanda and Emily Sands. "Why the Referential Treatment: Evidence from Field Experiments on Referrals." Journal of Political Economy, forthcoming. http://scholar.harvard.edu/files/pallais/files/why_the_referential_treatment_2.pdf

Cited by

No citation data available for this registration yet.

Keywords