Referrals to motivate take-up of educational opportunities
How to cite
Munoz, Manuel; Acampora, Michelle. 2025. "Referrals to motivate take-up of educational opportunities." AEA RCT Registry. AEARCTR-0015611. https://doi.org/10.1257/rct.15611-1.1
Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.
* Primary investigator
Abstract
In this incentivized online survey experiment, we investigate the effect of peer-to-peer referrals on the take-up of a beneficial educational opportunity – an online soft-skill training course – focusing on enrollment and completion. The course focuses on self-efficacy, helping learners acquire valuable skills to better set and achieve their personal and professional goals. In the project's first phase, we re-contacted the set of students who had completed the last edition of the program and invited them to submit up to four referrals for their peers to be invited to the new edition. We refer to these students as the “seeds” for our referral experiment. In the second phase, students nominated by the seeds are randomly assigned to a treatment or a control group. Everyone receives an invitation from the University’s Office of International Relations to join the training program. Students assigned to the treatment group additionally learn that they were referred to the course by a peer.
Additionally, we consider a second control group randomly selected among students in the student population who were not nominated by any seed. We assess the impact of referrals and selection of nominated students on program take-up and completion by comparing students across the three treatment groups. Additionally, available survey and administrative data on the student population, including information on their co-enrollment network, will be used to identify the predictors of making a referral, characterize the selection of nominated students, and tease out mechanisms behind any detected effects of referrals.
Intervention
Participants in the referral experiment are selected through two channels and randomized into three groups. The first set of participants was selected through peer-to-peer referrals collected via an incentivized online survey targeting all 635 students who completed the last edition of the soft-skills course, referred to as “the seeds”, which included 166 students who were no longer enrolled in a degree at the partner university. This set of students will be randomly assigned to two groups:
- A treatment group (T1), which receives the invitation email to the course from the Office of International Relations and learns that they were referred to take the course by a peer. For students nominated by more than one seed, one seed is randomly selected and reported as the “referrer”.
- A “nominated” control group (T2), which receives the standard invitation email to the course from the Office of International Relations without being informed that they were referred to it by a peer.
Additionally, we selected a second group of participants among all students who were not nominated by the seeds. These students are assigned to the “random” control group (C), which also receives the standard invitation email to the course from the Office of International Relations. Online registration for the course will be open for one week, and students in the experimental sample will receive up to two reminder emails. Students will have seven weeks to complete the course.
Experimental design
This study builds upon an initial phase that targeted participants from a previous experiment conducted by the PI. We invited all students who had completed the previous edition of an online soft-skill course (N = 635) to submit up to four referrals, selecting peers to be invited to the new edition of the course. We refer to these students as the “seeds” for our experiment. Seeds received performance-based incentives for their referrals: for each referred student who completes the course, they will receive a ticket in two random draws for an iPad. Seeds were informed that all the students they referred to the course would be invited to participate and that they may learn that the seed referred them to the course. Additionally, seeds were asked to indicate which peer they would refer to the course if they were only allowed to recommend one. Seeds were given two weeks to complete the referral survey.
The first part of our experimental sample consists of all the students identified through peer-to-peer referrals submitted by the seeds. This set of students is randomly assigned to two groups:
- A treatment group (T1), which receives the invitation email to the course from the Office of International Relations and learns that they were referred to take the course by a peer. For students nominated by more than one seed, one seed is randomly selected and reported as the “referrer”;
- A “nominated” control group (T2), which receives the standard invitation email to the course from the Office of International Relations without being informed that they were referred to it by a peer.
Randomization is stratified based on the following characteristics: gender, GPA above or below the population median, and rural versus urban background. Additionally, we selected a second group of participants among all students who were not nominated by the seeds. These students are assigned to a “random” control group (C), which also receives the standard invitation email to the course from the Office of International Relations. Online registration for the course will be open for one week, and students in the experimental sample will receive up to two reminder emails. Students will have seven weeks to complete the course.
All students in the experimental sample will receive an invitation to participate in the course from the University’s Office of International Relations, which includes a personalized registration link. This link will allow us to track registrations. The registration form will also collect additional socio-demographic characteristics and students' prior beliefs about the course, which will enable us to explore the mechanisms underlying any effects of the referrals. Registered students will receive weekly emails with links to the course sessions, which will allow us to track course completion.
For the analysis of the effects of referrals on course take-up and completion, we will focus on two primary hypotheses and three secondary hypotheses. We will estimate the corresponding OLS regressions and present results from one-sided tests to improve our statistical power.
Primary hypotheses:
1. Learning about a peer-to-peer referral can increase course take-up or completion through learning or psychological mechanisms (holding fixed selection) (T1 vs T2);
2. Being nominated by a seed can increase course take-up or completion (T1+T2 vs C).
Secondary hypotheses:
1. If take-up or completion is statistically different between T1 and T2, being nominated can also increase course take-up or completion through selection (T2 vs C);
2. If take-up or completion is statistically different between T1 and T2, the effect of referrals may be larger when the comparison group consists of non-nominated students (T1 vs C);
3. If the effects of referrals are driven by selection on observables, there should be no residual effect after controlling for the selection on observables (T1+T2 vs C). To explore this mechanism, we will use matching and weighting methods to assess whether any effect of referrals is robust to accounting for observable characteristics.
Design details
Cited by
No citation data available for this registration yet.