The value of online credentials in the labor market
How to cite
Agrawal, Keshav; Palikot, Emil; Athey, Susan. 2022. "The value of online credentials in the labor market." AEA RCT Registry. AEARCTR-0009438. https://doi.org/10.1257/rct.9438-1.0
Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.
* Primary investigator
Abstract
Online courses issuing certificates have gotten substantially more popular over recent years. However, it is unclear how valuable such non-traditional certificates are in the labor market. We study this in the context of the Coursera platform, one of the largest online course providers.
The existing evidence of the value of credentials gained from online courses is generally based on observational data where the selection of unobservable characteristics is a major concern (see e.g., Hadavand 2018). To address this issue, we carry out a randomized controlled experiment in which the treatment group receives a behavioral nudge in the form of an in-app notification encouraging posting the credential on LinkedIn. Additionally, the treatment group receives a new substantially simplified process of adding the credential to the profile. In this way, we leverage the fact that many users do not post their certificates to create an exogenous variation in their usage.
We are primarily interested in whether learners in the treatment group achieve better job market outcomes than learners in the control group. We also analyze the heterogeneity of the treatment effects. Additionally, we study the impact of the treatment on the usage of the credential.
In the experiment we include subjects who have recently graduated from a STEM course on Coursera and do not have a college degree or come from a developing country. This choice is based on findings from a pilot experiment run by Coursera in the past.
Intervention
The intervention is a behavioral nudge encouraging adding credential to the learner’s LinkedIn profile. The proposed nudge is in the form of an in-app message that appears when the user logs in to the Coursera app or website the first time after being randomized in the experiment. Additionally, the process of adding the credential to a LinkedIn profile is simplified for the treatment group.
Experimental design
The intervention proceeds in batches. All eligible learners who completed a course and obtained a credential on the same day form a batch. In each batch, learners are randomized into treatment and control. Randomization is stratified on characteristics of users. Treated learners receive reminders to share their credentials and a simplified process of adding the credential to LinkedIn. Unit of randomization is an individual learner. The experiment lasts for approximately 4 months.
Approximately 6 months after the treatment, subjects receive the outcomes survey. Additionally, for a randomly selected 10,000 subjects, we collect data from their LinkedIn profiles.
Design details
Cited by
No citation data available for this registration yet.