The value of online credentials in the labor market

How to cite

Agrawal, Keshav; Palikot, Emil; Athey, Susan. 2022. "The value of online credentials in the labor market." AEA RCT Registry. AEARCTR-0009438. https://doi.org/10.1257/rct.9438-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Keshav Agrawal* , Emil Palikot , Susan Athey

* Primary investigator

Registry ID
AEARCTR-0009438
DOI
https://doi.org/10.1257/rct.9438-1.0
First registered
Last updated
Status
In development
Trial dates
2022-08-10 – 2023-12-15
Countries
Private
JEL codes
E24, J01, J24, J62, I26
Registry record
http://www.socialscienceregistry.org/trials/9438

Abstract

Online courses issuing certificates have gotten substantially more popular over recent years. However, it is unclear how valuable such non-traditional certificates are in the labor market. We study this in the context of the Coursera platform, one of the largest online course providers.

The existing evidence of the value of credentials gained from online courses is generally based on observational data where the selection of unobservable characteristics is a major concern (see e.g., Hadavand 2018). To address this issue, we carry out a randomized controlled experiment in which the treatment group receives a behavioral nudge in the form of an in-app notification encouraging posting the credential on LinkedIn. Additionally, the treatment group receives a new substantially simplified process of adding the credential to the profile. In this way, we leverage the fact that many users do not post their certificates to create an exogenous variation in their usage.

We are primarily interested in whether learners in the treatment group achieve better job market outcomes than learners in the control group. We also analyze the heterogeneity of the treatment effects. Additionally, we study the impact of the treatment on the usage of the credential.

In the experiment we include subjects who have recently graduated from a STEM course on Coursera and do not have a college degree or come from a developing country. This choice is based on findings from a pilot experiment run by Coursera in the past.

Intervention

The intervention is a behavioral nudge encouraging adding credential to the learner’s LinkedIn profile. The proposed nudge is in the form of an in-app message that appears when the user logs in to the Coursera app or website the first time after being randomized in the experiment. Additionally, the process of adding the credential to a LinkedIn profile is simplified for the treatment group.

Experimental design

The intervention proceeds in batches. All eligible learners who completed a course and obtained a credential on the same day form a batch. In each batch, learners are randomized into treatment and control. Randomization is stratified on characteristics of users. Treated learners receive reminders to share their credentials and a simplified process of adding the credential to LinkedIn. Unit of randomization is an individual learner. The experiment lasts for approximately 4 months.

Approximately 6 months after the treatment, subjects receive the outcomes survey. Additionally, for a randomly selected 10,000 subjects, we collect data from their LinkedIn profiles.

Design details

Randomization method
Randomization is stratified based on individuals’ observed characteristics in every batch.
Randomization unit
Individual learner
Clusters
Not applicable
Observations
640.000 subjects
Arms
320,000 subjects in treatment and 320,000 in control.
Primary outcomes
Our primary outcomes are whether the subject shared the credential, got a new job, promotion, internship or a pay increase. We get these endpoints through data collected in an outcome’s survey sent to subjects approximately six months after the treatment and data collected from LinkedIn.
Secondary outcomes
Usage of the credential: the number of clicks on the credential, source of the clicks, the number of activity logs, section of the profile in which the credential has been shared.

Cited by

No citation data available for this registration yet.

Keywords