Incentive Design on MOOC: A Field Experiment

How to cite

Liu, Tracy. 2019. "Incentive Design on MOOC: A Field Experiment." AEA RCT Registry. AEARCTR-0004201. https://doi.org/10.1257/rct.4201-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Tracy Liu*

* Primary investigator

Registry ID
AEARCTR-0004201
DOI
https://doi.org/10.1257/rct.4201-1.0
First registered
Last updated
Status
Completed
Trial dates
2015-02-01 – 2016-02-29
Countries
China ()
Registry record
http://www.socialscienceregistry.org/trials/4201

Abstract

In this study, we examine the impact of monetary incentives on learner engagement and learning outcomes in massive open online courses (MOOCs). While MOOCs have innovated education by offering high-quality interactive educational resources to users worldwide, maintaining student learning enthusiasm in these courses is a challenge. To address this issue, we conduct a field experiment in which users are given monetary incentives to engage in online learning. Our results show that those given a monetary incentive are more likely to submit homework and to gain higher grades. The effect largely reflects the continued involvement of regular users whose activity would otherwise decrease over time. We further find that the effect persists even after we remove the monetary incentives and that it spills over into learning behavior in other courses in the same and subsequent semester. Lastly, we find that females and users from regions with fewer educational institutions show stronger treatment effects. Overall, our findings suggest that monetary incentives counteract the decay of learning engagement and may help online education users form persistent learning habits.

Experimental design

To investigate the effect of monetary incentives on learner engagement and performance, we use a 3x2 factorial design, with our control group receiving no incentive. In treatment groups, we vary the incentive size and framing. On the size dimension, we offer three levels of incentives---small, medium and large---to investigate the degree to which incentive size affects engagement and performance. On the framing dimension, we investigate whether positive versus negative framing (i.e, gain versus loss) leads to different effects for a given size of incentive.

Design details

Randomization method
randomization done in office by a computer
Randomization unit
individual
Clusters
2 courses
Observations
800 students (individuals)
Arms
110 students for each of the six treatments, and 110 for control
Primary outcomes
assignment submission and grade

Cited by

No citation data available for this registration yet.

Keywords