Self-control, naivete and completion rate for MOOCs: a field experiment

How to cite

Liu, Yiming; Wang, Stephanie; Liu, Xiao. 2019. "Self-control, naivete and completion rate for MOOCs: a field experiment." AEA RCT Registry. AEARCTR-0005144. https://doi.org/10.1257/rct.5144-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Yiming Liu* , Stephanie Wang , Xiao Liu

* Primary investigator

Registry ID
AEARCTR-0005144
DOI
https://doi.org/10.1257/rct.5144-1.0
First registered
Last updated
Status
In development
Trial dates
2019-12-30 – 2020-01-31
Countries
Private
Registry record
http://www.socialscienceregistry.org/trials/5144

Abstract

The low completion rates for Massive Open Online Courses (MOOCs) has long been a controversial topic. While some see the low rates of completion as a sign of inefficiency, others argue that completion rate is a misleading index as MOOCs give students the freedom to learn what they want without finishing the course. However, the latter argument only makes sense if students do achieve their personalized learning goals on MOOCs. This project aims to answer two sets of questions: first, does self-control play a role in explaining the low completion rates for MOOCs? If the answer is yes, it means the low rates of completion is indeed a problem. Then the next question is can we design some interventions to raise the rate of completion? In particular, we plan to design personalized commitment devices based on students' present biases. One design choice we need to make is whether to inform them that their answers to the time preference elicitation questions will be used to calculate the optimal commitment devices for them. If they know in advance that the elicited present bias will affect the commitment contracts they later get, then they have incentives to game the system. However, whether they will be truth-telling or not when answering the time preferences questions is an empirical question and we plan to test that before we implement the interventions. The basic idea is to randomly select half of the subjects to inform them the personalized interventions in the future before they answer the questions and leave the other half uninformed. Then we can test whether their elicited time preferences/present biases are drawn from the same distribution or not. If we cannot reject the null hypothesis, then we can conclude that it is safe to inform the subjects in advance that the commitment devices they will get is contingent on their elicited time preferences.

Experimental design

There is a treatment group and a control group. Subjects in the treatment group receive a message before they submit their answers to the question we use to elicit their time preferences. In the message we inform them that the following questions will elicit their preferences and those elicited preferences will be used to calculate the optimal personalized interventions to enhance their performances on the MOOCs platform. We are vague about the specific preferences the following questions will elicit, how their answers to the questions will be translated into measures of their preferences, and how the measured preferences will affect the interventions they will get.

Design details

Randomization method
simple randomization with a pseudo-random random number generator.
Randomization unit
individual
Clusters
N/A
Observations
2000
Arms
1000 in each treatment, 2 treatments in total
Primary outcomes
present bias; measured with both money (incentivized) and effort (hypothetical)

Cited by

No citation data available for this registration yet.

Keywords