AI-based Experimentation on MOOC

How to cite

Liu, Tracy; Wang, Stephanie; Malmendier, Ulrike. 2020. "AI-based Experimentation on MOOC." AEA RCT Registry. AEARCTR-0005916. https://doi.org/10.1257/rct.5916-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Tracy Liu* , Stephanie Wang , Ulrike Malmendier

* Primary investigator

Registry ID
AEARCTR-0005916
DOI
https://doi.org/10.1257/rct.5916-1.0
First registered
Last updated
Status
In development
Trial dates
2020-05-28 – 2021-07-31
Countries
China ()
Registry record
http://www.socialscienceregistry.org/trials/5916

Abstract

Low-engagement is a central challenging for Massive Open Online Course users. In particular, most students are silent and do not ask questions. Deploying Xiaomu, the AI teaching assistant on XuetangX, which is the largest MOOC platform in China, we examine which social information is more effective for encouraging students to ask questions and consequently improve their learning performance.

Experimental design

A user for a course will randomly see different greeting message once she clicks Xiaomu.
1. Control: I am the AI TA, Xiaomu. I will learn and make progress with you together.

2. Prosocial Message: I am the AI TA, Xiaomu. I will learn and make progress with you together. The more question you ask will benefit students who have the same/similar doubts.

3. Authority Figure Message:I am the AI TA, Xiaomu. I will learn and make progress with you together. The instructor expects you to ask more questions and this shows that you are paying attention.

4. Instrumental benefits Message: I am the AI TA, Xiaomu. I will learn and make progress with you together. Asking more questions could improve your grade in the class.

5. Upward comparison/role model+instrumental benefits : I am the AI TA, Xiaomu. I will learn and make progress with you together. Tsinghua students who ask more questions perform better in the class. You can too.

Design details

Randomization method
randomization done in office by a computer
Randomization unit
individual
Clusters
9588 users from three different courses we are going to implement the experiment
Observations
same as number of clusters
Arms
1916 in control; 1917 in Prosocial Message: 1917 in Authority Figure Message; 1918 in Instrumental benefits Message; 1920 in Upward comparison/role model+instrumental benefits
Primary outcomes
(1)A user's frequency for asking questions to Xiaomu; (2) A user's learning activities including the time spent on watching videos and her grades.

Cited by

No citation data available for this registration yet.

Keywords