Motivation and monitoring in modern higher education

How to cite

O'Connell, Stephen; Joyce, Theodore. 2017. "Motivation and monitoring in modern higher education." AEA RCT Registry. AEARCTR-0001957. https://doi.org/10.1257/rct.1957-2.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Stephen O'Connell* , Theodore Joyce

* Primary investigator

Registry ID
AEARCTR-0001957
DOI
https://doi.org/10.1257/rct.1957-2.0
First registered
Last updated
Status
In development
Trial dates
2017-01-27 – 2017-06-30
Countries
Private
JEL codes
I21
Registry record
http://www.socialscienceregistry.org/trials/1957

Abstract

Today's students face many pressures vying to capture their attention, and undergraduate curricula increasingly rely on self-directed content exposure that occurs outside of the traditional classroom. This combination may tend to exacerbate behavioral failures inhibiting human capital production. In this study, we propose to randomize over 500 students across several sections of a standardized, mixed-format (hybrid) introductory economics course taught at a large, public, urban university into treatment arms to receive different types of either motivations or monitoring interventions throughout the semester. These interventions will be provided in electronic (e-mail) format and sent uniquely to students with information pertinent to their study habits and learning process. We will utilize both administrative data, standardized test outcomes, and detailed microdata of student study habits captured by the online content publisher to measure the effect of the intervention on study habits as well as the return to online study.

Intervention

We will send e-mails to students registered in our experimental sections thoughout the semester. These will contain content that intends to motivate students proactively to study particular concepts, and/or indicate that their online study habits are being monitored, along with a recommendation for how much weekly study time is recommended.

Experimental design

The study design will use within- and across-classroom variation for the separate identification of the effects of motivation and monitoring nudges. We will block-randomize students into two groups, referred to as 1 and 2 below. All randomization will be done via within-class stratification based on those above and below the median GPA at baseline. Students in one set of sections (group A sections) will be randomized into treatment arms that receive either monitoring only emails (A1), or emails that have a monitoring and motivation component (A2). Students in the other sections (group B) will receive either nothing (B1) or a motivation email (B2). In the second half of the semester, we will switch the assignment, so that students who received the A1/B1 treatment will receive the A2/B2 treatment for the remainder of the semester, and vice versa. This way, within any class, no group receives a different amount of treatment accounting over the whole semester (this latter condition was required by our IRB).

The design allows us to compare the effect of different types of treatments both within the same class as well as across classes. Ultimately, we can compare the effect of motivation via the difference between (A1-A2) and (B1-B2); and the effect of monitoring by (A2-B2) and (A1-B1).

Design details

Randomization method
Block randomization done by program in Stata based on beginning-of-semester registration records.
Randomization unit
Individual/student
Clusters
0 clusters
Observations
Approximately 600 students, although this may depend on registration and course drop patterns after the semester begins. In some estimations we will use two observations per student (for midterm and final exams) or estimate directly on question-level outcomes (as detailed in the full analysis plan).
Arms
150 individuals per treatment arm, with 4 treatment arms (A1,A2,B1,B2)
Primary outcomes
Exam scores (standardized), total time (natural log) and visits (integer) online, total time and visits on content activities (all), total time and visits on direct-from-text questions, tries (integer) and grades (percentage correct) on quiz and direct-from-text questions, and time-to-next-access (natural log) from email sending times.

Cited by

No citation data available for this registration yet.

Keywords