An Information Intervention Targeting Effort in a College Course

How to cite

Carrera, Mariana; Hill, Andrew. 2023. "An Information Intervention Targeting Effort in a College Course." AEA RCT Registry. AEARCTR-0012201. https://doi.org/10.1257/rct.12201-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Mariana Carrera* , Andrew Hill

* Primary investigator

Registry ID
AEARCTR-0012201
DOI
https://doi.org/10.1257/rct.12201-1.0
First registered
Last updated
Status
On going
Trial dates
2023-08-16 – 2024-09-30
Countries
Private
Registry record
http://www.socialscienceregistry.org/trials/12201

Abstract

We conduct an information intervention via tailored messages sent to students of a large introductory course at a public university. Messages reference the student's observed assignment completion, thus far in the course, and provide statistics on the typical passing rates of students on that trajectory in the past. Outcome variables studied will be the number of subsequent assignments successfully completed on time and the subjective expectations, halfway through the semester, of own future assignment completion in the second half of the course.

Intervention

Students are randomly assigned to treatment or control. A tailored information message is sent via email to students in the treatment group. The message differs with whether the student has completed 0, 1, 2, or 3 of the first 3 assignments given in the course. Information includes the student's number of assignments completed and the historical passing rate of students with the same level of assignment completion over the first three assignments. The message also states how the passing rates of students in the past varied with their level of assignment completion in the subsequent six assignments. The control group instead receives a generic message about the importance of course assignments.

Experimental design

Students are categorized for tailored information messages based on their initial completion of the first 3 Problems & Applications (P&A) assignments in the course. There are different messages tailored for students who completed 0, 1, 2, or 3 of these first 3 assignments.

In each of these categories, half of the students are randomized to treatment and half to control. All students receive an email via the learning management system, but only the students in the treatment group receive tailored information based on their past performance and highlighting the success rates of past students with different levels of assignment completion.

Design details

Randomization method
Randomization done with software (StataSE 15) and stratified by: #P&A completed successfully of first 3, participation in first-day survey, gender (if participated in first-day survey), and enrollment in a discussion section.
Randomization unit
Individual.
Clusters
582 students
Observations
582 students
Arms
288 Control, 294 Treatment
Primary outcomes
1. Number of Problems & Applications assignments completed successfully (>70%). 2. Subjective guess of the number of Problems & Applications assignments they will successfully complete before the spring deadline.
Secondary outcomes
Grade in the course

Cited by

No citation data available for this registration yet.

Keywords