Addressing Barriers to Student Success in Higher Education

How to cite

Pugatch, Todd; Wilson, Nicholas. 2018. "Addressing Barriers to Student Success in Higher Education." AEA RCT Registry. AEARCTR-0002744. https://doi.org/10.1257/rct.2744-2.1

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Todd Pugatch* , Nicholas Wilson

* Primary investigator

Registry ID
AEARCTR-0002744
DOI
https://doi.org/10.1257/rct.2744-2.1
First registered
Last updated
Status
Completed
Trial dates
2018-09-20 – 2019-06-30
Countries
United States of America (Oregon)
JEL codes
I21, I23, I24
Registry record
http://www.socialscienceregistry.org/trials/2744

Abstract

More than two of every five students who enroll in college fail to graduate within 6 years. Prior research has identified ineffective study habits as a major barrier to success. Using insights from behavioral economics, this study will assess whether focusing student attention on improving study habits can change behavior and improve outcomes. We will conduct a randomized controlled trial at Oregon State University to assess multiple interventions designed to overcome barriers to college completion. The interventions include encouragement to receive academic coaching on study strategies, to attend academic tutoring, and to increase study effort. We will also randomize the medium, timing, frequency, and offer of a lottery-based incentive for each encouragement, allowing us to measure how message delivery alters student behavior. Our findings will provide evidence on how to increase use of these services and the causal effects of these services.

Intervention

1. Improved study strategies: encouragement to visit the university Academic Success Center for academic coaching, or the Economics Tutoring Lab for tutoring in Economics courses.
2. Additional study effort: encouragement to complete extra practice problems.

Encouragement will occur via email and text messages, as follows:
1. None: Current standard for notifications [control condition].
2. Email: Emails encouraging use of support service, where number of emails sent will be randomized.
3. Text message: Text encouragement, where number of messages will be randomized.
4. Email with incentive: Students will receive an email indicating that they will be entered in a lottery to receive $250 credit at the campus dining halls and bookstore if they access the support service before a specified date.
5. Text message with incentive: Students will receive the incentive encouragement via text.

Frequency and timing of messages will vary randomly within the 10 weeks of each academic term, as follows:
1. Week 3
2. Week 6
3. Week 9
4. Weeks 3/6
5. Weeks 3/9
6. Weeks 6/9
7. Weeks 3/6/9

Experimental design

We will encourage students to take specific actions to improve their performance in introductory economics courses. All students will be eligible for the full range of academic support services and receive the current standard for notifications, but subsets of students will be encouraged to access particular services. We will also randomize the medium (email or text), timing, frequency, and offer of a lottery-based incentive for each encouragement, allowing us to measure how message delivery alters student behavior. See the description of interventions for additional details.

Design details

Randomization method
randomization done in office by computer using random number generator
Randomization unit
individual student enrolled in Economics Principles courses
Clusters
3,000 students enrolled in 12 sections of Economics Principles courses (ECON 201/202 at Oregon State University, Corvallis campus)
Observations
3,000 students
Arms
750 students in control group. Remaining students will be divided evenly between cells defined by encouragement intervention, communication medium, and frequency/timing. The encouragement interventions are: 1. academic coaching 2. Economics peer tutoring 3. extra practice The communication media are: 1. email 2. text message 3. email, with lottery incentive 4. text message, with lottery incentive The frequency/timing combinations during the 10 weeks of the term are: 1. Week 3 2. Week 6 3. Week 9 4. Weeks 3/6 5. Weeks 3/9 6. Weeks 6/9 7. Weeks 3/6/9 Within the subsample of treated students who do not provide a phone number, there are thus 42 possible combinations of treatment characteristics (3 messages x 2 incentives x 7 frequency/timing combinations). Within the subsample of treated students who provide a phone number, these 42 combinations exist for both media, leaving 84 possible combinations. We will divide students as evenly as possible among these treatments, though actual cell sizes may vary due to the large number of treatment combinations.
Primary outcomes
Take-up of academic services: --visits to Academic Success Center --visits to Economics Tutoring Lab --usage of and performance on extra practice problems
Secondary outcomes
Student academic performance: --course grades --graduation

Papers from this trial

  1. Pugatch, Todd and Wilson, Nicholas, Nudging Demand for Academic Support Services: Experimental and Structural Evidence from Higher Education. IZA Discussion Paper No. 13732, Available at SSRN: https://ssrn.com/abstract=3699849 https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3699849
  2. Todd Pugatch, Nicholas Wilson. "Nudging Demand for Academic Support Services: Experimental and Structural Evidence from Higher Education." Journal of Human Resources, Published online before print March 09, 2022. https://doi.org/10.3368/jhr.0221-11474R2

Cited by

No citation data available for this registration yet.

Keywords