Pilot study to Improve Student Success at the University of Kansas: A Randomized Evaluation of Technology and Peer Support

How to cite

Slusky, David; Doan, Alesha; Warren, Elizabeth. 2026. "Pilot study to Improve Student Success at the University of Kansas: A Randomized Evaluation of Technology and Peer Support." AEA RCT Registry. AEARCTR-0019441. https://doi.org/10.1257/rct.19441-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

David Slusky* , Alesha Doan , Elizabeth Warren

* Primary investigator

Registry ID
AEARCTR-0019441
DOI
https://doi.org/10.1257/rct.19441-1.0
First registered
Last updated
Status
In development
Trial dates
2026-09-01 – 2027-12-01
Countries
Private
JEL codes
I21; I23; C93
Registry record
http://www.socialscienceregistry.org/trials/19441

Abstract

The University of Kansas, the state’s flagship institution, strives to retain and graduate all of its students. This goal is challenging, given its mission to accept and educate the vast majority of students who apply. This study evaluates the effectiveness of technology-driven outreach strategies in improving student success and retention at the University of Kansas. Despite widespread adoption of progress reporting tools like Navigate360 (Jayhawk GPS), faculty engagement and utilization remain low. Progress reporting is widely regarded as an effective retention strategy, yet causal evidence of its impact is limited. We propose a cluster-randomized evaluation across multiple sections of high-enrollment, high-DFW courses within KU’s required general education. Sections will be randomly assigned to one of three arms: (1) no progress reporting, (2) progress reporting only, and (3) progress reporting with navigator-led outreach. Outcomes will include course grades, DFW rates, term-to-term retention, and student survey responses, adjusted for demographic and course-level factors. This research aims to identify the most effective outreach approach, optimize resource allocation, and inform evidence-based retention practices. Results will contribute to the broader literature on randomized evaluations in higher education and guide institutional strategies for student success.

Intervention

Navigate360 (called “Jayhawk GPS” at the University of Kansas) is a multifunctional tool available as an app and web platform that is used by universities across the country for student success and retention. Students can schedule appointments with various campus offices, receive important course alerts from faculty, request specific support from offices on campus, and view meeting notes from past appointments with advisors among other features.

In addition to offering a range of student services, Jayhawk GPS includes several retention-focused functions for university staff including quick polls, progress reports, population health assessments, predictive analytics, and success markers. Progress reports are one of the primary functions that University of Kansas uses as a part of its proactive retention efforts. Progress reporting offers an opportunity to identify students showing signs of academic distress early, allowing staff to review options and connect students with appropriate campus resources before they have earned a low or failing final grade.

How Progress Reporting Works
Jayhawk GPS administrators send instructors a progress report campaign weblink at specific points throughout the semester (e.g., week two and week seven). Instructors or course TAs are asked to submit feedback on student performance in their courses. The system then generates student alerts, which are delivered either automatically through the platform or through directly by the outreach team. Student navigators begin outreach with a phone call to learn more about the challenges affecting the student’s academic performance and connecting them to the appropriate campus resources. During the call, student navigators may also escalate the case to the student’s academic advisor and assist with scheduling the appointment. If the student is not reached by phone call, student navigators will follow up with a text message.

Experimental design

This study will include general education courses at KU with high levels of enrollment, high DFW rates (mostly from KU’s general education https://kucore.ku.edu/), and three or more sections. Within each course, each section (i.e., cluster) will be randomly assigned to one of the following treatment arms:

- No Progress Reporting
- Jayhawk GPS Progress Reporting
- Jayhawk GPS Progress Reporting with navigator interventions

Sections assigned to no progress reporting will not use Jayhawk GPS. Sections assigned to progress reporting only will input relevant information about student progress into the Jayhawk system. Sections assigned to progress reporting with navigator-led outreach will input relevant information about student progress into the Jayhawk system, and will have student outreach coordinators supporting efforts to communicate with students flagged in these systems as being at risk for not passing.

Design details

Randomization method
Randomization done in office by a computer
Randomization unit
Section within a course
Clusters
We are inviting a range of courses with a collective 155 course sections to participate in this study.
Observations
There are approximately 4,500 students across the courses we are inviting to participate in the study.
Arms
If all invited courses choose to participate, we will have 51-52 clusters in our control group and each treatment arm.
Primary outcomes
Grades in the course DFW (withdrawal) rates Retention to the next term
Secondary outcomes
Grades in other courses Self-reported survey responses about the usefulness of the tool and the extent to which they felt supported in these classes.

Cited by

No citation data available for this registration yet.

Keywords