College Success and Personalized Feedback

How to cite

Khoury, Stephanie El; Aucejo, Esteban; Peyre, Agustina Affonso. 2025. "College Success and Personalized Feedback." AEA RCT Registry. AEARCTR-0015150. https://doi.org/10.1257/rct.15150-1.1

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Stephanie El Khoury* , Esteban Aucejo , Agustina Affonso Peyre

* Primary investigator

Registry ID
AEARCTR-0015150
DOI
https://doi.org/10.1257/rct.15150-1.1
First registered
Last updated
Status
In development
Trial dates
2025-01-20 – 2025-05-15
Countries
Private
JEL codes
I2, D8
Registry record
http://www.socialscienceregistry.org/trials/15150

Abstract

This study is designed to create and administer a survey that identifies key areas of struggle for students, including financial stress, academic success, social life, and study habits. Based on the survey results, we will generate personalized emails for treated participant, providing targeted advice and resources to address their primary area of concern. The objective is to evaluate the effectiveness of these personalized interventions by examining their impact on various student outcomes, such as academic scores and personal perceptions of their struggles.

Intervention

Students at Arizona State University that have enrolled in our study will be randomly assigned into receiving feedback and advice around the area concerning their academic journey that they are scoring the worst in. This includes information on their study habits, academic life, social life in college, or financial situation. We use our survey to identify the area in which a student struggles the most on an individual level, allowing us to provide personalized feedback tailored to their experience.

Experimental design

1.At the beginning of the semester, the research team and professors will inform students about a survey available for participation in a study conducted by ASU professors, contingent upon their consent. Instructors are encouraged to offer extra credit to students who complete the survey, with the amount varying by instructor. However, students may opt out of the study and still earn extra credit by completing the survey.

2. Based on the responses from the initial survey, students are grouped according to the area in which they performed the poorest. Within each group, students are stratified into treatment and control groups based on whether their score in their weakest area is above or below the average score for that area (calculated based on students with the same weakest area)., their first-generation status, and their GPA (below or above the average GPA of the student population at ASU). If the sample size is too small to maintain the number of desired strata, grouping will be simplified to a dummy for above/below average score in the weakest area and GPA.

3. Using the collected information, the research team will then send personalized messages to treated students about the area that they scored the lowest in. Students in the treatment group will receive personalized emails detailing their scores across all areas, along with a link to a video tailored to the area they scored lowest in. This email will be sent after their first exam. If students achieve perfect scores in all areas or tie in their lowest scores across multiple areas, a "priority list" dictates the video that will be sent to students: the study habits area is first, followed by academic area, social life, and finally financial issues [The "priority list" of the stratification was modified on 02/09/2025, before randomization and intervention]. For example, a student with perfect scores across the board will receive the study habits video, while a student scoring lowest in both academic and social life will receive the academic video.

4. Following the distribution of personalized information, all students will receive a follow-up email to gauge their feelings about the areas discussed in the survey.

5. Later, treated students will receive a reminder email highlighting the advice most relevant to their needs. Where the focus is on their worst area and the sub-areas that exist within it. At this stage all videos relevant to this area are shared as individual links with treated students.

A second survey will be administered at the semester's end to assess how students' perceptions of their college struggles have evolved.

Design details

Randomization method
Randomization done in the office on a computer using STATA.
Randomization unit
Individual level (student)
Clusters
1,500 students
Observations
1,500 students
Arms
750 treated students, 750 control students
Primary outcomes
Scores on exams and scores on feelings concerning struggles that they report to us, scores of "how are you feeling" question that is asked half way through the experiment. In addition to this, we aim to look at the heterogeneous effects of treatment by looking at first generation students, GPA, dummy for being above/below average score on areas, and gender.

Cited by

No citation data available for this registration yet.

Keywords