Unpacking the Long-Term Impact of Holistic Supports for Community College Students: Evidence from a Randomized Controlled Trial

How to cite

Hallberg, Kelly; Bertrand, Marianne. 2023. "Unpacking the Long-Term Impact of Holistic Supports for Community College Students: Evidence from a Randomized Controlled Trial." AEA RCT Registry. AEARCTR-0012406. https://doi.org/10.1257/rct.12406-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Kelly Hallberg* , Marianne Bertrand

* Primary investigator

Registry ID
AEARCTR-0012406
DOI
https://doi.org/10.1257/rct.12406-1.0
First registered
Last updated
Status
On going
Trial dates
2016-01-01 – 2029-12-31
Countries
Private
Registry record
http://www.socialscienceregistry.org/trials/12406

Abstract

A growing body of evidence finds that comprehensive programs, designed to address the multiple barriers community college students face to degree attainment, hold substantial promise for improving community college completion rates (Weiss et al., 2019; Sommo et al., 2018; Evans et al., 2017). Our research team has added to this literature through an RCT of the OMD program. OMD is a non-profit organization that provides financial, academic, personal, and professional supports to community college students. Our study found that the randomized offer of a spot in the OMD program leads to a statistically significant and substantively meaningful increase in community college enrollment, persistence, and associate degree attainment three years after randomization (Hallberg, Hofmeister, Bertrand, & Morgan, 2022).

Building on this RCT in which 4,878 aspiring community college students were randomly assigned to either an offer of a spot on the OMD program or business as usual support, the proposed study aims to add to this literature by examining the long-term effects of providing holistic supports to community college students. Specifically, we will examine the impact of the OMD program on students’ long-term employment prospects and four-year college transfers and bachelor’s degree attainment. We will also use these data and those from the original RCT to complete an analysis of the program’s cost effectiveness.

Intervention

OMD is a non-profit organization serving community college students in the Chicago metro area that supports students financially, academically, socially, and professionally.

Experimental design

The original study was an RCT in which randomization was implemented at the student-level, blocking on the campus the applicant was enrolled in or intended to enroll in and whether the applicant was a graduating high school student or a current community college
student. The research team will use regression analysis using a linear probability model to estimate intent-to-treat effects with fixed effects at the randomization block level, and will use two-stage least squares regression with the treatment assignment as an instrument to
estimate the effects of treatment-on-the-treated.

Design details

Randomization method
Prospective and current community college students applied to the OMD program through the standard application process. OMD screened applicants for program eligibility and the complete list of eligible applicants was sent to the research team. The research team then implemented permutation randomization in STATA, blocking on intended campus and high school or current community college status.
Randomization unit
Randomization was conducted at the student-level.
Clusters
N/A
Observations
In spring 2016, a total of 1,452 unique, eligible OMD applicants were randomized, 779 of whom were offered a spot in the program. In spring 2017, 2,821 unique, eligible OMD applicants were randomized, 1,396 of whom were offered a spot in the program. In spring 2018, 623 unique, eligible OMD applicants were randomized, 398 of whom were offered a spot in the program. Across these three cohorts, a total of 4,896 unique applicants were randomized, 2,573 of whom were offered a spot in the program.
Arms
2,567 scholars were randomized into the treatment group. 2,311 scholars were randomized into the control group.
Primary outcomes
The proposed follow up study will track associate degree completion, transfer to 4-year institutions, 4-year degree completion, and employment outcomes up to nine years after randomization.
Secondary outcomes
The proposed follow up study will analyze the cost-effectiveness to understand the cost of the improved outcomes that result from program participation.

Cited by

No citation data available for this registration yet.

Keywords