Operation Graduation: A controlled experiment targeting persistence and graduation for community college students

How to cite

Carrell, Scott; Kearney, Melissa; Sacerdote, Bruce. 2019. "Operation Graduation: A controlled experiment targeting persistence and graduation for community college students." AEA RCT Registry. AEARCTR-0003817. https://doi.org/10.1257/rct.3817-2.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Scott Carrell* , Melissa Kearney , Bruce Sacerdote

* Primary investigator

Registry ID
AEARCTR-0003817
DOI
https://doi.org/10.1257/rct.3817-2.0
First registered
Last updated
Status
On going
Trial dates
2018-01-08 – 2020-06-08
Countries
Private
JEL codes
I23
Registry record
http://www.socialscienceregistry.org/trials/3817

Abstract

Community colleges offer great promise to help students build human capital. Yet 60 percent of current students report being ill informed about career opportunities, 33 percent want more academic advising, and fewer than half of community college students complete their associates or certificate program. This study will implement and evaluate an intervention aimed at increasing persistence and graduation at community colleges. The research uses a randomized controlled trial (RCT) research design at several community college campuses within the Community College System of New Hampshire (CCSNH). This project helps distinguish among several distinct hypotheses as to why college coaching/ counseling can be effective for students. The three treatment arms include 1) business as usual, 2) major, career and course planning coupled with auto generated reminders, and 3) the same planning sessions coupled with intensive bi-weekly counseling from a professional based at the college. Survey and in process data will be combined with results across treatment arms to identify the barriers to college completion and which elements of these interventions are the most effective.

Intervention

This study will implement and evaluate a community college based intervention program aimed at increasing persistence and graduation. We use a randomized controlled trial (RCT) design within the Community College System of New Hampshire (CCSNH). The project will also investigate several distinct hypotheses as to why college coaching/ counseling can be effective for students: a) Students lack basic information about what steps they need to take to succeed or basic information about where to obtain help; b) Students lack a concrete plan for their academic major and early career, but once a plan is put in place, students can be effective at executing this plan thereafter; c) Students need interactions with an older adult as a commitment device or reminder to continue to make progress in their plan; d) Students face a multitude of obstacles that require help from an experienced counselor to surmount.

The study consists of two treatment arms and is designed to help distinguish among several distinct hypotheses as to why college coaching/ counseling can be effective for students. In Treatment Arm 1, called the “Auto Advising Group” students receive 4-5 texts per semester. In Treatment Arm 2, students receive bi-weekly meetings (individual and group) with a “College Access Navigator” (CAN).

Experimental design

We will examine the effectiveness of the two treatment arms relative to a control group by implementing a randomized control trial. Eligible students within each campus will be randomized to one of three groups as follows:

1) The Control group will receive “business as usual” meaning the existing advising system.

2) The Automated Advising group will have a single meeting with a WMCC Dean to discuss a plan for the coming two semesters. This will include outlining course choices. The Auto Advising group will receive 4-5 texts per semester reminding them to a) refile the FAFSA, b) register for courses, c) seek help at midterm time if struggling in courses, d) an email reminder with the list of courses selected. Students will have the option to opt out of receiving reminder texts by replying STOP. The WMCC official performing this work will be someone other than the College Access Navigator. WMCC will maintain a spreadsheet/ database record with each of the contacts (or lack thereof).

3) The College Access Navigator (CAN) group will have biweekly meetings with the CAN. Each meeting (or its cancellation) will be recorded in the spreadsheet along with the time and approximate length of the meeting. The purpose of the meetings will include course selection, staying on track in the desired major, choosing majors that match the student’s skills and interest, making career plans, completing financial aid forms, identifying any academic areas where the student is struggling, identifying (and helping solve) any other obstacles to college completion. For each meeting the CAN should note which of the topics below are covered. The CAN should also note key items including: sources of family and friend support used by the student, major and career interests, any academic struggles, any obstacles to college completion, financial aid questions or concerns, best ways for the CAN to reach the student.

Design details

Randomization method
Randomization in office by a computers
Randomization unit
Individual
Clusters
1670 students
Observations
1670 students
Arms
700 students in the control, 700 student in the texting treatment, 270 students in the CAN treatment
Primary outcomes
Key outcomes include: number of credit hours attempted; number of credit hours completed; whether the student re-enrolls the next semester or year; and whether the student obtains a degree or certificate.
Secondary outcomes
Intermediate outcomes such as difficulties selecting courses and difficulties registering for the semester will be collected through pre and post-student surveys. Our surveys measure both the specificity of student’s college and career plans and their levels of determination to complete these plans. We also measure students’ knowledge about campus resources and where to find help on specific topics. Finally we measure sources of family and friend emotional and practical support.

Cited by

No citation data available for this registration yet.

Keywords