College Forward RCT Follow-Up: Labor Market Impacts
How to cite
Castleman, Ben; Bird, Kelli; Lohner, Gabrielle. 2025. "College Forward RCT Follow-Up: Labor Market Impacts." AEA RCT Registry. AEARCTR-0016417. https://doi.org/10.1257/rct.16417-1.0
Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.
* Primary investigator
Abstract
We will conduct a follow-up study to a multi-cohort randomized controlled trial (RCT) of the
College Possible Texas (formerly College Forward) intensive college advising program. The
RCT experimental sample comprises 1,605 Texas high school students from the graduating
classes of 2017-2020; the intervention is described in detail in Castleman, Deustchlander, and
Lohner (2024).1 We have reported large, positive impacts of the program on bachelorβs degree
attainment up to five years after high school, and will follow the experimental sample into the
labor market by leveraging Texas state workforce data available through the Texas Education
Research Center (ERC). By collecting labor market outcomes for the RCT experimental sample
over the next several years, we will be able to follow the entire experimental sample into at least
the tenth year following their expected high school graduation.
Intervention
The intervention is described in detail in Castleman, Deustchlander, and Lohner (2024). A public version of the working paper is available here: https://edworkingpapers.com/sites/default/files/College_Forward_Paper_June24.pdf
Experimental design
Sample selection and randomization for the study has already been completed. The application pool contained students at 11 local high schools in Austin and Houston, Texas; we used high school as a randomization block. Each year, we assigned approximately 60% of the applicants from each high school who met the College Forward eligibility requirements to the offer of College Forward advising, an offer which virtually all students took up, or to a control group that received no advising services from College Forward. As we show in Table 2 of Castleman, Deustchlander, and Lohner (2024), the experimental sample is well-balanced on baseline characteristics. Our experimental sample size for the proposed study is the same as the sample size in the original RCT: 1,605 individuals across four cohorts (high school classes of 2017 - 2020), with 963 assigned to treatment and 642 assigned to control.
The experimental sample includes students who were offered College Possible Texas advising services. While we do not have data on actual take-up of the advising offer, College Possible Texas has shared with us that the vast majority of students who receive an offer join the program. Still, we will view our estimates as intent-to-treat (ITT). We will use a standard OLS regression model to estimate the ITT impact on unconditional earnings:
πΈπππππππ π = Ξ²0 + Ξ²1πππππ‘ππππ‘πΊπππ’ππ + Ξ²2ππ + πΉπΈπ»π * πΆπβπππ‘+ Ο΅π
Where ππ is a vector of available student baseline characteristics (cohort, gender, first generation status, free or reduced price lunch status, race and ethnicity, whether English is spoken at home),and πΉπΈ is a set of high school by cohort fixed effects. We include the latter because the π»π * πΆπβπππ‘ student-level randomization was stratified within high school and cohort. The coefficient of interest is Ξ²1, which provides ITT estimates of assignment to College Possible Texas advising. We will repeat the same OLS regression model using a binary indicator for employment as the
outcome.
Following Castleman, Deutschlander, and Lohner (2024), to account for modest crossover between experimental groups we will also estimate an instrumental variables (IV) model in which we will use studentsβ original experimental group assignment as an instrument for the
offer of College Forward advising; this will yield a crossover-adjusted ITT estimate.*** The IV model takes the following form:
πππππ‘ππππ‘ππππππ = Ξ±0 + Ξ±1πππππ‘ππππ‘π΄π π πππππππ‘π + Ξ±2ππ + πΉπΈπ»π * πΆπβπππ‘+ π’π
ππ’π‘πππππ = Ξ³0 + Ξ³1πππππ‘ππππ‘ππππππ + Ξ³2ππ + πΉπΈπ»π * πΆπβπππ‘ + Ο΅π
where πππππ‘ππππ‘π΄π π πππππππ‘π is the studentβs original randomization group and πππππ‘ππππ‘ππππππ corresponds to the studentβs ultimate treatment status. These variables only differ for the 50 crossover students. In Castleman, Deustchlander, and Lohner (2024), we find that the main ITT and IV impacts on enrollment differ by only 0.5 percentage points, or 7 percent (Table 3). We will report both ITT and IV impacts on our primary and secondary labor market outcomes.
Given that all students in the experimental sample attended public Texas high schools, we expect a near 100% match rate within the Texas ERC database. However, if any individuals are working outside the state of Texas or are working in positions not covered by the TWC data (e.g. independent contractors), then we will not observe their employment and will be unable to distinguish these individuals from those who are truly unemployed. We will treat all individuals without employment and earnings records in the TWC data as unemployed ($0 earnings). We will examine the data for outliers, and bottom or top code the earnings data accordingly. For instance, if there are any quarterly earnings either so large (e.g. $300,000) or so small (e.g. $10) that we could reasonably expect these values to impact the OLS estimates, then we will top or bottom code earnings to the 99.5th percentile and 0.5th percentile, accordingly. We expect that the number of adjustments will be minimal, if any.
*** Specifically, 25 individuals assigned to the treatment group ended up in the control group, and vice versa.
Design details
Cited by
No citation data available for this registration yet.