Impact Evaluation of Girls Inc.’s EmpowerHub
How to cite
Batistich, Mary Kate; Tebes, Jonathan. 2024. "Impact Evaluation of Girls Inc.’s EmpowerHub." AEA RCT Registry. AEARCTR-0014379. https://doi.org/10.1257/rct.14379-1.1
Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.
* Primary investigator
Abstract
The Wilson Sheehan Lab for Economic Opportunities (LEO) has partnered with Girls Inc. of Greater Indianapolis, located in Indianapolis, Indiana, to evaluate their EmpowerHub program. EmpowerHub is a high-impact, comprehensive program with a primary focus on supporting participants to explore healthy lifestyles, academic achievement, life skills development, and STEAM (science, technology, engineering, arts, and math) exposure. Middle school girls are identified for the program if they are entering sixth grade at a participating middle school within Indianapolis Public Schools (IPS). Including within IPS, chronic absenteeism remains at an all time high and school enrollment has not recovered to pre-pandemic levels. Overall school engagement can be a challenge, particularly for students from diverse and low-socioeconomic families like many of the families in IPS. A key component of this program is the provision of a safe space during the school day for young girls to develop the skills and community to address the challenges they face.
To evaluate this program, we will use a randomized control trial (RCT) to examine whether the program improves grades, homework completion, school attendance, and disciplinary outcomes. Eligible girls are randomly assigned to one of two groups: a control group, not offered a spot in EmpowerHub (630 individuals), or the treatment group, offered a spot in EmpowerHub (420 individuals). The study will utilize administrative records from Indianapolis Public Schools and Girls Inc. program data. Results from this RCT will be disseminated to policymakers and providers across the country to inform the replication and expansion of programs designed to support under-resourced children. We plan to enroll approximately 1,050 people in the study over three years (academic years 2024-25 to 2026-27).
Intervention
The EmpowerHub program is delivered by trained program coordinators and is broken into three sections – Strong (health and wellness), Smart (academic readiness), Bold (civic responsibility and leadership). The program is designed to help deliver consistent programming across each program site. EmpowerHub's strategy encompasses a multifaceted approach that includes reinforcing academic behaviors, fostering perseverance, cultivating positive mindsets, enhancing learning strategies, and developing social skills, all integral to shaping well-rounded individuals and re-engaging students in their future.
The Girls Inc.’s Experience involves the interplay of people, environment, and programming to create a holistic developmental space to address these areas. EmpowerHub’s comprehensive strategy also utilizes programming to emphasize developing non-cognitive skills affecting academic pursuits. This program focuses on non-cognitive factors such as academic behaviors, mindsets, perseverance, learning strategies, and social skills. EmpowerHub’s curricular interventions are strategically designed to develop non-cognitive skills shown by research to be critical in enhancing students' cognitive and emotional realms, thereby improving academic outcomes.
Programmatic components include mentorship from program coordinators, activities in STEM and arts, support in building academic and life skills through goal setting and leadership training, and other engaging sessions.
EmpowerHub operates within the school setting, taking place during advisory periods, with a focus on addressing middle school girls' disengagement and academic underperformance. The goal is to provide participants at each partnering location with 35-50 hours of high-impact programming throughout the academic year. EmpowerHub program will be available to a cohort of 25-40 6th-grade girls, at each of the seven participating IPS middle schools.
Experimental design
The Girls Inc. team iteratively designed the study throughout weekly calls with the research team. The following elements describe the procedures beginning with recruitment and study enrollment.
Study recruitment will run in July and August of school years 2024-2025 through 2026-2027. The Girls Inc. recruitment team will attend school-based back-to-school events and present during the in-school lunch periods at the seven Indianapolis Public School (IPS) middle schools in which Girls Inc. will begin offering EmpowerHub programming to 6th grade girls starting in the fall of 2024. Those eligible children who provide assent and whose parents provide parental consent will be enrolled in the study.
In September of each year of the study, the research team will randomize study participants into two equal groups, treatment and control, by school. Depending on program capacity constraints in subsequent years, the randomization ratio will change as the number randomized into treatment will be reduced to match the number of open spots left by attriters. The treatment group will begin EmpowerHub programming soon after randomization, and the control group will continue attending standard in-school programming (i.e., an advisory period and lunch). EmpowerHub participants will be invited to continue in the EmpowerHub program through 8th grade.
Through a data sharing partnership with Girls Inc. and IPS, the research team will receive academic outcomes for study participants from the PowerSchool and Schoology platforms, as well as other administrative data collected by the school system. The research team will also receive data from an annual survey of all students across the seven involved schools, using only the responses of study participants in any analyses for the study. We are in the process of coordinating with school administrators to potentially expand existing survey content.
Program effects will be estimated by an intent-to-treat design where standard deviation changes in grades and test scores will be regressed on a vector of observed characteristics, and a treatment group dummy. We will also report treatment-on-treated effects using a two-stage least squares regression approach and treatment assignment as the instrument. Heterogeneous impacts can be obtained by estimating the baseline regression with additional controls for groups and group-by-treatment interaction effects. The sub-groups outlined below are subject to change based upon data availability as we continue to formalize data sharing relationships with relevant schools and other stakeholders.
One-year outcomes will be collected and reported for the first enrollment cohort in summer 2025, and preliminary results will be updated and reported for each subsequent year of the study. Three-year results will be available for the first enrollment cohort in summer of 2027, and for the full sample in the summer of 2029.
We plan to investigate the following sub-groups:
- Baseline cognitive measures index: We will use grades and standardized test scores prior to randomization to predict baseline cognitive/academic performance.
- Baseline non-cognitive measures index: We will use disciplinary outcomes, attendance, homework completion, and grade repetition prior to randomization to predict baseline non-cognitive traits.
- To measure the level of poverty and family resources at baseline, we will create a family resources index: This index will consist of family structure, family income, parent/guardian education level, family homelessness status, all measured at baseline.
- Racial congruence: We will use student and program coordinator race to investigate the impact of same-race program coordinators on participant outcomes.
Design details
Cited by
No citation data available for this registration yet.