Middle School Parent Engagement Text Messaging Study--General Program Analysis Plan

How to cite

Cortes, Kalena; Holzman, Brian. 2022. "Middle School Parent Engagement Text Messaging Study--General Program Analysis Plan." AEA RCT Registry. AEARCTR-0009726. https://doi.org/10.1257/rct.9726-2.3

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Kalena Cortes* , Brian Holzman

* Primary investigator

Registry ID
AEARCTR-0009726
DOI
https://doi.org/10.1257/rct.9726-2.3
First registered
Last updated
Status
On going
Trial dates
2018-12-20 – 2026-08-31
Countries
Private
JEL codes
I21, I24, I26, I29
Secondary IDs
National Science Foundation Award Number: 1918016
Registry record
http://www.socialscienceregistry.org/trials/9726

Abstract

Parent involvement at both home and school during the middle school years is positively associated with a range of behavioral and academic outcomes. Yet, due to structural changes in school environments and the increasing autonomy of teenagers, parent involvement often declines during the formative middle school years. Therefore, parents face unique challenges in their ability to both monitor their middle school child’s academic progress and be engaged in their child’s life.

This project covers a set of randomized controlled trials (RCTs) of Texts4Teens, a text messaging program for parents of middle school that aims to increase parental involvement by decreasing the behavioral barriers to engaged parenting.

This document describes general text message interventions administered during two academic years: 2018-2019 and 2019-2020. The general program uses a non-differentiated curriculum that gave students in grades 6 through 8 the same text messages. These interventions were implemented in District 1 (pseudonym). The 2018-2019 program is considered a pilot year and lasted 18 weeks. The 2019-2020 program lasted 32 weeks.

Our middle school parenting program, Texts4Teens, is a text-based intervention that seeks to positively influence parent-teenage day-to-day interactions by addressing potential barriers to parents’ home and school involvement with their child. Texts4Teens’ goal is to narrow achievement gaps before children enter high school and beyond. The text messages include facts and tips on: 1) How to best support and guide their child’s academic trajectory as they transition from middle school to high school; 2) How to best support their child’s social and emotional learning (SEL) skills; and 3) How knowledge, skills, and abilities of their child are grow-able. Parents can choose to receive texts in English or Spanish. Every week, we will send middle school parents in the treatment group three texts about a particular academic topic and an SEL skill or activity for their child. Specifically,

--> The INSPIRE texts will be sent on Mondays. These texts are designed to motivate parents on a weekly academic topic related to their middle school child (e.g., asking questions in class, learning from mistakes, sharing schoolwork in progress, talking about report cards, and talking to teachers).
--> The EXCEL texts will be sent on Wednesdays. These texts address the academic topic of the week and aim to: (1) develop specific social and emotional learning (SEL) skills for their child (i.e., growth mindset, self-efficacy, self-management, self-awareness, and social awareness, responsible decision-making), (2) promote their child’s school engagement (i.e., emotional, behavioral, or cognitive), (3) encourage a parenting practice (i.e., autonomy support, monitoring, or warmth) and/or (4) foster a type of parental involvement (i.e., home-based, school-based, or academic socialization).
--> The BOND texts will be sent on Fridays and are also related to the academic topic of the week. These texts typically reinforce the week’s aim from the EXCEL text by fostering positive parent-child interactions (e.g., affective interactions).

Intervention

Our middle school parenting program, Texts4Teens, is a text-based intervention that seeks to positively influence parent-teenage day-to-day interactions by addressing potential barriers to parents’ home and school involvement with their child. Texts4Teens’ goal is to narrow achievement gaps before children enter high school and beyond. The text messages include facts and tips on: 1) How to best support and guide their child’s academic trajectory as they transition from middle school to high school; 2) How to best support their child’s social and emotional learning (SEL) skills; and 3) How knowledge, skills, and abilities of their child are grow-able. Parents can choose to receive texts in English or Spanish. Every week, we will send middle school parents in the treatment group three texts about a particular academic topic and an SEL skill or activity for their child. Specifically,

--> The INSPIRE texts will be sent on Mondays. These texts are designed to motivate parents on a weekly academic topic related to their middle school child (e.g., asking questions in class, learning from mistakes, sharing schoolwork in progress, talking about report cards, and talking to teachers).
--> The EXCEL texts will be sent on Wednesdays. These texts address the academic topic of the week and aim to: (1) develop specific social and emotional learning (SEL) skills for their child (i.e., growth mindset, self-efficacy, self-management, self-awareness, and social awareness, responsible decision-making), (2) promote their child’s school engagement (i.e., emotional, behavioral, or cognitive), (3) encourage a parenting practice (i.e., autonomy support, monitoring, or warmth) and/or (4) foster a type of parental involvement (i.e., home-based, school-based, or academic socialization).
--> The BOND texts will be sent on Fridays and are also related to the academic topic of the week. These texts typically reinforce the week’s aim from the EXCEL text by fostering positive parent-child interactions (e.g., affective interactions).

Experimental design

To assign parents to one of the texting groups, we will employ a multi-site person-level randomized controlled trial design, blocking on, for example, middle school site, grade level, and texting language, English or Spanish (Spybrook et al., 2011). Specifically, within the districts’ middle schools, grades, and texting languages, we will randomly select half of participating parents to join the control texting group and half to join the INSPIRE-EXCEL-BOND texting group.

District 1 parents who participated in the pilot year program and who re-enrolled in 2019-2020 were reassigned to their initial treatment condition. This design allows us to examine whether multiple years of treatment has effects on student outcomes, relative to zero years of treatment.

Design details

Randomization method
Randomization done in Stata
Randomization unit
Individual-level randomization within school-by-grade-by texting language blocks - Grade includes grade levels 6, 7, or 8 - Texting language includes English or Spanish text messages (chosen by parent during enrollment)
Clusters
2018-2019 (same-year effects sample sizes) District 1: 501 students, 48 blocks in 2018-2019 (school-by-grade-by texting language fixed-effects) 2019-2020 (same-year effects sample sizes) District 1: 1,156 students, 42 blocks in 2019-2020 (school-by-grade-by texting language fixed-effects)
Observations
2018-2019 (same-year effects sample sizes) District 1: 501 students, 48 blocks in 2018-2019 (school-by-grade-by texting language fixed-effects) 2019-2020 (same-year effects sample sizes) District 1: 1,156 students, 42 blocks in 2019-2020 (school-by-grade-by texting language fixed-effects)
Arms
2018-2019 (same-year effects sample sizes) District 1 - Treatment: 253 - Control: 248 - Total: 501 - Blocks: 48 2019-2020 (same-year effects sample sizes) District 1 - Treatment: 581 - Control: 575 - Total: 1,156 - Blocks: 42
Primary outcomes
- Student academic and behavioral outcomes (using student-level administrative data from each district) - Perceived levels of parental engagement and students’ development of social and emotional skills (using end-of-year parent survey data) - Parent and student educational aspirations and expectations? (using parent survey data)
Secondary outcomes
Data from the texting platform will be used to examine opt-out rates. Open-ended text responses from the parent survey will be used to examine parent perceptions of the program.

Cited by

No citation data available for this registration yet.

Keywords