Impact Evaluation of TipsByText: A Parent-Oriented Language Program for Preschool Children
How to cite
Simonsen, Marianne; Loeb, Susanna; Lilleør, Helene Bie; Riis-Vestergaard, Michala Iben. 2020. "Impact Evaluation of TipsByText: A Parent-Oriented Language Program for Preschool Children." AEA RCT Registry. AEARCTR-0006393. https://doi.org/10.1257/rct.6393-1.0
Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.
* Primary investigator
Abstract
Early-life skills acquisition is a strong predictor of later life outcomes such as education and income, even in Denmark with highly subsidized childcare and free education. Parents play an instrumental role in their children’s acquisition of skills, but research suggests that parents from different socioeconomic backgrounds invest differently in their children. Consequentially, substantial skills gaps emerge between children from different family backgrounds already at an early age, and research suggests that these gaps can be difficult to close at later ages. In this paper, we evaluate the impact of a low-cost way to reduce the early skills gaps: by sending text messages directly to parents of preschool children with tips about how to incorporate simple language stimulation exercises into their busy everyday lives. The text messages are designed to eliminate some of the behavioral barriers to active language stimulation: lack of information, cognitive load, and discounting of future rewards. The intervention was originally developed by American researchers at Stanford University and has been adapted to the Danish context. The evaluation is designed as an RCT with a total of 3,181 families across five municipalities in Denmark.
Intervention
TipsByText is a text-messaging program that aims to help parents support their children’s language development in the preschool years. For eight months, parents receive three weekly text messages with tips for fun and simple language-stimulating games and activities they can do with their children. The text messages are formulated in non-complex language and the tone in the texts is short, direct, and with a call for immediate action in daily routines, e.g., bath time. The curriculum is aimed at parents of three- to five-year-old children, as children in Denmark typically enter preschool around the age of three and stay there until they start primary school (kindergarten class) in the year they turn six.
The intervention is an adapted version of an American parent education program, Ready4K, developed by Susanna Loeb and Benjamin York of Stanford University. The intervention is designed around three behavioral barriers to involved parenting: First, some parents have insufficient information about the impact their child-directed speech has on their child’s language development. To overcome this barrier, each Monday parents receive a “FACT” text designed to generate knowledge by highlighting the importance of particular skills. Second, parenting is a complex task and the cognitive load of parenting can result in a low prioritization of active language stimulation. To help alleviate this barrier, each Wednesday the parents receive a “TIP” text, which contains a specific and creative exercise on how to incorporate a language-stimulating element into a daily routine that is already taking place. Third, to motivate parents and keep them engaged in the language support of their children, each Friday the parents receive a “GROWTH” text, which provides encouragement and a deeper insight of the benefits of the exercise given on Wednesday.
The Danish adaptation of the intervention builds on the same principles as the American version but is specific to the Danish set-up and culture. In particular, the Danish curriculum focuses on three components of language development, which are a priority for language development in the public childcare sector. These components are:
• Formal language (vocabulary: understanding and producing words)
• Early literacy (letters, reading direction, etc.)
• Use of language (conversation, dialogue, narrativity, taking turns, and initiatives).
The adaptation was facilitated by the ROCKWOOL Foundation Interventions Unit (RFI) and was carried out in collaboration with Susanna Loeb and a diverse group of researchers and stakeholders who represent a wide knowledge of early language acquisition, child psychology, child development, and parent education programs and/or early interventions in Denmark. This group consisted of Pia Thomson, who is a prominent Danish language researcher, local municipalities, practitioners, and parent groups.
Experimental design
We employ a family-level randomized controlled trial with an opt-out design for parents of children aged three-to-five in five partnering municipalities in Denmark: Hoeje-Taastrup, Ikast-Brande, Langeland, Lejre, and Middelfart.
Recruitment: Each of the five municipalities provided us with a list of preschools that would participate in the evaluation; it was at the municipalities’ discretion to determine which preschools would participate, and the municipalities included between 67% and 100% of public preschools.
Sample: In total, 3,804 children born in or later than year 2016 (age 3 at the start of the intervention) were enrolled in the 70 participating preschools on October 1, 2019; these children constitute our population. Children in the population were included in the trial if two conditions were met on January 1st, 2020: First, that their parents had not opted out of the trial, second, that we had received at least one parental phone number from the collaborating municipalities. In total, 3,498 children in 3,181 families were included in the trial. At the start of the intervention their age distribution was as follows: 1,024 3-year-old children, 1,106 4-year-old children, 1,219 5-year-old children, and 149 6-year-old children.
Timing: Baseline language assessments were performed by the collaborating preschools in the Fall of 2019. Randomization was conducted in January 2020. On January 24, 2020, parents in the treatment condition received the first text message. Children in the control condition received treatment as usual. The last text message will be sent out on September 5, 2020.
Endline data: In September 2020, the municipalities will start collecting the first round of child-level endline data on language development (using “Sprogvurdering 3-6”). The data collection is scheduled to be complete by the end of 2020, at which time we will receive the data. In September-November 2021 and 2022, respectively, the municipalities will collect the second and third rounds of child-level endline data on language development (also using “Sprogvurdering 3-6”).
Information provided to parents: All parents in the participating preschools received the same informational pamphlet about the intervention in October 2019 before any data was collected. The pamphlet describes the intervention, the evaluation (including randomization), the data collection, and the research team. The information was delivered in printed form to the parents in the wardrobe of each preschool and was uploaded to most preschools’ intranet. The material was translated into eight languages; all parents received the printed version in Danish, and for each child the personnel in the preschool decided whether to attach a translated version. The material provided the parents with a link to a website that gave additional information, and with a phone number/email they could contact if they wished to opt out of the trial. In total, parents of 52 children opted out of the trial before randomization was conducted.
Spillover/contamination risk: To minimize spillover and contamination of the intervention to the control group, we aimed to minimize the probability that the preschool staff knew the allocation of children into the treatment or control group. We used three strategies to achieve this. First, the preschool staff was given no information about the allocation. Second, the preschool staff was explicitly instructed not to initiate conversations with the parents about the intervention. Third, to minimize the risk of parents engaging the preschool staff in conversation about the intervention, the informational pamphlet does not mention the preschool. Instead, the sender of the informational pamphlet is the municipality and the ROCKWOOL Foundation Interventions Unit.
Design details
Cited by
No citation data available for this registration yet.