Experimental evaluation of the integration of Sesame Workshop’s Watch, Play, Learn and the Semillas de Apego intervention to foster maternal mental health and early childhood development among conflict-affected communities in Colombia
How to cite
Moya, Andres; Piñeros-Leaño, Maria; Herrera, Maria Jose Torres. 2023. "Experimental evaluation of the integration of Sesame Workshop’s Watch, Play, Learn and the Semillas de Apego intervention to foster maternal mental health and early childhood development among conflict-affected communities in Colombia." AEA RCT Registry. AEARCTR-0011834. https://doi.org/10.1257/rct.11834-1.0
Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.
* Primary investigator
Abstract
Over half a million children between 0 to 5 years of age have been affected by armed conflict and forced displacement in Colombia, while many others have been forced to migrate with their families from Venezuela. While conflict and displacement can bring about devastating effects for young children, healthy ad secure emotional attachments between children and caregivers can help regulate the socioemotional responses to stress and adversities and lay the foundations for proper early childhood development.
In this trial, we will evaluate the impact of integrating Sesame Workshop’s Watch, Play, Learn (WPL) socioemotional content within the Semillas de Apego program (SA). The program is a community and group-based psychosocial intervention focused on restoring mental health and promoting healthy child-parent attachments of caregivers of young children in conflict-affected settings. Between 2018 and 2020, the impact evaluation of SA was implemented in Tumaco, Colombia with a sample of around 1,400 primary caregivers of children ages 2-5. The results of the impact evaluation demonstrate that the program had sizeable and statistically significant effects on caregiver mental health, the style and quality of the child-caregiver relationship, and on child mental health and development.
This new trial evaluates the integration of the WPL socioemotional contents within the SA program to strengthen socio-emotional learning and regulation among the children of the caregivers participating in the SA group sessions. Specifically, the SA and WPL enhanced model integrates 23 socioemotional videos and 3 visual aids from WPL into the SA curriculum. While the SA standard approach targets children indirectly by supporting their caregivers, the enhanced model aims to reach children directly through the delivery of these contents and to strengthen caregivers’ capacities to connect with their children through 1) improved understanding of children’s social-emotional development; 2) specific age-appropriate contents that enable caregivers to engage with their children’s in social-emotional learning ; 3) increased avenues for socioemotional co-regulation (this is, the improved socioemotional regulation of children will have positive effects on their caregivers, which will then create positive feedbacks on children themselves).
In this study, we will analyze whether the enhanced model brings about additional impacts on caregivers’ mental health, caregiver-child relationships, and children’s developmental outcomes. Since we are limited by the study’s sample and underpowered, this trial should be considered as a feasibility study with the hope of a future well-powered impact evaluation. In parallel, we will conduct a process evaluation based on the principles of implementation science to understand the processes and factors that enable or hinder the appropriate integration of the two programs.
The standard and enhanced SA models were implemented in Tumaco and Jamundí, two municipalities in Colombia heavily affected by violence and poverty during the first cohort of 2023 (April – July). Over a time span of 7 months, we will follow the implementation of the enhanced program with 20 groups of on average 16 participants each, all of them mothers or primary caregivers of children 3 to 5, thereby reaching a total of 320 participants and their children.
The impact evaluation is based on a randomized control trial in which we will assign eligible subjects to two experimental arms: the standard program, which serves as the control, and the enhanced model, which in this case will be the treatment group. We randomly assigned the implementation groups (n=19) to the treatment (n=9) and control arms (n=10). In this case, each implementation group corresponds to a different neighborhood, meaning that random assignment was conducted at the neighborhood level.
Participants in both experimental groups participated in 15 group-led sessions over the period of 3 months. Participants in the treatment (enhanced model) group will also have access to WPL videos starting from the 7th session when the program changes focus from the caregiver to the child and their relationship.
We will assess whether the enhanced program brings about differentiated positive and sequential impacts on the following dimensions, relative to the standard program: (i) primary caregiver’s mental health, (ii) child-parent relationship, (iii) quality of the child-parent emotional bond, (iv) children’s mental health, and (v) children’s cognitive and socioemotional development. For this purpose, data will be collected by an independent firm at baseline and two post-intervention assessments: immediately after the intervention and 4 months after the implementation has concluded to understand the short-run impacts of the enhanced model and whether these impacts persist over time.
Intervention
The SA program is implemented through 15-weekly sessions among groups of 16 participants, who are mothers or primary caregivers of children 3 to 5. The implementation of the SA program is based on a community-based model, where each implementation group is led by 2 non-professional community agents, also known as facilitators, who have previously participated in a three-week intensive training or have been participants of the SA program in the past. Overall, there are 8 facilitators, arranged into 4 dyads. In each municipality, one dyad will lead the group assigned to the standard model while the other dyad will lead the sessions of the groups assigned to the enhanced program. There will be 10 groups in the WPL intervention and 10 groups in the control arm, with 160 participants in each group.
Two to three weeks before the program started, community meetings were conducted to share the information on the program, its objectives, structure, and eligibility criteria, and to invite caregivers to participate. To facilitate participation and promote adherence to the program, we held during the day and time convened with the participants, provided incentives, including a 10 USD voucher for the participants every time they attend 3 sessions and a monthly phone plan to those participants that remain in the program.
Only the treatment group received the WPL content. The WPL content was conceptually integrated into each session starting from session 7, which is when SA sessions’ objectives emphasize understanding early childhood development milestones and healthy child-parent relationships to promote Early Childhood Development (ECD) (weeks 8-12) and building support networks and child-rearing teams (weeks 12-15). The education team at SW and the technical team at Universidad de los Andes organized the WPL videos and visual aids into five groups. Group 1 introduces big emotions; Group 2 addresses fear and dealing with challenging situations; Group 3 helps caregivers relate the child's behavior to big emotions and identify alternative strategies to deal with these emotions; Group 4 involves child-rearing teams in identifying the child's emotions and strategies; and Group 5 reinforces breathing techniques. At the end of each session, facilitators linked the discussions that emerged during the session to the WPL videos.
The WPL content was delivered through social media (Facebook and WhatsApp). On FB, the contents were disseminated on private groups within the SA general page, one private group per intervention group. Private groups allow control of the enrollment of caregivers, which is key for the validity of the experimental evaluation, and in particular to prevent contamination to caregivers in the control group. In the private groups, caregivers in the treatment arms received private posts with WPL contents after each weekly session is completed in addition to the standard SA contents. Additionally, they received messages through private group chats and had the chance to interact with other members in the same group. Participants in the control group only received SA content via group chats and the public posts on the SA FB general page. Since the success of this strategy depended on access to internet, participants in both groups received pre-paid phone plans.
On WhatsApp, participants in the treatment arm received a message with a WPL trailer for that week’s videos and a link inviting to watch the videos in the corresponding FB group. Additionally, by the end of each week, the participants in the treatment arm received a full WPL video, in case they were not able to join FB for any particular reason. In this sense, WhatsApp allow for greater reach as it gives access to those participants without FB access. Facebook’s large advantage is that it provides data analytics to understand the participant’s access and use of the WPL content.
Experimental design
The experimental evaluation of the enhanced model will be conducted as a Cluster-Randomized Control Trial (C-RCT). The eligible population for the study is all families in Tumaco and Jamundí, Colombia whose children’s ages range between 3 to 5 years of age.
Random assignment to the treatment was conducted at the group level (n=20). The groups were assigned by neighborhoods to minimize possible spillovers and to facilitate the program’s implementation. We could not cluster our random assignment at the facilitator level (randomizing which pair of facilitators has the WPL content), because we would have few clusters, and this hurts our power. For this reason, we will randomize across groups, meaning that certain facilitators will introduce the WPL in some groups. Participants are, thus, blind to treatment prior to the implementation.
Originally, 10 groups were going to be assigned to receive the enhanced model and the other 10 groups would have been assigned to the control arm. However, once the implementation started, only 9 groups were selected to the treatment arm due to geographical and contextual violence reasons. Additionally, the groups were expected to have 16 participants, but they actually have on average 13 participants, totaling 227 participants in the pilot.
Design details
Cited by
No citation data available for this registration yet.