Optimal Design of Digital Early Childhood Development Interventions: A Multifactorial Randomized Control Trial

How to cite

McCoy, Dana; Kitamura, Kenji; Trías, Julieta; Oliveira, Jimmy; Cuartas, Jorge. 2023. "Optimal Design of Digital Early Childhood Development Interventions: A Multifactorial Randomized Control Trial." AEA RCT Registry. AEARCTR-0008419. https://doi.org/10.1257/rct.8419-2.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Dana McCoy* , Kenji Kitamura , Julieta Trías , Jimmy Oliveira , Jorge Cuartas

* Primary investigator

Registry ID
AEARCTR-0008419
DOI
https://doi.org/10.1257/rct.8419-2.0
First registered
Last updated
Status
On going
Trial dates
2023-01-20 – 2024-06-30
Countries
Private
JEL codes
J13, O15, C93
Registry record
http://www.socialscienceregistry.org/trials/8419

Abstract

The COVID-19 pandemic has increased demand for virtual early learning programs in low- and middle-income countries. However, little is known about these programs’ effectiveness or how they may address post-pandemic opportunity gaps for marginalized populations at scale. This study will examine the sustained impacts of Afini, a technology-based, interactive chatbot that uses artificial intelligence to recommend customized, culturally-sensitive activities that parents complete with young children (0- to 3-year-olds) to promote early learning and development. To do so, we will follow families participating in the national parenting program that aims to provide child stimulation for children living in poverty in the State of Ceará, Brazil. Using a multifactorial randomized controlled trial, we will (1) estimate the sustained impacts of Afini on parental behavior, mental health, and child development outcomes, (2) explore whether these impacts vary across different dimensions (e.g., child gender, maternal education, child development at baseline), (3) identify the components of Afini (e.g., delivery platform) that maximize cost-effectiveness. We will also conduct a qualitative assessment to gather participants’ feedback, regarding program benefits and drawbacks. This research will inform policymakers on whether and how to implement digital learning programs for low-income families in a scalable setting. In doing so, we aim to promote more positive and equitable trajectories of life-long learning at scale for children in low- and middle-income countries.

Intervention

Afini (i.e., the intervention) is an interactive “virtual assistant” that uses a chatbot to recommend simple, fun, age-appropriate activities that parents and other caregivers can complete with young children to support child development. Afini includes 1,500 activities that have been delivered to 70,000 users in Latin America. Afini’s activity recommendations are evidence-based and reflect principles of behavioral economics (e.g., by providing scientific rationale for the activities). Although they are designed to be “culturally neutral,” Afini activities can be adapted to reflect materials, games, and concepts that are most relevant to a given context or program. Activities focus largely on supporting children’s language, cognitive, motor, and social-emotional development.

We will test the benefits of Afini as an add-on to the Criança Feliz national home visiting program (relative to a control group that will keep receiving the Criança Feliz program as usual) and the relative benefits of specific Afini features, focusing on tradeoffs for cost-effectiveness. Specifically, we will examine:
1. delivery through a standalone app (a lower-cost alternative that does not rely on third-party fees) vs. WhatsApp messenger (an existing provider trusted by families, which may improve engagement);
2. sending alerts (i.e., unsolicited activity recommendations) once (less expensive) vs. twice (more intensive) per week;
3. customizing content to caregiver preference (may improve engagement) vs. children’s developmental needs (may lead to greater child-level impact).

Afini seeks to promote young children’s healthy development by supporting these day-to-day interactions that serve as the basis of nurturing care. Our theory of change is that parents (or other caregivers in the home) will engage with Afini and complete recommended activities with children. These processes will lead to improvements in parents’ knowledge, provision of stimulation, and mental health, which will improve the quality of their interactions with children as well as children’s ECD outcomes (i.e., motor, cognitive, language, and social-emotional skills). We hypothesize that Afini will benefit families already receiving home visiting because, unlike Criança Feliz (which does not currently have a defined curriculum), Afini provides concrete, specific, and customized activity recommendations designed specifically for vulnerable families (e.g., minimal text, few required materials). Furthermore, Afini can be used at families’ convenience, improving accessibility.

Experimental design

The project will conduct a randomized controlled trial and a multifactorial experiment, gathering two points of data for the evaluation (baseline and follow-up).
Participants will include parents (or primary caregivers) of children under age 30 months who are participating in the national home visiting program for socioeconomically vulnerable families (Criança Feliz) in the state of Ceará. We will recruit families for participation in this study using a government administrative database for vulnerable families with children under age three (i.e., the Cadastro Único). Staff from Criança Feliz will recruit potential participants.
We planned this trial with the objective of assessing impact in real implementation. As such, we randomized in advance to baseline, when informed consent was collected by trained enumerators. We had initially planned to include 3,200 families and 290 home visitors, but we obtained consent from 1,599 families receiving services from 281 home visitors nested in 200 Centros de Referencia de Asistencia Social (CRAS) from 41 municipalities. As such, our sample comprises 1,599 families and 281 home visitors.
We randomized the 290 home visitors to a treatment group (which will receive the Afini intervention plus normal Criança Feliz services; 60%) or a control group (which will receive normal Criança Feliz services only; 40%). The randomization was conducted in Stata 17 MP.
Subsequently, consistent with a multifactorial design, we re-randomized the home visitors in the treatment group according to the following factors (there are 8 unique conditions, reflecting the different combinations of these factors):
1. delivery through a standalone app vs. WhatsApp messenger;
2. sending alerts once vs. twice per week;
3. customizing content to caregiver preference vs. children’s developmental needs.

Design details

Randomization method
Randomization done in office by a computer, using Stata 17 MP
Randomization unit
Home visitor
Clusters
Planned: 290 home visitors. Effective: 281 home visitors
Observations
Effective sample: 1,599 caregiver-child dyads. Our sampling frame included 3,200 caregiver-child dyads linked to 290 home visitors. The planned sample assumed that 50% (1600) would provide consent to participate in the study. Our effective sample, after requesting consent is 1,599 caregiver-child dyads
Arms
164 home visitors in the treatment group and 117 home visitors in the control group
Primary outcomes
1. Child Development: We will use the Caregiver-Reported Early Development Instruments - Long Form (CREDI-LF) with a full sample and the Global Scales of Early Development - Long Form (GSED-LF) with a subsample.
Secondary outcomes
1. Caregiver mental health: The Depression, Anxiety and Stress Scale - 21 Items (DASS-21) 2. Parents’ early stimulation: Family Care Indicators (FCI) and Parenting Styles and Dimensions Questionnaire (PSDQ) 3. Parents’ discipline behaviors: Conflict Tactics Scales: Parent-child Version (CTSPC) 4. Parent self-efficacy: Self-efficacy for Parenting Tasks Index-Toddler Scale (SEPTI-TS)

Cited by

No citation data available for this registration yet.

Keywords