The “Digital Plus” Approach to Upscaling Early Childhood Development Services: Evaluating the Effectiveness of a Mixed Online-Offline Caregiver Education Program in Rural China

How to cite

Rule, Andrew; Li, Shanshan; Qian, Yiwei; Reiling, Kelly. 2024. "The “Digital Plus” Approach to Upscaling Early Childhood Development Services: Evaluating the Effectiveness of a Mixed Online-Offline Caregiver Education Program in Rural China." AEA RCT Registry. AEARCTR-0013908. https://doi.org/10.1257/rct.13908-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Andrew Rule* , Shanshan Li , Yiwei Qian , Kelly Reiling

* Primary investigator

Registry ID
AEARCTR-0013908
DOI
https://doi.org/10.1257/rct.13908-1.0
First registered
Last updated
Status
In development
Trial dates
2024-08-01 – 2025-09-01
Countries
Private
Registry record
http://www.socialscienceregistry.org/trials/13908

Abstract

Rates of developmental delay remain high among young children in many low- and middle-income countries. One effective way to promote early childhood development in these settings is through programs in which trainers visit caregivers in the home and teach them activities and skills to stimulate their child’s development. However, such programs have typically been costly and difficult to expand across wide areas or large populations. This study, conducted in rural China, seeks to determine if delivering the trainings partially through a specially designed digital app can increase the scalability of a parenting training program without compromising its effectiveness.

What does the study involve?
The study will be undertaken in 80 villages in three rural counties in a province in central China. Participants are children aged between 6 and 24 months at the time of the survey, as well as their caregivers. Caregivers in 40 villages will receive trainings for one year, with the first two months of trainings occurring in person, and the next ten months occurring over the app (with in-person visits every two months to check in). Caregivers in the other 40 villages will not receive any trainings and will serve as the control group. The primary outcome will be early childhood development. Secondary outcomes will include caregiver mental health, caregivers’ usage and attitudes toward digital programs, caregivers’ attitudes and feelings about parenting, and the amount of time and resources that caregivers put into stimulating their child’s development.

This research will generate rigorous evidence on the impact of government-administered ECD programs on child psychosocial stimulation. The potential benefits of this study are improved cognitive and non-cognitive skills of children. If successful, the intervention will also offer broader insights that can inform future programs and policies to promote early childhood development at scale in rural China.

Intervention

Past research has established that home visit-based parent education programs are effective in promoting cognitively stimulating parenting practices and early child development in households with children under the age of 2 years. The objective of the current study is to determine whether mixed offline and online delivery of parenting trainings can maintain intervention effectiveness while reducing costs and increasing scalability. While parenting trainings will be conducted via in-person home visit during the first two months of the intervention, most trainings beyond this point will occur via prerecorded video through a specially designed app, reducing the number of trainers needed to deliver the trainings throughout the study period. On the village level, the intervention will be implemented by two types of municipal government-affiliated authorities overseeing women’s and family issues in rural areas of China, peer mothers (tongban mama) and children’s committee directors (ertong zhuren). Moreover, local doctors will be asked to send reminder texts to caregivers in the treatment group to remind them to engage with online training materials.

By reducing the number of staff needed overall to conduct trainings and entrusting most village-level implementation to local authorities in the municipal and medical systems, this project design has the potential to be significantly upscaled or expanded to remote reasons with relatively low additional cost. We also take various steps to offset potential negative impacts of offline delivery on the trainings’ effectiveness in promoting ECD, including conducting additional in-home visits every two months during the primarily online delivery period. Therefore, we hypothesize that this mixed online-offline study design will produce significantly positive effects on ECD outcomes comparable to those found in past, fully-offline parenting training interventions.

Experimental design

The Digital Plus project seeks to develop, deliver, and evaluate a multi-stage, mixed-format caregiver education program to target early childhood psychosocial development in rural China. The intervention contains two arms, one that receives the early childhood development education services (treatment) and one that does not (control), and will occur in two phases.

The first phase is fully offline and will last two months. During this phase, caregivers in the treatment group will receive weekly in-home, in-person lessons from parenting trainers recruited for this project. The content of the lessons mostly consists of an activity-based parenting training curriculum that is based the preexisting Reach Up and Learn curriculum and was adapted by the research team with assistance from early childhood development experts in China. In the adapted curriculum, parenting trainers will conduct one session per week that guide caregivers through interactive activities that are designed to stimulate the early development of children between 6 and 36 months old across four dimensions: cognitive, language, motor, and social-emotional skill development. Trainers will also lend caregivers toys and books and instruct them to use these materials to practice that week’s activities before the next session. In addition to the activity-based curriculum, trainers will also deliver feedback about the caregiver’s interactions with the target child using a handbook developed by the research team in partnership with experts from China.

The second phase contains mixed online and offline deployment and will last ten months. During this phase, caregivers will continue to receive activity-based lessons following the parenting curriculum, but the lessons will take the form of prerecorded videos delivered through an app developed for this project. Community health workers will continue to lend caregivers toys and books related to each week’s lesson and will be on hand to assist caregivers if they have questions. Once every two months, the parenting trainers will conduct another home visit to answer questions and offer feedback on the caregiver’s interaction skills using the handbook.

Design details

Randomization method
Randomization done in office by a computer
Randomization unit
Village
Clusters
80 villages
Observations
1280 caregiver-child dyads
Arms
40 villages control, 40 villages treatment
Primary outcomes
The primary outcome of this study is early childhood psychosocial development. This outcome will be measured at baseline and endline (i.e., after 1 year at the end of the trial) using the following scales: 1. Bayley Scales of Infant and Toddler Development, third edition (Bayley-III) 2. Ages and Stages Questionnaires: Social-emotional (ASQ:SE) 3. New Wolke Social-Emotional Behavior Ratings
Secondary outcomes
Secondary outcomes to be measured at baseline and endline (i.e., after 1 year at the end of the trial) include the following: 1. Parenting and attachment style, measured with: 1.1. The World Value Survey 1.2 The Mother’s Object Relations Scale – Short Form (MORS-SF) 2. Parenting stress, measured with the Parenting Stress Index 3. Parental investments in stimulating parenting practices and materials, measured with: 3.1. The Family Care Indicators (FCI) 3.2. Home Observation Measurement of the Environment – Short Form (HOME-SF) 4. Parenting self-efficacy, measured with the TOol to measure Parenting Self-Efficacy (TOPSE) 5. Caregiver mental health, measured using: 5.1. The Patient Health Questionnaire (PHQ) 5.2. The Depression, Anxiety, and Stress Scales, 21 items (DASS-21) 6. Positive perception of daily chores, measured with the Parenting Daily Hassles scale (PDH) 7. Structural and functional social support (community/family), measured with the Multidimensional Scale of Perceived Social Support (MSPSS) 8. Caregiver digital literacy, measured using a self-designed questionnaire 9. Caregiver and child screen exposure

Cited by

No citation data available for this registration yet.

Keywords