Supporting healthier pregnancies and early child development one text at a time: Can personalized text messages, increased community participation and incentives to service providers help improve pregnancy and early childhood outcomes?
How to cite
Aguilar, Arturo; Gaitan, Pablo; Szteliga, Natalia; Gonzalez, Cristina Barnard; Silva, Monica Wills; Ita, Rodrigo Gonzalez de; Villar, Francisco del; Metland, Daphne; Ravenscroft, Luke; Kettle, Stewart; Vilar, Mireya; Vargas, Manett. 2016. "Supporting healthier pregnancies and early child development one text at a time: Can personalized text messages, increased community participation and incentives to service providers help improve pregnancy and early childhood outcomes?." AEA RCT Registry. AEARCTR-0001035. https://doi.org/10.1257/rct.1035-2.0
Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.
* Primary investigator
Abstract
This project seeks to improve maternal health, birth outcomes and early child development, by empowering mothers through a SMS information system. The SMS information system is targeted at beneficiaries of Prospera, Mexico’s conditional cash transfer programme (formerly known as Progresa and Oportunidades). The SMS information system consists of appointment reminders, prompts to plan for birth and emergencies, information on potential concerns, and preventative health care advice. SMS are sent in a personalized manner using administrative information, medical records and the responses from the beneficiaries to SMS. The two-way system also allows beneficiaries to seek emergency care, report health concerns and change their regular appointments.
Three treatments variations will be evaluated with a randomized control trial (RCT) design. The first treatment arm will test the impact of the two-way information system. The second variation will test the SMS system with additional messages from local community members. Finally, the third group will test the SMS system with the additional component of enabling beneficiaries to provide feedback on the health services received. The feedback collected on the quality of the clinic services will be later used to provide incentives to clinic personnel.
Rigorous evidence about potential changes in habits, knowledge, health service demand, anthropometrics and developmental outcomes will be explored.
Intervention
The presented project (hereon Opening Prosperity) seeks to improve the delivery and impact of health services provided by Prospera. It was designed with the purpose of improving maternal health, birth outcomes and early child development of Prospera beneficiaries through timely and personalized SMS with healthcare information. Opening Prosperity consists of a two-way SMS information tool using RapidPro, an open source SMS tool designed by UNICEF. The messages were personalized and tailored to the specific circumstances of each participant using three sources of information: beneficiaries’ response to messages, Prospera administrative information, and clinical history information.
The design and content of messages to be sent during pregnancy, puerperium and early child stages was developed by the Behavioral Insights Team and BabyCenter. Que Funciona para el Desarrollo helped in the revision, translation and adaptation of messages to meet the platform requirements. The development of the messages also benefited from the expert advice from the Ministry of Health in the UK and in Mexico. Finally, the messages were revised by the Ministry of Health in Mexico to ensure compatibility with the information delivered to beneficiaries. The messages include a variety of topics relevant for pre- and post-natal care, such as: appointment reminders, prompts to plan for birth and emergencies, identification and what to do in case of potential concerns and alarm signs, preventative health care advice, lactation tips, vaccination reminders, among others. Additional flows of messages were also included to enable beneficiaries to seek emergency care, express health concerns, and change their checkup appointments through the platform. All these components are thought as complements to their regular clinic visits, which remain one of the mandatory conditionalities of Prospera.
Two rounds of training sessions with beneficiaries were scheduled at the clinic level. The SMS platform runs through a free number that was provided by the two major cell phone companies in Mexico. Non-Prospera pregnant women can also sign up to receive the messages. However, they are not invited to the training event and messages could have a regular SMS cost to them.
Beneficiaries in the first variation of the programme will only be receiving the SMS through the platform. In the second variation community members, which comprise Prospera vocales (beneficiaries elected at the community level to act as local programme representative) or health promoters, actively participate. This variation seeks to test whether the support of a local network can influence the behavior of pregnant women and encourage usage of the platform. Community members’ participation will happen in two main ways. First, community members attend the initial training session and sign mock contracts with the beneficiaries to obtain a commitment from them on either attending all their prenatal checkup visits, taking their pregnancy supplements (e.g. folic acid) or responding to all the messages. Second, community members are encouraged to send pre-designed messages with certain regularity to support the beneficiaries’ pregnancy.
Finally, the third variation enables the users to send feedback through SMS on the service provided by the clinic. By replying to SMS, beneficiaries are able to report compliance of basic protocols that should be followed during checkups and to evaluate the quality of the service provided in the clinic. To protect the beneficiaries, only a subset of the beneficiaries will receive messages asking them to evaluate the clinic, and anonymity will be guaranteed at all times. Based on the information gathered, clinics will receive information of the beneficiaries’ responses and how they compare to similar clinics in terms of geography and size. The best performing clinics will receive a set of incentives.
Experimental design
The unit of randomisation is the primary-level health clinic and the unit of analysis is the pregnant woman or her child. Each health clinic in the country is associated with a set of localities. Thus, the clinic conforms a cluster, with beneficiaries located in associated localities.
Clinics are randomly assigned to a control group or to one of three treatment arms. The control group means that Prospera beneficiaries are not offered any of the intervention components. Pregnant women and children that would have been eligible for the program will be tracked during the study.
The main component of the intervention, which consists of the delivery of personalized messages and the ability to contact health authorities to report emergencies and health concerns, is delivered to the three treatment arms. Thus, the comparison of the control group and treatment arm one will allow the research team to evaluate the impact of the main component in isolation. The comparison of the control group and the three treatment arms (grouped) allows to evaluate the impact of the project’s components.
Treatment arm two receives the second component of the project, which consists of the local network interaction, in addition to the main component. The comparison of treatment arms one and two will give evidence of the additional effect that results from the local network interaction. Since both groups receive the main component, this comparison will not convey the local network effect by itself since there is a potential complementarity between the main component and the local network interaction.
Treatment arm three receives the third component of the project, which consist of the possibility to evaluate and report compliance of health service received, in addition to the main component. The comparison of treatment arms one and three will give evidence of the additional evaluation and incentives component. Similarly as described above, the component will not be identified in isolation since there are possible complementarities with the main component.
The sample of clinics for the study contains 655 clinics located in five states: Chiapas, Guanajuato, Hidalgo, Puebla, and the State of Mexico. The five states contribute to the heterogeneity of the project. The following filters were implemented to determine the set of clinics where the study could be feasibly carried out: (i) hospitals, administrative buildings itinerant clinics and units administered by the municipality were excluded, (ii) clinics with less than five estimated Prospera pregnant beneficiaries are excluded, (iii) clinics in localities with no mobile signal available are excluded, and (iv) clinics in localities where less than 80% of females between 13 and 35 speak Spanish were excluded.
The set of clinics that remain after implementing these set of filters represent our population. We keep the clinics from the five selected states since a greater mass of clinics was found and the states represent very different contexts. Finally, to select the clinics for the study from these five states, a greedy algorithm was used with the objective of selecting clinics that maximize the distance between each other while keeping a representative sample with respect to the population of clinics. The reason for this is to ensure SUTVA and reduce the risk of contamination.
Once the clinics were selected, they were instructed to invite every pregnant Prospera beneficiary that had less than 32 weeks of gestational age. This restriction seek that the beneficiaries had exposure to the program at least 8 weeks.
Throughout the pregnancy a beneficiary will receive around 580 SMS. By the end of 2016 approximately 6550 beneficiaries will be part of the trial, half of them will be in treatment localities. We expect to have results from the impact evaluation by 2017.
Design details
Cited by
No citation data available for this registration yet.