Testing SMS interventions to increase COVID-19 vaccination completion in Kenya

How to cite

Carney, Kevin; Maffioli, Elisa; Rosenzweig, Leah; Wong, Wendy. 2022. "Testing SMS interventions to increase COVID-19 vaccination completion in Kenya." AEA RCT Registry. AEARCTR-0009930. https://doi.org/10.1257/rct.9930-2.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Kevin Carney* , Elisa Maffioli , Leah Rosenzweig , Wendy Wong

* Primary investigator

Registry ID
AEARCTR-0009930
DOI
https://doi.org/10.1257/rct.9930-2.0
First registered
Last updated
Status
Completed
Trial dates
2022-07-22 – 2023-02-15
Countries
Kenya (Kisumu)
Registry record
http://www.socialscienceregistry.org/trials/9930

Abstract

This study tests SMS messages designed to increase completion rates among people who received a first but not second dose of the COVID-19 vaccine. Partnering with the Kisumu County Department of Health, four experiments were conducted to test a series of SMS- based interventions aimed at encouraging participants who had already been vaccinated for COVID-19 once to complete their vaccination regimen. The first experiment focuses on messages related to different reasons to get vaccinated. The subsequent experiments tests different deadlines to get the vaccine and obtain an airtime benefit for doing so.

Intervention

Experiment 1 Messages: Framing the Benefits of Getting Vaccinated
1. Control: No message
2. Reminder: Reminder from Kisumu MOH to finish your COVID-19 vaccination.
3. Reminder + info: Reminder from Kisumu MOH to finish your COVID-19 vaccination. Reply 1 (no cost) for more info.
4. Reserved for you: Reminder from Kisumu MOH to finish your COVID-19 vaccination. Your 2nd jab has been reserved for you. Reply 1 (no cost) for more info.
5. COVID side effects: Reminder from Kisumu MOH to finish your COVID-19 vaccination. Mild side effects are normal & mean you are building protection. Reply 1 (no cost) for more info.
6. Duty: Reminder from Kisumu MOH to finish your COVID-19 vaccination. It’s our duty to protect each other. Vaccination is part of that. Reply 1 (no cost) for more info.
7. COVID still a threat: Reminder from Kisumu MOH to finish your COVID-19 vaccination. COVID-19 is still out there. Get your 2nd jab today! Reply 1 (no cost) for more info.
8. Time-limited reimbursement - deadline of one week: Reminder from Kisumu MOH to finish your COVID-19 vaccination. Get your 2nd jab in the next week and receive 100/= airtime! Reply 1 (no cost) for more info.

Experiment 2 Messages: Optimizing the Timing of Vaccination Benefits
1. Control: No message
2. Reminder: Reminder from Kisumu MOH to finish your COVID-19 vaccination.
3. Reminder + info: Reminder from Kisumu MOH to finish your COVID-19 vaccination. Reply 1 (no cost) for more info.
4. Time-limited reimbursement - deadline of current day: Reminder from Kisumu MOH to finish your COVID-19 vaccination. Get your 2nd jab today and receive 100/= airtime! Reply 1 (no cost) for more info.
5. Time-limited reimbursement - deadline of one week: Reminder from Kisumu MOH to finish your COVID-19 vaccination. Get your 2nd jab in the next week and receive 100/= airtime! Reply 1 (no cost) for more info.
6. No limit reimbursement (with reimbursement valid for one month): Reminder from Kisumu MOH to finish your COVID-19 vaccination. Get your 2nd jab and receive 100/= airtime! Reply 1 (no cost) for more info.
7. Scarcity: Reminder from Kisumu MOH to finish your COVID-19 vaccination. Hurry! The next 100 to get a 2nd jab receive 100/= airtime. Reply 1 (no cost) for more info.

Experiment 3 and 4 Messages: Optimizing the Timing of Vaccination Benefits
1. Control: No message
2. Reminder: Reminder from Kisumu MOH to finish your COVID-19 vaccination.
3. Reminder + info: Reminder from Kisumu MOH to finish your COVID-19 vaccination. Reply 1 (no cost) for more info.
4. Time-limited reimbursement - deadline of current day: Reminder from Kisumu MOH to finish your COVID-19 vaccination. Get your 2nd jab today and receive 100/= airtime! Reply 1 (no cost) for more info.
5. Time-limited reimbursement - deadline of one week: Reminder from Kisumu MOH to finish your COVID-19 vaccination. Get your 2nd jab in the next week and receive 100/= airtime! Reply 1 (no cost) for more info.

Upon replying 1, respondents receive an SMS stating: Your 2nd vaccine dose reduces your risk of getting COVID-19 & severe illness. Available for free at most health facilities. Full facilities list: [tracked link to facilities]

Where airtime is offered, upon replying 1, respondents will also receive an SMS stating: 100/= airtime will be sent to your phone if you reply here with the facility name and date where you got your 2nd jab. Offer not transferable.

Experimental design

This study involves the 29,474 people in three subcounties of Kisumu County who had received a first, but not second, dose of the COVID-19 vaccine as of July 17, 2022. The subcounties included in the study are Kisumu Central, Kisumu West, and Nyakach. These particular subcounties were chosen to exclude locations where the Kisumu County Department of Health already had other COVID-19 experiments ongoing in partnership with our research team.

The two experiments described above were scheduled to occur approximately one week apart. Half of the individuals were randomized to the first experiment, and half to the second. Within each experiment, individuals were randomized in equal proportions into the eight treatment conditions listed above (seven messages and one control group). Each individual within a trial received the message assigned to them at the same time, and received any relevant follow-up messages immediately upon replying “1”. This is the extent of the interventions.

Design details

Randomization method
Randomization occurred at the individual level and was stratified on observables in the vaccination database: gender, age (using an indicator for being above age 35), and subcounty where the first vaccination dose occurred. The randomization process occurred in an office on a computer.
Randomization unit
Individual
Clusters
N/A
Observations
26,755
Arms
Experiment 1 1. Control: 1,834 2. Baseline reminder: 1,842 3. Baseline reminder + info: 1,846 4. Reserved for you: 1,842 5. Covid side effects: 1,842 6. Duty: 1,843 7. Covid is still a threat: 1,841 8. Airtime (1 week deadline): 1,846 Experiment 2 1. Control: 1,710 2. Baseline reminder: 1,716 3. Baseline reminder + info: 1,719 4. Time-limited reimbursement - deadline of current day: 1,716 5. Time-limited reimbursement - deadline of one week: 1,719 6. No limit reimbursement (with reimbursement valid for one month): 1,716 7. Scarcity: 1,726
Primary outcomes
Rates of completion of the full, two-dose vaccination course. Vaccination completion rates will be measured at several points in time using administrative data from the Kisumu County Department of Health. The primary outcome will be the rate of full (two-dose) vaccination. The speed of second-dose completion will also be analyzed.
Secondary outcomes
To supplement the administrative vaccination records, the SMS system will also collect data on people’s engagement with (responses to) the intervention messages. The first outcome to analyze is the rate at which participants reply “1” in each of the conditions where they are invited to do so. The second outcome is the rate at which participants click the link they are provided upon replying “1,” measured using an individualized link for each treatment condition. The final outcome is the response rate in the airtime conditions when people are asked to reply with their vaccination date and location.

Cited by

No citation data available for this registration yet.

Keywords