Can targeted messages reduce COVID-19 vaccination hesitancy? A randomized trial

How to cite

Reddinger, Lucas; Levine, David; Charness, Gary. 2021. "Can targeted messages reduce COVID-19 vaccination hesitancy? A randomized trial." AEA RCT Registry. AEARCTR-0007478. https://doi.org/10.1257/rct.7478-3.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Lucas Reddinger* , David Levine , Gary Charness

* Primary investigator

Registry ID
AEARCTR-0007478
DOI
https://doi.org/10.1257/rct.7478-3.0
First registered
Last updated
Status
Completed
Trial dates
2021-04-07 – 2021-04-30
Countries
United States of America ()
Secondary IDs
NIH 2P30AG012839
Registry record
http://www.socialscienceregistry.org/trials/7478

Abstract

Widespread vaccination is certainly a critical element in successfully fighting the COVID-19 pandemic. We apply theories of social identity to design targeted messaging to reduce vaccine hesitancy among groups with low vaccine uptake, such as African Americans and political conservatives. We conducted an online experiment from April 7 to 27, 2021, that oversampled Black, Latinx, conservative, and religious U.S. residents. We first solicited the vaccination status of over 10,000 individuals. Of the 4,609 individuals who reported being unvaccinated, 4,190 enrolled in our covariate-adaptive randomized trial. We provided participants messages that presented the health risks of COVID-19 to oneself and others; they also received messages about the benefits of a COVID-19 vaccine and an endorsement by a celebrity. Messages were randomly tailored to each participant’s identities—Black, Latinx, conservative, religious, or being a parent. Respondents reported their intent to obtain the vaccine for oneself and, if a parent, for one’s child. We report results for the 2,621 unvaccinated respondents who passed an incentivized manipulation check. We find no support for the hypothesis that customized messages or endorsers reduce vaccine hesitancy among our segments. A post hoc analysis finds evidence that a vaccine endorsement from Dr. Fauci reduces stated intent to vaccinate among conservatives. We find no evidence that tailoring public-health communication regarding COVID-19 vaccination for broad demographic groups would increase its effectiveness. We recommend further research on communicators and endorsers, as well as incentives.

Intervention

Consult attached documents.

Experimental design

We survey US residents on the Prolific survey platform. Our goal is to survey individuals who have not yet taken a COVID-19 vaccine dose. Because Prolific offers a pre-screening question on this, we start with individuals who have previously reported to Prolific as not yet having taken a vaccine dose (N=5912 as of April 2). Because this status changes quickly for individuals, we conduct our own pre-screening as well. We will target recruitment towards African-Americans, people who identify as Hispanic or Latina/o/x, people who voted for Trump in 2020, and those who participate in weekly religious activities.

The survey begins with an introduction and some demographic questions.

Treatment depends on five particular segments: African-Americans, those who identify as Hispanic or Latina/o/x, those who report having voted for Trump in the 2020 presidential election (or if neither a Biden nor Trump voter, consider themselves conservative), those who report participating in weekly religious activities, and parents. Because subjects can be members of multiple segments, we have 32 sub-segments in total on which treatment may depend.

We present message components about a hypothetical COVID-19 vaccine. Some message components are shown to all subjects. Other message components vary between subjects, dependent on the subject’s sub-segment. For example, a Black parent’s message components will be randomly drawn from one set, whereas a religious conservative’s message components will be randomly drawn from a different set. These are outlined in the attached supporting documents.

After receiving about 10 message components, subjects are given an incentivized manipulation check question. Subjects are then asked questions about their intent to vaccinate, their intended delay in vaccination, their intent to vaccinate their children (if a parent), and their history of COVID-19.

Design details

Randomization method
Qualtrics balanced randomizers.
Randomization unit
Treatment is jointly determined by individual-level randomization and individual characteristics.
Clusters
Individual characteristics result in 32 sub-segment quasi-clusters.
Observations
Our initial plan was to collect responses from 6,500 to 7,000 individuals. However, our sample pool is much more limited than we predicted. We anticipate stopping data collection with about 4,000 individuals.
Arms
The experiment creates an intensity of treatment. For exact randomization procedures, please consult attached documents.
Primary outcomes
Stated intent to take a hypothetical COVID-19 vaccine. Stated delay to take a hypothetical COVID-19 vaccine. Stated intent to obtain a hypothetical COVID-19 vaccine for one’s child.
Sponsors
Name: University of California, Berkeley, Center on the Economics and Demography of Aging Location: Berkeley, CA Url: http://ceda.berkeley.edu/

Materials

Papers from this trial

  1. Reddinger, J. L., David Levine, and Gary Charness. 2022. "Can theories of social identity help increase uptake of a COVID-19 vaccine? A randomized trial". Preventive Medicine Reports 29 (October) 101903. https://doi.org/10.1016/j.pmedr.2022.101903

Cited by

No citation data available for this registration yet.

Keywords