COVID-19 Thanksgiving Messaging at Scale
How to cite
Duflo, Esther. 2020. "COVID-19 Thanksgiving Messaging at Scale." AEA RCT Registry. AEARCTR-0006821. https://doi.org/10.1257/rct.6821-2.0
Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.
* Primary investigator
Abstract
In prior work, we have found that video messages delivered by doctors increase knowledge of COVID-19, and in some cases, lead to viewers taking actions consistent with the messaging. In a scale-up phase, we plan to use Facebook ads to show a 15 second video clip recorded by 6 MGH, Harvard and Lynn Community health center doctors to approximately 40,000,000 Facebook users. The ads will be shown between November 14-29 and focus on staying safe – limiting travel, social distancing and mask-wearing. We are randomizing exposure to the ad campaign at the ZIP code and county level to study whether the videos change mobility and Thanksgiving holiday travel and whether there are any detectable impacts on the spread of COVID-19. Using information about Facebook social network connections and mobility patterns between counties, we also plan to measure whether exposure to the ad campaign spilled over along the network.
Following the completion of the Thanksgiving intervention, we implemented a follow-on Christmas intervention with the same two-stage research design, re-randomized in the same 13 states. Videos recorded by nurses and physicians encouraging people to stay home for Christmas were again pushed as ads to Facebook users.
Intervention
Facebook users will be exposed to an ad campaign featuring a set of videos about Thanksgiving travel. 6 doctors from MGH, Harvard and Lynn Community health center have each recorded one short message (15 seconds) using an identical script: “This Thanksgiving, the best way to show your love is to stay home. If you do visit, wear a mask at all times. I'm Dr. XX from XX, and I'm urging you: don't risk spreading COVID. Stay safe, stay home.”
The video messages will be posted to a project Facebook page titled "The Doctors for Coronavirus Prevention Project". Users will see the ads and the name of the Facebook group associated with the ads on their feeds. Watching the videos in the ad posts is completely optional for Facebook users.
Within treated geographies, Facebook's algorithm will be used to place the ads. We expect each treated individual to see the ads approximately 3 times over the course of the ad campaign.
The same intervention protocols were followed again prior to the Christmas holiday with a new set of messages recorded by doctors and nurses.
Experimental design
Individuals in treatment geographies selected by Facebook's algorithms to be exposed to the ad campaign view videos on their Facebook feeds approximately 3 times during the duration of the campaign. Individuals in control geographies receive no treatment.
We rolled out the campaign in 2 phases:
Phase 1:
13 states were chosen based on the availability of zip-code level COVID-19 data. We used a 2-stage randomization with both county and zip-code level variation:
- 50% of counties in the 13 states were assigned to Low Intensity treatment
- 25% of zip codes in the low intensity counties were assigned to treatment
- 50% of counties in the 13 states were assigned to High Intensity treatment
- 75% of zip codes in the high intensity counties were assigned to treatment
The campaign began on November 14 and will run through November 29.
Phase 2:
Facebook was interested in scaling up the campaign to 15 additional states with high COVID-19 case rates and relatively low levels of compliance with preventative behaviors. Given Facebook's budget constraint, we randomized 80% of counties in these 15 states to receive the treatment. The campaign began on November 23 and will run through November 29.
Design details
Papers from this trial
- arXiv:2106.11012 https://arxiv.org/abs/2106.11012
Cited by
No citation data available for this registration yet.