Harnessing social media influencers or using X ads to combat misinformation?

How to cite

Larreguy, Horacio; Bandiera, Antonella; Barrutia, Joaquin; Bowles, Jeremy; Liu, Shelley; Marshall, John; Zago, Eduardo. 2024. "Harnessing social media influencers or using X ads to combat misinformation?." AEA RCT Registry. AEARCTR-0014139. https://doi.org/10.1257/rct.14139-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Horacio Larreguy* , Antonella Bandiera , Joaquin Barrutia , Jeremy Bowles , Shelley Liu , John Marshall , Eduardo Zago

* Primary investigator

Registry ID
AEARCTR-0014139
DOI
https://doi.org/10.1257/rct.14139-1.0
First registered
Last updated
Status
On going
Trial dates
2022-10-01 – 2024-12-31
Countries
Kenya (), South Africa ()
Registry record
http://www.socialscienceregistry.org/trials/14139

Abstract

In partnership with the fact-checker Africa Check, we assess whether social media influencers (SMIs) can be effectively recruited to increase awareness of, and knowledge about, misinformation among their social media audiences. Our partnering fact-checker recruited ``micro'' SMIs---individuals, such as journalists and social activists, with significant followings---on Twitter in Kenya and South Africa. We then provided a random half of the SMIs with digital literacy training videos, as well as contemporaneous fact-checks, for them to share with their audiences through social media. We additionally cross-randomized the dissemination of identical content to their audiences via regular Twitter ads to compare whether SMIs are more effective than ads in ensuring that digital literacy training and fact checks reach and are internalized by their followers. This at-scale intervention ultimately seeks to understand how fact-checking institutions can effectively combat misinformation.

Intervention

In partnership with Africa Check, the first and largest fact-checking organization in sub-Saharan Africa, we ask whether ``micro'' social media influencers (SMIs) can be recruited to increase awareness and knowledge of misinformation among their online audiences by posting digital literacy training materials and fact-checks. The effectiveness of fact-checking interventions relies heavily on users' trust in and attention to a source. Consequently, micro SMIs with engaged audiences may be an especially effective mode of delivery to target large numbers of individuals at minimal cost. However, this raises a critical question: can such SMIs be incentivized to disseminate information about misinformation? And will their followers engage with it? While piloting indicated that financial incentives for posting digital literacy training materials and fact-checks are required for compliance (in the form of compensating the fact-checkers for internet data costs and time), their effectiveness is unclear. To benchmark the effectiveness of leveraging SMIs to disseminate digital literacy training materials and fact-checks, we additionally use an equivalent amount of funds to instead target ads to social media followers. Our goal is to inform the programming decisions that fact-checkers face relating to how to optimally mitigate misinformation's potentially deleterious effects.

Experimental design

Followers of SMIs participating in the study were, at random, either (1) treated with information from one or more SMIs they followed, (2) treated with information from ads, (3) treated with both, or (4) assigned to receive no information as part of this intervention.

Following the recruitment and randomization of SMIs and followers, the intervention then proceeded as follows. Over the course of eight weeks, treated SMIs in each phase of the intervention received materials from Africa Check twice a week and were encouraged to tweet about these materials to their followers. Africa Check used Twitter's ad targeting tool around the same days that treated SMIs to promote the same materials to treated followers. The research team tracked selected SMI followers' social media activity throughout the eight weeks of treatment and four weeks after.

Design details

Randomization method
In office by a computer.
Randomization unit
Social media influencers and their followers.
Clusters
Not applicable.
Observations
Around 200,000 followers of 262 social media influencers.
Arms
The 200,000 followers are split roughly equally across the four treatment arms.
Primary outcomes
Our outcomes are organized into six subcategories: activity, verifiability, fake/true, topic sentiment, URLs, and interactions. For each subcategory, we define and, in some cases, create various outcome variables that enable us to assess the impact of the intervention on users' overall behavior.
Sponsors
Name: SSRC - Mercury Project Location: United States Url: https://www.ssrc.org/programs/the-mercury-project/ Name: New Venture Fund Location: United States Url: https://newventurefund.org/
Partners
Name: Africa Check Partner_type: ngo Url: https://africacheck.org/

Cited by

No citation data available for this registration yet.

Keywords