Evaluating Policy Interventions to Prevent the Spread of Health Misinformation on Social Media: Experimental evidence from the Global South

How to cite

Chandra, Gauri. 2022. "Evaluating Policy Interventions to Prevent the Spread of Health Misinformation on Social Media: Experimental evidence from the Global South." AEA RCT Registry. AEARCTR-0010432. https://doi.org/10.1257/rct.10432-2.1

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Gauri Chandra*

* Primary investigator

Registry ID
AEARCTR-0010432
DOI
https://doi.org/10.1257/rct.10432-2.1
First registered
Last updated
Status
In development
Trial dates
2022-11-25 – 2023-09-30
Countries
Private
JEL codes
D83, D91, I12, I18.
Registry record
http://www.socialscienceregistry.org/trials/10432

Abstract

Belief in misinformation causes confusion, reduces trust in authorities and encourages risky behaviours that can cause significant harm to health, as exemplified by the COVID-19 pandemic. Social media platforms have taken several policy measures to address this challenge; working with independent fact-checking companies to label inaccurate content, promoting verified information through prompts of fact-checked articles, or tailoring the algorithm to demote false posts in the newsfeed. But how effective are these measures? I aim to address this issue with a focus on Facebook and its policies to combat health-related misinformation in the context of the Global South. My study has three key goals. First, using an online survey experiment I will evaluate the effectiveness of a specific label currently used by Facebook to debunk misinformation. Second, I aim to examine design tweaks informed by behavioural science to improve the effectiveness of the existing labels. Finally, I will examine if introducing a very low-cost and scalable digital media literacy intervention increase discernment between true and false, as well as increases the effectiveness of the label in debunking misinformation. I will collect data in two waves, spaced two weeks apart to measure if the effects endure over a period of time.

Intervention

I am testing the effects of a specific label used by Facebook to flag inaccurate posts as such.

Interventions:
1. Label attached to inaccurate posts by third-party fact-checking organisations working with Meta
2. A slightly modified label that is more salient than the original one.
3. Original label + Digital media literacy intervention (a simple low-cost and scalable intervention)

Experimental design

I will use a between-subjects design.

Design details

Randomization method
Online randmonisation by Qualtrics algorithm
Randomization unit
Individual
Clusters
4800
Observations
4800
Arms
600 per treatment arm, per stimuli
Primary outcomes
Perceived accuracy of the claims contained in the posts Intention to share the posts Intention to read an article related to the post (demand for facts)
Secondary outcomes
Performance on the cognitive reflection test Trust in science, experts and authorities; Conspiracist ideation

Cited by

No citation data available for this registration yet.

Keywords