Exploring the external validity of debunking “fake news” on social media via fact checking and media literacy interventions
How to cite
Berger, Lara Marie; Kerkhof, Anna; Münster, Johannes; Mindl, Felix. 2024. "Exploring the external validity of debunking “fake news” on social media via fact checking and media literacy interventions." AEA RCT Registry. AEARCTR-0013629. https://doi.org/10.1257/rct.13629-1.0
Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.
* Primary investigator
Abstract
This study builds on our results from the project "Debunking “fake news” on social media: short-term, long-term, and spillover effects of fact check and media literacy interventions", which was pre-registered under the RCT ID AEARCTR-0008199. In our original study we analyzed the effectiveness of fact-checking and media literacy interventions in the context of Covid-19- and other health-related posts on social media. With this follow-up study we aim to better understand the external validity of our findings by taking the interventions to a new context (replacing the fake news and facts about Covid-19 with fake news and facts about environmental topics). Additionally, we want to understand if and how the degree of the credibility of a certain fake is related to the effectiveness of an intervention.
Intervention
1) Fact check intervention
2) Media literacy intervention
Each intervention is tested for high-credibility fakes and low-credibility fakes (2x3 design).
See Experimental Design for details.
Experimental design
We will expose the participants to fakes and facts on environmental and health-related topics that we retrieve from Facebook.
The participants will be randomly divided into six groups:
- Participants who are exposed to high-credibility fakes and facts --> Control group high
- Participants who are exposed to low-credibility fakes and facts --> Control group low
- Participants who are exposed to high-credibility fakes and facts and fact checks that debunk the fake news --> Fact check intervention high
- Participants who are exposed to low-credibility fakes and facts and fact checks that debunk the fake news --> Fact check intervention low
- Participants who are shown Facebook’s “Tips how to spot false news” and are afterwards exposed to high-credibility fakes and facts --> Media literacy intervention high
- Participants who are shown Facebook’s “Tips how to spot false news” and are afterwards exposed to low-credibility fakes and facts --> Media literacy intervention low
The environment-related fakes participants are exposed to have been rated as more-credible or less-credible in a pre-study. Participants in the "high" groups are exposed to two fakes which have been rated as more-credible, while participants in the "low" groups see two fakes which have been rated as less-credible. The facts and health-related fakes and facts are identical in all groups. The order in which the fakes and facts are displayed will be randomized. We also randomize whether participants in the fact check group see the fact check before or after the corresponding fake.
To study the effects of the fact check and the media literacy intervention, we will compare participants’ perceived credibility of the “fake news” to participants who saw the fakes and facts, but did not receive an intervention (always comparing the high groups to one another and the low groups to the other low groups). To study the effect of the degree of credibility we will compare the coefficients for the treatment effects in the high groups to the coefficients for the treatment effects in the low groups.
Estimation procedure:
Our main regressions estimate the effect of the treatment group dummies on the perceived credibility of “fake news”. Control variables include age, gender, family status, income, education, “big 5”, political preferences, and prior knowledge on current events, health, and nutrition.
We hypothesize the following effects:
1) The fact checking intervention reduces the credibility of the „fake news” as compared to participants without intervention.
2) The media literacy intervention reduces the credibility of the „fake news” as compared to participants without intervention.
3) The effects of both interventions are higher for fakes which are ex-ante rated as less credible.
Design details
Cited by
No citation data available for this registration yet.