Motivations to share true and false information online

How to cite

HENRY, EMERIC; Zhuravskaya, Ekaterina; Guriev, Sergei; Marquis, Theo. 2024. "Motivations to share true and false information online." AEA RCT Registry. AEARCTR-0014074. https://doi.org/10.1257/rct.14074-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

EMERIC HENRY* , Ekaterina Zhuravskaya , Sergei Guriev , Theo Marquis

* Primary investigator

Registry ID
AEARCTR-0014074
DOI
https://doi.org/10.1257/rct.14074-1.0
First registered
Last updated
Status
In development
Trial dates
2024-10-01 – 2024-10-23
Countries
Private
Registry record
http://www.socialscienceregistry.org/trials/14074

Abstract

This study is designed to assess the effect of two alternative policy measures aimed at curbing the dissemination of false news on social media: fact-checking and priming users of social or reputational costs of sharing misinformation. The study will be based on a randomized experiment with actual users of X (formerly Twitter).

The purpose of the study is threefold:
1) Estimate the effect of two policies that have been proposed in the public debate to limit the circulation of fake news, on social media: (1) making reputational or social costs of sharing false news more salient through a nudge and (2) offering fact checking of the content.

2) Using structural estimation, we will estimate parameters of the utility function of shares of news on social media that explain the motivation behind the decision to share news (true or false). In particular, we will estimate how individuals trade off the following 3 motives: partisan persuasion, partisan signaling, and reputation concerns.

3) We will use the results of structural estimation to evaluate the channels through which the policies affect the sharing of true and false news.

Intervention

In the study, the participants will be offered a choice to retweet one of 4 tweets (2 true, 2 false, selected according to a well-defined procedure detailed in the pre-analysis plan) or not to retweet. The treatments will emulate two policies to reduce the circulation of fake news, namely, fact checking and priming fake news circulation. The treatments will be implemented after the presentation of the tweets and before the decision to share.

Experimental design

The experiment aims to study the drivers of the sharing behavior of news. We will conduct an online survey of about 10000 American voting-age individuals on the CINT online platform, restricting our sample to X users.

The survey will have the following phases:
(a) Pre treatment phase: Collecting socio-demographic characteristics, political preferences, Twitter usage
(b) Presentation of 4 tweets in random order (see below)
(c) Treatment phase
(d) Sharing decision (not share or share one of the 4 tweets)
(e) Evaluation of veracity and partisanship of each tweet.

The 4 tweets will be selected according to the following procedure.The aim is to obtain four lists (true democrat, false democrat, true republican, false republican) covering the same distribution of topics that were central in the electoral campaign.
To do this, we first collect all recent false news fact-checked by major fact checking groups. We note that the false news favoring democrats are (much) fewer than false news favoring republicans. We drop from this list all the false news that are not related to federal politics or 2024 elections. We also drop any false news that are related to false images. (As we focus on the text). We, then, from the remaining false news, select 10 most recent false news favoring democrats that cover different topics. (We start with democrat false tweets because this is the most restricted set of false news.) We then select 10 corresponding false news favoring republicans such that we maintain the same distribution across topics as in the list of false news favoring democrats, trying to select the most similar in form and most recent, e.g., most relevant for the elections. We then reformulate these pieces of news into the form of tweets, if they are not in that form initially. We use ChatGPT to help with reformulation.
We then consider the population of the recent tweets from both liberal and conservative media with political news (defined by keywords as detailed below). Then, from this list, we select10 tweets from conservative and 10 tweets from liberal news media. In both cases we follow the same distribution across topics as in the lists of pro-democrat (and pro-republican) 10 false news.

This procedure results in four lists of 10 Tweets :
1) True tweets from conservative media
2) True tweets from liberal media
3) False tweets favoring Democrats
4) False tweets favoring Republicans

Each participant will be shown (in random order) four tweets, one drawn from each list.

Treatment groups:

T1: Control group: Participants proceed to the sharing decision right after seeing the tweets

T2: Offer fact check: After seeing the tweets, we provide participants with the opportunity to see a fact check of the false tweets, before the sharing decision

T3: Prime fake news circulation: After seeing the tweets and before sharing the decision, we warn participants that fake news circulates on social media

Participants will be randomly assigned to one of those three treatment groups.

Design details

Randomization method
The participants to the survey will be randomly allocated to the different groups by the survey platform CINT
Randomization unit
individual
Clusters
na
Observations
10000 survey participants
Arms
One-third of the sample in each treatment group
Primary outcomes
The primary outcome is whether the participant chose to share one of the tweets we show them and if so, which one of the 4 tweets they chose to share (if any).
Secondary outcomes
For each participant, we ask them to evaluate the veracity and the partisanship of each tweet
Sponsors
Name: Project Liberty Institute Location: Paris Url: https://www.sciencespo.fr/nous-soutenir/en/our-projects/developing-the-research/digital-transformations/project-liberty-institute/

Cited by

No citation data available for this registration yet.

Keywords