Information Interventions about Deepfakes and their Impact on News Consumption

How to cite

Sen, Ananya; Campante, Filipe; Durante, Ruben; Hagemeister, Felix. 2025. "Information Interventions about Deepfakes and their Impact on News Consumption." AEA RCT Registry. AEARCTR-0016741. https://doi.org/10.1257/rct.16741-1.1

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Ananya Sen* , Filipe Campante , Ruben Durante , Felix Hagemeister

* Primary investigator

Registry ID
AEARCTR-0016741
DOI
https://doi.org/10.1257/rct.16741-1.1
First registered
Last updated
Status
Completed
Trial dates
2025-09-12 – 2025-10-01
Countries
Germany ()
JEL codes
D91, L82
Registry record
http://www.socialscienceregistry.org/trials/16741

Abstract

This study aims to understand the impact of providing information about the potential of AI to generate misinformation (deepfakes) on news consumption and subscription outcomes. In particular, the key idea is that highlighting the ability of AI to generate seemingly real content encourages news consumers to engage more with a trusted outlet. We partner with a large news outlet in Germany to test this by encouraging users to engage with custom-created content. In particular, as part of the field experiment, we utilize the mailing list of our partner news organization. We use approximately 150,000 subscribers as part of the experiment, who are then randomly split into three groups. In the treatment group, readers gain access to an AI literacy article that highlights ways to identify deepfake videos better. In this process, readers are encouraged to take a quiz that tests their ability to identify AI-generated videos and based on each question, the article will provide dimensions of videos that readers should look out for.

This intervention will test an active approach that can be taken by a news outlet to combat technology-enabled misinformation. The direction and magnitude of the results can have an important impact on how we design policies to combat misinformation and have individuals engage with high-quality news, which in turn provides incentives to news outlets to keep investing in writing stories with important societal implications.

As a benchmark to quantify the treatment effects, we will also have two control conditions. In the first control condition, we will email another group a link to a different, yet comparable, news story from SZ. This will account for changes in browsing and subscription behavior resulting from an email from the news organization itself. A final control group will receive no email, and we will track their browsing and subscription behavior as a "pure control" group.

Intervention

We use approximately 150,000 subscribers as part of the experiment, who are then randomly split into three groups. In the treatment group, readers gain access to an AI literacy article that highlights ways to identify deepfake videos better as they go through a quiz.

As a benchmark to quantify the treatment effects, we will also have two control conditions. In the first control condition, we will email a group a link to a different SZ news story. This will account for changes in browsing and subscription behavior resulting from an email from the news organization itself. A final control group will receive no email, and we will track their browsing and subscription behavior as a "pure control" group.

Experimental design

We use approximately 150,000 subscribers as part of the experiment, who are then randomly split into three groups. In the treatment group, readers gain access to an AI literacy article that highlights ways to identify deepfake videos better. They will be guided through different techniques to spot deepfakes as they are encouraged to take a quiz that tests their ability to identify AI-generated videos.

We will also have two control conditions. In the first control condition, we will email a group of individuals on the mailing list a link to a different SZ news story. This will account for changes in browsing and subscription behavior resulting from an email from the news organization itself. A final control group will receive no email, and we will track their browsing and subscription behavior as a "pure control" group.

We will employ a between-subjects design, such that an individual on the mailing list will be assigned to one of the treatments. The main outcome variables of interest will be their subsequent browsing and subscription behavior.

We will also explore heterogeneity along two dimensions: (1) their prior news consumption and (2) their prior knowledge based on topics they consume on the platform

Design details

Randomization method
Randomization will be done with a computer software.
Randomization unit
Individual reader
Clusters
--
Observations
About 150,000 -- this could be subject to some change based on survey uptake and traffic allocation by the company.
Arms
50,000
Primary outcomes
(1) Browsing on the SZ platform. (2) Subscribing to SZ.

Cited by

No citation data available for this registration yet.

Keywords