The Impact of Comments on Social Media Campaigns

How to cite

Song, Lena; Donati, Dante. 2024. "The Impact of Comments on Social Media Campaigns." AEA RCT Registry. AEARCTR-0013812. https://doi.org/10.1257/rct.13812-2.2

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Lena Song* , Dante Donati

* Primary investigator

Registry ID
AEARCTR-0013812
DOI
https://doi.org/10.1257/rct.13812-2.2
First registered
Last updated
Status
Completed
Trial dates
2025-01-15 – 2026-07-01
Countries
United States of America ()
Registry record
http://www.socialscienceregistry.org/trials/13812

Abstract

We measure the causal impact of comment sections on social media posts promoting racial justice. Conducted in two phases, it involves an online field experiment with over millions of Facebook users. We first collect and analyze comments to understand how political ideology influences engagement with posts. We then evaluates how exposure to different comment narratives affects subsequent engagement (comments, views), intentions (clicks), and off-platform behaviors (mailing list sign-up, donations).

Intervention

Our main intervention is to manipulate the comment section on Facebook ads.

Experimental design

We will use tools on Facebook to vary what users see in the comment section of our posts.

Design details

Randomization method
randomization done by a computer (by Meta AB testing technology)
Randomization unit
at the individual level
Clusters
Around 150 clusters
Observations
1.5-2 million Facebook users
Arms
Around 450,000 control (no comments), 450,000 treatment 1 (mixed comments), 450,000 treatment 2 (progressive comments), 450,000 treatment 3 (conservative comments)
Primary outcomes
engagement (comments, views), intentions (clicks), and off-platform behaviors (mailing list sign-up, donations)

Cited by

No citation data available for this registration yet.

Keywords