Improving User Experience on Social Media. A Field Experiment

How to cite

Stalinski, Mateusz; Beknazar-Yuzbashev, George; Crosky, Jesse Mc; Jimenez, Rafael. 2022. "Improving User Experience on Social Media. A Field Experiment." AEA RCT Registry. AEARCTR-0009628. https://doi.org/10.1257/rct.9628-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Mateusz Stalinski* , George Beknazar-Yuzbashev , Jesse Mc Crosky , Rafael Jimenez

* Primary investigator

Registry ID
AEARCTR-0009628
DOI
https://doi.org/10.1257/rct.9628-1.0
First registered
Last updated
Status
In development
Trial dates
2022-07-06 – 2023-02-01
Countries
Private
Registry record
http://www.socialscienceregistry.org/trials/9628

Abstract

This is a field experimental study on social media. More details will be available after the trial is completed.

Experimental design

The experimental design description is hidden until the end of the trial.

Design details

Randomization method
After the user installs the browser extension (and agrees to the data collection), the extension (using JavaScript) generates a random number between 0 and 1. If the number exceeds 0.5, the user is assigned one of the treatments. If it is below 0.5, the user is assigned the other.
Randomization unit
Individual
Clusters
The number of clusters/observations depends on how successful we will be in promoting the browser extension (it will be promoted through advertisement on Twitter and by the Mozilla Foundation). In particular, the second component is difficult to estimate. However, a rough prediction is that the number of observations should be in the range of 1000-2000.
Observations
The same as the number of clusters.
Arms
We randomly assign units to treatments with equal probabilities. Therefore, half of the observations should be in the treatment group and the other half in the control.
Primary outcomes
Average time (per day) spent on Twitter, Facebook, and YouTube (in minutes) Heterogeneity: We will look at heterogeneity with respect to the median level of toxicity that the user is exposed to during the observation period preceding the intervention. In particular, we will look separately at users with above-median toxicity and below-median toxicity.
Secondary outcomes
1. A measure of the average amount of content consumed on Twitter, Facebook, YouTube. 2. Average time spent on other social media platforms -- where we do not conduct the hiding intervention (in minutes). 3. Average number of ads users see on Twitter and Facebook (if available). 4. User engagement – measured as the average number of user’s reactions (such as likes), posts, and retweets (Twitter only) on Twitter, Facebook, and YouTube. 5. Average toxicity score of content that the user posts, retweets, or reacts to (e.g. likes) on Twitter, Facebook, and YouTube. 6. Proportion of content on Twitter, Facebook, and YouTube that is hidden and that remains on the user's feed, as well as the average toxicity. 7. Long term effects of the intervention (see the explanation below). Heterogeneity: As an additional measure, in the case of outcomes combining multiple platforms, we will also look at each platform separately. We will also look at heterogeneity with respect to the median level of toxicity in the observation period (as in the case of the primary outcome).

Cited by

No citation data available for this registration yet.

Keywords