Real vs. Hypothetical Stimuli in Digital-Literacy Interventions
How to cite
Enríquez, José Ramón; Athey, Susan; Koutout, Kristine. 2026. "Real vs. Hypothetical Stimuli in Digital-Literacy Interventions." AEA RCT Registry. AEARCTR-0018909. https://doi.org/10.1257/rct.18909-1.0
Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.
* Primary investigator
Abstract
Most survey experiments on misinformation sharing use researcher-authored hypothetical stimuli rather than real social-media stimuli. If responses differ across the two types, treatment effects may not generalize. We recruit English-speaking Nigerian Facebook users and cross-randomize each into a 2x2 design: (i) stimuli arm (Real vs. Hypothetical) and (ii) digital-literacy course (an Emotions course teaching recognition of emotional manipulation vs. a Facts-based active control). Primary outcomes are binary willingness-to-share decisions on misinformation and non-misinformation stimuli, elicited pre- and post-course. The first research question tests Real vs. Hypothetical pre-course sharing differences; the second tests whether the course effect differs by stimuli arm. Findings inform the external validity of survey-based misinformation evidence and stimulus-construction choices.
Intervention
After consent and covariate collection, each participant is cross-randomized to one of four cells. The stimuli arm factor: Real (verbatim Nigerian Facebook posts) vs. Hypothetical (the same posts edited along five linguistic dimensions—length, capitalization, present-tense rate, redaction indicators, sentiment intensity—to emulate researcher-authored stimuli from prior survey experiments). The digital-literacy course factor: an Emotions course teaching recognition of fear, anger, and superiority appeals in misinformation, vs. a Facts-based active control of comparable length covering misinformation prevalence, history, and cognitive-bias findings without manipulation-detection instruction. Both courses adapt the chatbot course of Appel et al. (2026), itself adapted from Athey, Cersosimo, Koutout, and Li (2023).
Experimental design
Between-participant 2x2 factorial cross-randomization at study entry, after pre-treatment covariates. Factors: stimuli arm (Real vs. Hypothetical) and digital-literacy course (Emotions vs. Facts-based control). Assignment is stratified on a binarization of the nine-item Digital Literacy Index (Offer-Westort, Rosenzweig, and Athey, 2024), age (cutoff 25), and sex (male vs. non-male), giving eight strata. Per-cell counters within each stratum keep the four cells balanced throughout recruitment. Sharing intentions are elicited in five blocks of six stimuli each: a pre-course binary block, an immediate post-course binary block (fixed position after the course), and three post-course blocks (a third binary block, a pairwise forced-choice block, a two-stage block) presented in uniformly randomized order at the participant level.
Within each block, three misinformation and three non-misinformation stimuli appear in randomized order with one embedded attention check at a random position. Each participant sees each of the 30 source stimuli exactly once. The first research question is identified from the pre-course block; the second from the immediate post-course block.
Design details
Cited by
No citation data available for this registration yet.