Obfuscatory language, information acquisition, and opinions: a 2×2 online experiment

How to cite

Hemsley, Pedro; Pavão, Lynda. 2025. "Obfuscatory language, information acquisition, and opinions: a 2×2 online experiment." AEA RCT Registry. AEARCTR-0017269. https://doi.org/10.1257/rct.17269-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Pedro Hemsley* , Lynda Pavão

* Primary investigator

Registry ID
AEARCTR-0017269
DOI
https://doi.org/10.1257/rct.17269-1.0
First registered
Last updated
Status
In development
Trial dates
2025-12-08 – 2025-12-12
Countries
Private
JEL codes
C91, D91, Z13
Registry record
http://www.socialscienceregistry.org/trials/17269

Abstract

We run a pre-registered online experiment to study how obfuscatory language affects (i) participants’ decision to acquire information and (ii) downstream opinions. Participants read a brief news-style description of a fatal traffic-stop incident and then choose whether to view a short facts summary before answering opinion questions. We independently randomize (1) the syntax of the initial description—Active voice (clear agent) vs Intransitive (more obfuscatory)—and (2) a content-neutral salience cue on the “See facts” option (Z=0: “See facts”; Z=1: “See facts (~10–15 seconds)”). Z changes text only (no content, order, size, or placement).

Primary outcomes are: (1) information acquisition (clicked “See facts”, 0/1) and (2) an Opinion Index (mean of z-scores of participants' opinions about moral responsability and legal penalties to the perpetrator). We estimate the impact of language on acquisition and opinions. To identify the causal effect of acquisition on opinions, we use 2SLS with the salience cue as an instrument. We then decompose the total language effect on opinions into the component mediated by acquisition. Secondary outcomes include recall and perceived agency clarity (mechanism checks), as well as responses to additional opinion questions.

Intervention

We run an online, individual-level randomized experiment with a 2×2 design. Factor 1 is Language: participants read a brief news-style description written in either Active voice (clear agent; control) or Intransitive syntax (more obfuscatory; treatment). Factor 2 is a salience cue (Z) applied to the “See facts” option that allows respondents to view a short facts summary before answering opinion questions. In Z=1, the label reads “See facts (~10–15 seconds)”; in Z=0, it reads “See facts.” Z changes text only (not option order/size/placement or the facts content). We measure (i) whether the respondent clicks to see facts (information acquisition) and (ii) opinions in a Likart scale about the presented news.

Experimental design

Individual-level randomized online experiment with a 2×2 design. Factor 1 (Language): Active voice (control) vs Intransitive (treatment). Factor 2 (Salience Z): text-only cue on the “See facts” option (Z=1 “See facts (~10–15 seconds)” vs Z=0 “See facts”). After reading the vignette, respondents choose whether to view a brief facts summary before answering opinion questions.

Design details

Randomization method
Randomization is implemented at the individual level using SurveyMonkey’s A/B testing / random assignment features. Language (Active vs Intransitive) is randomized 50/50, and Salience Z (0 vs 1) is randomized 50/50 independently, producing four cells with equal expected proportions.
Randomization unit
Individual respondent. No clustering; no stratification.
Clusters
None — individual-level randomization (no clustering)
Observations
Target sample: N = 2500 participants (online sample)
Arms
2×2 design, equal allocation (expected): • Active × Z=0: n ≈ 625 • Active × Z=1: n ≈ 625 • Intransitive × Z=0: n ≈ 625 • Intransitive × Z=1: n ≈ 625
Primary outcomes
Primary outcomes: (a) Acquire = 1 if “See facts” was clicked, 0 otherwise; (b) Opinion Index = mean of z-scores of moral-responsibility and legal-penalty items (higher = more punitive), along with average response for each question.
Secondary outcomes
Secondary/mechanism outcomes: Jail recommendation (binary), recall items, perceived agency clarity, polarization.

Cited by

No citation data available for this registration yet.

Keywords