A Word is Worth A Thousand Words: Biased Beliefs about Political Language Use

How to cite

Shah, Rohen. 2022. "A Word is Worth A Thousand Words: Biased Beliefs about Political Language Use." AEA RCT Registry. AEARCTR-0009476. https://doi.org/10.1257/rct.9476-1.1

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Rohen Shah*

* Primary investigator

Registry ID
AEARCTR-0009476
DOI
https://doi.org/10.1257/rct.9476-1.1
First registered
Last updated
Status
Completed
Trial dates
2021-08-25 – 2021-08-29
Countries
United States of America ()
JEL codes
P16, D72, D91
Registry record
http://www.socialscienceregistry.org/trials/9476

Abstract

In a time when politics seem to be polarized as ever, it isn’t surprising that language use may be polarized too. If people define words in different ways, then using those words to describe their political positions can result in being perceived as more (less) extreme than they actually are. I conducted a survey with 782 MTurk workers in the U.S., eliciting their definition of the term "Democratic Socialism". This included asking them to predict how others would define the word, as well as a treatment group that received financial incentives based on predictive accuracy. I find that there is a large discrepancy between those on the Left and Right when defining the word. Financial incentives increase predictive accuracy more for those on the Right more than those on the Left or Moderates. More importantly, people from both groups made errors when predicting how others would define the word, but the nature of these errors was asymmetric across parties. In particular, those on the Right tended to make similar predictions for others on the Left versus Right, whereas those on the Left believed others on the Left were more likely to agree with them.

Intervention

Treatment participants will receive a financial incentive for making accurate predictions about others' beliefs.

Experimental design

Participants are asked true/false questions regarding certain political words and their usage. They are then asked to predict what fraction of other survey respondents on the political left and right would answer true or false to those questions. Treatment participants are incentivized for accuracy in prediction.

Design details

Randomization method
randomization done in office by a computer.
Randomization unit
Individual
Clusters
782
Observations
782
Arms
389 control, 393 treatment.
Primary outcomes
Prediction accuracy

Papers from this trial

  1. Shah, R. (2022). Word is Worth A Thousand Words: Biased Beliefs about Political Language Use. Working Paper. https://drive.google.com/file/d/1ATemEi02UeyXXjiSeDSwQ7w2fsDtzI23/view?usp=sharing

Cited by

No citation data available for this registration yet.

Keywords