The supply and demand of AI sycophancy
How to cite
Duran, Rafael Jimenez; Goldberg, Samuel; Caprini, Giulia. 2026. "The supply and demand of AI sycophancy." AEA RCT Registry. AEARCTR-0018435. https://doi.org/10.1257/rct.18435-1.0
Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.
* Primary investigator
Abstract
We experimentally measure user preferences for sycophancy in large language models. A pre-registered sample of U.S. adults recruited via Prolific answers 40 multiple-choice questions and, on 30 of them, sees an AI-generated response, reports an incentivized belief that the AI is correct, and rates the response on a five-star scale incentivized via Incentivized Resume Rating. The design is a 2x2x2 between-subjects experiment crossing question domain (objective English usage and math vs political and social misperceptions), the timing of when correct answers are revealed (before vs after the rating), and the AI's agreement rate when the respondent is wrong (high vs low). Within respondent, the AI's correctness and agreement with the respondent's answer are randomized at the question level, exogenously populating all four correctness-by-agreement cells. From post-revelation ratings we recover respondent-level preferences over AI answers; the pre-revelation ratings correspond to how raters annotate AI answers in practice. We combine these preferences with structural estimates of LLM sycophancy across leading models to quantify the welfare consequences of sycophancy and the scope for personalization to amplify or attenuate it.
Intervention
Each respondent answers 30 multiple-choice questions and, after each answer, sees an example of an AI-generated response (hereafter: AI's answer) that either agrees or disagrees with the respondent's answer and is either correct or incorrect.
Respondents are asked to rate the AI's answers.
We introduce incentives to induce respondents to 1) answer the multiple-choice questions as accurately as possible, 2) reveal their posterior beliefs about the AI's answer, and 3) rate the AI's answer based on the type of answers that they'd like an AI assistant to give to them (based on an Incentivized Resume Rating procedure).
Experimental design
Three between-subjects manipulations vary: (i) the question domain — objective English usage and math drawn from publicly available SAT-style items, vs. political and social misperception questions about U.S. demographic groups; (ii) whether the correct answer is revealed to the respondent before or after they rate the AI response; and (iii) the AI's probability of agreeing with the respondent when the respondent's answer is wrong (high regime: 0.45; low regime: 0.25). When the respondent's answer is correct, the AI agrees with probability 0.75 in both regimes. This way, we vary agreement while keeping accuracy constant.
Within respondent, AI correctness and agreement with the respondent are randomized at the question level conditional on the respondent's answer, populating correctness-by-agreement cells exogenously. AI responses are generated on Qualtrics. When the AI does not agree with a wrong respondent, the residual probability mass is split between the correct option and a random alternative wrong option (high regime: 0.44 correct, 0.11 other wrong; low regime: 0.47 correct, 0.28 other wrong). When the AI does not agree with a correct respondent, it draws uniformly from the wrong options.
AI responses are a combination of a multiple-choice answer AND a wording style (respondents are debriefed at the end of the survey that responses are pre-generated). Each AI response is paired with one of ten pre-written AI-generated explanatory templates with an AI-generated question-specific generic justification, so that wording does not co-vary systematically with correctness or agreement.
To summarize,
- Between subjects: Database (political misperceptions / SAT) X truth revelation (pre/post ratings) X AI's agreement level (high/low)
- Within subjects: question ordering, AI's suggested answers and wording.
Design details
Cited by
No citation data available for this registration yet.