Do Policymakers Distinguish Correlation from Causation? Evidence from an international Survey Experiment
How to cite
Keeble, Jack. 2026. "Do Policymakers Distinguish Correlation from Causation? Evidence from an international Survey Experiment." AEA RCT Registry. AEARCTR-0019081. https://doi.org/10.1257/rct.19081-1.0
Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.
* Primary investigator
Abstract
This study examines whether policymakers distinguish between correlational and causally identified evidence when evaluating policy-relevant research. Policymakers recruited through the Warwick Policymaker Lab complete an online experimental vignette survey in which they evaluate four summaries of evidence on the same healthcare intervention. The vignettes vary experimentally along two dimensions: the inferential basis of the evidence (correlational versus random assignment) and the geographical context (the respondent's own country versus a similar foreign country). The primary outcome is respondents' assessment of the causal credibility of the evidence, while the secondary outcome is their stated willingness to rely on the evidence for policymaking. The primary analysis exploits the randomisation of the first vignette to estimate between-subject treatment effects. Secondary analyses use all four vignette evaluations in respondent fixed-effects models and examine heterogeneity by methodological training, policymaking experience, policy sector, and country where sample sizes permit.
Experimental design
Online survey experiment with policymakers. Respondents evaluate short evidence vignettes about the same policy intervention. Vignettes vary along two dimensions: inferential basis of the evidence, correlational versus random assignment, and geographical context, own country versus similar foreign country. Vignette order is randomised at the respondent level. The analysis uses the first vignette as a between-subject comparison and all four vignettes in within-subject specifications.
Design details
Cited by
No citation data available for this registration yet.