Evidence-Based Policymaking in Education
How to cite
Nakajima, Nozomi. 2020. "Evidence-Based Policymaking in Education." AEA RCT Registry. AEARCTR-0006563. https://doi.org/10.1257/rct.6563-1.2
Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.
* Primary investigator
Abstract
Decisions made by education policymakers determine how schools and teachers are organized, and how students learn. In the era of evidence-based policymaking, education policymakers face pressure to use research to inform their decisions. This paper explores the mental models that policymakers use when integrating research evidence in their policy decisions. I conduct survey experiments on education policymakers. First, I examine policymakers’ preferences for research evidence. Using a discrete-choice experiment, I present policymakers with a series of research studies that vary along attributes of internal and external validity. They are asked about their preference between pairs of research studies as they make a hypothetical policy decision, requiring them to make trade-offs between different study attributes. Second, I explore what policymakers believe, what information they seek out, and how they update their beliefs about the effectiveness of education policies. I elicit policymakers’ predictions for the effect of an education policy in a particular setting. Then, I conduct an information experiment to study how policymakers update their beliefs in response to new information from researchers and from peers. Together, the results of my study will help us better understand how evidence-based decisions are made by education policymakers.
Experimental design
Discrete-choice experiment: Policymakers are presented with hypothetical scenarios in which they evaluate different research evidence to help guide policy decisions in their own local setting. Each scenario contains two potential research studies, which randomly vary along aspects of internal and external validity with the intent of creating realistic variation of study attributes.
Information experiment: The experimental design has three stages. In the first stage, I elicit policymakers’ prior beliefs by asking them to forecast the effect of an education policy in a specific setting. In the second stage of the experiment, policymakers are asked to rank their choices between different pieces of information that could be useful for making their own forecast: (1) a forecast made by researchers (split between a basic forecast and a forecast with explanations about research design), (2) a forecast made by peer policymakers, or (3) no information. In the third stage, policymakers are randomly assigned to receive the researcher forecast, peer forecast, or no additional information. In the fourth stage, I re-elicit policymakers’ beliefs about the policy effect asked in the first stage.
Design details
Cited by
No citation data available for this registration yet.