The Null Result Penalty
How to cite
Roth, Christopher; Haaland, Ingar; Chopra, Felix; Stegmann, Andreas. 2022. "The Null Result Penalty." AEA RCT Registry. AEARCTR-0009513. https://doi.org/10.1257/rct.9513-1.0
Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.
* Primary investigator
Abstract
We examine how the evaluation of research studies in economics depends on
whether a study yielded a null result. Studies with null results are perceived to
be less publishable, of lower quality, less important, and less precisely estimated
than studies with significant results, even when holding constant all other study
features, including the precision of estimates. The null result penalty is of similar
magnitude among PhD students and journal editors. The penalty is larger when
experts predict a large effect and when statistical uncertainty is communicated
with p-values rather than standard errors. Our findings highlight the value of
pre-results review.
Experimental design
See the paper.
Design details
Cited by
No citation data available for this registration yet.