Bias in Peer Review
How to cite
Levine, S; Williams, H; Stein, C. 2022. "Bias in Peer Review." AEA RCT Registry. AEARCTR-0008755. https://doi.org/10.1257/rct.8755-1.0
Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.
* Primary investigator
Abstract
In many scientific contexts, peer review can be either single-blind or double-blind: in single-blind review, research work (e.g., manuscripts, proposals) is reviewed alongside information on the author(s), whereas in double-blind review, information on the author(s) is withheld. We will report results from a randomized experiment conducted in collaboration with a grantmaking body, in the context of the grantmaker reviewing proposals in one field of science. By comparing scores across single-blind and double-blind reviews for groups of different characteristics, we can test for potential biases in the review process.
Intervention
Research proposals received by the grantmaking will be randomly assigned to reviewers (while avoiding conflicts of interest, as defined by the grantmaking body). Then, each assigned reviewer–application pair will be further randomly assigned to either:
a. Single-blind review, in which the reviewer sees both the project description and the applicant's information
b. Double-blind review, in which the reviewer sees only the project description but not the applicant's information
c. Project-blind review, in which the reviewer sees only the applicant's information but not the project description
Experimental design
The experiment empirically tests for bias in the grantmaking process
Design details
Cited by
No citation data available for this registration yet.