Are the Referees and Editors in Economics Gender Neutral?

How to cite

DellaVigna, Stefano; Card, David; Funk, Patricia; Iriberri, Nagore. 2018. "Are the Referees and Editors in Economics Gender Neutral?." AEA RCT Registry. AEARCTR-0003048. https://doi.org/10.1257/rct.3048-2.1

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Stefano DellaVigna* , David Card , Patricia Funk , Nagore Iriberri

* Primary investigator

Registry ID
AEARCTR-0003048
DOI
https://doi.org/10.1257/rct.3048-2.1
First registered
Last updated
Status
Completed
Trial dates
2018-06-11 – 2018-09-11
Countries
United States of America (California)
JEL codes
A11, O3, J7
Registry record
http://www.socialscienceregistry.org/trials/3048

Abstract

Do men under-value the scientific contributions of women? We study the effects of gender on the evaluation of economic research using data on submissions to four leading journals, matched to referee recommendations, editorial decisions, and subsequent citations. A customized name-matching algorithm allows us to classify the genders of 97% of all authors and referees with an error rate of under 1%. About one-fifth of submitting authors are female, though rates vary widely across subfields. The fractions of female referees are similar. We begin by examining whether editors are more likely to match a female-authored paper with a female referee, suggesting an awareness of possible gender differences in recommendations. We then address four main sets of questions. First, do male and female referees assess papers differently, and does the gender composition of authors matter for how different referees rate a paper? Second, how reliable are the assessments of male and female referees in predicting future citations, and does this vary with the gender of the authors? Third, how do editors weigh the recommendations of different referees against the information contained in prior publications and other author characteristics, including gender? Fourth, are there gender-related differences in the time that referees take to make a recommendation, or that editors take to reach an initial decision? We compare our findings to the results from a survey of economists, and use the survey results to help interpret the gender gaps in referees' and editors' decisions.

Intervention

This registration is for an observational study analyzing whether editors and referees at 4 leading economics journals are gender-neutral in their recommendations and decisions. We detail how we will analyze the data in a pre-analysis plan, written before we have access to the main data set.

Experimental design

The trial is about an observational study, analyzing the role of gender of authors and referees in editorial decisions. The design, which is specified in detail in the analysis plan, builds on Card and DellaVigna (2017). As part of the project, we will also survey economists about how they see the role of gender in editorial decisions; the full test of the survey is in the analysis plan.

Design details

Randomization method
N/A
Randomization unit
N/A
Clusters
We will analyze about 30,000 papers, of which a bit more than half are not desk rejected.
Observations
29,872 papers total, including 15,177 non desk rejected papers.
Arms
There are not treatment arms in this observational study
Primary outcomes
Rates of desk rejection and revise and resubmit among submitted papers; length (in days and number of rounds) of the editorial process; rate of positive referee recommendations

Materials

Papers from this trial

  1. "Are Referees and Editors in Economics Gender Neutral?" (with David Card, Patricia Funk, Nagore Irriberri), Quarterly Journal of Economics, February 2020, Vol. 135, 269-327 https://academic.oup.com/qje/article/135/1/269/5614978#199163952

Cited by

No citation data available for this registration yet.

Keywords