Staying in the game: Gaps in perseverance for science funding (previously: Can’t you take a rejection)

How to cite

Cairo, Sofie. 2025. "Staying in the game: Gaps in perseverance for science funding (previously: Can’t you take a rejection)." AEA RCT Registry. AEARCTR-0015663. https://doi.org/10.1257/rct.15663-1.1

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Sofie Cairo*

* Primary investigator

Registry ID
AEARCTR-0015663
DOI
https://doi.org/10.1257/rct.15663-1.1
First registered
Last updated
Status
On going
Trial dates
2024-11-27 – 2028-12-31
Countries
Denmark (Copenhagen)
JEL codes
J16, I23, O31
Registry record
http://www.socialscienceregistry.org/trials/15663

Abstract

With some public funding schemes providing funding to fewer than 10% of applicants, an increasing number of researchers will experience a funding rejection. Understanding what stimulates both women’s and men’s persistence in applying for science funding is an important goal of science policy makers, especially as studies find differences in funding levels between male and female scientists (see e.g., Kolev et al. 2020). While funding evaluation (see e.g., Jappelli et al. 2017) has received extensive attention, the gender gap in applicant behavior after rejection, i.e. in persistence for funding, remains understudied. To address this gap,we focus on the effect of feedback after funding rejections on subsequent choices, in terms of reapplication, publishing and career trajectories, of female and male researchers. We aim to answer two research questions. RQ1: Can feedback provided in rejection letters to funding applicants enhance persistence in science funding applications? RQ2: Does reapplication behavior respond differentially to feedback across gender, seniority and applicant quality? The communication of relative rank to rejected candidates has the potential to reduce the gender gap in reapplication, as it anchors candidates’ beliefs about the relative quality of their proposal. Communicating rank in rejection letters may thus stimulate reapplication among the strongest candidates, while deterring the weakest. In addition, experimental studies show that accurate information about relative performance may mitigate the gender gap in willingness to compete (Wozniak et al. 2014). This suggests that the way a rejection is communicated and which kind of information it contains, is an effective and easy-to-implement solution to mitigate gender differences in reapplication, and may ultimately lower existing inequalities in the scientific system. The novelty in this study is the high-stakes field setting. which is novel because much of the gender gap literature stems from low-stakes lab experiments.

Intervention

We randomly vary the type of information rejected applicants for a grant at the Lundbeck Foundation receive after rejection.

Experimental design

We randomly vary the type of information rejected applicants for a grant at the Lundbeck Foundation receive after rejection.
We provide aggregate statistics to all rejected applicants, but vary whether rejected applicants receive personal information about their relative rank compared to other applicants, and whether they get access to personalized feedback on their application.
This essentially allows us to estimate the causal effect of relative rank signals and feedback on reapplication rate at the same funder, publications and career outcomes.
We elicit beliefs about own quality, rank, and probability reapplying at the time of submission, after rejection, and after the treatment is distributed. This allows us to study updating of beliefs regarding own probability of winning across gender, quality and seniority.

Design details

Randomization method
First, applicants are separted by category: Fundable, non-fundable with above median score (among non-fundable), and non-fundable with below median score (among the non-fundable). Second, applicants within each category are split by gender. Within each category-gender group, individuals are shuffled by assigning random numbers and sorting smallest to largest. Finally, every other individual within category-gender group is assigned to treatment and control. This strategy does not ensure equal shares of women and men in each treatment arm, but is fair in terms of sending an information about relative rank that is truthful.
Randomization unit
No the treatment is not clustered. It is possible that researchers in the same research field and at the same institution may exchange information about the treatment they have received, but it is very uncommon to share such information across institutions, because it is not public who has been rejected for a grant.
Clusters
We are including approximately 900 individuals, of which the majority are early career researchers. They are applying to three grant programs at the Lundbeck Foundation. We may be underpowered for testing treatment effects by gender, quality and seniority, but the funder is willing to extend the intervention period.
Observations
We are including approximately 900 individuals, of which the majority are early career researchers. They are applying to three grant programs at the Lundbeck Foundation. We may be underpowered for testing treatment effects by gender, quality and seniority, but the funder is willing to extend the intervention period.
Arms
We are operating within the limits of our collaboratoring funder. We have a sample of 930. With treatment arms: Control without feedback: 275 (junior, senior by gender) Controls with feedback: 175 (only junior by gender) - similar to previous years Treatment with feedback: 440 (junior, senior by gender), of which 220 with a positive signal and 220 with a negative signal.
Primary outcomes
Intention to reapply, actual reapplication rates by gender, seniority and quality of the applicant (1-2 years after treatment) Productivity measured by number and quality of publications/citation. Promotion to assistant and associate professor.
Secondary outcomes
Intention to reapply as measured immediately after the information treatment. Beliefs about the success of winning if reapplying after rejection and after treatment relative to at grant application submission. Beliefs about winning if using the provided after feedback relative to initial beliefs. Signing up to receive reminders from the funder of upcoming calls.
Sponsors
Name: The Lundbeck Foundation Location: Copenhagen Url: https://lundbeckfonden.com/
Partners
Name: The Lundbeck Foundation Partner_type: ngo Url: https://lundbeckfonden.com/

Cited by

No citation data available for this registration yet.

Keywords