The Effect of Recommendation Letter Timing on Applicant Behavior
How to cite
Cecere, Grazia; Parasurama, Prasanna; Zhang, Jinny; Bapna, Sofia. 2025. "The Effect of Recommendation Letter Timing on Applicant Behavior." AEA RCT Registry. AEARCTR-0017483. https://doi.org/10.1257/rct.17483-1.0
Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.
* Primary investigator
Abstract
Applications—such as those to PhD programs—often require recommendation letters. We examine how the timing of this requirement affects application behavior. Specifically, potential applicants in the control group are informed that recommendation letters are required upfront (before their application is evaluated), whereas potential applicants in the treatment group are informed that recommendation letters are required only if they are shortlisted. We analyze application behavior across conditions and examine heterogeneity by gender and experience/quality.
Intervention
The study is set in the context of recruitment for an Engineering PhD program in Europe. Potential candidates are solicited via LinkedIn Recruiter InMail and are randomly assigned to one of two groups: control or treatment. The solicitation messages sent to all candidates are identical except for information about the selection process. The control and treatment groups receive the following information about the selection process.
The control group sees the following selection process:
** SELECTION PROCESS**
1. By midnight (CET) on February 15, submit application (CV, cover letter, transcript)
2. By midnight (CET) on February 15, letter writers submit two recommendation letters
3. Admission decision
Note: Recommendation letters are REQUIRED WITH THE APPLICATION.
The treatment group sees the following selection process:
** SELECTION PROCESS**
1. By midnight (CET) on February 15, submit application (CV, cover letter, transcript)
2. Shortlisting decision
3. If shortlisted, letter writers submit two recommendation letters
4. Admission decision
Note: Recommendation letters are REQUIRED ONLY IF SHORTLISTED.
Experimental design
The study is set in the context of recruitment for an Engineering PhD program in Europe.
Target candidates are identified using LinkedIn’s Recruiter tool (details under “Sample Size”) and solicited using LinkedIn's InMail.
(Note: LinkedIn’s Recruiter tool is a platform for talent acquisition. LinkedIn InMail is a premium messaging feature that lets recruiters send private messages directly to any member on the platform, using a limited number of monthly "credits" that come with a paid Recruiter subscription.)
Candidates are randomly assigned to one of two conditions: treatment or control.
Via LinkedIn InMail, each candidate receives information about the program (e.g., focus areas and campuses, program offerings, eligibility criteria, and the selection process), along with a unique link (i.e. unique to each candidate) to the application form. The InMail messages are identical across conditions except for information about the selection process (details under “Intervention”).
Due to LinkedIn InMail use limitations (constrained by LinkedIn Recruiter subscription credits, mentioned above), the InMails to candidates will be sent across three months (December 2025, January 2026, and February 2026). Candidates are randomly assigned to one of the three months (details under 'Randomization Method'); thus, we will identify upfront which month's mailing each candidate belongs to.
As noted, each candidate receives a unique URL, which limits them to a single application. The candidate’s name and LinkedIn ID are linked to the URL; if a different candidate uses the URL to apply, the observation will be discarded. A candidate may access the URL across different devices and resume the application where they left off if they do not complete it in one session.
Applications will not be accepted after the application deadline noted in the InMail.
We analyze application behavior (details under “End Points”) across conditions and examine heterogeneity by gender and experience/quality.
Design details
Cited by
No citation data available for this registration yet.