The Tradeoffs of Transparency: Measuring Inequality When Subjects Are Told They Are in a Study

How to cite

Gee, Laura; Agan, Amanda; Cowgill, Bo. 2025. "The Tradeoffs of Transparency: Measuring Inequality When Subjects Are Told They Are in a Study." AEA RCT Registry. AEARCTR-0015210. https://doi.org/10.1257/rct.15210-1.5

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Laura Gee* , Amanda Agan , Bo Cowgill

* Primary investigator

Registry ID
AEARCTR-0015210
DOI
https://doi.org/10.1257/rct.15210-1.5
First registered
Last updated
Status
On going
Trial dates
2025-06-26 – 2026-06-26
Countries
Private
JEL codes
J7, C9, D9
Registry record
http://www.socialscienceregistry.org/trials/15210

Abstract

Correspondence audit studies have sent almost one-hundred-thousand resumes without informing subjects they are in a study --- increasing realism, but without being fully transparent. We study the potential trade-offs of this lack of transparency by running a hiring field experiment with recruiters in a natural setting.

Intervention

In the interest of preserving the integrity of the experiment, the intervention is being described in full in the experimental design sections that will remain hidden until the experiment is completed.

Experimental design

In the interest of preserving the integrity of the experiment, the experimental design is being described in full in the experimental design sections that will remain hidden until the experiment is completed.

Design details

Randomization method
Randomization done by computer. We follow the re-randomization procedure described in Appendix B in the PAP for this pre-registration.
Randomization unit
Recruiter
Clusters
We plan to hire about 1,440 recruiters. We plan to invite about 16,000 recruiters. We will invite about 4,000 recruiters each in treatment groups (A) and (B) and 2,000 each in the remaining four groups (C)-(F). We are uncertain of the acceptance rate for our invites, but expect it to be between 12% to 20% based on previous projects using similar procedures. Each recruiter who completes the task will evaluate 12 applicants, so a total of about 17,280 applicant level observations are expected (though actual number will depend on true acceptance rate of the task). Due to budgetary constraints we plan to stop hiring recruiter subjects once we meet our target of 1,440 recruiters. Though all invited subjects will be included in analyses of acceptance rates.
Observations
We plan to have a total of about 1,440 recruiters (and thus 1,440 x 12 =17,280 applicant level observations). The exact total is partially contingent on the acceptance rate. The current sample size is based on funding expectations, but contingent on more funding becoming available we may increase the sample size.
Arms
Randomization A: 4,000 invites to arm A; our goal is to have a total of around 360 acceptances. Similar studies have had acceptance rates between 12-20%. If the acceptance rate is 12% then we expect that approximately 480 will accept. If the acceptance rate is 20% we expect that around 800 will accept. We have set a goal of around 360 acceptances and will not hire workers after we hit that goal due to budgetary constraints. Randomization B: 4,000 invites to arm B; our goal is to have a total of around 360 acceptances. We will follow a procedure similar to that for Randomization A to do our best to obtain this goal. Randomization C, D, E and F: 2000 invites each; our goal is to have a total of around 180 acceptances in each of these four arms. Similar studies have had acceptance rates between 12-20%. If the acceptance rate is 12% then we expect approximately 240 will accept. If instead the acceptance rate is 20% we expect that around 400 will accept. We have set a goal of around 180 acceptances and will not hire workers after we hit that goal due to budgetary constraints.
Primary outcomes
A recruiter (subject) accepting our invitation to work (whether or not the recruiter completed the final task) A recruiter (subject) accepting our invitation to work and completing the final task) The recruiter suggesting an interview for a job candidate How much interest the company should have in extending an interview to the job candidate The recruiter’s salary offer suggestions for a job candidate The recruiter’s stated willingness-to-pay for a job candidate
Secondary outcomes
The recruiter’s time to answer questions about primary outcomes Text analysis of open ended notes and length of open ended notes left by the recruiter Single Offer: If the recruiter can make an offer to single candidate who would it be Outside Option: A salary the recruiter thinks the applicant would be just as happy taking or rejecting (50% likely to accept or reject).

Cited by

No citation data available for this registration yet.

Keywords