Whom Would You Rather Work With? Experiment 3
How to cite
Ferreira, Pedro de Souza; Alfonsi, Livia. 2024. "Whom Would You Rather Work With? Experiment 3." AEA RCT Registry. AEARCTR-0012908. https://doi.org/10.1257/rct.12908-1.0
Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.
* Primary investigator
Abstract
Personal connections are an important search and matching channel across different labor markets, formal and informal, in both high- and low-income settings (Topa, 2011; Burks et al., 2015). Despite improving matching efficiency, the system of employee referral risks penalizing minority groups and reinforcing labor market segregation. In informal labor markets, where networks are key for landing a job through referrals, biases among employees, and not only firm owners or HR departments, act as an additional barrier to gender equality in access to certain occupations (Beaman et al., 2018). Employees tend to refer network members with similar characteristics, including gender (Brown et al., 2016). In particular, women are less likely to use informal contacts than men, their contacts tend to be more clustered in certain occupations, and, for them, similar levels of network usage yield lower wages and promotion chances than for men (Topa, 2011). This project is an extension of two previously registered project (AEARCTR-0008036 and AEARCTR-0011599) to examine the extent of gender bias perpetuated by employees through the referral system. As in the original project, we present employees of businesses operating in highly segregated occupations with profiles of potential candidates to investigate their gender preferences as well as how these preferences interplay with personal connection to the candidate. Also here, we also assess whether information shocks and changes in confidentiality can change the referring preferences of employees over candidates.
In this project, we keep the additions made in AEARCTR-0011599 to AEARCTR-0008036, namely: (1) we have 4 main treatment arms rather than 2, (2) we improve the framing of the confidentiality, (3) we introduce vignette experiments to understand the mechanisms, and (4) we improve the construction of the profiles shown to respondents. In addition to it (and lacking in AEARCTR-0011599), we also: (5) introduce two new treatment arms for confidentiality, (6) add new questions on gender of the employer, gender composition of the business, and perceived gender attitudes of the employer (that we will use as relevant sources of heterogeneity), (7) add new outcome variables on (7.a) employees’ second-order beliefs of employers’ rating of the profile, (7.b) employees’ second-order beliefs of coworkers’ rating of the profile, (7.c) employees’ perceived accuracy of their guess of retention probability of the profile, and (7.d) employees’ perception on the ability of the profile performing usual tasks at their job. We also (8) introduce a new source of exogenous variation by changing whether we ask second-order beliefs of employers’ ratings before or after the referral decision. In this experiment, we also (9) make respondents believe that the profiles that we show are truthful, setting us halfway between the general IRR framework of presenting profiles as hypothetical (done in AEARCTR-0011599 and AEARCTR-0008036) and traditional audit studies. This is done to avoid the issue of making respondents guess which parts of the profile are hypothetical and which are not.
Intervention
The experiment will offer to successful alumni of VT institutions in Uganda the opportunity of referring someone to a 6-week subsidized internship at their company. We will show to each of them a pair of profiles that match their respective trainings. The pair of profiles will always have different gender. Respondents will also have the chance to refer a person they know. We will cross-randomize the sample in four ways.
First:
(1a) Group 1 (High quality male and High quality female): respondents are shown a randomly generated male profile with 11 months of work experience and a randomly generated female profile with 11 months of work experience;
(1b) Group 2 (High quality male and Low quality female): respondents are shown a randomly generated male profile with 11 months of work experience and a randomly generated female profile with 6 months of work experience;
(1c) Group 3 (Low quality male and High quality female): respondents are shown a randomly generated male profile with 6 months of work experience and a randomly generated female profile with 11 months of work experience;
(1d) Group 4 (Low quality male and Low quality female): respondents are shown a randomly generated male profile with 6 months of work experience and a randomly generated female profile with 6 months of work experience.
We will tell respondents that profiles are truthful and willing to accept the internship if offered it. This element of deception differs this experiment from its predecessors (AEARCTR-0011599 and AEARCTR-0008036) and serves the purpose of avoiding having respondents guess which parts of the profile are hypothetical or not. This different component sets us between the IRR literature and traditional audit studies.
Second:
(2a) Public referral (same as AEARCTR-0011599 and AEARCTR-0008036): the business owner will know who referred the candidate and the respondent will be warned that his/her referral will be PUBLIC;
(2b) Private referral (same as AEARCTR-0011599):We will NOT inform the employer that the employee referred the candidate, and we will never mention his/her name. However, we will tell the employer that the referral came from a worker in the company;
(2c) Referred by BRAC: the EMPLOYER will be told that the matched candidate was selected by BRAC, which is truthful, with no mention to any worker in the company;
(2d) "Private" referral (same as AEARCTR-0008036): We tell the respondent that the business owner will NOT know who referred the candidate and that his/her referral will be PRIVATE. However, we have anecdotal evidence that the interpretation of this treatment arm was ambiguous during AEARCTR-0008036, for which we changed it in AEARCTR-0011599. We are reintroducing it now (keeping its ambiguity) to gauge how respondents interpreted it in AEARCTR-0008036. After outcomes are realized (i.e., respondents rate profiles and choose the candidate), we clarify the ambiguity and respondents have to choose between either (2b) Private referral (as in AEARCTR-0011599) and (2c) BRAC Referral.
Third, we also cross-randomize a vignette experiment to understand the mechanisms of referrals:
(3a) Vignette group 1: we present two scenarios, one in which a man applies to a job by walking in and another in which a man applies to a job through a referral.
(3b) Vignette group 2: we present two scenarios, one in which a woman applies to a job by walking in and another in which a woman applies to a job through a referral.
(3c) Vignette group 3: we present two scenarios, one in which a woman applies to a job by walking in and another in which a man applies to a job through a referral.
(3d) Vignette group 4: we present two scenarios, one in which a man applies to a job by walking in and another in which a woman applies to a job through a referral.
In the vignette experiment, the order of the scenarios shown is also randomized.
Fourth, we cross-randomize a question to prime respondents to incorporate employers' preferences:
(4a) Priming: After the first profile is shown, respondents are asked how much they would like to work with the profile and, right after, how much they think their employers would like to have the profile as their employee. Then, we elicit the remaining outcomes.
(4b) No priming: Only after all other outcomes are realized and respondents make their referring choice among the two profiles, we elicit their second-order beliefs about how much they think their employers would like to have the profile as their employee.
With this, we want to understand to what extent second-order beliefs on employers' preferences can affect referral decisions.
Randomization 1 is stratified by gender of the respondent, dummy =1 if respondent was trained in a female dominated sector, dummy = 1 if respondent was wage-employed the last time we interviewed, and dummy = 1 if respondent was found in the previous wave. Randomization 2 is stratified by the exact same variables plus treatment assignment in Randomization 1. Randomization 3 and Randomization 4 are both stratified by assignment in Randomization 1 and assignment in Randomization 2.
Experimental design
This study is an extension of previously registered trials (AEARCTR-0008036 and AEARCTR-0011599), which were, on their hand, was a spin-off of the Meet Your Future Project (MYF), an RCT designed to analyze a career-coaching program for Ugandan vocational students aimed at reducing labor market access inequities for socioeconomically disadvantaged students. Both the main and the spin-off studies are conducted in collaboration with the NGO BRAC, who implemented all data collections and interventions, and five reputable vocational training institutes (VTIs) in Central and Eastern Uganda. The experimental evidence from this study comes from a cohort of 1,000 successful alumni from vocational training institutes which the research team has been following for more than 4 years as part of the MYF Project. We leveraged a follow-up survey of the MYF project and added an extra module to explore how gender preferences in segregated occupations interplay with a referral-based hiring system.
We showed to respondents pairs of randomly generated profiles based on real-life candidates and asked them to refer one of the candidates for a 6-week subsidized internship program in their companies. Selected candidates will be called for the program based on a lottery system (approximately 200 will be selected). Respondents also had the chance to name up to two network members and select one of them instead of the anonymous candidates. To ensure all respondents had quality-seeking behaviors, we offered to all of them a monetary reward if the candidate is retained. Non-wage-employed respondents answered the survey only hypothetically, as their choices will not be part of the lottery and they will be offered no money.
Design details
Cited by
No citation data available for this registration yet.