The Impacts of Soft Affirmative Action: Experimental Evidence

How to cite

Hu, Hairong; Kubitz, Gregory; Ke, Changxia. 2021. "The Impacts of Soft Affirmative Action: Experimental Evidence." AEA RCT Registry. AEARCTR-0007383. https://doi.org/10.1257/rct.7383-4.6

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Hairong Hu* , Gregory Kubitz , Changxia Ke

* Primary investigator

Registry ID
AEARCTR-0007383
DOI
https://doi.org/10.1257/rct.7383-4.6
First registered
Last updated
Status
Completed
Trial dates
2022-09-26 – 2022-10-31
Countries
Australia (QLD)
Registry record
http://www.socialscienceregistry.org/trials/7383

Abstract

Affirmative action (AA) policies are used to increase the representation of minorities in candidate pools for hiring and/or promotions. In this study, we plan to use the controlled setting of a lab experiment to understand the true size and nature of the spillover effect of a soft AA (SAA) policy on employer’s discrimination. It allows us to determine 1) whether this effect is predominately positive or negative, and 2) if it is primarily driven by behavioural preferences (i.e., taste-based discrimination) or rational choices (i.e., statistical discrimination). We do this by comparing a soft AA policy based on minority ethnicity status with one for a random “priority” group that has no distinct characteristics, and also by separating hiring decisions from performance estimations. Our findings would provide insights into the mechanisms of the spillover effects of soft AA policies in the labour market.

Intervention

1) Baseline_colour (Treatment 1): A treatment with randomly assigned colours (red or green) to each candidate, but with neither the soft AA policy nor the information about candidates’ ethnicities.
2) Baseline_minority (Treatment 2): A treatment without a soft AA policy but with revealed information on candidates’ ethnicities (White or East Asian).
3) Soft AA_lucky (Treatment 3): A treatment with a soft AA policy for a randomly selected “lucky” group, namely the candidates assigned to red colour (red or green).
4) Soft AA_minority (Treatment 4): A Treatment with a soft AA policy for the ethnic minority group (White or East Asian).

Experimental design

This experiment consists of two phases: 1) the preliminary phase, in which we aim to recruit 150 participants to complete a series of anagram tasks; and 2) the main phase, in which we aim to recruit 100 participants for each of the four treatments to complete either hiring or performance estimation tasks (i.e., 800 participants in total).

In the preliminary phase, participants will be asked to complete five 2-minute anagram tasks individually and paid by piece-rate performance. This phase is designed to generate actual profiles of candidates to be used in the main phase of the experiment. The benefit of using actual profiles is to introduce real consequences for discriminatory behaviour and therefore capture the actual level of employer discrimination (Hedegaard & Tyran, 2018). To construct a balanced candidates pool for the second phase, 75 participants will be recruited from an ethnic minority group (i.e., East Asians) and the remaining 75 will be recruited from the ethnic majority group (i.e., Whites). Out of the five performances, we drop the lowest and the highest scores to form the final candidate profiles. For each candidate profile, we randomly name each of the three scores remaining as the pre-screening score, interview score and employment score.

In the main phase of the experiment, participants will be asked to either complete some hiring decisions or make performance estimations, given sets of pre-screened candidate profiles drawn from the data collected in the preliminary phase. Each participant in this phase will be assigned to one of the following four experimental treatments: a baseline_colour treatment with randomly assigned colours (red or green) to each candidate, but with neither the soft AA policy nor the information about candidates’ ethnicities (Treatment 1), a baseline-minority treatment without soft AA policy but with revealed information on candidates’ ethnicities (Treatment 2), a baseline_colour intervention treatment with soft AA policy for a randomly selected “lucky” group, namely the candidates assigned to red colour (Treatment 3), and a baseline-minority intervention Treatment with soft AA policy for the ethnic minority group (Treatment 4). Note that we will only recruit participants from the ethnic majority group as “employers/managers”. Each set of the four candidates’ profiles is pre-screened from 12 randomly selected participants (with similar average performances from the preliminary phase) through a treatment-specific “pre-screen process” based on the candidates’ pre-screening performances. The employer/manager is given the interview performances of all four candidates and is asked to either select one candidate to be hired (in the hiring task condition) or to give estimates of the actual employment performances for all four candidates (in the estimation task condition). On top of interview performances, the randomly assigned group colour (in Treatment 1 and 3) or ethnicity information (reflected through the surnames in Treatment 2 and 4), the potential employer/manager will also be given candidates’ age, prolific id, priority status (in Treatment 3 and 4).

Design details

Randomization method
Randomisation was done by a computer through O-Tree
Randomization unit
Individual participant
Clusters
150 participants in the preliminary phase and 100 participants per Treatment per task in the second phase (950 in total, 800 for the main experiment in phase 2)
Observations
4*100*4 = 1600 performance estimation decisions and 100*4=400 hiring decisions.
Arms
150 participants in the preliminary phase, and 100 participants per Treatment per task (total are 800 clusters) in the main experiment.
Primary outcomes
Overall Effect: The main outcome of interest is how a soft affirmative action (SAA) policy impacts the percentage of candidates being hired of the type that is the target of the policy.
Secondary outcomes
The primary outcome (overall effect) can be decomposed into a Frequency Effect (which is mechanically generated by the SAA policy) and a Token effect * (which is potentially confounded by several factors). The Frequency Effect measures how the SAA policy increases the number of candidates of the targeted type in the candidate pool, whereas the Token Effect1 measures how the SAA policy impacts the likelihood that a member of the targeted group is hired given that they are selected by the pre-screening process. Our design aims to further disentangle the confounding factors of the Token Effect. * Tokenism is the practice of doing something purely symbolic to appear inclusive. A (numerically) positive Token Effect is a reduction in the probability that a targeted candidate is hired in the presence of an SAA policy conditional on them being in the candidate pool. In this case, additional representation in the candidate pool does not translate fully into improved hiring outcomes for the targeted candidates.

Cited by

No citation data available for this registration yet.

Keywords