Can Feedback on Racial Bias Change the Behavior of Labor Market Counselors: A RCT in Public Employment Agencies in Colombia

How to cite

Duryea, Suzanne; Millan-Quijano, Jaime; Morrison, Judith; Gil, Yanira Oviedo. 2021. "Can Feedback on Racial Bias Change the Behavior of Labor Market Counselors: A RCT in Public Employment Agencies in Colombia." AEA RCT Registry. AEARCTR-0008376. https://doi.org/10.1257/rct.8376-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Suzanne Duryea* , Jaime Millan-Quijano , Judith Morrison , Yanira Oviedo Gil

* Primary investigator

Registry ID
AEARCTR-0008376
DOI
https://doi.org/10.1257/rct.8376-1.0
First registered
Last updated
Status
On going
Trial dates
2021-07-25 – 2021-11-15
Countries
Private
JEL codes
J7, O2
Registry record
http://www.socialscienceregistry.org/trials/8376

Abstract

A long economic literature has explored the profound impact of hiring discrimination on race gaps in labor outcomes (Charles 2008). In Colombia, this bias also contributes to the employment and salary gaps between Afro- and Non-Afro-descendant Colombians
(Rodriguez et al., 2013). The objective of this study is not to measure discrimination per se, but to measure the impact of a low-cost intervention provided to service providers in public employment services. The study aims to measure whether providing feedback to job-counselors on their implicit racial bias changes their behavior with respect to activities aimed at promoting employment, as measured by referrals and placements of Afro-descendant clients as well as through a task-based experiment that simulates their work duties.

Intervention

The intervention has two stages. In the first stage, we will invite all job-counselors working in the public job-centers network in Colombia to take an IAT about race. The test has been adjusted for the context of Colombia. After the IAT we will collect information about explicit racial bias.
In the second stage, we will randomly select a group of job-counselors (clustering at job-center level) to give them feedback about their own IAT result. Our treatment variable will be to be working in a job center selected for receiving IAT feedback. We will collect data and analyze short- and medium-run effects. After the analysis is complete, job counselors in the control job centers will receive feedback.

Experimental design

Experimental Design
In this study we will replicate the work of Alesina et.al (2018), in Italian schools, adapted for the context of racial bias among job counselors in public employment centers in Colombia. This design seeks to answer the following questions:

1. Is there an unconscious bias against the Afro-descendant population in job-counselors in Colombia?
2. Do job-counselors change their behavior related to job referrals when they know their bias?
3. Are job counselors with low levels of explicit bias more responsive to the feedback than their peers who have reported high levels explicit bias?
4. Could this low-cost intervention have relevant impacts on Afro-descendant's employment?

To answer these questions, the study has 3 stages: (i) list exercise of counselors in participating agencies and baseline measurements, (ii) random assignment and feedback, and (iii) collection of information on results and estimation of impacts. In the first stage, an invitation was made to all job-agencies in Colombia inviting them to participate in the study. According to the information provided by Asocajas so far, the study universe would be composed of:

31 job-agencies (cajas de compensación familiar)
129 job-centers
29 departments
103 municipalities
548 job-counselors (including business managers and intermediaries who have contact with clients)

After the invitation, we aim to work with approximately 400 job-counselors in approximately 110 job-centers. At this stage, all job-counselors participating in the study will take the IAT test and a survey including questions about racial biases.
In the second stage, job-centers will be randomly divided in two groups, treatment and control:

Treatment group: Job-counselors in this group will receive feedback on their IAT test result just after phase 1 ends.
Control group: The counselors in this group will receive their results until the end of the study.

Rigorous randomization will be carried out, taking into account the size of the job-center, the share of the Afro-descendant population in each region, and other characteristics of local labor markets. To reduce the effects of contamination (changes in the control group due to its interaction with the treatment group) and to reduce possible frustration effects (changes in the control group due to not receiving its result), the random assignment will be carried out at the job-center level.

In the third stage, the counselors of both groups will be followed and we will collect information on both their activities and the results of those job seekers who interact with them in order to estimate the impact of the feedback as explained in the next section. In addition, we will collect data about job-counselors activities using an online activity where we will simulate the activities they carry out at the time of receiving a new job seeker. In this case we will randomly assign simulated CVs, job posts, and training courses. We first create all possible combinations of key characteristics in a CV or a job post (for example, education, gender, race for the CVs; and sector, wage, experience required for the job-posts). Then we will randomly create assign groups of 7CVs and 3 job-posts following the strategy of CITA).

Design details

Randomization method
Randomization will be done in the office by a computer.
Randomization unit
The unit of randomization is the job-center (or job-agency-city/locality). We will create strata for the job-centers by region (to control for local labor markets and proportion of Afro-descendant population) and size of the job-centers.
Clusters
We aim to have 129 job centers. If we use job-agency-city clustering we aim to have approximately 80 clusters.
Observations
We aim to have approximately 400 job-counselors. The total number of observations from administrative data depends on the final number of job-applications and posts that the system will receive for the period of the study. For the simulated exercise we will have 7 times 3 times N observations. Where N is the final number of job-counselors that take the exercise.
Arms
200 job-counselors by group. 50 job-centers by group.
Primary outcomes
Job counselors’ referral rate to jobs of Afro-descendant clients. Employment of Afro-descendant clients. Job counselors’ referral of Afro-descendants to a job posting in a simulated task. Job counselors’ willingness to participate in inclusion training.
Sponsors
Name: Inter-American Development Bank Location: Washington, DC USA Url: https://www.iadb.org/
Partners
Name: Econometría S.A. Partner_type: private_company Url: https://www.econometria.com/ Name: La Asociación Nacional de Cajas de Compensación Familiar en Colombia, Asocajas Partner_type: ngo Url: https://www.asocajas.org.co/

Cited by

No citation data available for this registration yet.

Keywords