Can Feedback on Racial Bias Change the Behavior of Labor Market Counselors: A RCT in Public Employment Agencies in Colombia
How to cite
Duryea, Suzanne; Millan-Quijano, Jaime; Morrison, Judith; Gil, Yanira Oviedo. 2021. "Can Feedback on Racial Bias Change the Behavior of Labor Market Counselors: A RCT in Public Employment Agencies in Colombia." AEA RCT Registry. AEARCTR-0008376. https://doi.org/10.1257/rct.8376-1.0
Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.
* Primary investigator
Abstract
A long economic literature has explored the profound impact of hiring discrimination on race gaps in labor outcomes (Charles 2008). In Colombia, this bias also contributes to the employment and salary gaps between Afro- and Non-Afro-descendant Colombians
(Rodriguez et al., 2013). The objective of this study is not to measure discrimination per se, but to measure the impact of a low-cost intervention provided to service providers in public employment services. The study aims to measure whether providing feedback to job-counselors on their implicit racial bias changes their behavior with respect to activities aimed at promoting employment, as measured by referrals and placements of Afro-descendant clients as well as through a task-based experiment that simulates their work duties.
Intervention
The intervention has two stages. In the first stage, we will invite all job-counselors working in the public job-centers network in Colombia to take an IAT about race. The test has been adjusted for the context of Colombia. After the IAT we will collect information about explicit racial bias.
In the second stage, we will randomly select a group of job-counselors (clustering at job-center level) to give them feedback about their own IAT result. Our treatment variable will be to be working in a job center selected for receiving IAT feedback. We will collect data and analyze short- and medium-run effects. After the analysis is complete, job counselors in the control job centers will receive feedback.
Experimental design
Experimental Design
In this study we will replicate the work of Alesina et.al (2018), in Italian schools, adapted for the context of racial bias among job counselors in public employment centers in Colombia. This design seeks to answer the following questions:
1. Is there an unconscious bias against the Afro-descendant population in job-counselors in Colombia?
2. Do job-counselors change their behavior related to job referrals when they know their bias?
3. Are job counselors with low levels of explicit bias more responsive to the feedback than their peers who have reported high levels explicit bias?
4. Could this low-cost intervention have relevant impacts on Afro-descendant's employment?
To answer these questions, the study has 3 stages: (i) list exercise of counselors in participating agencies and baseline measurements, (ii) random assignment and feedback, and (iii) collection of information on results and estimation of impacts. In the first stage, an invitation was made to all job-agencies in Colombia inviting them to participate in the study. According to the information provided by Asocajas so far, the study universe would be composed of:
31 job-agencies (cajas de compensación familiar)
129 job-centers
29 departments
103 municipalities
548 job-counselors (including business managers and intermediaries who have contact with clients)
After the invitation, we aim to work with approximately 400 job-counselors in approximately 110 job-centers. At this stage, all job-counselors participating in the study will take the IAT test and a survey including questions about racial biases.
In the second stage, job-centers will be randomly divided in two groups, treatment and control:
Treatment group: Job-counselors in this group will receive feedback on their IAT test result just after phase 1 ends.
Control group: The counselors in this group will receive their results until the end of the study.
Rigorous randomization will be carried out, taking into account the size of the job-center, the share of the Afro-descendant population in each region, and other characteristics of local labor markets. To reduce the effects of contamination (changes in the control group due to its interaction with the treatment group) and to reduce possible frustration effects (changes in the control group due to not receiving its result), the random assignment will be carried out at the job-center level.
In the third stage, the counselors of both groups will be followed and we will collect information on both their activities and the results of those job seekers who interact with them in order to estimate the impact of the feedback as explained in the next section. In addition, we will collect data about job-counselors activities using an online activity where we will simulate the activities they carry out at the time of receiving a new job seeker. In this case we will randomly assign simulated CVs, job posts, and training courses. We first create all possible combinations of key characteristics in a CV or a job post (for example, education, gender, race for the CVs; and sector, wage, experience required for the job-posts). Then we will randomly create assign groups of 7CVs and 3 job-posts following the strategy of CITA).
Design details
Cited by
No citation data available for this registration yet.