Elevating Employment Success: Empowering Puerto Rico’s American Job Centers with Innovative Job Search Strategies

How to cite

Hernandez-Saborit, Sara; Sotomayor, Orlando; Bobonis, Gustavo J; Zarate, Roman Andres. 2024. "Elevating Employment Success: Empowering Puerto Rico’s American Job Centers with Innovative Job Search Strategies." AEA RCT Registry. AEARCTR-0013875. https://doi.org/10.1257/rct.13875-1.2

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Sara Hernandez-Saborit* , Orlando Sotomayor , Gustavo J Bobonis , Roman Andres Zarate

* Primary investigator

Registry ID
AEARCTR-0013875
DOI
https://doi.org/10.1257/rct.13875-1.2
First registered
Last updated
Status
In development
Trial dates
2024-10-01 – 2029-06-01
Countries
Private
Registry record
http://www.socialscienceregistry.org/trials/13875

Abstract

We propose to conduct an impact evaluation of an intervention to enhance the efficacy of American Job Centers (AJCs) by focusing on elevating the quality of case management and job search services. Prior work facilitated by a SLII grant has identified this strategy as the most promising approach to help job seekers in Puerto Rico. The plan involves selecting and contracting an external provider of job search and support services from a pool of nationally recognized organizations. This selected provider will offer a comprehensive range of intensive and individualized job search assistance, along with career navigator support. Treatment will be randomized. This initiative is designed to benefit eligible Workforce Innovation and Opportunity Act (WIOA) participants who are transitioning out of various programs, namely Adults, Youth, Dislocated Workers, Wagner-Peyser Employment Services. The primary focus of the evaluation will be on assessing the labor market outcomes of these individuals, including their compensation and employment status during the 2nd, 4th, 6th, 8th and 10th quarters after receiving treatment. By prioritizing the enhancement of case management and job search services, it is anticipated that individuals will experience improved agency and job market opportunities.

Intervention

A recently commissioned study presents compelling evidence that case management can be improved substantially in Puerto Rico’s American Job Centers—the main provider of labor exchange services to disadvantaged populations both in the island and in the mainland US (DEDC, 2021). The potential benefits are considerable. Currently in Puerto Rico, six out of every ten individuals of working age are neither working, nor looking for employment, one of the lowest labor force participation rates in the world. The situation is influenced by the design of a variety of public transfer programs that generate powerful incentives for low-skilled individuals to remain economically inactive (Burtless and Sotomayor, 2006). In turn, low levels of labor force participation are the main determinants of the high levels of inequality and poverty in the island (Sotomayor, 1996, 2004), where 58 percent of children and 42 percent of the total population lives in poverty. The dire macroeconomic scenario is exacerbated by the increasing number of Puerto Ricans who are relocating to various U.S. states.

Our partner, the Department of Economic Development and Commerce (DEDC), is the lead agency responsible for establishing public policy for economic development in Puerto Rico. Within the agency, the Workforce Development Program (WDP) is tasked with planning and coordinating employment and training programs across the island’s 15 Local Areas of Labor Development, each overseen by a Local Workforce Development Board. The areas share common labor market characteristics and are responsible for providing services through one or more AJCs.

For this intervention, the government partner will hire an external provider of job search and support services from a pool of nationally recognized organizations. Once contracted, the selected provider will be furnished a monthly list of clients who have recently had a programmatic exit from WIOA (from the universe of AJCs). Subsequently, the entity will initiate contact with these individuals, extending a range of job search assistance services as part of their offerings. These services will include: (i) the development and implementation of individual action plans (Abel, Burger, Caranza, 2019), (ii) disseminating local and broader job opportunities to clients (Abebe et al., 2020), (iii) providing information regarding high-demand occupations, earnings, and skill requirements to broaden their search horizons (Belot, Kircher, Muller, 2018), (iv) offering instruction on effectively utilizing job search engines, (v) assistance in crafting resumés, interview preparation, and showcasing their skills (Bassi and Nansamba, 2021), and facilitating opportunities for career advancement. Once employment is secured, (vi) clients will receive guidance to address job retention challenges and the necessary support for advancing their careers over the next six months. The aim of this intervention is to implement a tailored, differentiated, and hands-on approach to job placement assistance and coaching that surpasses the quality of the conventional career services usually provided at AJCs. The study will rigorously evaluate - via a randomized controlled trial - the impact of the intensive and individualized job search assistance and career navigator support.

Experimental design

On a monthly basis, a randomly assigned group of individuals exiting Title I and Title III WIOA programs will be offered the package of additional, comprehensive/tailored employment services that have shown positive effects when rigorously evaluated in other settings. The intervention will take place for up to 18 months. Each month, the target sample size will be approximately 1,500 individuals (average number of potential subjects with a WIOA exit record that could be randomized into treatment and control).

Once the government partner agency’s data services provider releases the monthly list of WIOA Title I and Wagner Payser program participants with an exit record, an official from the partner agency will the execute a randomization code, stratifying participants by gender and WIOA program of exit category (Adult, Dislocated Worker, Youth, and Wagner-Peyser). Within each stratum, an equal number of clients will be assigned to treatment and control. Once randomized, only the subset assigned to treatment will be shared with the contracted external provider to initiate contacts, thereby ensuring the integrity of the control group. This process will be repeated in each of the subsequent months throughout the intervention period.

Design details

Randomization method
Randomization in government office by a computer.
Randomization unit
The unit of randomization is the individual.
Clusters
According to the latest available numbers from the Puerto Rico WIOA & Wagner-Peyser Annual Report (PY 2022) , in 2022 there were 9,153 Title I program exits: 46% were from the Adults Program (n=4,251), 42% Dislocated Workers (n=3,845) and the remaining 12% Youth Program exits (n=1,057). In addition, there were 7,455 Wagner-Peyser (Title III) program exits. Combining these two sub-groups (Title I and Title III participants), we have a planned number of 18,000 potential clients (those individuals with a WIOA exit record) over the course of a year. Thus, we estimate an average monthly flow of 1,500 individuals that could be randomized into treatment and control (planned monthly sample size). The government agency is open to running the intervention over a longer period, as needed (between 12 to 18 months), which might increase the sample size accordingly.
Observations
18,000 individuals.
Arms
Over the course of an entire year, 9,000 individuals will be assigned to control; 9,000 individuals assigned to treatment. Note that the operating capacity of the selected provider may require adjusting the treatment allocation (proportion of the sample assigned to treatment).
Primary outcomes
The primary outcomes of interest will be program participant employment status and earnings following treatment. Specifically, the first main outcome concerns employment status (employed=1) two, and four quarters after exiting WIOA programs. The second primary outcome corresponds to earnings two, and four quarters after exiting WIOA programs. These outcomes are currently available in the administrative data shared with the research team. However, in order to measure longer term outcomes, we have petitioned the partner agency to include medium-term follow ups in order to observe labor market outcomes 18, 24 and 30 months after WIOA program exit.
Secondary outcomes
Additional exploratory outcomes of interest will help us understand what features and components of the program might increase take up and strengthen implementation quality. They will also provide additional insights about treatment effect heterogeneity and possible effects on participant’s mobility (as measured by inter-state migration). In addition to mean earnings impact, we will include a binary variable intended to indicate the attainment of a good job. We suggest defining this variable as the median earnings goal negotiated between the Puerto Rico WDP and the US Department of Labor, in accordance with WIOA. We will also use two other stable employment variables defined by earnings levels set at 25% and 50% above the state-negotiated earnings goal. In addition, we are also interested in determining if program participant choose to migrate outside of Puerto Rico.

Cited by

No citation data available for this registration yet.

Keywords