National Evaluation of Welfare-to-Work Strategies (NEWWS)
How to cite
Hamilton, Gayle; Freedman, Stephen; Michalopoulos, Charles. 2018. "National Evaluation of Welfare-to-Work Strategies (NEWWS)." AEA RCT Registry. AEARCTR-0001839. https://doi.org/10.1257/rct.1839-1.0
Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.
* Primary investigator
Abstract
How best to help people move from welfare to work--particularly whether an employment-focused approach or an education-focused approach is more effective--has been a subject of long-standing debate. The National Evaluation of Welfare-to-Work Strategies (NEWWS), a multi-year study of alternative approaches to helping welfare recipients find jobs, advance in employment, and leave public assistance, compared the effects of two alternative pre-employment strategies, for different groups of welfare recipients: programs that emphasize short-term job search assistance and encourage people to find employment quickly (referred to as "Labor Force Attachment" or, more broadly, "employment-focused" programs); and programs that emphasize longer-term skill-building activities, primarily basic education (referred to as "Human Capital Development" or, more broadly, "education-focused" programs). The primary research question addressed was: What works best for whom?
The effects of each approach were estimated using a multi-arm randomized controlled trial (RCT). Over 55,000 single parents (mostly mothers) were randomly assigned to different treatments, including different program groups (with services) or control groups (without services). A wealth of information was collected pertaining to the adults and their children, over a five-year follow-up period (falling somewhere between 1991 and 1999, depending on the site). The study also includes a cost-benefit analysis.
Intervention
The 11 programs in the NEWWS Evaluation were operated in seven sites across the country. Employment-focused programs were operated in Atlanta, Georgia; Grand Rapids, Michigan; Riverside, California; and Portland, Oregon. Atlanta, Grand Rapids, and Riverside also operated education-focused programs, as did Columbus, Ohio (two programs); Detroit, Michigan; and Oklahoma City, Oklahoma. The four employment-focused programs--the Labor Force Attachment (LFA) programs in Atlanta, Grand Rapids, and Riverside, and Portland's program--assigned most enrollees to job club as their first activity, and they encouraged enrollees to find work as quickly as possible. Further, both Portland's and Riverside's programs employed full-time job developers to help place program enrollees in unsubsidized jobs.
In contrast to the three LFA programs, however, Portland's program offered GED preparation classes to people who case managers thought had a good chance of attaining a GED certificate relatively quickly. Furthermore, Portland case managers, more often than those in the LFA programs, encouraged enrollees to hold out for jobs that paid well above the minimum wage (about 25 percent higher) and that offered the best chance for long-lasting and stable employment. Case managers in the LFA programs, especially Riverside's, stressed the value of starting off with any job, even a low-paying one, and then advancing toward more stable and better-paying jobs in the future.
The Human Capital Development (HCD) programs in Atlanta, Grand Rapids, and Riverside; the Columbus Integrated and Traditional case management programs; and the programs in Detroit and Oklahoma City can be characterized as "education-focused." A large percentage of program enrollees in these programs were initially assigned to some type of skill-building activity. The types of activities to which enrollees were first assigned depended, in part, on the level of educational attainment that individuals had achieved prior to entering the program. Those who had not completed high school or received a GED certificate but who were assessed by case managers as having high-school-level skills were assigned to GED preparation classes. Those with lower reading or math levels were assigned to adult basic skills classes. In addition, non-English speakers could be assigned to English as a Second Language (ESL) programs. Finally, those who had completed high school or held a GED certificate could be assigned to vocational training or employment-oriented skills courses at local community colleges. All in all, however, assignments to GED preparation or basic education courses predominated in these education-focused programs, and assignments to vocational training programs were less common, primarily as a result of welfare recipients' low levels of educational achievement; enrollment in college played an even smaller role.
Other key program features varied across the 11 studied programs as well. All four employment-focused programs and five of the seven education-focused programs can be considered "high enforcement" programs: They worked with a cross-section of the welfare applicants and recipients who were required to participate; monitored participation closely; and, especially in the two programs in Columbus and the two in Grand Rapids, frequently invoked sanctions (reductions in welfare grants) for nonparticipation. The remaining two education-focused programs, in Detroit and Oklahoma City, did not have these characteristics (because of either lack of funds or program philosophy) and can be considered "low enforcement" programs.
The programs also differed in their child care policies and practices (within each site, however, child care assistance policies were identical for program and control group members). During the early to mid-1990s, the Atlanta, Oklahoma City, Portland, and Detroit programs provided the strongest staff support for arranging for child care, and the programs in Atlanta and Oklahoma City emphasized the use of licensed care; in contrast, case managers for both Riverside programs encouraged enrollees to find low- or zero-cost, informal child care.
The programs also differed in their case management strategies. Three programs--Columbus Integrated, Portland, and Oklahoma City--implemented an integrated case management staffing arrangement. The other programs used a traditional case management structure.
Experimental design
To assess the effectiveness of different welfare-to-work strategies, the evaluation used a random assignment research design. In each of the seven sites in the evaluation, people who were required to participate in a welfare-to-work program were assigned, by chance, to one or two program groups, which had access to employment and training services and whose members were required to participate in the program, or to a control group, which received no program services and whose members were not subject to a participation requirement but could seek out similar services on their own in the community. Program group members who did not comply with the participation mandate risked incurring a sanction, that is, having their welfare grant reduced. Sample members in each research group were tracked over a follow-up period of five years after their date of random assignment.
Four of the 11 sites implemented a three-way random assignment research design in order to test the effectiveness of two different program approaches. In the three-way design, each person was assigned, by chance, to either one type of program, another type of program, or a control group.
Three of these four sites (Atlanta, Grand Rapids, and Riverside) operated two programs that were designed--for purposes of the evaluation--to magnify the differences between the employment- and education-focused approaches described above. The Labor Force Attachment (LFA) programs emphasized rapid job placement as the best way for welfare recipients to develop their work habits and skills, even if the job paid low wages. The Human Capital Development (HCD) programs emphasized that welfare recipients had to develop their "human capital," that is, their knowledge and basic skills, through education and training, before seeking employment, in order to have a better chance of finding and keeping jobs and advancing toward well-paid and secure employment.
Unlike in the other sites that used a three-way design, the goal in the three-way Columbus test was to compare the effectiveness of two different case management models. In the Traditional model, one worker handled the welfare department’s employment and training function and another worker handled welfare eligibility and payment issues--often called "income maintenance." Both workers maintained relatively large caseloads. In the Integrated model, a single worker handled both the employment and training and income maintenance functions. In the Integrated model, the worker maintained a smaller caseload than either of the workers in the Traditional model since, on a per client basis, the worker was handling jobs "traditionally" done by two workers.
The remaining three sites in the evaluation (Oklahoma City, Detroit, and Portland) used a two-way random assignment design to test the effectiveness of program models already established in those sites. In other words, instead of implementing a program designed expressly for research purposes, as in the three-way sites, program administrators in each of the two-way sites randomly assigned people to a group that entered their welfare-to-work program or to a control group.
A "two-stage" random assignment design was also included in NEWWS. This was implemented in two of the three LFA/HCD sites -- Riverside and Grand Rapids. In the first stage, over 23,000 welfare recipients were randomly assigned to two groups when they appeared in the welfare office for in-person eligibility (or eligibility redetermination) interviews. One group was required to attend a welfare-to-work program orientation. The other group was excused from such an orientation or any program participation. The comparison of the early experiences of these two groups showed the effects of a mandate to enter a welfare-to-work program without including any effects of program activities and services. Individuals randomly assigned at this first stage to the "required to attend orientation" group were subsequently randomly assigned again (the second stage), if and when they attended orientation, to one of the three research groups described above.
More details are available in the report cited under Post-Trial: Relevant Papers.
Design details
Materials
Papers from this trial
- Hamilton, Gayle. 2002. Moving People from Welfare to Work: Lessons from the National Evaluation of Welfare-to-Work Strategies. Washington, DC: U.S. Department of Health and Human Services and U.S. Department of Education. https://www.mdrc.org/publication/moving-people-welfare-work
- Hamilton, Gayle. 2002. Moving People from Welfare to Work: Lessons from the National Evaluation of Welfare-to-Work Strategies. Washington, DC: U.S. Department of Health and Human Services and U.S. Department of Education. https://www.mdrc.org/publication/moving-people-welfare-work
- Hamilton, Gayle, Stephen Freedman, Lisa A. Gennetian, Charles Michalopoulos, Johanna Walter, Diana Adams-Ciardullo, Anna Gassman-Pines, Sharon McGroder, Martha Zaslow, Jennifer Brooks, and Surjeet Ahluwalia. 2001. How Effective Are Different Welfare-to-Work Approaches? Five-Year Adult and Child Impacts for Eleven Programs. Washington, DC: U.S. Department of Health and Human Services and U.S. Department of Education. http://www.mdrc.org/publication/how-effective-are-different-welfare-work-approaches
Cited by
No citation data available for this registration yet.