Preventing criminal recruitment and careers: An Evaluation of the Parceritos program in Medellin, Colombia

How to cite

Blattman, Christopher; Tobon, Santiago; Rodríguez-Uribe, María Aránzazu. 2025. "Preventing criminal recruitment and careers: An Evaluation of the Parceritos program in Medellin, Colombia." AEA RCT Registry. AEARCTR-0014388. https://doi.org/10.1257/rct.14388-1.1

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Christopher Blattman* , Santiago Tobon , María Aránzazu Rodríguez-Uribe

* Primary investigator

Registry ID
AEARCTR-0014388
DOI
https://doi.org/10.1257/rct.14388-1.1
First registered
Last updated
Status
On going
Trial dates
2022-10-15 – 2027-06-30
Countries
Colombia (South America)
JEL codes
K42, I26, J13, J24
Registry record
http://www.socialscienceregistry.org/trials/14388

Abstract

We worked with the city of Medellin to identify adolescent boys at moderate to high risk of gang recruitment and criminal careers. At the time of targeting and randomization, they were enrolled in low- and middle-income schools in Medellin, Colombia. Survey data and qualitative interviews suggest several drivers of gang recruitment and criminal careers: an undervaluation of the returns to legal careers, an underestimate of one's belonging and ability to access these careers, a lack of information about the path to these careers, an overestimation of the cost of schooling, and difficulties planning, goal setting, and dealing with obstacles. We worked with the city, schools, and a local NGO to develop an after-school program called Parceritos to address these challenges. It seeks to resolve these informational and identity gaps through experiential visits to centers of higher education and employers. It seeks to improve skills of goal setting and attainment through a repeated behavioral intervention (WOOP) focused on developing planning and goal commitment skills. We will evaluate short run impacts on school enrollment and longer term impacts on criminal involvement, including gang membership.

Intervention

The intervention, Parceritos, targets adolescent boys in Medellín identified as at moderate to high risk of criminal careers and gang recruitment. The program consists of two main components: (i) an informational/experiential component and (ii) a behavioral skill-building component.

The informational/experiential component is designed to address a set of common misperceptions that are associated with crime and gang interest: an underestimation of the range of legal opportunities available (and the returns to education), a misunderstanding of the tertiary educational opportunities and costs, and a lack of identification with these careers. Participants visit tertiary vocational schools, universities, and employers to understand the accessibility of higher education and skilled careers, learn about free education options, and meet people from their neighborhoods in these schools and careers.

The behavioral change intervention is called WOOP (Wish, Outcome, Obstacle, Plan). It is a structured process that fosters goal-setting, motivation, planning, and mental contrasting as an innate, automatic skill. In addition to helping students learn to set concrete, meaningful goals, it emphasizes two additional cognitive processes thought to be important to staying motivated and attaining one’s goals: vividly imagining potential obstacles (mental contrasting) and forming concrete plans to overcome those obstacles through “if-then” thinking (“implementation Intentions”). Participants practice setting goals and planning around obstacles on a small day-to-day scale and over longer timeframes.

The intervention is implemented across 8 sessions, each one up to 8 hours long, out of school, in groups of about 25, over the course of several weeks.

The program is principally targeted at boys in grades 6-9, with an emphasis on grades 7 and 8. To screen and recruit moderate to high-risk adolescent boys, we screen and stratify boys both by self-reported risk and interest in criminal careers, as well as through a predicted risk algorithm.

We identified an initial experimental sample (Cohort 1) of 1,476 boys from a pool of 10,000. 365 of these subjects were assigned to receive Parceritos between October 2024 and April 2025. We originally anticipated a Cohort 2 of roughly similar size to be selected from a March-May 2025 screening of an additional 10,000 boys to receive the program in August-November 2025. In the end, the city decided to split this into a Cohort 2 and a Cohort 3 in 2025 and 2026 with approximately 250 assigned to treatment per cohort.

Experimental design

(Note that one week prior to the first receipt of primary outcome data (school enrollment and dropout data) for Cohort 1. We updated this experimental design and estimation strategy for several minor items, including: the final size of each cohort; the fact that we must control for strata fixed effects along with cohort fixed effects; and the clarification of our heterogeneity analysis variable as the same variable that we used to stratify the experimental sample at baseline for randomization.)

For each cohort, we identified moderate to high-risk boys and conducted a 2-stage randomization. First, half of the schools were randomly assigned to have their pupils be eligible for treatment. Within schools eligible for treatment, half of the moderate- to high-risk boys enrolled at the time of randomization were assigned to treatment. This results in three experimental conditions: treatment boys, spillover boys (control boys in treatment schools), and pure control boys (control boys in control schools).

Due to budget considerations, the school system implemented this over three school years in three cohorts.

Cohort 1:
N: 1476
N Assigned to Treatment: 365
N Spillovers: 353
N Controls: 758
N Schools: 52

Cohort 2:
N: 1063
N Assigned to Treatment: 269
N Spillovers: 258
N Controls: 536
N Schools: 40

Cohort 3 (projected):
N: 980
N Assigned to Treatment: 240
N Spillovers: 228
N Controls: 512
N Schools: 40
Total across cohorts:

C1 + C2 + C3:
N: 3519
N Assigned to Treatment: 874
N Spillovers: 839
N Controls 1806
N School x cohort: 132

Finally, prior to Cohorts 1 and 2, we conducted a pilot program and evaluation with an experimental sample of 250 youth in 6 schools. Four schools were assigned to treatment and students were assigned to the program within schools at random, stratified by baseline risk level. We had access to 9-month post-intervention results of the pilot before registering the full experimental design. We did not have access to any post-randomization data on Cohort 1 prior to registration (Cohort 1 is currently undergoing the intervention at the time of registration).

ESTIMATION OF DIRECT TREATMENT EFFECTS

We are primarily interested in direct treatment effects. Spillover effects are of secondary interest, and more exploratory, given that we do not have strong priors about the direction or magnitude of spillovers. We will return to this below.

For average treatment effects, we will estimate the simple intent-to-treat (ITT) effect of treatment as well as the effect of treatment on the treated (TOT). TOT uses individual random assignment as an instrument for a “treated” indicator. We define “treated” as equaling one if the pupil attended at least one session of the program and zero if they declined to participate or never attended (e.g. because they transferred to another school before the program began).

We plan to run the following OLS regression:

y = 𝛿T + 𝜃S + 𝛽X + 𝜀

where:
y is the outcome
T = 1 for students assigned to treatment and is 0 for spillover and pure controls
S is a vector of spillover variables, discussed below
X is a vector of baseline covariates (school and pupil level) selected via a double lasso method, plus fixed effects for the cohort and strata fixed effects

For the ITT we are interested in 𝛿. As mentioned, we will also estimate the TOT estimate, using T as an instrument for treated.

HETEROGENEITY ANALYSIS

Treatment effects stratified by baseline criminal recruitment risk, using the same variable used for stratification: an average of self-reported and predicted recruitment risk. Below-median risk designation as primary indicator. The entire sample is relatively high risk. We do not necessarily anticipate differential treatment effects within the medium to high risk students in the sample, but we do believe this is the most plausible source of heterogeneity to expect.

ESTIMATION OF SPILLOVERS

The primary reason for estimating spillovers is to improve our direct treatment estimates by accounting for all potential interference between units.

Otherwise, the spillover effects are a secondary analysis partly because we probably do not have the statistical power to detect all but relatively large spillovers (see power analysis below). What’s more, there may be countervailing effects that reduce estimated spillovers on net. On the one hand, positive informational and behavioral spillovers could improve school dropout, criminal engagement, and gang entry. On the other hand, if demand for labor in the gangs is relatively inelastic, then this could result in negative spillovers to criminal careers and gang membership.

There are several options for improving statistical power and disentangling these countervailing effects. One is to take advantage of the fact that we have partial social network data for surveyed students (up to 10 friends in the school, a subset of whom would have answered our survey and also be eligible for the experimental sample based on risk). The other is to take advantage of the fact that we will have administrative data (such as school dropout, and eventually arrest data) on all classmates, including the lower risk students and the students who did not answer the survey. Finally, there will be random variation in the degree to which the number of friends are treated.

Thus we expect the vector S to include:
1) An indicator for the spillover condition
2) A measure of friends treated
3) The total number of friends in the experimental sample and the total number of friends they listed in their cohort

Note that the coefficients on 3 are not of substantive interest. As for 2, the number of friends and the proportion of friends treated should yield substantively the same coefficient. We can also use an indicator for any friends treated. Since, for cohort 1, the majority of the experimental sample have only 1 friend treated, this indicator should yield qualitatively similar results to the proportion, and if so, is more easily interpreted. But the default would be to use the proportion for accuracy, especially if the results are not qualitatively the same.

We will consider alternate specifications. Note that our primary estimate of interest, the direct treatment effect 𝛿, should not be significantly affected by the specific vector of spillover variables used.

Finally, we will calculate spillover effects first within the “core” experimental sample, but also within the broader sample. The core sample of 1,476 excludes pupils in the same classrooms who were designated “low risk”, or who did not complete the risk assessment survey. A broader experimental sample would include them, along with indicators for each of these strata.

Design details

Randomization method
We conducted the randomization using Stata. Procedures below.
Randomization unit
In a first stage (school-level randomization) we stratified the schools into strata of 4 schools each, based on the school’s total number of moderate- and high risk pupils. Two schools in each strata were randomly assigned to have their pupils eligible for treatment. In the second stage (pupil-level randomization within schools eligible for treatment) half of the moderate to high risk students were assigned to treatment using a random variable. Prior to this procedure, where data were available, we dropped from the eligible experimental sample any pupils that were not listed as officially registered as of the month prior to randomization (i.e. students who transferred schools or left school between the time of survey and the randomization). We set an algorithm that conducted this 2-stage randomization ~4000 times and selected the randomization with the highest level of balance in two multivariate regressions: of treatment (T) on a selection of pupil-level covariates and spillovers (S) on the same covariates.
Clusters
There were 52 schools in cohort 1, 40 schools in cohort 2, and 40 schools in cohort 3.
Observations
Approximately 3519 across all three cohorts
Arms
Cohort 1: Of the 132 school-cohorts, 66 were assigned to have students eligible for treatment, and 66 were assigned to control status. Within treatment schools, we assigned students to treatment with a 50% probability on average.
Primary outcomes
For the first short term endpoint—12 months following the end of the intervention—the primary outcome is school dropout, defined as completion of mandatory schooling (completion of grade 9). Our proxy for this is a failure to appear in the national school register, supplemented where possible with additional data from the school, family, or student to account for any potential errors in the national registry. We will be able to monitor impacts on school enrollment at regular intervals following the first endpoint. Longer term, our preferred primary outcome is an aggregate index of dropout and criminal and gang engagement. If the data become available, we envisage a standardized index that averages measures of: (i) school dropout; (ii) general criminal engagement; and (iii) gang involvement. We are interested in the overall impact on this index as well as on the individual components (adjusted for the number of relevant comparisons). As discussed below, there is some uncertainty as to what data and outcomes will be available for (ii) and (iii), and so the number and nature of the components will adapt to the available data. Note: One week prior to the first receipt of educational data, we made minor clarifications to the primary outcome above to clarify how we would operationalize school dropout.
Secondary outcomes
This is a longitudinal study and we expect to measure secondary and exploratory outcomes over the lifecycle. We will generally not adjust analysis for multiple comparisons for these more exploratory outcomes. First-stage outcomes. We will measure participation in the program on the intensive and extensive margins. In addition, in order to assess comprehension and retention of the intervention's information/behavior changes, as well as assess mechanisms, as exploratory analysis we will run an endline survey 1-6 months after each cohort to measure: - WOOP comprehension and concreteness/career orientation of stated goals - Educational aspirations - Tertiary education accessibility - Adverse school attitudes and delinquent behaviors - Beliefs about returns to alternative careers - Own occupational expectations Other schooling outcomes. In addition to measuring overall school attainment and grade repetition, we will also seek data on school performance, disciplinary records, etc. With the exception of grade 11 standardized test scores, at present schools do not systematically collect such data in a consistent and centralized fashion, but we are helping them develop these capabilities and more measures may become available depending on the systems developed by the school system. Long-term outcomes: Longer term we will be able to observe in administrative data tertiary educational choices, occupational choices, lifetime earnings in the formal sector, and participation in social welfare programs. Note: We piloted an in-line survey one to three months after cohort 1. Based on our assessment of which questions were clear and well understood, we refined this instrument and will use it for cohorts 2 and 3. We have updated the pre-registration one week prior to the receipt of our primary outcome data, in one week prior to launch of the in-line survey for Cohort 2, to reflect these finalized first-stage measures.

Cited by

No citation data available for this registration yet.

Keywords