EXPERIMENTAL EVALUATION OF THE NOVOTEC INTEGRADO PROGRAM

How to cite

Castro, Caio; Souza, André Portela; Costa, Gabriel Weber; Lima, Lycia; Ferman, Bruno; Finamor, Lucas. 2024. "EXPERIMENTAL EVALUATION OF THE NOVOTEC INTEGRADO PROGRAM." AEA RCT Registry. AEARCTR-0013649. https://doi.org/10.1257/rct.13649-2.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Caio Castro* , André Portela Souza , Gabriel Weber Costa , Lycia Lima , Bruno Ferman , Lucas Finamor

* Primary investigator

Registry ID
AEARCTR-0013649
DOI
https://doi.org/10.1257/rct.13649-2.0
First registered
Last updated
Status
On going
Trial dates
2021-01-01 – 2029-12-31
Countries
Private
Secondary IDs
I25, I28, J24
Registry record
http://www.socialscienceregistry.org/trials/13649

Abstract

This research project centers on the Novotec Integrado Program, designed to enhance technical and vocational education offerings in São Paulo, Brazil. This initiative seamlessly integrates technical education into the traditional high school curriculum, aligning with the regulatory reforms established in 2017.Within the public high school system, students have the autonomy to select a specialized field of technical education. During enrollment periods in 2021 and 2023, instances of oversubscription prompted admissions to be determined through a lottery system, facilitating an experimental impact evaluation framework. Our primary objective is to assess the effects of Novotec Integrado on enrolled students. Specifically, we aim to evaluate its impact on key indicators such as academic performance, school attendance, and high school completion rates. Furthermore, we seek to quantify its influence on labor market outcomes and enrollment in higher education. To achieve these objectives, we will utilize educational administrative data and conduct comprehensive primary data collection efforts.

Intervention

The Novotec Integrado program offers technical and vocational training for high school students in the state educational system. Students choose their area of interest from 12 available options (including e.g., marketing, logistics, human resources, systems development) and attend training during their second and third grades, integrated within the same modality of the general academic curriculum (i.e., students who attend high school e.g. only during mornings also attend technical training during mornings). The vocational branch of the curriculum is delivered by Centro Paula Souza, a well-known institution linked to the state government that offers professional education at the secondary and tertiary levels within the state of São Paulo.

The program is designed in the form of the so-called Novo Ensino Médio in Brazil, which divides the high school curriculum into formative itineraries, one of which is technical and vocational training. At the end of high school, students receive a technical education diploma in the area that they chose, in addition to the regular high school certification

Experimental design

In the lottery process for the 2021 cohort, students in the final year of upper primary education designated their preferred school and technical course for the entirety of their high school journey. To ensure fairness, the lottery was stratified by gender, with each gender allocated half of the available seats in each class. Candidates were randomly ordered and assigned to either an initial offer treatment group or a waiting list. Consequently, each stratum comprised a combination of course, class, and gender. Within each gender stratum, priority was given to students residing within a 2km radius of their chosen school.

For the 2023 cohort, students were already in their first year of high school when indicating their school and technical course preferences for the remaining years (second and third grades). In this instance, only students expressing interest in courses offered at their current school were considered for randomization, with stratification based solely on class.

This research aims to track the progress of students from these two cohorts, leveraging the randomization process for oversubscribed classes to estimate the program's impacts on educational and labor outcomes. By comparing the two cohorts—those selecting at the end of primary education versus after the first year of high school—we aim to glean additional insights into the optimal timing for offering technical education pathways.

Design details

Randomization method
Randomization done in office by a computer, following an algorithm in R with given seed.
Randomization unit
Individual
Clusters
Total of 104,164 students. Currently 48,454 from the first lottery and 57,710 Total of 800 strata in 2021 cohort Total of 399 (expected|) strata in 2023 cohort
Observations
104,161 students
Arms
Expected sample of 18,236 treated on first cohort and 18,814 on the second cohort.
Primary outcomes
Education-related variables such as performance, attendance, and approval, measured through bimonthly SEDUC administrative records and through scores from a standardized exam administered by the São Paulo State Secretariat of Education. The standardized assessment was originally pre-registered as SARESP (Sistema de Avaliação de Rendimento Escolar do Estado de São Paulo, Portuguese Language, Mathematics, and Natural Sciences); following the substitution of SARESP by Provão Paulista at the state level in September 2023, the standardized assessment outcome is operationalized through Provão Paulista (Portuguese Language and Mathematics only; Natural Sciences not covered by the substituted instrument). Labor market variables: employment, formal employment, earnings, wages, and field of work (occupation and sector).
Secondary outcomes
Socio-emotional variables, such as happiness, anxiety, and depression. Aspirations for educational and labor market careers.

Cited by

No citation data available for this registration yet.

Keywords