Improving and Sustaining Management Practices in Public Schools: Evidence from Puerto Rico

How to cite

Gonzalez-Navarro, Marco; Bobonis, Gustavo; Scur, Daniela. 2019. "Improving and Sustaining Management Practices in Public Schools: Evidence from Puerto Rico." AEA RCT Registry. AEARCTR-0004066. https://doi.org/10.1257/rct.4066-2.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Marco Gonzalez-Navarro* , Gustavo Bobonis , Daniela Scur

* Primary investigator

Registry ID
AEARCTR-0004066
DOI
https://doi.org/10.1257/rct.4066-2.0
First registered
Last updated
Status
In development
Trial dates
2018-08-13 – 2021-07-21
Countries
Private
JEL codes
I20; M12
Registry record
http://www.socialscienceregistry.org/trials/4066

Abstract

Improvements in management practices have been credited with generating stunning productivity improvement in the private sector. Although their adoption in the education sector has been slow, management-level interventions have been shown to lead to significant improvements in school quality and students’ academic achievement. However, adoption of these practices in the public sector is often not sustained in the long run. Promoting improvements in school management practices is thus an amenable area for policy intervention, given the need to identify ways to achieve this sustainably and at scale.

Our proposed study is a collaboration with the Puerto Rico Department of Education (PRDE) to experimentally evaluate the impact of a large-scale principal training program among its school directors. We will measure impacts on managerial practices collecting detailed longitudinal data to measure short and long-term adoption, as well as impacts on student achievement using standardized test scores data. The study will help inform whether improvements in managerial practices can be implemented in schools at scale, their long-term sustainability, and their effects on student learning.

Intervention

As part of the government’s policy priorities, the Puerto Rico Department of Education (PRDE) is seeking to introduce school leadership quality reforms to improve educational outcomes in the territory. The study will rigorously evaluate – via a randomized controlled trial – the impact of EDUGESPRO; a large-scale management training program to be implemented among the universe of approximately 900 PRDE school principals in the territory’s public education system over a two-year period (Academic Years 2010-20, 2020-21). The training of each cohort of principals will take place over the course of one academic year (approximately 154 hours), composed of an intensive 2-week summer intensive session in addition to monthly workshops and follow-up support during the academic year. A second treatment arm will also receive a post-training intervention aimed at sustaining managerial upgrades and maintenance of learned strategies via reminders.

Experimental design

The proposed design of the Puerto Rico Principals’ Academy program comprises two stages. Approximately 819 PRDE schools and their principals will be stratified by academic level (i.e., K-8, 9-12), PRDE district/region, and adoption of modern management practices at baseline. All schools within each stratum will be randomly assigned to one of three (3) experimental arms:

Treatment Arm 1 – Intensive Management Training (IMT) (Summer 2019, AY 2019-20) + Adoption Reminders (AYs 2019-20, 2020-21);
Treatment Arm 2 – IMT (Summer 2020, AY 2020-21) + Adoption Reminders (AY 2020-21);
Control Arm – Status Quo (Placebo)

Each of the arms of this stepped-wedge design will be composed of 273 schools/principals, with principals in all schools receiving the IMT by the end of the third year.

Design details

Randomization method
Stratified randomization by academic level (i.e., K-8, 9-12), PRDE district/region, and predicted adoption of modern management practices at baseline, done in office by a computer.
Randomization unit
School
Clusters
817 schools
Observations
140,000 students
Arms
Treatment Arm 1 – 273 schools Treatment Arm 2 – 272 schools Control Arm - 272 schools
Primary outcomes
student standardized test scores
Secondary outcomes
school-level managerial practices index; principal attendance; teacher attendance; classroom instruction; classroom management; student attendance; student grades

Cited by

No citation data available for this registration yet.

Keywords