What is the effect of informing schools of their internal efficiency indicators? Experimental evidence from Argentina

How to cite

Ganimian, Alejandro; Cortelezzi, María A.; Rockoff, Jonah E.; Ganimian, Alejandro J.. 2018. "What is the effect of informing schools of their internal efficiency indicators? Experimental evidence from Argentina." AEA RCT Registry. AEARCTR-0003033. https://doi.org/10.1257/rct.3033-2.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Alejandro Ganimian* , María A. Cortelezzi , Jonah E. Rockoff , Alejandro J. Ganimian

* Primary investigator

Registry ID
AEARCTR-0003033
DOI
https://doi.org/10.1257/rct.3033-2.0
First registered
Last updated
Status
On going
Trial dates
2017-03-15 – 2019-07-01
Countries
Private
JEL codes
C93, I21, I22, I25
Registry record
http://www.socialscienceregistry.org/trials/3033

Abstract

Many developing countries provide schools with diagnostic feedback on their performance. Yet, evidence on these initiatives focuses on the effect of providing information on student achievement. We conducted four experiments in Argentina to estimate the effect of providing schools with information on internal efficiency (e.g., passing, repetition, and dropout rates), which is more readily available and easier to understand.

In 2017, we carried out two studies. In study 1, which covered 23 out of Argentina’s 24 provinces, we randomly assigned schools to one of three groups: (a) one in which they received report cards that compared their internal efficiency indicators to those of all other schools in the country; (b) one in which they received similar reports that only compared them to schools of the same management type (i.e., public or private); or (c) one that did not receive any reports. In study 2, in the Province of Tucumán, we randomly assigned schools to one of four groups: (a) one of the three groups in study 1; or (b) one in which schools received report cards that compared their internal efficiency indicators to those of all other schools in the country and a professional development workshop for principals.

In 2018, we conducted two more studies. In study 3, which covered 23 provinces, we randomly assigned schools to one of two groups: (a) one in which they received report cards that compared their internal efficiency indicators to those of all other schools in the country; or (b) one that did not receive any report cards. In study 4, in the Province of Salta, we randomly assigned schools to: (a) a group that received a print version of the report; or (b) one that did not receive any reports.

Experimental design

In 2017, we carried out two studies. In study 1, which covered 23 out of Argentina’s 24 provinces, we randomly assigned 14,404 primary schools and 8,016 secondary schools to one of three groups: (a) one in which schools received report cards that compared their internal efficiency indicators to those of all other schools in the country; (b) one in which schools received similar report cards that only compared them to schools of the same management type (i.e., public or private); or (c) one that did not receive any reports. In study 2, in one of the 24 provinces, we randomly assigned 605 primary schools and 398 secondary schools to one of four groups: (a) one of the three groups in study 1; or (b) one in which schools received report cards that compared their internal efficiency indicators to those of all other schools in the country and a professional development workshop for principals. All treatment schools in 2017 accessed the report cards through an online platform.

In 2018, we conducted two more studies. In study 3, which covered 23 provinces, we randomly assigned 13,776 primary schools and 8,109 secondary schools to one of two groups: (a) one in which schools received report cards that compared their internal efficiency indicators to those of all other schools in the country; or (b) one that did not receive any report cards. All treatment schools accessed the report cards through the same online platform from 2017, but we made it more difficult for schools to opt out of the report. In study 4, in one of the 24 provinces, we randomly assigned 629 primary schools and 241 secondary schools to: (a) a group that received a print version of the report; or (b) one that did not receive any reports.

Design details

Randomization method
Randomization was conducted in Stata 15 in a computer
Randomization unit
Schools
Clusters
N/A
Observations
Study 1: 14,404 primary schools and 8,016 secondary schools Study 2: 605 primary schools and 398 secondary schools Study 3: 13,776 primary schools and 8,109 secondary schools Study 4: 629 primary schools and 241 secondary schools
Arms
We ran two lotteries in 2017. In study 1, which covered 23 out of Argentina’s 24 provinces, we randomly assigned 14,404 primary schools and 8,016 secondary schools to one of three groups: (a) one in which schools received report cards that compared their internal efficiency indicators to those of all other schools in the country (group 1A); (b) one in which schools received similar report cards that only compared them to schools of the same management type (i.e., public or private) (group 1B); or (c) one that did not receive any reports (group 2). In study 2, in one of the 24 provinces, we randomly assigned 605 primary schools and 398 secondary schools to one of four groups: (a) one of the three groups in study 1; or (b) one in which schools received report cards that compared their internal efficiency to that of all other schools in the country and a professional development workshop for principals (group 3). We also ran two lotteries in 2018. In study 3, which covered 23 provinces, we randomly assigned 13,776 primary schools and 8,109 secondary schools to one of two groups: (a) one in which schools received report cards that compared their internal efficiency indicators to those of all other schools in the country (group 1A); or (b) one that did not receive any reports (group 2). In study 4, in one of the 24 provinces, we randomly assigned 629 primary schools and 241 secondary schools to one of three groups: (a) one in which schools received web-based report cards that compared their internal efficiency to that of all other schools in the country (group 1A); (b) one in which schools received similar printed report cards (group 1C); or (b) one that did not receive any reports (group 2).
Primary outcomes
number of enrolled students, passing rates, grade failure rates, repetition rates, dropout rates, learning outcomes

Cited by

No citation data available for this registration yet.

Keywords