Teaching with the test: Experimental Evidence on Diagnostic Feedback and Capacity-Building for Public Schools in Argentina

How to cite

Ganimian, Alejandro; Holland, Peter; Hoyos, Rafael De. 2017. "Teaching with the test: Experimental Evidence on Diagnostic Feedback and Capacity-Building for Public Schools in Argentina." AEA RCT Registry. AEARCTR-0002434. https://doi.org/10.1257/rct.2434-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Alejandro Ganimian* , Peter Holland , Rafael De Hoyos

* Primary investigator

Registry ID
AEARCTR-0002434
DOI
https://doi.org/10.1257/rct.2434-1.0
First registered
Last updated
Status
Completed
Trial dates
2013-06-03 – 2016-06-30
Countries
Argentina (La Rioja)
JEL codes
C93, I21, I22, I25
Registry record
http://www.socialscienceregistry.org/trials/2434

Abstract

Large-scale assessments have allowed policy-makers, researchers, and the general public to compare learning outcomes across (national and sub-national) school systems and over time. This study examines whether they can achieve another equally-important goal: to provide useful information to improve school management and/or classroom instruction. We present experimental evidence on the impact of the use of large-scale assessments for diagnostic feedback and capacity-building. We randomly assigned 105 public primary schools in the province of La Rioja, Argentina to: (a) a diagnostic feedback group in which we administered standardized tests in math and Spanish at baseline and two follow-ups and made their results available to the schools through user-friendly reports; (b) a capacity-building group in which we did the same and also provided schools with professional development workshops for supervisors, principals, and teachers; or (c) a control group, in which we administered standardized tests only at the second follow-up.

Intervention

We administered: (a) student assessments of math and Spanish; and (b) surveys of students; (c) teachers; and (d) principals. Treatment schools were asked to participate in all rounds of data collection and control schools only in the 2015 round. The diagnostic feedback component included an user-friendly province and school-level results report made available to principals and supervisors. The capacity-building component included five workshops for supervisors, principals, and teachers, and two school visits. The workshops covered the student assessment results, school improvement plans, quality assurance and geometry instruction. The school visits included a meeting with the principal and his/her leadership team, a classroom observation and a meeting with the teaching staff.

Experimental design

We randomly assigned 105 public primary schools in the province of La Rioja, Argentina to three experimental groups: (a) Treatment 1: a diagnostic feedback group in which we administered standardized tests in math and Spanish at baseline and two follow-ups and made their results available to the schools through user-friendly reports; (b) Treatment 2: a capacity-building group in which we did the same and also provided schools with professional development workshops for supervisors, principals, and teachers; or (c) a control group, in which we administered standardized tests only at the second follow-up.

Design details

Randomization method
The randomization was be done by running a Stata code on a computer in office.
Randomization unit
We randomly assigned the 105 sampled schools to one of three experimental groups, stratifying our randomization by school size. First, we grouped all sampled schools into three strata by size: small (199 students or fewer), medium (between 200 and 350 students), and large schools (351 students or more). Then, we randomly assigned schools within each stratum to one of the three experimental groups.
Clusters
105 schools
Observations
Baseline (2013): 10.050 students, 310 teachers First follow-up (2014): 15.800 students, 454 teachers, 77 principals Second follow-up (2015): 16.750 students, 443 teachers, 129 principals
Arms
30 schools in Treatment 1, 30 schools in Treatment 2, 45 schools in Control group.
Primary outcomes
We measure the impact of the interventions over learning outcomes, captured by standardized tests in math and Spanish

Materials

Cited by

No citation data available for this registration yet.

Keywords