School improvement through customized support: Evaluation of a randomized targeted intervention program

How to cite

Sjogren, Anna; Öckert, Björn. 2026. "School improvement through customized support: Evaluation of a randomized targeted intervention program." AEA RCT Registry. AEARCTR-0016314. https://doi.org/10.1257/rct.16314-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Anna Sjogren* , Björn Öckert

* Primary investigator

Registry ID
AEARCTR-0016314
DOI
https://doi.org/10.1257/rct.16314-1.0
First registered
Last updated
Status
In development
Trial dates
2025-05-30 – 2029-06-30
Countries
Sweden ()
Registry record
http://www.socialscienceregistry.org/trials/16314

Abstract

The Swedish National Agency for Education (SNAE; Skolverket) introduced a targeted school improvement program for compulsory schools with persistently low student outcomes starting in fall 2025. The program aims to improve student achievement, instructional quality, and educational equity by providing customized professional development, coaching, and organizational support to schools with limited capacity for self-driven improvement.
In collaboration with SNAE, the Institute for Evaluation of Labour Market and Education Policy (IFAU) developed a selection mechanism. Targeted school providers (school districts) and eligible schools were identified using a needs index based on prior student achievement, student composition, and teacher qualifications. Within participating school districts, schools were ranked using the need index and pair-wise randomized to receive the intervention or serve as controls.
This study evaluates the effects of targeted support on student achievement, measured using national standardized test scores and grades. Secondary outcomes and potential mechanisms include teacher resources, instructional practices, classroom climate, student attendance, and teacher turnover, measured using administrative registers and survey data from national education authorities.
Ethical approval will be sought from the Swedish Ethical Review Authority. The application is planned for spring 2026. At the time of registration, approval has not yet been obtained.

Intervention

The intervention consists of targeted school improvement support provided by the Swedish National Agency for Education (SNAE; Skolverket) to compulsory schools with persistently low student outcomes. The support program is part of a government mandate that SNAE support school development and its design has been developed over time by the SNAE and used before. The research team has not been involved in the design of the program.
The program spans three to four years and includes two main phases. During the first year (the needs assessment phase), a local development team at each participating school, together with representatives from the school district and SNAE, conducts a structured analysis of the school’s strengths, weaknesses, and development needs. Based on this analysis, a customized action plan is formulated.
During the subsequent two to three years (the implementation phase), the action plan is implemented and continuously adjusted. Implementation is supported through financial resources and guidance from SNAE. Interventions typically include professional development activities, coaching, and organizational development efforts aimed at improving instructional quality, strengthening school leadership, and enhancing the school’s capacity for improvement.

Experimental design

In collaboration with the Swedish National Agency for Education (SNAE), IFAU has developed a selection and randomization procedure to allocate targeted support to schools.
Eligible school districts (municipalities) were identified using a pre-determined needs index incorporating prior academic outcomes, student composition, and teacher qualifications. Priority was given to districts with a high share of students attending low-performing schools, i.e. schools in the lower half of the national distribution of student outcomes. Priority was also given to districts with multiple schools.
School districts were informed that at most half of their eligible schools would receive support. Prior to randomization, districts were allowed to exclude schools deemed unsuitable due to planned reorganizations or mergers.
Within participating school districts, low performing schools were ranked according to the needs index. Schools were stratified by grade configuration. Pair-wise randomization within strata determined whether a school was offered the intervention or assigned to the control group.
The randomization aimed to assign approximately 100 schools to treatment and control. In practice, 23 school districts participated, resulting in 86 treated schools and 86 control schools.

Randomization motivates the following statistical analysis plan
The main analysis will estimate intention-to-treat (ITT) effects using linear regression models of the form:
Y_ist=α+β⋅Treatment_s+γ^' X_s+δ_k+ε_ist,

where Y_ist the outcome of student i in school s at time t, Treatment_s is an indicator for assignment to the intervention, X_s is a vector of pre-determined school-level characteristics, and δ_k are fixed effects for randomization pair. Standard errors will be clustered at the school level.
The primary specification will not condition on any post-treatment variables such as student characteristics at time t, since changes in composition of students may be endogenous to treatment. Potential compositional changes will be assessed explicitly by examining effects of treatment on student mobility, test participation, grade retention, and observable student characteristics. Balance between treatment and control groups will be evaluated both at baseline and over time. Sensitivity of the primary specification to student characteristics will be assessed.

Estimates will be based on assignment to treatment, regardless of intervention take-up. However, to the extent schools dropped out from treatment before the intervention started, we will also consider IV-estimates where assignment to treatment is used as an instrument for actual participation at the school level.

Administrative data on students, teachers, and parents will be obtained from Statistics Sweden’s education registers. Survey data on school climate, student perceptions of teaching practices and teachers view of collegial collaboration and school climate will be obtained from the Swedish Schools Inspectorate.
During the early stages of the intervention, interviews with SNAE process support agents (approximately 3–6 individuals) will be conducted to document the content and intended mechanisms of the support packages. This information will be used to design a teacher survey administered to teachers in treated and control schools in collaboration with SNAE.
The use of these administrative data for research purposes, which in a legal sense, are not sensitive, formally does not require ethical approval. Ethical approval will, however, be sought from the Swedish Ethical Review Authority. The application is planned for spring 2026.

Design details

Randomization method
Randomization was conducted using a computer algorithm. Re-randomization was used to achieve balance between treatment and control schools on pre-determined student characteristics and baseline performance measures.
Randomization unit
Randomization took place at the school unit level within school heads and strata of grade configurations.
Clusters
Treatment it clustered at the school level. In total 172 schools were pairwise randomly assigned.
Observations
The average school size among participating schools is some 294 students. This implies an expected treated student population of roughly 27,000 students.
Arms
In total, 172 schools were pairwise randomly assigned: 86 schools to treatment, 86 schools to be controls.
Primary outcomes
Student academic achievement measured using: • National standardized test scores • Compulsory school grades • Educational attainment outcomes (upper secondary school eligibility and program choice)
Secondary outcomes
We also intend to study the effects of the interventions on pathways through which the intervention might affect student outcomes relating to teaching resources, classroom organization and climate. These include: student-to-teacher ratios, teacher qualifications, , instructional practices, targeted student support, classroom organization and climate, student attendance, and teacher turnover.

Cited by

No citation data available for this registration yet.

Keywords