Does Leveling the Classroom Prevent Drop-Out? Impact Evaluation of the Complex Instruction Program in Hungary

How to cite

Hermann, Zoltan; Molnár, Tímea Laura; Holb, Éva; Vadle, Zsuzsanna. 2026. "Does Leveling the Classroom Prevent Drop-Out? Impact Evaluation of the Complex Instruction Program in Hungary." AEA RCT Registry. AEARCTR-0018904. https://doi.org/10.1257/rct.18904-1.1

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Zoltan Hermann* , Tímea Laura Molnár , Éva Holb , Zsuzsanna Vadle

* Primary investigator

Registry ID
AEARCTR-0018904
DOI
https://doi.org/10.1257/rct.18904-1.1
First registered
Last updated
Status
In development
Trial dates
2026-03-30 – 2030-08-31
Countries
Private
Registry record
http://www.socialscienceregistry.org/trials/18904

Abstract

We study whether the Complex Instruction Program (CIP) improves the achievement of disadvantaged students and lowers their risk of dropping out. CIP restructures classroom group work to break entrenched status hierarchies and raise the standing of low-status students, on the premise that dropout is as much rooted in how students are positioned in the classroom as in what they are taught. We test this in a school-level cluster-randomized trial across 84 Hungarian primary schools serving disadvantaged populations, using a staggered treatment assignment design: treatment teachers are trained and mentored over a school year and deliver CIP lessons to students in grades 5–8, while control schools adopt the program two years later. Our primary outcomes are standardized mathematics and reading scores and eventual drop-out, drawn from national administrative records. We further examine the channels through which CIP may operate on both the student and teacher level.

Intervention

Treatment schools receive: (i) a 30-hour CIP training workshop delivered by experienced CIP trainers in June-August 2026; and (ii) ongoing mentoring via lesson plan feedback, class visits and individual meetings on demand for the following academic year. Trained teachers implement one CIP lesson approximately every two weeks per subject for grades 5–8 students over a nine-month period beginning September 2026. Control schools receive equivalent training and begin CIP implementation in June 2028, after the evaluation period.

Experimental design

We use a multi-site, school-level cluster-randomized trial in Hungary with a delayed-rollout control design. Schools willing to implement CIP are recruited and offered coverage of initial implementation costs (teacher training and mentoring).

Design details

Randomization method
The unit of treatment assignment is the school site. Assignment follows a 1:1 ratio between treatment (early rollout) and control (delayed rollout). Randomization is conducted within matched groups (strata) formed using administrative records from 2024. Matching cells are defined by two categorical variables: settlement type (city vs. village) and school type (state vs. church). Within each cell, school sites are ranked by the first principal component of a PCA using the following school-level variables for grades 5–8: share of disadvantaged students, share of cumulatively disadvantaged students, share of grade repeaters, share of students missing 10–250 hours of school, and share of students missing more than 250 hours. School sites are then grouped into quadruplets based on this ranking. School sites that belong to the same school are handled as follows. The treatment status assigned to the main school is applied to all of its sites. To preserve balance, we identify a number of similar matched schools equal to the number of school sites belonging to the main school. For example, five matched schools for a school with five sites, two for a school with two sites. Treatment is then assigned between the multi-site school (together with its sites) and the matched schools as a unit. Within each matched group, treatment is assigned by a computer-generated random number sequence and is conducted by our research team in Stata. As we proceeded with school agreements, we randomized school sites on a rolling basis in three waves. Each randomization wave is logged.
Randomization unit
School site level
Clusters
84 school sites
Observations
84 school sites and 8400 students
Arms
Staggered design: Treatment group includes 42 school sites with early rollout teacher training Control group includes 42 school sites with late rollout teacher training
Primary outcomes
1. Mathematics test score 2. Reading test score 3. Dropout by and after 10th grade in secondary school
Secondary outcomes
Student-level outcomes: 1. Predicted drop-out probability 2. Upper-secondary school quality (after grade 8) 3. Student attendance 4. Student grades 5. Non-cognitive skills (from student surveys): Pre-specified scale indices for non-cognitive skill variables (under construction). Teacher-level outcomes: 1. Behavior management difficulty 2. Low student achievement attributions 3. Growth mindset 4. Generalized self-efficacy 5. Teaching enjoyment 6. Job-related stress and burnout 7. Job satisfaction

Cited by

No citation data available for this registration yet.

Keywords